Aug 01 13:45:28 user nova-compute[72129]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Aug 01 13:45:30 user nova-compute[72129]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=72129) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Aug 01 13:45:30 user nova-compute[72129]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=72129) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Aug 01 13:45:30 user nova-compute[72129]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=72129) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Aug 01 13:45:30 user nova-compute[72129]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Aug 01 13:45:30 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:45:30 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:45:31 user nova-compute[72129]: INFO nova.virt.driver [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] Loading compute driver 'libvirt.LibvirtDriver'
Aug 01 13:45:31 user nova-compute[72129]: INFO nova.compute.provider_config [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] Acquiring lock "singleton_lock" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] Acquired lock "singleton_lock" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] Releasing lock "singleton_lock" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] Full set of CONF: {{(pid=72129) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] ******************************************************************************** {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] Configuration options gathered from: {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] ================================================================================ {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] allow_resize_to_same_host      = True {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] arq_binding_timeout            = 300 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] backdoor_port                  = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] backdoor_socket                = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] block_device_allocate_retries  = 300 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] block_device_allocate_retries_interval = 5 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] cert                           = self.pem {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] compute_monitors               = [] {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] config_dir                     = [] {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] config_drive_format            = iso9660 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] config_source                  = [] {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] console_host                   = user {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] control_exchange               = nova {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] cpu_allocation_ratio           = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] daemon                         = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] debug                          = True {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] default_access_ip_network_name = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] default_availability_zone      = nova {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] default_ephemeral_format       = ext4 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] default_schedule_zone          = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] disk_allocation_ratio          = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] enable_new_services            = True {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] enabled_apis                   = ['osapi_compute'] {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] enabled_ssl_apis               = [] {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] flat_injected                  = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] force_config_drive             = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] force_raw_images               = True {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] graceful_shutdown_timeout      = 5 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] heal_instance_info_cache_interval = 60 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] host                           = user {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] initial_disk_allocation_ratio  = 1.0 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] initial_ram_allocation_ratio   = 1.0 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] instance_build_timeout         = 0 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] instance_delete_interval       = 300 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] instance_format                = [instance: %(uuid)s]  {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] instance_name_template         = instance-%08x {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] instance_usage_audit           = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] instance_usage_audit_period    = month {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] internal_service_availability_zone = internal {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] key                            = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] live_migration_retry_count     = 30 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] log_config_append              = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] log_dir                        = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] log_file                       = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] log_options                    = True {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] log_rotate_interval            = 1 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] log_rotate_interval_type       = days {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] log_rotation_type              = none {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] long_rpc_timeout               = 1800 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] max_concurrent_builds          = 10 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] max_concurrent_live_migrations = 1 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] max_concurrent_snapshots       = 5 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] max_local_block_devices        = 3 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] max_logfile_count              = 30 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] max_logfile_size_mb            = 200 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] maximum_instance_delete_attempts = 5 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] metadata_listen                = 0.0.0.0 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] metadata_listen_port           = 8775 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] metadata_workers               = 3 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] migrate_max_retries            = -1 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] mkisofs_cmd                    = genisoimage {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] my_block_storage_ip            = 10.0.0.210 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] my_ip                          = 10.0.0.210 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] network_allocate_retries       = 0 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] osapi_compute_listen           = 0.0.0.0 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] osapi_compute_listen_port      = 8774 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] osapi_compute_unique_server_name_scope =  {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] osapi_compute_workers          = 3 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] password_length                = 12 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] periodic_enable                = True {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] periodic_fuzzy_delay           = 60 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] pointer_model                  = ps2mouse {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] preallocate_images             = none {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] publish_errors                 = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] pybasedir                      = /opt/stack/nova {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] ram_allocation_ratio           = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] rate_limit_burst               = 0 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] rate_limit_except_level        = CRITICAL {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] rate_limit_interval            = 0 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] reboot_timeout                 = 0 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] reclaim_instance_interval      = 0 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] record                         = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] reimage_timeout_per_gb         = 60 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] report_interval                = 10 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] rescue_timeout                 = 0 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] reserved_host_cpus             = 0 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] reserved_host_disk_mb          = 0 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] reserved_host_memory_mb        = 512 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] reserved_huge_pages            = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] resize_confirm_window          = 0 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] resize_fs_using_block_device   = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] resume_guests_state_on_host_boot = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] rpc_response_timeout           = 60 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] run_external_periodic_tasks    = True {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] running_deleted_instance_action = reap {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] running_deleted_instance_poll_interval = 1800 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] running_deleted_instance_timeout = 0 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] scheduler_instance_sync_interval = 120 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] service_down_time              = 60 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] servicegroup_driver            = db {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] shelved_offload_time           = 0 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] shelved_poll_interval          = 3600 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] shutdown_timeout               = 0 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] source_is_ipv6                 = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] ssl_only                       = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] state_path                     = /opt/stack/data/nova {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] sync_power_state_interval      = 600 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] sync_power_state_pool_size     = 1000 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] syslog_log_facility            = LOG_USER {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] tempdir                        = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] timeout_nbd                    = 10 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] transport_url                  = **** {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] update_resources_interval      = 0 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] use_cow_images                 = True {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] use_eventlog                   = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] use_journal                    = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] use_json                       = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] use_rootwrap_daemon            = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] use_stderr                     = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] use_syslog                     = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vcpu_pin_set                   = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vif_plugging_is_fatal          = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vif_plugging_timeout           = 0 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] virt_mkfs                      = [] {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] volume_usage_poll_interval     = 0 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] watch_log_file                 = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] web                            = /usr/share/spice-html5 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_concurrency.disable_process_locking = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] api.auth_strategy              = keystone {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] api.compute_link_prefix        = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] api.dhcp_domain                = novalocal {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] api.enable_instance_password   = True {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] api.glance_link_prefix         = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] api.instance_list_cells_batch_strategy = distributed {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] api.instance_list_per_project_cells = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] api.list_records_by_skipping_down_cells = True {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] api.local_metadata_per_cell    = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] api.max_limit                  = 1000 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] api.metadata_cache_expiration  = 15 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] api.neutron_default_tenant_id  = default {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] api.use_forwarded_for          = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] api.use_neutron_default_nets   = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] api.vendordata_dynamic_failure_fatal = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] api.vendordata_dynamic_targets = [] {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] api.vendordata_jsonfile_path   = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] cache.backend                  = dogpile.cache.memcached {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] cache.backend_argument         = **** {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] cache.config_prefix            = cache.oslo {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] cache.dead_timeout             = 60.0 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] cache.debug_cache_backend      = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] cache.enable_retry_client      = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] cache.enable_socket_keepalive  = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] cache.enabled                  = True {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] cache.expiration_time          = 600 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] cache.hashclient_retry_attempts = 2 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] cache.hashclient_retry_delay   = 1.0 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] cache.memcache_dead_retry      = 300 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] cache.memcache_password        =  {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] cache.memcache_pool_maxsize    = 10 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] cache.memcache_sasl_enabled    = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] cache.memcache_socket_timeout  = 1.0 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] cache.memcache_username        =  {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] cache.proxies                  = [] {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] cache.retry_attempts           = 2 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] cache.retry_delay              = 0.0 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] cache.socket_keepalive_count   = 1 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] cache.socket_keepalive_idle    = 1 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] cache.socket_keepalive_interval = 1 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] cache.tls_allowed_ciphers      = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] cache.tls_cafile               = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] cache.tls_certfile             = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] cache.tls_enabled              = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] cache.tls_keyfile              = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] cinder.auth_section            = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] cinder.auth_type               = password {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] cinder.cafile                  = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] cinder.catalog_info            = volumev3::publicURL {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] cinder.certfile                = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] cinder.collect_timing          = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] cinder.cross_az_attach         = True {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] cinder.debug                   = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] cinder.endpoint_template       = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] cinder.http_retries            = 3 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] cinder.insecure                = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] cinder.keyfile                 = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] cinder.os_region_name          = RegionOne {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] cinder.split_loggers           = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] cinder.timeout                 = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] compute.cpu_dedicated_set      = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] compute.cpu_shared_set         = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] compute.image_type_exclude_list = [] {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] compute.live_migration_wait_for_vif_plug = True {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] compute.max_concurrent_disk_ops = 0 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] compute.max_disk_devices_to_attach = -1 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] compute.resource_provider_association_refresh = 300 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] compute.shutdown_retry_interval = 10 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] conductor.workers              = 3 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] console.allowed_origins        = [] {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] console.ssl_ciphers            = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] console.ssl_minimum_version    = default {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] consoleauth.token_ttl          = 600 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] cyborg.cafile                  = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] cyborg.certfile                = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] cyborg.collect_timing          = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] cyborg.connect_retries         = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] cyborg.connect_retry_delay     = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] cyborg.endpoint_override       = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] cyborg.insecure                = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] cyborg.keyfile                 = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] cyborg.max_version             = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] cyborg.min_version             = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] cyborg.region_name             = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] cyborg.service_name            = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] cyborg.service_type            = accelerator {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] cyborg.split_loggers           = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] cyborg.status_code_retries     = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] cyborg.status_code_retry_delay = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] cyborg.timeout                 = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] cyborg.version                 = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] database.backend               = sqlalchemy {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] database.connection            = **** {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] database.connection_debug      = 0 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] database.connection_parameters =  {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] database.connection_recycle_time = 3600 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] database.connection_trace      = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] database.db_inc_retry_interval = True {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] database.db_max_retries        = 20 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] database.db_max_retry_interval = 10 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] database.db_retry_interval     = 1 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] database.max_overflow          = 50 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] database.max_pool_size         = 5 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] database.max_retries           = 10 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] database.mysql_enable_ndb      = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] database.mysql_wsrep_sync_wait = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] database.pool_timeout          = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] database.retry_interval        = 10 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] database.slave_connection      = **** {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] database.sqlite_synchronous    = True {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] api_database.backend           = sqlalchemy {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] api_database.connection        = **** {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] api_database.connection_debug  = 0 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] api_database.connection_parameters =  {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] api_database.connection_recycle_time = 3600 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] api_database.connection_trace  = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] api_database.db_inc_retry_interval = True {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] api_database.db_max_retries    = 20 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] api_database.db_max_retry_interval = 10 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] api_database.db_retry_interval = 1 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] api_database.max_overflow      = 50 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] api_database.max_pool_size     = 5 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] api_database.max_retries       = 10 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] api_database.mysql_enable_ndb  = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] api_database.mysql_wsrep_sync_wait = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] api_database.pool_timeout      = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] api_database.retry_interval    = 10 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] api_database.slave_connection  = **** {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] api_database.sqlite_synchronous = True {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] devices.enabled_mdev_types     = [] {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] ephemeral_storage_encryption.enabled = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] ephemeral_storage_encryption.key_size = 512 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] glance.api_servers             = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] glance.cafile                  = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] glance.certfile                = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] glance.collect_timing          = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] glance.connect_retries         = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] glance.connect_retry_delay     = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] glance.debug                   = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] glance.default_trusted_certificate_ids = [] {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] glance.enable_certificate_validation = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] glance.enable_rbd_download     = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] glance.endpoint_override       = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] glance.insecure                = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] glance.keyfile                 = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] glance.max_version             = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] glance.min_version             = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] glance.num_retries             = 3 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] glance.rbd_ceph_conf           =  {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] glance.rbd_connect_timeout     = 5 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] glance.rbd_pool                =  {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] glance.rbd_user                =  {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] glance.region_name             = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] glance.service_name            = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] glance.service_type            = image {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] glance.split_loggers           = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] glance.status_code_retries     = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] glance.status_code_retry_delay = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] glance.timeout                 = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] glance.verify_glance_signatures = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] glance.version                 = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] guestfs.debug                  = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] hyperv.config_drive_cdrom      = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] hyperv.config_drive_inject_password = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] hyperv.enable_instance_metrics_collection = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] hyperv.enable_remotefx         = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] hyperv.instances_path_share    =  {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] hyperv.iscsi_initiator_list    = [] {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] hyperv.limit_cpu_features      = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] hyperv.power_state_check_timeframe = 60 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] hyperv.power_state_event_polling_interval = 2 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] hyperv.use_multipath_io        = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] hyperv.volume_attach_retry_count = 10 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] hyperv.volume_attach_retry_interval = 5 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] hyperv.vswitch_name            = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] mks.enabled                    = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] image_cache.manager_interval   = 2400 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] image_cache.precache_concurrency = 1 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] image_cache.remove_unused_base_images = True {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] image_cache.subdirectory_name  = _base {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] ironic.api_max_retries         = 60 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] ironic.api_retry_interval      = 2 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] ironic.auth_section            = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] ironic.auth_type               = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] ironic.cafile                  = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] ironic.certfile                = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] ironic.collect_timing          = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] ironic.connect_retries         = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] ironic.connect_retry_delay     = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] ironic.endpoint_override       = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] ironic.insecure                = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] ironic.keyfile                 = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] ironic.max_version             = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] ironic.min_version             = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] ironic.partition_key           = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] ironic.peer_list               = [] {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] ironic.region_name             = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] ironic.serial_console_state_timeout = 10 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] ironic.service_name            = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] ironic.service_type            = baremetal {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] ironic.split_loggers           = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] ironic.status_code_retries     = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] ironic.status_code_retry_delay = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] ironic.timeout                 = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] ironic.version                 = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] key_manager.fixed_key          = **** {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] barbican.barbican_api_version  = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] barbican.barbican_endpoint     = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] barbican.barbican_endpoint_type = public {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] barbican.barbican_region_name  = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] barbican.cafile                = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] barbican.certfile              = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] barbican.collect_timing        = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] barbican.insecure              = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] barbican.keyfile               = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] barbican.number_of_retries     = 60 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] barbican.retry_delay           = 1 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] barbican.send_service_user_token = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] barbican.split_loggers         = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] barbican.timeout               = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] barbican.verify_ssl            = True {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] barbican.verify_ssl_path       = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] barbican_service_user.auth_section = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] barbican_service_user.auth_type = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] barbican_service_user.cafile   = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] barbican_service_user.certfile = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] barbican_service_user.collect_timing = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] barbican_service_user.insecure = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] barbican_service_user.keyfile  = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] barbican_service_user.split_loggers = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] barbican_service_user.timeout  = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vault.approle_role_id          = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vault.approle_secret_id        = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vault.cafile                   = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vault.certfile                 = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vault.collect_timing           = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vault.insecure                 = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vault.keyfile                  = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vault.kv_mountpoint            = secret {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vault.kv_version               = 2 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vault.namespace                = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vault.root_token_id            = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vault.split_loggers            = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vault.ssl_ca_crt_file          = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vault.timeout                  = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vault.use_ssl                  = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] keystone.cafile                = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] keystone.certfile              = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] keystone.collect_timing        = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] keystone.connect_retries       = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] keystone.connect_retry_delay   = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] keystone.endpoint_override     = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] keystone.insecure              = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] keystone.keyfile               = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] keystone.max_version           = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] keystone.min_version           = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] keystone.region_name           = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] keystone.service_name          = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] keystone.service_type          = identity {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] keystone.split_loggers         = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] keystone.status_code_retries   = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] keystone.status_code_retry_delay = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] keystone.timeout               = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] keystone.version               = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.connection_uri         =  {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.cpu_mode               = custom {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.cpu_model_extra_flags  = [] {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: WARNING oslo_config.cfg [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.cpu_power_governor_high = performance {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.cpu_power_governor_low = powersave {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.cpu_power_management   = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.device_detach_attempts = 8 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.device_detach_timeout  = 20 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.disk_cachemodes        = [] {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.disk_prefix            = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.enabled_perf_events    = [] {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.file_backed_memory     = 0 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.gid_maps               = [] {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.hw_disk_discard        = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.hw_machine_type        = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.images_rbd_ceph_conf   =  {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.images_rbd_glance_store_name =  {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.images_rbd_pool        = rbd {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.images_type            = default {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.images_volume_group    = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.inject_key             = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.inject_partition       = -2 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.inject_password        = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.iscsi_iface            = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.iser_use_multipath     = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.live_migration_bandwidth = 0 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.live_migration_completion_timeout = 800 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.live_migration_downtime = 500 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.live_migration_downtime_delay = 75 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.live_migration_downtime_steps = 10 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.live_migration_inbound_addr = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.live_migration_permit_auto_converge = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.live_migration_permit_post_copy = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.live_migration_scheme  = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.live_migration_timeout_action = abort {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.live_migration_tunnelled = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: WARNING oslo_config.cfg [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Aug 01 13:45:31 user nova-compute[72129]: live_migration_uri is deprecated for removal in favor of two other options that
Aug 01 13:45:31 user nova-compute[72129]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Aug 01 13:45:31 user nova-compute[72129]: and ``live_migration_inbound_addr`` respectively.
Aug 01 13:45:31 user nova-compute[72129]: ).  Its value may be silently ignored in the future.
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.live_migration_with_native_tls = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.max_queues             = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.mem_stats_period_seconds = 10 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.nfs_mount_options      = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.num_aoe_discover_tries = 3 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.num_iser_scan_tries    = 5 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.num_memory_encrypted_guests = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.num_nvme_discover_tries = 5 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.num_pcie_ports         = 0 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.num_volume_scan_tries  = 5 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.pmem_namespaces        = [] {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.quobyte_client_cfg     = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.rbd_connect_timeout    = 5 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.rbd_secret_uuid        = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.rbd_user               = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.realtime_scheduler_priority = 1 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.remote_filesystem_transport = ssh {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.rescue_image_id        = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.rescue_kernel_id       = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.rescue_ramdisk_id      = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.rx_queue_size          = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.smbfs_mount_options    =  {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.snapshot_compression   = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.snapshot_image_format  = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.sparse_logical_volumes = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.swtpm_enabled          = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.swtpm_group            = tss {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.swtpm_user             = tss {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.sysinfo_serial         = unique {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.tb_cache_size          = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.tx_queue_size          = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.uid_maps               = [] {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.use_virtio_for_bridges = True {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.virt_type              = kvm {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.volume_clear           = zero {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.volume_clear_size      = 0 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.volume_use_multipath   = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.vzstorage_cache_path   = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.vzstorage_mount_group  = qemu {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.vzstorage_mount_opts   = [] {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.vzstorage_mount_user   = stack {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] neutron.auth_section           = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] neutron.auth_type              = password {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] neutron.cafile                 = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] neutron.certfile               = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] neutron.collect_timing         = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] neutron.connect_retries        = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] neutron.connect_retry_delay    = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] neutron.default_floating_pool  = public {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] neutron.endpoint_override      = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] neutron.extension_sync_interval = 600 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] neutron.http_retries           = 3 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] neutron.insecure               = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] neutron.keyfile                = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] neutron.max_version            = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] neutron.metadata_proxy_shared_secret = **** {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] neutron.min_version            = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] neutron.ovs_bridge             = br-int {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] neutron.physnets               = [] {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] neutron.region_name            = RegionOne {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] neutron.service_metadata_proxy = True {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] neutron.service_name           = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] neutron.service_type           = network {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] neutron.split_loggers          = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] neutron.status_code_retries    = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] neutron.status_code_retry_delay = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] neutron.timeout                = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] neutron.version                = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] notifications.bdms_in_notifications = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] notifications.default_level    = INFO {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] notifications.notification_format = unversioned {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] notifications.notify_on_state_change = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] pci.alias                      = [] {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] pci.device_spec                = [] {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] pci.report_in_placement        = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] placement.auth_section         = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] placement.auth_type            = password {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] placement.cafile               = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] placement.certfile             = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] placement.collect_timing       = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] placement.connect_retries      = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] placement.connect_retry_delay  = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] placement.default_domain_id    = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] placement.default_domain_name  = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] placement.domain_id            = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] placement.domain_name          = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] placement.endpoint_override    = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] placement.insecure             = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] placement.keyfile              = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] placement.max_version          = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] placement.min_version          = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] placement.password             = **** {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] placement.project_domain_id    = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] placement.project_domain_name  = Default {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] placement.project_id           = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] placement.project_name         = service {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] placement.region_name          = RegionOne {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] placement.service_name         = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] placement.service_type         = placement {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] placement.split_loggers        = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] placement.status_code_retries  = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] placement.status_code_retry_delay = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] placement.system_scope         = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] placement.timeout              = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] placement.trust_id             = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] placement.user_domain_id       = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] placement.user_domain_name     = Default {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] placement.user_id              = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] placement.username             = placement {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] placement.version              = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] quota.cores                    = 20 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] quota.count_usage_from_placement = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] quota.injected_file_content_bytes = 10240 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] quota.injected_file_path_length = 255 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] quota.injected_files           = 5 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] quota.instances                = 10 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] quota.key_pairs                = 100 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] quota.metadata_items           = 128 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] quota.ram                      = 51200 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] quota.recheck_quota            = True {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] quota.server_group_members     = 10 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] quota.server_groups            = 10 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] rdp.enabled                    = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] scheduler.image_metadata_prefilter = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] scheduler.max_attempts         = 3 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] scheduler.max_placement_results = 1000 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] scheduler.query_placement_for_availability_zone = True {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] scheduler.query_placement_for_image_type_support = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] scheduler.workers              = 3 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] filter_scheduler.host_subset_size = 1 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] filter_scheduler.image_properties_default_architecture = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] filter_scheduler.isolated_hosts = [] {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] filter_scheduler.isolated_images = [] {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] filter_scheduler.max_instances_per_host = 50 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] filter_scheduler.pci_in_placement = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] filter_scheduler.track_instance_changes = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] metrics.required               = True {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] metrics.weight_multiplier      = 1.0 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] metrics.weight_setting         = [] {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] serial_console.enabled         = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] serial_console.port_range      = 10000:20000 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] serial_console.serialproxy_port = 6083 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] service_user.auth_section      = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] service_user.auth_type         = password {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] service_user.cafile            = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] service_user.certfile          = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] service_user.collect_timing    = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] service_user.insecure          = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] service_user.keyfile           = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] service_user.send_service_user_token = True {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] service_user.split_loggers     = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] service_user.timeout           = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] spice.agent_enabled            = True {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] spice.enabled                  = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] spice.html5proxy_port          = 6082 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] spice.image_compression        = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] spice.jpeg_compression         = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] spice.playback_compression     = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] spice.server_listen            = 127.0.0.1 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] spice.streaming_mode           = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] spice.zlib_compression         = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] upgrade_levels.baseapi         = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] upgrade_levels.cert            = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] upgrade_levels.compute         = auto {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] upgrade_levels.conductor       = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] upgrade_levels.scheduler       = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vendordata_dynamic_auth.auth_section = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vendordata_dynamic_auth.auth_type = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vendordata_dynamic_auth.cafile = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vendordata_dynamic_auth.certfile = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vendordata_dynamic_auth.collect_timing = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vendordata_dynamic_auth.insecure = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vendordata_dynamic_auth.keyfile = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vendordata_dynamic_auth.split_loggers = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vendordata_dynamic_auth.timeout = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vmware.api_retry_count         = 10 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vmware.ca_file                 = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vmware.cache_prefix            = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vmware.cluster_name            = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vmware.connection_pool_size    = 10 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vmware.console_delay_seconds   = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vmware.datastore_regex         = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vmware.host_ip                 = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vmware.host_password           = **** {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vmware.host_port               = 443 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vmware.host_username           = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vmware.insecure                = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vmware.integration_bridge      = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vmware.maximum_objects         = 100 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vmware.pbm_default_policy      = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vmware.pbm_enabled             = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vmware.pbm_wsdl_location       = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vmware.serial_port_proxy_uri   = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vmware.serial_port_service_uri = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vmware.task_poll_interval      = 0.5 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vmware.use_linked_clone        = True {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vmware.vnc_keymap              = en-us {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vmware.vnc_port                = 5900 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vmware.vnc_port_total          = 10000 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vnc.auth_schemes               = ['none'] {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vnc.enabled                    = True {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vnc.novncproxy_port            = 6080 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vnc.server_listen              = 0.0.0.0 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vnc.vencrypt_ca_certs          = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vnc.vencrypt_client_cert       = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vnc.vencrypt_client_key        = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] workarounds.disable_fallback_pcpu_query = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] workarounds.disable_group_policy_check_upcall = True {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] workarounds.disable_rootwrap   = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] workarounds.enable_numa_live_migration = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] workarounds.handle_virt_lifecycle_events = True {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] workarounds.libvirt_disable_apic = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] workarounds.never_download_image_if_on_rbd = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] wsgi.client_socket_timeout     = 900 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] wsgi.default_pool_size         = 1000 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] wsgi.keep_alive                = True {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] wsgi.max_header_line           = 16384 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] wsgi.secure_proxy_ssl_header   = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] wsgi.ssl_ca_file               = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] wsgi.ssl_cert_file             = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] wsgi.ssl_key_file              = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] wsgi.tcp_keepidle              = 600 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] zvm.ca_file                    = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] zvm.cloud_connector_url        = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] zvm.reachable_timeout          = 300 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_policy.enforce_new_defaults = True {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_policy.enforce_scope      = True {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_policy.policy_default_rule = default {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_policy.policy_file        = policy.yaml {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] profiler.connection_string     = messaging:// {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] profiler.enabled               = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] profiler.es_doc_type           = notification {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] profiler.es_scroll_size        = 10000 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] profiler.es_scroll_time        = 2m {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] profiler.filter_error_trace    = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] profiler.hmac_keys             = **** {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] profiler.sentinel_service_name = mymaster {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] profiler.socket_timeout        = 0.1 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] profiler.trace_requests        = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] profiler.trace_sqlalchemy      = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] profiler_jaeger.process_tags   = {} {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] profiler_jaeger.service_name_prefix = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] profiler_otlp.service_name_prefix = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] remote_debug.host              = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] remote_debug.port              = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_messaging_rabbit.ssl      = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_messaging_rabbit.ssl_version =  {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_messaging_notifications.retry = -1 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_messaging_notifications.transport_url = **** {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_limit.auth_section        = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_limit.auth_type           = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_limit.cafile              = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_limit.certfile            = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_limit.collect_timing      = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_limit.connect_retries     = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_limit.connect_retry_delay = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_limit.endpoint_id         = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_limit.endpoint_override   = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_limit.insecure            = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_limit.keyfile             = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_limit.max_version         = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_limit.min_version         = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_limit.region_name         = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_limit.service_name        = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_limit.service_type        = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_limit.split_loggers       = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_limit.status_code_retries = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_limit.status_code_retry_delay = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_limit.timeout             = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_limit.valid_interfaces    = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_limit.version             = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_reports.file_event_handler = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] oslo_reports.log_dir           = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vif_plug_linux_bridge_privileged.group = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vif_plug_linux_bridge_privileged.user = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vif_plug_ovs_privileged.group  = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vif_plug_ovs_privileged.helper_command = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] vif_plug_ovs_privileged.user   = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] os_vif_linux_bridge.flat_interface = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] os_vif_linux_bridge.vlan_interface = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] os_vif_ovs.isolate_vif         = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] os_vif_ovs.ovsdb_interface     = native {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] os_vif_ovs.per_port_bridge     = False {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] os_brick.lock_path             = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] privsep_osbrick.capabilities   = [21] {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] privsep_osbrick.group          = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] privsep_osbrick.helper_command = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] privsep_osbrick.thread_pool_size = 12 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] privsep_osbrick.user           = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] nova_sys_admin.group           = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] nova_sys_admin.helper_command  = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] nova_sys_admin.thread_pool_size = 12 {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] nova_sys_admin.user            = None {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG oslo_service.service [None req-a43fa46a-3cc9-4830-9c44-3f991e0b561d None None] ******************************************************************************** {{(pid=72129) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Aug 01 13:45:31 user nova-compute[72129]: INFO nova.service [-] Starting compute node (version 0.0.0)
Aug 01 13:45:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Starting native event thread {{(pid=72129) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Starting green dispatch thread {{(pid=72129) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Starting connection event dispatch thread {{(pid=72129) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Connecting to libvirt: qemu:///system {{(pid=72129) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f2829ffca00> {{(pid=72129) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Aug 01 13:45:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f2829ffca00> {{(pid=72129) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Aug 01 13:45:31 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Connection event '1' reason 'None'
Aug 01 13:45:31 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 01 13:45:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.mount [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Initialising _HostMountState generation 0 {{(pid=72129) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Aug 01 13:45:38 user nova-compute[72129]: INFO nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Libvirt host capabilities <capabilities>
Aug 01 13:45:38 user nova-compute[72129]:   <host>
Aug 01 13:45:38 user nova-compute[72129]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Aug 01 13:45:38 user nova-compute[72129]:     <cpu>
Aug 01 13:45:38 user nova-compute[72129]:       <arch>x86_64</arch>
Aug 01 13:45:38 user nova-compute[72129]:       <model>IvyBridge-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <vendor>Intel</vendor>
Aug 01 13:45:38 user nova-compute[72129]:       <microcode version='1070'/>
Aug 01 13:45:38 user nova-compute[72129]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Aug 01 13:45:38 user nova-compute[72129]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature name='ss'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature name='vmx'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature name='pcid'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature name='osxsave'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature name='hypervisor'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature name='arat'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature name='tsc_adjust'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature name='md-clear'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature name='stibp'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature name='arch-capabilities'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature name='ssbd'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature name='invtsc'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature name='rsba'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature name='skip-l1dfl-vmentry'/>
Aug 01 13:45:38 user nova-compute[72129]:       <pages unit='KiB' size='4'/>
Aug 01 13:45:38 user nova-compute[72129]:       <pages unit='KiB' size='2048'/>
Aug 01 13:45:38 user nova-compute[72129]:     </cpu>
Aug 01 13:45:38 user nova-compute[72129]:     <power_management>
Aug 01 13:45:38 user nova-compute[72129]:       <suspend_mem/>
Aug 01 13:45:38 user nova-compute[72129]:       <suspend_disk/>
Aug 01 13:45:38 user nova-compute[72129]:       <suspend_hybrid/>
Aug 01 13:45:38 user nova-compute[72129]:     </power_management>
Aug 01 13:45:38 user nova-compute[72129]:     <iommu support='no'/>
Aug 01 13:45:38 user nova-compute[72129]:     <migration_features>
Aug 01 13:45:38 user nova-compute[72129]:       <live/>
Aug 01 13:45:38 user nova-compute[72129]:       <uri_transports>
Aug 01 13:45:38 user nova-compute[72129]:         <uri_transport>tcp</uri_transport>
Aug 01 13:45:38 user nova-compute[72129]:         <uri_transport>rdma</uri_transport>
Aug 01 13:45:38 user nova-compute[72129]:       </uri_transports>
Aug 01 13:45:38 user nova-compute[72129]:     </migration_features>
Aug 01 13:45:38 user nova-compute[72129]:     <topology>
Aug 01 13:45:38 user nova-compute[72129]:       <cells num='2'>
Aug 01 13:45:38 user nova-compute[72129]:         <cell id='0'>
Aug 01 13:45:38 user nova-compute[72129]:           <memory unit='KiB'>8189224</memory>
Aug 01 13:45:38 user nova-compute[72129]:           <pages unit='KiB' size='4'>2047306</pages>
Aug 01 13:45:38 user nova-compute[72129]:           <pages unit='KiB' size='2048'>0</pages>
Aug 01 13:45:38 user nova-compute[72129]:           <distances>
Aug 01 13:45:38 user nova-compute[72129]:             <sibling id='0' value='10'/>
Aug 01 13:45:38 user nova-compute[72129]:             <sibling id='1' value='20'/>
Aug 01 13:45:38 user nova-compute[72129]:           </distances>
Aug 01 13:45:38 user nova-compute[72129]:           <cpus num='6'>
Aug 01 13:45:38 user nova-compute[72129]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Aug 01 13:45:38 user nova-compute[72129]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Aug 01 13:45:38 user nova-compute[72129]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Aug 01 13:45:38 user nova-compute[72129]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Aug 01 13:45:38 user nova-compute[72129]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Aug 01 13:45:38 user nova-compute[72129]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Aug 01 13:45:38 user nova-compute[72129]:           </cpus>
Aug 01 13:45:38 user nova-compute[72129]:         </cell>
Aug 01 13:45:38 user nova-compute[72129]:         <cell id='1'>
Aug 01 13:45:38 user nova-compute[72129]:           <memory unit='KiB'>8206460</memory>
Aug 01 13:45:38 user nova-compute[72129]:           <pages unit='KiB' size='4'>2051615</pages>
Aug 01 13:45:38 user nova-compute[72129]:           <pages unit='KiB' size='2048'>0</pages>
Aug 01 13:45:38 user nova-compute[72129]:           <distances>
Aug 01 13:45:38 user nova-compute[72129]:             <sibling id='0' value='20'/>
Aug 01 13:45:38 user nova-compute[72129]:             <sibling id='1' value='10'/>
Aug 01 13:45:38 user nova-compute[72129]:           </distances>
Aug 01 13:45:38 user nova-compute[72129]:           <cpus num='6'>
Aug 01 13:45:38 user nova-compute[72129]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Aug 01 13:45:38 user nova-compute[72129]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Aug 01 13:45:38 user nova-compute[72129]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Aug 01 13:45:38 user nova-compute[72129]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Aug 01 13:45:38 user nova-compute[72129]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Aug 01 13:45:38 user nova-compute[72129]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Aug 01 13:45:38 user nova-compute[72129]:           </cpus>
Aug 01 13:45:38 user nova-compute[72129]:         </cell>
Aug 01 13:45:38 user nova-compute[72129]:       </cells>
Aug 01 13:45:38 user nova-compute[72129]:     </topology>
Aug 01 13:45:38 user nova-compute[72129]:     <cache>
Aug 01 13:45:38 user nova-compute[72129]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Aug 01 13:45:38 user nova-compute[72129]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Aug 01 13:45:38 user nova-compute[72129]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Aug 01 13:45:38 user nova-compute[72129]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Aug 01 13:45:38 user nova-compute[72129]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Aug 01 13:45:38 user nova-compute[72129]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Aug 01 13:45:38 user nova-compute[72129]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Aug 01 13:45:38 user nova-compute[72129]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Aug 01 13:45:38 user nova-compute[72129]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Aug 01 13:45:38 user nova-compute[72129]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Aug 01 13:45:38 user nova-compute[72129]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Aug 01 13:45:38 user nova-compute[72129]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Aug 01 13:45:38 user nova-compute[72129]:     </cache>
Aug 01 13:45:38 user nova-compute[72129]:     <secmodel>
Aug 01 13:45:38 user nova-compute[72129]:       <model>apparmor</model>
Aug 01 13:45:38 user nova-compute[72129]:       <doi>0</doi>
Aug 01 13:45:38 user nova-compute[72129]:     </secmodel>
Aug 01 13:45:38 user nova-compute[72129]:     <secmodel>
Aug 01 13:45:38 user nova-compute[72129]:       <model>dac</model>
Aug 01 13:45:38 user nova-compute[72129]:       <doi>0</doi>
Aug 01 13:45:38 user nova-compute[72129]:       <baselabel type='kvm'>+64055:+108</baselabel>
Aug 01 13:45:38 user nova-compute[72129]:       <baselabel type='qemu'>+64055:+108</baselabel>
Aug 01 13:45:38 user nova-compute[72129]:     </secmodel>
Aug 01 13:45:38 user nova-compute[72129]:   </host>
Aug 01 13:45:38 user nova-compute[72129]:   <guest>
Aug 01 13:45:38 user nova-compute[72129]:     <os_type>hvm</os_type>
Aug 01 13:45:38 user nova-compute[72129]:     <arch name='alpha'>
Aug 01 13:45:38 user nova-compute[72129]:       <wordsize>64</wordsize>
Aug 01 13:45:38 user nova-compute[72129]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='4'>clipper</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <domain type='qemu'/>
Aug 01 13:45:38 user nova-compute[72129]:     </arch>
Aug 01 13:45:38 user nova-compute[72129]:     <features>
Aug 01 13:45:38 user nova-compute[72129]:       <cpuselection/>
Aug 01 13:45:38 user nova-compute[72129]:       <deviceboot/>
Aug 01 13:45:38 user nova-compute[72129]:       <disksnapshot default='on' toggle='no'/>
Aug 01 13:45:38 user nova-compute[72129]:     </features>
Aug 01 13:45:38 user nova-compute[72129]:   </guest>
Aug 01 13:45:38 user nova-compute[72129]:   <guest>
Aug 01 13:45:38 user nova-compute[72129]:     <os_type>hvm</os_type>
Aug 01 13:45:38 user nova-compute[72129]:     <arch name='armv6l'>
Aug 01 13:45:38 user nova-compute[72129]:       <wordsize>32</wordsize>
Aug 01 13:45:38 user nova-compute[72129]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>integratorcp</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>borzoi</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>spitz</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2'>nuri</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2'>musca-b1</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>versatileab</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>kzm</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2'>musca-a</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2'>smdkc210</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>sx1</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>z2</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>tosa</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='4'>sabrelite</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>realview-eb</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>n810</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>n800</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>versatilepb</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>terrier</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>mainstone</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='4'>midway</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>musicpal</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>microbit</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>cubieboard</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>verdex</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>netduino2</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='4'>raspi2b</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>cheetah</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='4'>highbank</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>akita</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>connex</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>collie</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>raspi0</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <domain type='qemu'/>
Aug 01 13:45:38 user nova-compute[72129]:     </arch>
Aug 01 13:45:38 user nova-compute[72129]:     <features>
Aug 01 13:45:38 user nova-compute[72129]:       <cpuselection/>
Aug 01 13:45:38 user nova-compute[72129]:       <deviceboot/>
Aug 01 13:45:38 user nova-compute[72129]:       <disksnapshot default='on' toggle='no'/>
Aug 01 13:45:38 user nova-compute[72129]:     </features>
Aug 01 13:45:38 user nova-compute[72129]:   </guest>
Aug 01 13:45:38 user nova-compute[72129]:   <guest>
Aug 01 13:45:38 user nova-compute[72129]:     <os_type>hvm</os_type>
Aug 01 13:45:38 user nova-compute[72129]:     <arch name='armv7l'>
Aug 01 13:45:38 user nova-compute[72129]:       <wordsize>32</wordsize>
Aug 01 13:45:38 user nova-compute[72129]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>integratorcp</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>borzoi</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>spitz</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2'>nuri</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2'>musca-b1</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>versatileab</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>kzm</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2'>musca-a</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2'>smdkc210</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>sx1</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>z2</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>tosa</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='4'>sabrelite</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>realview-eb</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>n810</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>n800</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>versatilepb</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>terrier</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>mainstone</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='4'>midway</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>musicpal</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>microbit</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>cubieboard</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>verdex</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>netduino2</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='4'>raspi2b</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>cheetah</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='4'>highbank</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>akita</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>connex</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>collie</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>raspi0</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <domain type='qemu'/>
Aug 01 13:45:38 user nova-compute[72129]:     </arch>
Aug 01 13:45:38 user nova-compute[72129]:     <features>
Aug 01 13:45:38 user nova-compute[72129]:       <cpuselection/>
Aug 01 13:45:38 user nova-compute[72129]:       <deviceboot/>
Aug 01 13:45:38 user nova-compute[72129]:       <disksnapshot default='on' toggle='no'/>
Aug 01 13:45:38 user nova-compute[72129]:     </features>
Aug 01 13:45:38 user nova-compute[72129]:   </guest>
Aug 01 13:45:38 user nova-compute[72129]:   <guest>
Aug 01 13:45:38 user nova-compute[72129]:     <os_type>hvm</os_type>
Aug 01 13:45:38 user nova-compute[72129]:     <arch name='aarch64'>
Aug 01 13:45:38 user nova-compute[72129]:       <wordsize>64</wordsize>
Aug 01 13:45:38 user nova-compute[72129]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>integratorcp</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>borzoi</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>spitz</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2'>nuri</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2'>musca-b1</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>versatileab</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>kzm</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2'>musca-a</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2'>smdkc210</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>sx1</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>z2</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>tosa</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='4'>sabrelite</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>realview-eb</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='512'>sbsa-ref</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>n810</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>n800</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>versatilepb</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>terrier</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>mainstone</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='4'>midway</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>musicpal</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>microbit</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='4'>raspi3ap</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>cubieboard</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>verdex</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>netduino2</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='4'>raspi3b</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='4'>raspi2b</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>cheetah</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='4'>highbank</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>akita</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>connex</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>collie</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>raspi0</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <domain type='qemu'/>
Aug 01 13:45:38 user nova-compute[72129]:     </arch>
Aug 01 13:45:38 user nova-compute[72129]:     <features>
Aug 01 13:45:38 user nova-compute[72129]:       <acpi default='on' toggle='yes'/>
Aug 01 13:45:38 user nova-compute[72129]:       <cpuselection/>
Aug 01 13:45:38 user nova-compute[72129]:       <deviceboot/>
Aug 01 13:45:38 user nova-compute[72129]:       <disksnapshot default='on' toggle='no'/>
Aug 01 13:45:38 user nova-compute[72129]:     </features>
Aug 01 13:45:38 user nova-compute[72129]:   </guest>
Aug 01 13:45:38 user nova-compute[72129]:   <guest>
Aug 01 13:45:38 user nova-compute[72129]:     <os_type>hvm</os_type>
Aug 01 13:45:38 user nova-compute[72129]:     <arch name='cris'>
Aug 01 13:45:38 user nova-compute[72129]:       <wordsize>32</wordsize>
Aug 01 13:45:38 user nova-compute[72129]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>axis-dev88</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <domain type='qemu'/>
Aug 01 13:45:38 user nova-compute[72129]:     </arch>
Aug 01 13:45:38 user nova-compute[72129]:     <features>
Aug 01 13:45:38 user nova-compute[72129]:       <cpuselection/>
Aug 01 13:45:38 user nova-compute[72129]:       <deviceboot/>
Aug 01 13:45:38 user nova-compute[72129]:       <disksnapshot default='on' toggle='no'/>
Aug 01 13:45:38 user nova-compute[72129]:     </features>
Aug 01 13:45:38 user nova-compute[72129]:   </guest>
Aug 01 13:45:38 user nova-compute[72129]:   <guest>
Aug 01 13:45:38 user nova-compute[72129]:     <os_type>hvm</os_type>
Aug 01 13:45:38 user nova-compute[72129]:     <arch name='i686'>
Aug 01 13:45:38 user nova-compute[72129]:       <wordsize>32</wordsize>
Aug 01 13:45:38 user nova-compute[72129]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>x-remote</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>isapc</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>microvm</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <domain type='qemu'/>
Aug 01 13:45:38 user nova-compute[72129]:       <domain type='kvm'/>
Aug 01 13:45:38 user nova-compute[72129]:     </arch>
Aug 01 13:45:38 user nova-compute[72129]:     <features>
Aug 01 13:45:38 user nova-compute[72129]:       <pae/>
Aug 01 13:45:38 user nova-compute[72129]:       <nonpae/>
Aug 01 13:45:38 user nova-compute[72129]:       <acpi default='on' toggle='yes'/>
Aug 01 13:45:38 user nova-compute[72129]:       <apic default='on' toggle='no'/>
Aug 01 13:45:38 user nova-compute[72129]:       <cpuselection/>
Aug 01 13:45:38 user nova-compute[72129]:       <deviceboot/>
Aug 01 13:45:38 user nova-compute[72129]:       <disksnapshot default='on' toggle='no'/>
Aug 01 13:45:38 user nova-compute[72129]:     </features>
Aug 01 13:45:38 user nova-compute[72129]:   </guest>
Aug 01 13:45:38 user nova-compute[72129]:   <guest>
Aug 01 13:45:38 user nova-compute[72129]:     <os_type>hvm</os_type>
Aug 01 13:45:38 user nova-compute[72129]:     <arch name='m68k'>
Aug 01 13:45:38 user nova-compute[72129]:       <wordsize>32</wordsize>
Aug 01 13:45:38 user nova-compute[72129]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>mcf5208evb</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>an5206</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>virt-6.0</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>q800</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>virt-6.2</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>next-cube</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>virt-6.1</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <domain type='qemu'/>
Aug 01 13:45:38 user nova-compute[72129]:     </arch>
Aug 01 13:45:38 user nova-compute[72129]:     <features>
Aug 01 13:45:38 user nova-compute[72129]:       <cpuselection/>
Aug 01 13:45:38 user nova-compute[72129]:       <deviceboot/>
Aug 01 13:45:38 user nova-compute[72129]:       <disksnapshot default='on' toggle='no'/>
Aug 01 13:45:38 user nova-compute[72129]:     </features>
Aug 01 13:45:38 user nova-compute[72129]:   </guest>
Aug 01 13:45:38 user nova-compute[72129]:   <guest>
Aug 01 13:45:38 user nova-compute[72129]:     <os_type>hvm</os_type>
Aug 01 13:45:38 user nova-compute[72129]:     <arch name='microblaze'>
Aug 01 13:45:38 user nova-compute[72129]:       <wordsize>32</wordsize>
Aug 01 13:45:38 user nova-compute[72129]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <domain type='qemu'/>
Aug 01 13:45:38 user nova-compute[72129]:     </arch>
Aug 01 13:45:38 user nova-compute[72129]:     <features>
Aug 01 13:45:38 user nova-compute[72129]:       <cpuselection/>
Aug 01 13:45:38 user nova-compute[72129]:       <deviceboot/>
Aug 01 13:45:38 user nova-compute[72129]:       <disksnapshot default='on' toggle='no'/>
Aug 01 13:45:38 user nova-compute[72129]:     </features>
Aug 01 13:45:38 user nova-compute[72129]:   </guest>
Aug 01 13:45:38 user nova-compute[72129]:   <guest>
Aug 01 13:45:38 user nova-compute[72129]:     <os_type>hvm</os_type>
Aug 01 13:45:38 user nova-compute[72129]:     <arch name='microblazeel'>
Aug 01 13:45:38 user nova-compute[72129]:       <wordsize>32</wordsize>
Aug 01 13:45:38 user nova-compute[72129]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <domain type='qemu'/>
Aug 01 13:45:38 user nova-compute[72129]:     </arch>
Aug 01 13:45:38 user nova-compute[72129]:     <features>
Aug 01 13:45:38 user nova-compute[72129]:       <cpuselection/>
Aug 01 13:45:38 user nova-compute[72129]:       <deviceboot/>
Aug 01 13:45:38 user nova-compute[72129]:       <disksnapshot default='on' toggle='no'/>
Aug 01 13:45:38 user nova-compute[72129]:     </features>
Aug 01 13:45:38 user nova-compute[72129]:   </guest>
Aug 01 13:45:38 user nova-compute[72129]:   <guest>
Aug 01 13:45:38 user nova-compute[72129]:     <os_type>hvm</os_type>
Aug 01 13:45:38 user nova-compute[72129]:     <arch name='mips'>
Aug 01 13:45:38 user nova-compute[72129]:       <wordsize>32</wordsize>
Aug 01 13:45:38 user nova-compute[72129]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='16'>malta</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>mipssim</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <domain type='qemu'/>
Aug 01 13:45:38 user nova-compute[72129]:     </arch>
Aug 01 13:45:38 user nova-compute[72129]:     <features>
Aug 01 13:45:38 user nova-compute[72129]:       <cpuselection/>
Aug 01 13:45:38 user nova-compute[72129]:       <deviceboot/>
Aug 01 13:45:38 user nova-compute[72129]:       <disksnapshot default='on' toggle='no'/>
Aug 01 13:45:38 user nova-compute[72129]:     </features>
Aug 01 13:45:38 user nova-compute[72129]:   </guest>
Aug 01 13:45:38 user nova-compute[72129]:   <guest>
Aug 01 13:45:38 user nova-compute[72129]:     <os_type>hvm</os_type>
Aug 01 13:45:38 user nova-compute[72129]:     <arch name='mipsel'>
Aug 01 13:45:38 user nova-compute[72129]:       <wordsize>32</wordsize>
Aug 01 13:45:38 user nova-compute[72129]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='16'>malta</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>mipssim</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <domain type='qemu'/>
Aug 01 13:45:38 user nova-compute[72129]:     </arch>
Aug 01 13:45:38 user nova-compute[72129]:     <features>
Aug 01 13:45:38 user nova-compute[72129]:       <cpuselection/>
Aug 01 13:45:38 user nova-compute[72129]:       <deviceboot/>
Aug 01 13:45:38 user nova-compute[72129]:       <disksnapshot default='on' toggle='no'/>
Aug 01 13:45:38 user nova-compute[72129]:     </features>
Aug 01 13:45:38 user nova-compute[72129]:   </guest>
Aug 01 13:45:38 user nova-compute[72129]:   <guest>
Aug 01 13:45:38 user nova-compute[72129]:     <os_type>hvm</os_type>
Aug 01 13:45:38 user nova-compute[72129]:     <arch name='mips64'>
Aug 01 13:45:38 user nova-compute[72129]:       <wordsize>64</wordsize>
Aug 01 13:45:38 user nova-compute[72129]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='16'>malta</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>mipssim</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>pica61</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>magnum</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <domain type='qemu'/>
Aug 01 13:45:38 user nova-compute[72129]:     </arch>
Aug 01 13:45:38 user nova-compute[72129]:     <features>
Aug 01 13:45:38 user nova-compute[72129]:       <cpuselection/>
Aug 01 13:45:38 user nova-compute[72129]:       <deviceboot/>
Aug 01 13:45:38 user nova-compute[72129]:       <disksnapshot default='on' toggle='no'/>
Aug 01 13:45:38 user nova-compute[72129]:     </features>
Aug 01 13:45:38 user nova-compute[72129]:   </guest>
Aug 01 13:45:38 user nova-compute[72129]:   <guest>
Aug 01 13:45:38 user nova-compute[72129]:     <os_type>hvm</os_type>
Aug 01 13:45:38 user nova-compute[72129]:     <arch name='mips64el'>
Aug 01 13:45:38 user nova-compute[72129]:       <wordsize>64</wordsize>
Aug 01 13:45:38 user nova-compute[72129]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='16'>malta</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='16'>loongson3-virt</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>mipssim</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>pica61</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>magnum</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='16'>boston</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>fuloong2e</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <domain type='qemu'/>
Aug 01 13:45:38 user nova-compute[72129]:     </arch>
Aug 01 13:45:38 user nova-compute[72129]:     <features>
Aug 01 13:45:38 user nova-compute[72129]:       <cpuselection/>
Aug 01 13:45:38 user nova-compute[72129]:       <deviceboot/>
Aug 01 13:45:38 user nova-compute[72129]:       <disksnapshot default='on' toggle='no'/>
Aug 01 13:45:38 user nova-compute[72129]:     </features>
Aug 01 13:45:38 user nova-compute[72129]:   </guest>
Aug 01 13:45:38 user nova-compute[72129]:   <guest>
Aug 01 13:45:38 user nova-compute[72129]:     <os_type>hvm</os_type>
Aug 01 13:45:38 user nova-compute[72129]:     <arch name='ppc'>
Aug 01 13:45:38 user nova-compute[72129]:       <wordsize>32</wordsize>
Aug 01 13:45:38 user nova-compute[72129]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>g3beige</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>mac99</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='32'>ppce500</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>pegasos2</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>sam460ex</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>bamboo</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>40p</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>ref405ep</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>taihu</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <domain type='qemu'/>
Aug 01 13:45:38 user nova-compute[72129]:     </arch>
Aug 01 13:45:38 user nova-compute[72129]:     <features>
Aug 01 13:45:38 user nova-compute[72129]:       <cpuselection/>
Aug 01 13:45:38 user nova-compute[72129]:       <deviceboot/>
Aug 01 13:45:38 user nova-compute[72129]:       <disksnapshot default='on' toggle='no'/>
Aug 01 13:45:38 user nova-compute[72129]:     </features>
Aug 01 13:45:38 user nova-compute[72129]:   </guest>
Aug 01 13:45:38 user nova-compute[72129]:   <guest>
Aug 01 13:45:38 user nova-compute[72129]:     <os_type>hvm</os_type>
Aug 01 13:45:38 user nova-compute[72129]:     <arch name='ppc64'>
Aug 01 13:45:38 user nova-compute[72129]:       <wordsize>64</wordsize>
Aug 01 13:45:38 user nova-compute[72129]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2048'>powernv9</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>taihu</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2048'>powernv10</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='32'>ppce500</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>40p</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>pegasos2</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>bamboo</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>g3beige</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>mac99</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>sam460ex</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>ref405ep</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2048'>powernv8</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <domain type='qemu'/>
Aug 01 13:45:38 user nova-compute[72129]:     </arch>
Aug 01 13:45:38 user nova-compute[72129]:     <features>
Aug 01 13:45:38 user nova-compute[72129]:       <cpuselection/>
Aug 01 13:45:38 user nova-compute[72129]:       <deviceboot/>
Aug 01 13:45:38 user nova-compute[72129]:       <disksnapshot default='on' toggle='no'/>
Aug 01 13:45:38 user nova-compute[72129]:     </features>
Aug 01 13:45:38 user nova-compute[72129]:   </guest>
Aug 01 13:45:38 user nova-compute[72129]:   <guest>
Aug 01 13:45:38 user nova-compute[72129]:     <os_type>hvm</os_type>
Aug 01 13:45:38 user nova-compute[72129]:     <arch name='ppc64le'>
Aug 01 13:45:38 user nova-compute[72129]:       <wordsize>64</wordsize>
Aug 01 13:45:38 user nova-compute[72129]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2048'>powernv9</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>taihu</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2048'>powernv10</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='32'>ppce500</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>40p</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>pegasos2</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>bamboo</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>g3beige</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>mac99</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>sam460ex</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>ref405ep</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2048'>powernv8</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <domain type='qemu'/>
Aug 01 13:45:38 user nova-compute[72129]:     </arch>
Aug 01 13:45:38 user nova-compute[72129]:     <features>
Aug 01 13:45:38 user nova-compute[72129]:       <cpuselection/>
Aug 01 13:45:38 user nova-compute[72129]:       <deviceboot/>
Aug 01 13:45:38 user nova-compute[72129]:       <disksnapshot default='on' toggle='no'/>
Aug 01 13:45:38 user nova-compute[72129]:     </features>
Aug 01 13:45:38 user nova-compute[72129]:   </guest>
Aug 01 13:45:38 user nova-compute[72129]:   <guest>
Aug 01 13:45:38 user nova-compute[72129]:     <os_type>hvm</os_type>
Aug 01 13:45:38 user nova-compute[72129]:     <arch name='riscv32'>
Aug 01 13:45:38 user nova-compute[72129]:       <wordsize>32</wordsize>
Aug 01 13:45:38 user nova-compute[72129]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='8'>spike</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>opentitan</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='5'>sifive_u</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>sifive_e</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='8'>virt</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <domain type='qemu'/>
Aug 01 13:45:38 user nova-compute[72129]:     </arch>
Aug 01 13:45:38 user nova-compute[72129]:     <features>
Aug 01 13:45:38 user nova-compute[72129]:       <cpuselection/>
Aug 01 13:45:38 user nova-compute[72129]:       <deviceboot/>
Aug 01 13:45:38 user nova-compute[72129]:       <disksnapshot default='on' toggle='no'/>
Aug 01 13:45:38 user nova-compute[72129]:     </features>
Aug 01 13:45:38 user nova-compute[72129]:   </guest>
Aug 01 13:45:38 user nova-compute[72129]:   <guest>
Aug 01 13:45:38 user nova-compute[72129]:     <os_type>hvm</os_type>
Aug 01 13:45:38 user nova-compute[72129]:     <arch name='riscv64'>
Aug 01 13:45:38 user nova-compute[72129]:       <wordsize>64</wordsize>
Aug 01 13:45:38 user nova-compute[72129]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='8'>spike</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='5'>sifive_u</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>shakti_c</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>sifive_e</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='8'>virt</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <domain type='qemu'/>
Aug 01 13:45:38 user nova-compute[72129]:     </arch>
Aug 01 13:45:38 user nova-compute[72129]:     <features>
Aug 01 13:45:38 user nova-compute[72129]:       <cpuselection/>
Aug 01 13:45:38 user nova-compute[72129]:       <deviceboot/>
Aug 01 13:45:38 user nova-compute[72129]:       <disksnapshot default='on' toggle='no'/>
Aug 01 13:45:38 user nova-compute[72129]:     </features>
Aug 01 13:45:38 user nova-compute[72129]:   </guest>
Aug 01 13:45:38 user nova-compute[72129]:   <guest>
Aug 01 13:45:38 user nova-compute[72129]:     <os_type>hvm</os_type>
Aug 01 13:45:38 user nova-compute[72129]:     <arch name='s390x'>
Aug 01 13:45:38 user nova-compute[72129]:       <wordsize>64</wordsize>
Aug 01 13:45:38 user nova-compute[72129]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <domain type='qemu'/>
Aug 01 13:45:38 user nova-compute[72129]:     </arch>
Aug 01 13:45:38 user nova-compute[72129]:     <features>
Aug 01 13:45:38 user nova-compute[72129]:       <cpuselection/>
Aug 01 13:45:38 user nova-compute[72129]:       <deviceboot/>
Aug 01 13:45:38 user nova-compute[72129]:       <disksnapshot default='on' toggle='no'/>
Aug 01 13:45:38 user nova-compute[72129]:     </features>
Aug 01 13:45:38 user nova-compute[72129]:   </guest>
Aug 01 13:45:38 user nova-compute[72129]:   <guest>
Aug 01 13:45:38 user nova-compute[72129]:     <os_type>hvm</os_type>
Aug 01 13:45:38 user nova-compute[72129]:     <arch name='sh4'>
Aug 01 13:45:38 user nova-compute[72129]:       <wordsize>32</wordsize>
Aug 01 13:45:38 user nova-compute[72129]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>shix</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>r2d</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <domain type='qemu'/>
Aug 01 13:45:38 user nova-compute[72129]:     </arch>
Aug 01 13:45:38 user nova-compute[72129]:     <features>
Aug 01 13:45:38 user nova-compute[72129]:       <cpuselection/>
Aug 01 13:45:38 user nova-compute[72129]:       <deviceboot/>
Aug 01 13:45:38 user nova-compute[72129]:       <disksnapshot default='on' toggle='no'/>
Aug 01 13:45:38 user nova-compute[72129]:     </features>
Aug 01 13:45:38 user nova-compute[72129]:   </guest>
Aug 01 13:45:38 user nova-compute[72129]:   <guest>
Aug 01 13:45:38 user nova-compute[72129]:     <os_type>hvm</os_type>
Aug 01 13:45:38 user nova-compute[72129]:     <arch name='sh4eb'>
Aug 01 13:45:38 user nova-compute[72129]:       <wordsize>64</wordsize>
Aug 01 13:45:38 user nova-compute[72129]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>shix</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>r2d</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <domain type='qemu'/>
Aug 01 13:45:38 user nova-compute[72129]:     </arch>
Aug 01 13:45:38 user nova-compute[72129]:     <features>
Aug 01 13:45:38 user nova-compute[72129]:       <cpuselection/>
Aug 01 13:45:38 user nova-compute[72129]:       <deviceboot/>
Aug 01 13:45:38 user nova-compute[72129]:       <disksnapshot default='on' toggle='no'/>
Aug 01 13:45:38 user nova-compute[72129]:     </features>
Aug 01 13:45:38 user nova-compute[72129]:   </guest>
Aug 01 13:45:38 user nova-compute[72129]:   <guest>
Aug 01 13:45:38 user nova-compute[72129]:     <os_type>hvm</os_type>
Aug 01 13:45:38 user nova-compute[72129]:     <arch name='sparc'>
Aug 01 13:45:38 user nova-compute[72129]:       <wordsize>32</wordsize>
Aug 01 13:45:38 user nova-compute[72129]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>SS-5</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='4'>SS-20</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>LX</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>SPARCClassic</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>leon3_generic</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>SPARCbook</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>SS-4</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='4'>SS-600MP</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='4'>SS-10</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>Voyager</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <domain type='qemu'/>
Aug 01 13:45:38 user nova-compute[72129]:     </arch>
Aug 01 13:45:38 user nova-compute[72129]:     <features>
Aug 01 13:45:38 user nova-compute[72129]:       <cpuselection/>
Aug 01 13:45:38 user nova-compute[72129]:       <deviceboot/>
Aug 01 13:45:38 user nova-compute[72129]:       <disksnapshot default='on' toggle='no'/>
Aug 01 13:45:38 user nova-compute[72129]:     </features>
Aug 01 13:45:38 user nova-compute[72129]:   </guest>
Aug 01 13:45:38 user nova-compute[72129]:   <guest>
Aug 01 13:45:38 user nova-compute[72129]:     <os_type>hvm</os_type>
Aug 01 13:45:38 user nova-compute[72129]:     <arch name='sparc64'>
Aug 01 13:45:38 user nova-compute[72129]:       <wordsize>64</wordsize>
Aug 01 13:45:38 user nova-compute[72129]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>sun4u</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>niagara</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>sun4v</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <domain type='qemu'/>
Aug 01 13:45:38 user nova-compute[72129]:     </arch>
Aug 01 13:45:38 user nova-compute[72129]:     <features>
Aug 01 13:45:38 user nova-compute[72129]:       <cpuselection/>
Aug 01 13:45:38 user nova-compute[72129]:       <deviceboot/>
Aug 01 13:45:38 user nova-compute[72129]:       <disksnapshot default='on' toggle='no'/>
Aug 01 13:45:38 user nova-compute[72129]:     </features>
Aug 01 13:45:38 user nova-compute[72129]:   </guest>
Aug 01 13:45:38 user nova-compute[72129]:   <guest>
Aug 01 13:45:38 user nova-compute[72129]:     <os_type>hvm</os_type>
Aug 01 13:45:38 user nova-compute[72129]:     <arch name='x86_64'>
Aug 01 13:45:38 user nova-compute[72129]:       <wordsize>64</wordsize>
Aug 01 13:45:38 user nova-compute[72129]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>x-remote</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='1'>isapc</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>microvm</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <domain type='qemu'/>
Aug 01 13:45:38 user nova-compute[72129]:       <domain type='kvm'/>
Aug 01 13:45:38 user nova-compute[72129]:     </arch>
Aug 01 13:45:38 user nova-compute[72129]:     <features>
Aug 01 13:45:38 user nova-compute[72129]:       <acpi default='on' toggle='yes'/>
Aug 01 13:45:38 user nova-compute[72129]:       <apic default='on' toggle='no'/>
Aug 01 13:45:38 user nova-compute[72129]:       <cpuselection/>
Aug 01 13:45:38 user nova-compute[72129]:       <deviceboot/>
Aug 01 13:45:38 user nova-compute[72129]:       <disksnapshot default='on' toggle='no'/>
Aug 01 13:45:38 user nova-compute[72129]:     </features>
Aug 01 13:45:38 user nova-compute[72129]:   </guest>
Aug 01 13:45:38 user nova-compute[72129]:   <guest>
Aug 01 13:45:38 user nova-compute[72129]:     <os_type>hvm</os_type>
Aug 01 13:45:38 user nova-compute[72129]:     <arch name='xtensa'>
Aug 01 13:45:38 user nova-compute[72129]:       <wordsize>32</wordsize>
Aug 01 13:45:38 user nova-compute[72129]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='4'>sim</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='32'>kc705</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='32'>ml605</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='32'>virt</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='32'>lx200</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='32'>lx60</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <domain type='qemu'/>
Aug 01 13:45:38 user nova-compute[72129]:     </arch>
Aug 01 13:45:38 user nova-compute[72129]:     <features>
Aug 01 13:45:38 user nova-compute[72129]:       <cpuselection/>
Aug 01 13:45:38 user nova-compute[72129]:       <deviceboot/>
Aug 01 13:45:38 user nova-compute[72129]:       <disksnapshot default='on' toggle='no'/>
Aug 01 13:45:38 user nova-compute[72129]:     </features>
Aug 01 13:45:38 user nova-compute[72129]:   </guest>
Aug 01 13:45:38 user nova-compute[72129]:   <guest>
Aug 01 13:45:38 user nova-compute[72129]:     <os_type>hvm</os_type>
Aug 01 13:45:38 user nova-compute[72129]:     <arch name='xtensaeb'>
Aug 01 13:45:38 user nova-compute[72129]:       <wordsize>32</wordsize>
Aug 01 13:45:38 user nova-compute[72129]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='4'>sim</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='32'>kc705</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='32'>ml605</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='32'>virt</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='32'>lx200</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='32'>lx60</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 01 13:45:38 user nova-compute[72129]:       <domain type='qemu'/>
Aug 01 13:45:38 user nova-compute[72129]:     </arch>
Aug 01 13:45:38 user nova-compute[72129]:     <features>
Aug 01 13:45:38 user nova-compute[72129]:       <cpuselection/>
Aug 01 13:45:38 user nova-compute[72129]:       <deviceboot/>
Aug 01 13:45:38 user nova-compute[72129]:       <disksnapshot default='on' toggle='no'/>
Aug 01 13:45:38 user nova-compute[72129]:     </features>
Aug 01 13:45:38 user nova-compute[72129]:   </guest>
Aug 01 13:45:38 user nova-compute[72129]: </capabilities>
Aug 01 13:45:38 user nova-compute[72129]: 
Aug 01 13:45:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=72129) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 13:45:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=72129) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 13:45:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=72129) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 13:45:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72129) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 13:45:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72129) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 13:45:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=72129) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 13:45:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72129) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 13:45:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=72129) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 13:45:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=72129) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 13:45:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=72129) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 13:45:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=72129) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 13:45:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Getting domain capabilities for i686 via machine types: {'ubuntu-q35', 'ubuntu', 'pc', 'q35'} {{(pid=72129) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 13:45:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Aug 01 13:45:38 user nova-compute[72129]: <domainCapabilities>
Aug 01 13:45:38 user nova-compute[72129]:   <path>/usr/bin/qemu-system-i386</path>
Aug 01 13:45:38 user nova-compute[72129]:   <domain>kvm</domain>
Aug 01 13:45:38 user nova-compute[72129]:   <machine>pc-q35-jammy</machine>
Aug 01 13:45:38 user nova-compute[72129]:   <arch>i686</arch>
Aug 01 13:45:38 user nova-compute[72129]:   <vcpu max='288'/>
Aug 01 13:45:38 user nova-compute[72129]:   <iothreads supported='yes'/>
Aug 01 13:45:38 user nova-compute[72129]:   <os supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:     <enum name='firmware'/>
Aug 01 13:45:38 user nova-compute[72129]:     <loader supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 01 13:45:38 user nova-compute[72129]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 01 13:45:38 user nova-compute[72129]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 01 13:45:38 user nova-compute[72129]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 01 13:45:38 user nova-compute[72129]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='type'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>rom</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>pflash</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='readonly'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>yes</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>no</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='secure'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>no</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:     </loader>
Aug 01 13:45:38 user nova-compute[72129]:   </os>
Aug 01 13:45:38 user nova-compute[72129]:   <cpu>
Aug 01 13:45:38 user nova-compute[72129]:     <mode name='host-passthrough' supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='hostPassthroughMigratable'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>off</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:     </mode>
Aug 01 13:45:38 user nova-compute[72129]:     <mode name='maximum' supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='maximumMigratable'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>on</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>off</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:     </mode>
Aug 01 13:45:38 user nova-compute[72129]:     <mode name='host-model' supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <vendor>Intel</vendor>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='ss'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='vmx'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='pcid'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='hypervisor'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='arat'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='tsc_adjust'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='umip'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='md-clear'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='stibp'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='arch-capabilities'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='ssbd'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='ibpb'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='ibrs'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='amd-stibp'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='amd-ssbd'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='disable' name='erms'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='disable' name='xsaveopt'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='disable' name='lm'/>
Aug 01 13:45:38 user nova-compute[72129]:     </mode>
Aug 01 13:45:38 user nova-compute[72129]:     <mode name='custom' supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>qemu64</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>qemu32</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>phenom</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>pentium3</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>pentium2</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>pentium</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>n270</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>kvm64</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>kvm32</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>coreduo</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>core2duo</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>athlon</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Westmere-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Westmere</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Snowridge</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Skylake-Server</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Skylake-Client</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>SandyBridge</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Penryn</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Opteron_G5</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Opteron_G4</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Opteron_G3</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Opteron_G2</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Opteron_G1</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Nehalem-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Nehalem</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>IvyBridge</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Icelake-Server</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Haswell-noTSX</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Haswell-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Haswell</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>EPYC-Rome</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>EPYC-Milan</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>EPYC-IBPB</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>EPYC</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Dhyana</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Cooperlake</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Conroe</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Cascadelake-Server</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Broadwell-noTSX</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Broadwell-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Broadwell</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>486</model>
Aug 01 13:45:38 user nova-compute[72129]:     </mode>
Aug 01 13:45:38 user nova-compute[72129]:   </cpu>
Aug 01 13:45:38 user nova-compute[72129]:   <memoryBacking supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:     <enum name='sourceType'>
Aug 01 13:45:38 user nova-compute[72129]:       <value>file</value>
Aug 01 13:45:38 user nova-compute[72129]:       <value>anonymous</value>
Aug 01 13:45:38 user nova-compute[72129]:       <value>memfd</value>
Aug 01 13:45:38 user nova-compute[72129]:     </enum>
Aug 01 13:45:38 user nova-compute[72129]:   </memoryBacking>
Aug 01 13:45:38 user nova-compute[72129]:   <devices>
Aug 01 13:45:38 user nova-compute[72129]:     <disk supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='diskDevice'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>disk</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>cdrom</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>floppy</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>lun</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='bus'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>fdc</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>scsi</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>virtio</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>usb</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>sata</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='model'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>virtio</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>virtio-transitional</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>virtio-non-transitional</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:     </disk>
Aug 01 13:45:38 user nova-compute[72129]:     <graphics supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='type'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>sdl</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>vnc</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>spice</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>egl-headless</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:     </graphics>
Aug 01 13:45:38 user nova-compute[72129]:     <video supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='modelType'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>vga</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>cirrus</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>vmvga</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>qxl</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>virtio</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>none</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>bochs</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>ramfb</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:     </video>
Aug 01 13:45:38 user nova-compute[72129]:     <hostdev supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='mode'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>subsystem</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='startupPolicy'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>default</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>mandatory</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>requisite</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>optional</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='subsysType'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>usb</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>pci</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>scsi</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='capsType'/>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='pciBackend'/>
Aug 01 13:45:38 user nova-compute[72129]:     </hostdev>
Aug 01 13:45:38 user nova-compute[72129]:     <rng supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='model'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>virtio</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>virtio-transitional</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>virtio-non-transitional</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='backendModel'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>random</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>egd</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>builtin</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:     </rng>
Aug 01 13:45:38 user nova-compute[72129]:     <filesystem supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='driverType'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>path</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>handle</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>virtiofs</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:     </filesystem>
Aug 01 13:45:38 user nova-compute[72129]:     <tpm supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='model'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>tpm-tis</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>tpm-crb</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='backendModel'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>passthrough</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>emulator</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:     </tpm>
Aug 01 13:45:38 user nova-compute[72129]:   </devices>
Aug 01 13:45:38 user nova-compute[72129]:   <features>
Aug 01 13:45:38 user nova-compute[72129]:     <gic supported='no'/>
Aug 01 13:45:38 user nova-compute[72129]:     <vmcoreinfo supported='yes'/>
Aug 01 13:45:38 user nova-compute[72129]:     <genid supported='yes'/>
Aug 01 13:45:38 user nova-compute[72129]:     <backingStoreInput supported='yes'/>
Aug 01 13:45:38 user nova-compute[72129]:     <backup supported='yes'/>
Aug 01 13:45:38 user nova-compute[72129]:     <sev supported='no'/>
Aug 01 13:45:38 user nova-compute[72129]:   </features>
Aug 01 13:45:38 user nova-compute[72129]: </domainCapabilities>
Aug 01 13:45:38 user nova-compute[72129]:  {{(pid=72129) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 01 13:45:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Aug 01 13:45:38 user nova-compute[72129]: <domainCapabilities>
Aug 01 13:45:38 user nova-compute[72129]:   <path>/usr/bin/qemu-system-i386</path>
Aug 01 13:45:38 user nova-compute[72129]:   <domain>kvm</domain>
Aug 01 13:45:38 user nova-compute[72129]:   <machine>pc-i440fx-jammy</machine>
Aug 01 13:45:38 user nova-compute[72129]:   <arch>i686</arch>
Aug 01 13:45:38 user nova-compute[72129]:   <vcpu max='255'/>
Aug 01 13:45:38 user nova-compute[72129]:   <iothreads supported='yes'/>
Aug 01 13:45:38 user nova-compute[72129]:   <os supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:     <enum name='firmware'/>
Aug 01 13:45:38 user nova-compute[72129]:     <loader supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 01 13:45:38 user nova-compute[72129]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 01 13:45:38 user nova-compute[72129]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 01 13:45:38 user nova-compute[72129]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 01 13:45:38 user nova-compute[72129]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='type'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>rom</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>pflash</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='readonly'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>yes</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>no</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='secure'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>no</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:     </loader>
Aug 01 13:45:38 user nova-compute[72129]:   </os>
Aug 01 13:45:38 user nova-compute[72129]:   <cpu>
Aug 01 13:45:38 user nova-compute[72129]:     <mode name='host-passthrough' supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='hostPassthroughMigratable'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>off</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:     </mode>
Aug 01 13:45:38 user nova-compute[72129]:     <mode name='maximum' supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='maximumMigratable'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>on</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>off</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:     </mode>
Aug 01 13:45:38 user nova-compute[72129]:     <mode name='host-model' supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <vendor>Intel</vendor>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='ss'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='vmx'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='pcid'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='hypervisor'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='arat'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='tsc_adjust'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='umip'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='md-clear'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='stibp'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='arch-capabilities'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='ssbd'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='ibpb'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='ibrs'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='amd-stibp'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='amd-ssbd'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='disable' name='erms'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='disable' name='xsaveopt'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='disable' name='lm'/>
Aug 01 13:45:38 user nova-compute[72129]:     </mode>
Aug 01 13:45:38 user nova-compute[72129]:     <mode name='custom' supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>qemu64</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>qemu32</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>phenom</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>pentium3</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>pentium2</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>pentium</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>n270</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>kvm64</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>kvm32</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>coreduo</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>core2duo</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>athlon</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Westmere-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Westmere</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Snowridge</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Skylake-Server</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Skylake-Client</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>SandyBridge</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Penryn</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Opteron_G5</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Opteron_G4</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Opteron_G3</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Opteron_G2</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Opteron_G1</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Nehalem-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Nehalem</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>IvyBridge</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Icelake-Server</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Haswell-noTSX</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Haswell-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Haswell</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>EPYC-Rome</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>EPYC-Milan</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>EPYC-IBPB</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>EPYC</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Dhyana</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Cooperlake</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Conroe</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Cascadelake-Server</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Broadwell-noTSX</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Broadwell-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Broadwell</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>486</model>
Aug 01 13:45:38 user nova-compute[72129]:     </mode>
Aug 01 13:45:38 user nova-compute[72129]:   </cpu>
Aug 01 13:45:38 user nova-compute[72129]:   <memoryBacking supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:     <enum name='sourceType'>
Aug 01 13:45:38 user nova-compute[72129]:       <value>file</value>
Aug 01 13:45:38 user nova-compute[72129]:       <value>anonymous</value>
Aug 01 13:45:38 user nova-compute[72129]:       <value>memfd</value>
Aug 01 13:45:38 user nova-compute[72129]:     </enum>
Aug 01 13:45:38 user nova-compute[72129]:   </memoryBacking>
Aug 01 13:45:38 user nova-compute[72129]:   <devices>
Aug 01 13:45:38 user nova-compute[72129]:     <disk supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='diskDevice'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>disk</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>cdrom</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>floppy</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>lun</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='bus'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>ide</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>fdc</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>scsi</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>virtio</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>usb</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>sata</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='model'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>virtio</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>virtio-transitional</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>virtio-non-transitional</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:     </disk>
Aug 01 13:45:38 user nova-compute[72129]:     <graphics supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='type'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>sdl</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>vnc</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>spice</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>egl-headless</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:     </graphics>
Aug 01 13:45:38 user nova-compute[72129]:     <video supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='modelType'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>vga</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>cirrus</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>vmvga</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>qxl</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>virtio</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>none</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>bochs</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>ramfb</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:     </video>
Aug 01 13:45:38 user nova-compute[72129]:     <hostdev supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='mode'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>subsystem</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='startupPolicy'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>default</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>mandatory</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>requisite</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>optional</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='subsysType'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>usb</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>pci</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>scsi</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='capsType'/>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='pciBackend'/>
Aug 01 13:45:38 user nova-compute[72129]:     </hostdev>
Aug 01 13:45:38 user nova-compute[72129]:     <rng supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='model'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>virtio</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>virtio-transitional</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>virtio-non-transitional</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='backendModel'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>random</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>egd</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>builtin</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:     </rng>
Aug 01 13:45:38 user nova-compute[72129]:     <filesystem supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='driverType'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>path</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>handle</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>virtiofs</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:     </filesystem>
Aug 01 13:45:38 user nova-compute[72129]:     <tpm supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='model'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>tpm-tis</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>tpm-crb</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='backendModel'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>passthrough</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>emulator</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:     </tpm>
Aug 01 13:45:38 user nova-compute[72129]:   </devices>
Aug 01 13:45:38 user nova-compute[72129]:   <features>
Aug 01 13:45:38 user nova-compute[72129]:     <gic supported='no'/>
Aug 01 13:45:38 user nova-compute[72129]:     <vmcoreinfo supported='yes'/>
Aug 01 13:45:38 user nova-compute[72129]:     <genid supported='yes'/>
Aug 01 13:45:38 user nova-compute[72129]:     <backingStoreInput supported='yes'/>
Aug 01 13:45:38 user nova-compute[72129]:     <backup supported='yes'/>
Aug 01 13:45:38 user nova-compute[72129]:     <sev supported='no'/>
Aug 01 13:45:38 user nova-compute[72129]:   </features>
Aug 01 13:45:38 user nova-compute[72129]: </domainCapabilities>
Aug 01 13:45:38 user nova-compute[72129]:  {{(pid=72129) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 01 13:45:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Aug 01 13:45:38 user nova-compute[72129]: <domainCapabilities>
Aug 01 13:45:38 user nova-compute[72129]:   <path>/usr/bin/qemu-system-i386</path>
Aug 01 13:45:38 user nova-compute[72129]:   <domain>kvm</domain>
Aug 01 13:45:38 user nova-compute[72129]:   <machine>pc-i440fx-6.2</machine>
Aug 01 13:45:38 user nova-compute[72129]:   <arch>i686</arch>
Aug 01 13:45:38 user nova-compute[72129]:   <vcpu max='255'/>
Aug 01 13:45:38 user nova-compute[72129]:   <iothreads supported='yes'/>
Aug 01 13:45:38 user nova-compute[72129]:   <os supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:     <enum name='firmware'/>
Aug 01 13:45:38 user nova-compute[72129]:     <loader supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 01 13:45:38 user nova-compute[72129]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 01 13:45:38 user nova-compute[72129]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 01 13:45:38 user nova-compute[72129]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 01 13:45:38 user nova-compute[72129]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='type'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>rom</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>pflash</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='readonly'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>yes</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>no</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='secure'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>no</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:     </loader>
Aug 01 13:45:38 user nova-compute[72129]:   </os>
Aug 01 13:45:38 user nova-compute[72129]:   <cpu>
Aug 01 13:45:38 user nova-compute[72129]:     <mode name='host-passthrough' supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='hostPassthroughMigratable'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>off</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:     </mode>
Aug 01 13:45:38 user nova-compute[72129]:     <mode name='maximum' supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='maximumMigratable'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>on</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>off</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:     </mode>
Aug 01 13:45:38 user nova-compute[72129]:     <mode name='host-model' supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <vendor>Intel</vendor>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='ss'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='vmx'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='pcid'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='hypervisor'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='arat'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='tsc_adjust'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='umip'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='md-clear'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='stibp'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='arch-capabilities'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='ssbd'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='ibpb'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='ibrs'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='amd-stibp'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='amd-ssbd'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='disable' name='erms'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='disable' name='xsaveopt'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='disable' name='lm'/>
Aug 01 13:45:38 user nova-compute[72129]:     </mode>
Aug 01 13:45:38 user nova-compute[72129]:     <mode name='custom' supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>qemu64</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>qemu32</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>phenom</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>pentium3</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>pentium2</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>pentium</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>n270</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>kvm64</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>kvm32</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>coreduo</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>core2duo</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>athlon</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Westmere-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Westmere</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Snowridge</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Skylake-Server</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Skylake-Client</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>SandyBridge</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Penryn</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Opteron_G5</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Opteron_G4</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Opteron_G3</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Opteron_G2</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Opteron_G1</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Nehalem-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Nehalem</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>IvyBridge</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Icelake-Server</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Haswell-noTSX</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Haswell-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Haswell</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>EPYC-Rome</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>EPYC-Milan</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>EPYC-IBPB</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>EPYC</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Dhyana</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Cooperlake</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Conroe</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Cascadelake-Server</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Broadwell-noTSX</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Broadwell-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Broadwell</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>486</model>
Aug 01 13:45:38 user nova-compute[72129]:     </mode>
Aug 01 13:45:38 user nova-compute[72129]:   </cpu>
Aug 01 13:45:38 user nova-compute[72129]:   <memoryBacking supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:     <enum name='sourceType'>
Aug 01 13:45:38 user nova-compute[72129]:       <value>file</value>
Aug 01 13:45:38 user nova-compute[72129]:       <value>anonymous</value>
Aug 01 13:45:38 user nova-compute[72129]:       <value>memfd</value>
Aug 01 13:45:38 user nova-compute[72129]:     </enum>
Aug 01 13:45:38 user nova-compute[72129]:   </memoryBacking>
Aug 01 13:45:38 user nova-compute[72129]:   <devices>
Aug 01 13:45:38 user nova-compute[72129]:     <disk supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='diskDevice'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>disk</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>cdrom</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>floppy</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>lun</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='bus'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>ide</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>fdc</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>scsi</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>virtio</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>usb</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>sata</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='model'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>virtio</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>virtio-transitional</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>virtio-non-transitional</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:     </disk>
Aug 01 13:45:38 user nova-compute[72129]:     <graphics supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='type'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>sdl</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>vnc</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>spice</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>egl-headless</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:     </graphics>
Aug 01 13:45:38 user nova-compute[72129]:     <video supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='modelType'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>vga</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>cirrus</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>vmvga</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>qxl</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>virtio</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>none</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>bochs</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>ramfb</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:     </video>
Aug 01 13:45:38 user nova-compute[72129]:     <hostdev supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='mode'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>subsystem</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='startupPolicy'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>default</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>mandatory</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>requisite</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>optional</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='subsysType'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>usb</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>pci</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>scsi</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='capsType'/>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='pciBackend'/>
Aug 01 13:45:38 user nova-compute[72129]:     </hostdev>
Aug 01 13:45:38 user nova-compute[72129]:     <rng supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='model'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>virtio</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>virtio-transitional</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>virtio-non-transitional</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='backendModel'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>random</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>egd</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>builtin</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:     </rng>
Aug 01 13:45:38 user nova-compute[72129]:     <filesystem supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='driverType'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>path</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>handle</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>virtiofs</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:     </filesystem>
Aug 01 13:45:38 user nova-compute[72129]:     <tpm supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='model'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>tpm-tis</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>tpm-crb</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='backendModel'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>passthrough</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>emulator</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:     </tpm>
Aug 01 13:45:38 user nova-compute[72129]:   </devices>
Aug 01 13:45:38 user nova-compute[72129]:   <features>
Aug 01 13:45:38 user nova-compute[72129]:     <gic supported='no'/>
Aug 01 13:45:38 user nova-compute[72129]:     <vmcoreinfo supported='yes'/>
Aug 01 13:45:38 user nova-compute[72129]:     <genid supported='yes'/>
Aug 01 13:45:38 user nova-compute[72129]:     <backingStoreInput supported='yes'/>
Aug 01 13:45:38 user nova-compute[72129]:     <backup supported='yes'/>
Aug 01 13:45:38 user nova-compute[72129]:     <sev supported='no'/>
Aug 01 13:45:38 user nova-compute[72129]:   </features>
Aug 01 13:45:38 user nova-compute[72129]: </domainCapabilities>
Aug 01 13:45:38 user nova-compute[72129]:  {{(pid=72129) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 01 13:45:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Aug 01 13:45:38 user nova-compute[72129]: <domainCapabilities>
Aug 01 13:45:38 user nova-compute[72129]:   <path>/usr/bin/qemu-system-i386</path>
Aug 01 13:45:38 user nova-compute[72129]:   <domain>kvm</domain>
Aug 01 13:45:38 user nova-compute[72129]:   <machine>pc-q35-6.2</machine>
Aug 01 13:45:38 user nova-compute[72129]:   <arch>i686</arch>
Aug 01 13:45:38 user nova-compute[72129]:   <vcpu max='288'/>
Aug 01 13:45:38 user nova-compute[72129]:   <iothreads supported='yes'/>
Aug 01 13:45:38 user nova-compute[72129]:   <os supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:     <enum name='firmware'/>
Aug 01 13:45:38 user nova-compute[72129]:     <loader supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 01 13:45:38 user nova-compute[72129]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 01 13:45:38 user nova-compute[72129]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 01 13:45:38 user nova-compute[72129]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 01 13:45:38 user nova-compute[72129]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='type'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>rom</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>pflash</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='readonly'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>yes</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>no</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='secure'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>no</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:     </loader>
Aug 01 13:45:38 user nova-compute[72129]:   </os>
Aug 01 13:45:38 user nova-compute[72129]:   <cpu>
Aug 01 13:45:38 user nova-compute[72129]:     <mode name='host-passthrough' supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='hostPassthroughMigratable'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>off</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:     </mode>
Aug 01 13:45:38 user nova-compute[72129]:     <mode name='maximum' supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='maximumMigratable'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>on</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>off</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:     </mode>
Aug 01 13:45:38 user nova-compute[72129]:     <mode name='host-model' supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <vendor>Intel</vendor>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='ss'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='vmx'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='pcid'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='hypervisor'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='arat'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='tsc_adjust'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='umip'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='md-clear'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='stibp'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='arch-capabilities'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='ssbd'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='ibpb'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='ibrs'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='amd-stibp'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='amd-ssbd'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='disable' name='erms'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='disable' name='xsaveopt'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='disable' name='lm'/>
Aug 01 13:45:38 user nova-compute[72129]:     </mode>
Aug 01 13:45:38 user nova-compute[72129]:     <mode name='custom' supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>qemu64</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>qemu32</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>phenom</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>pentium3</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>pentium2</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>pentium</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>n270</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>kvm64</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>kvm32</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>coreduo</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>core2duo</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>athlon</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Westmere-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Westmere</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Snowridge</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Skylake-Server</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Skylake-Client</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>SandyBridge</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Penryn</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Opteron_G5</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Opteron_G4</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Opteron_G3</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Opteron_G2</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Opteron_G1</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Nehalem-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Nehalem</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>IvyBridge</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Icelake-Server</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Haswell-noTSX</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Haswell-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Haswell</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>EPYC-Rome</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>EPYC-Milan</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>EPYC-IBPB</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>EPYC</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Dhyana</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Cooperlake</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Conroe</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Cascadelake-Server</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Broadwell-noTSX</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Broadwell-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Broadwell</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>486</model>
Aug 01 13:45:38 user nova-compute[72129]:     </mode>
Aug 01 13:45:38 user nova-compute[72129]:   </cpu>
Aug 01 13:45:38 user nova-compute[72129]:   <memoryBacking supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:     <enum name='sourceType'>
Aug 01 13:45:38 user nova-compute[72129]:       <value>file</value>
Aug 01 13:45:38 user nova-compute[72129]:       <value>anonymous</value>
Aug 01 13:45:38 user nova-compute[72129]:       <value>memfd</value>
Aug 01 13:45:38 user nova-compute[72129]:     </enum>
Aug 01 13:45:38 user nova-compute[72129]:   </memoryBacking>
Aug 01 13:45:38 user nova-compute[72129]:   <devices>
Aug 01 13:45:38 user nova-compute[72129]:     <disk supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='diskDevice'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>disk</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>cdrom</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>floppy</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>lun</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='bus'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>fdc</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>scsi</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>virtio</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>usb</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>sata</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='model'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>virtio</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>virtio-transitional</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>virtio-non-transitional</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:     </disk>
Aug 01 13:45:38 user nova-compute[72129]:     <graphics supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='type'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>sdl</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>vnc</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>spice</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>egl-headless</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:     </graphics>
Aug 01 13:45:38 user nova-compute[72129]:     <video supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='modelType'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>vga</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>cirrus</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>vmvga</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>qxl</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>virtio</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>none</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>bochs</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>ramfb</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:     </video>
Aug 01 13:45:38 user nova-compute[72129]:     <hostdev supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='mode'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>subsystem</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='startupPolicy'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>default</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>mandatory</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>requisite</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>optional</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='subsysType'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>usb</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>pci</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>scsi</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='capsType'/>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='pciBackend'/>
Aug 01 13:45:38 user nova-compute[72129]:     </hostdev>
Aug 01 13:45:38 user nova-compute[72129]:     <rng supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='model'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>virtio</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>virtio-transitional</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>virtio-non-transitional</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='backendModel'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>random</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>egd</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>builtin</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:     </rng>
Aug 01 13:45:38 user nova-compute[72129]:     <filesystem supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='driverType'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>path</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>handle</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>virtiofs</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:     </filesystem>
Aug 01 13:45:38 user nova-compute[72129]:     <tpm supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='model'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>tpm-tis</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>tpm-crb</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='backendModel'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>passthrough</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>emulator</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:     </tpm>
Aug 01 13:45:38 user nova-compute[72129]:   </devices>
Aug 01 13:45:38 user nova-compute[72129]:   <features>
Aug 01 13:45:38 user nova-compute[72129]:     <gic supported='no'/>
Aug 01 13:45:38 user nova-compute[72129]:     <vmcoreinfo supported='yes'/>
Aug 01 13:45:38 user nova-compute[72129]:     <genid supported='yes'/>
Aug 01 13:45:38 user nova-compute[72129]:     <backingStoreInput supported='yes'/>
Aug 01 13:45:38 user nova-compute[72129]:     <backup supported='yes'/>
Aug 01 13:45:38 user nova-compute[72129]:     <sev supported='no'/>
Aug 01 13:45:38 user nova-compute[72129]:   </features>
Aug 01 13:45:38 user nova-compute[72129]: </domainCapabilities>
Aug 01 13:45:38 user nova-compute[72129]:  {{(pid=72129) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 01 13:45:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=72129) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 13:45:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72129) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 13:45:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72129) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 13:45:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=72129) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 13:45:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=72129) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 13:45:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=72129) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 13:45:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=72129) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 13:45:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=72129) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 13:45:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=72129) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 13:45:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=72129) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 13:45:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=72129) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 13:45:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=72129) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 13:45:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=72129) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 13:45:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=72129) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 13:45:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=72129) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 13:45:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=72129) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 13:45:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=72129) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 13:45:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', None, 'powernv'} {{(pid=72129) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 13:45:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72129) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 13:45:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72129) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 13:45:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72129) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 13:45:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=72129) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 13:45:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72129) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 13:45:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72129) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 13:45:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=72129) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 13:45:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=72129) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 13:45:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=72129) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 13:45:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=72129) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 13:45:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=72129) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 13:45:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=72129) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 13:45:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=72129) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 13:45:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=72129) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 13:45:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=72129) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 13:45:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=72129) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 13:45:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=72129) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 13:45:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=72129) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 13:45:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=72129) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 13:45:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=72129) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 13:45:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu-q35', 'ubuntu', 'pc', 'q35'} {{(pid=72129) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 13:45:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Aug 01 13:45:38 user nova-compute[72129]: <domainCapabilities>
Aug 01 13:45:38 user nova-compute[72129]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 01 13:45:38 user nova-compute[72129]:   <domain>kvm</domain>
Aug 01 13:45:38 user nova-compute[72129]:   <machine>pc-q35-jammy</machine>
Aug 01 13:45:38 user nova-compute[72129]:   <arch>x86_64</arch>
Aug 01 13:45:38 user nova-compute[72129]:   <vcpu max='288'/>
Aug 01 13:45:38 user nova-compute[72129]:   <iothreads supported='yes'/>
Aug 01 13:45:38 user nova-compute[72129]:   <os supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:     <enum name='firmware'>
Aug 01 13:45:38 user nova-compute[72129]:       <value>efi</value>
Aug 01 13:45:38 user nova-compute[72129]:     </enum>
Aug 01 13:45:38 user nova-compute[72129]:     <loader supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 01 13:45:38 user nova-compute[72129]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 01 13:45:38 user nova-compute[72129]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='type'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>rom</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>pflash</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='readonly'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>yes</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>no</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='secure'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>yes</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>no</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:     </loader>
Aug 01 13:45:38 user nova-compute[72129]:   </os>
Aug 01 13:45:38 user nova-compute[72129]:   <cpu>
Aug 01 13:45:38 user nova-compute[72129]:     <mode name='host-passthrough' supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='hostPassthroughMigratable'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>on</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>off</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:     </mode>
Aug 01 13:45:38 user nova-compute[72129]:     <mode name='maximum' supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='maximumMigratable'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>on</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>off</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:     </mode>
Aug 01 13:45:38 user nova-compute[72129]:     <mode name='host-model' supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <vendor>Intel</vendor>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='ss'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='vmx'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='pcid'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='hypervisor'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='arat'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='tsc_adjust'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='umip'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='md-clear'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='stibp'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='arch-capabilities'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='ssbd'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='invtsc'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='ibpb'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='ibrs'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='amd-stibp'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='amd-ssbd'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='rsba'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='pschange-mc-no'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='disable' name='erms'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='disable' name='xsaveopt'/>
Aug 01 13:45:38 user nova-compute[72129]:     </mode>
Aug 01 13:45:38 user nova-compute[72129]:     <mode name='custom' supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>qemu64</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>qemu32</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>phenom</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>pentium3</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>pentium2</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>pentium</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>n270</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>kvm64</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>kvm32</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>coreduo</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>core2duo</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>athlon</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>Westmere-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>Westmere</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Snowridge</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Skylake-Server</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Skylake-Client</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>SandyBridge</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>Penryn</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Opteron_G5</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Opteron_G4</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Opteron_G3</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Opteron_G2</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>Opteron_G1</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>Nehalem</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>IvyBridge</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Icelake-Server</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Haswell-noTSX</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Haswell-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Haswell</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>EPYC-Rome</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>EPYC-Milan</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>EPYC-IBPB</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>EPYC</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Dhyana</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Cooperlake</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>Conroe</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Cascadelake-Server</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Broadwell-noTSX</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Broadwell-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Broadwell</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>486</model>
Aug 01 13:45:38 user nova-compute[72129]:     </mode>
Aug 01 13:45:38 user nova-compute[72129]:   </cpu>
Aug 01 13:45:38 user nova-compute[72129]:   <memoryBacking supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:     <enum name='sourceType'>
Aug 01 13:45:38 user nova-compute[72129]:       <value>file</value>
Aug 01 13:45:38 user nova-compute[72129]:       <value>anonymous</value>
Aug 01 13:45:38 user nova-compute[72129]:       <value>memfd</value>
Aug 01 13:45:38 user nova-compute[72129]:     </enum>
Aug 01 13:45:38 user nova-compute[72129]:   </memoryBacking>
Aug 01 13:45:38 user nova-compute[72129]:   <devices>
Aug 01 13:45:38 user nova-compute[72129]:     <disk supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='diskDevice'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>disk</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>cdrom</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>floppy</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>lun</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='bus'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>fdc</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>scsi</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>virtio</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>usb</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>sata</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='model'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>virtio</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>virtio-transitional</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>virtio-non-transitional</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:     </disk>
Aug 01 13:45:38 user nova-compute[72129]:     <graphics supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='type'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>sdl</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>vnc</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>spice</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>egl-headless</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:     </graphics>
Aug 01 13:45:38 user nova-compute[72129]:     <video supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='modelType'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>vga</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>cirrus</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>vmvga</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>qxl</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>virtio</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>none</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>bochs</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>ramfb</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:     </video>
Aug 01 13:45:38 user nova-compute[72129]:     <hostdev supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='mode'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>subsystem</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='startupPolicy'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>default</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>mandatory</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>requisite</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>optional</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='subsysType'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>usb</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>pci</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>scsi</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='capsType'/>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='pciBackend'/>
Aug 01 13:45:38 user nova-compute[72129]:     </hostdev>
Aug 01 13:45:38 user nova-compute[72129]:     <rng supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='model'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>virtio</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>virtio-transitional</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>virtio-non-transitional</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='backendModel'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>random</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>egd</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>builtin</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:     </rng>
Aug 01 13:45:38 user nova-compute[72129]:     <filesystem supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='driverType'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>path</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>handle</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>virtiofs</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:     </filesystem>
Aug 01 13:45:38 user nova-compute[72129]:     <tpm supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='model'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>tpm-tis</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>tpm-crb</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='backendModel'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>passthrough</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>emulator</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:     </tpm>
Aug 01 13:45:38 user nova-compute[72129]:   </devices>
Aug 01 13:45:38 user nova-compute[72129]:   <features>
Aug 01 13:45:38 user nova-compute[72129]:     <gic supported='no'/>
Aug 01 13:45:38 user nova-compute[72129]:     <vmcoreinfo supported='yes'/>
Aug 01 13:45:38 user nova-compute[72129]:     <genid supported='yes'/>
Aug 01 13:45:38 user nova-compute[72129]:     <backingStoreInput supported='yes'/>
Aug 01 13:45:38 user nova-compute[72129]:     <backup supported='yes'/>
Aug 01 13:45:38 user nova-compute[72129]:     <sev supported='no'/>
Aug 01 13:45:38 user nova-compute[72129]:   </features>
Aug 01 13:45:38 user nova-compute[72129]: </domainCapabilities>
Aug 01 13:45:38 user nova-compute[72129]:  {{(pid=72129) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 01 13:45:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Aug 01 13:45:38 user nova-compute[72129]: <domainCapabilities>
Aug 01 13:45:38 user nova-compute[72129]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 01 13:45:38 user nova-compute[72129]:   <domain>kvm</domain>
Aug 01 13:45:38 user nova-compute[72129]:   <machine>pc-i440fx-jammy</machine>
Aug 01 13:45:38 user nova-compute[72129]:   <arch>x86_64</arch>
Aug 01 13:45:38 user nova-compute[72129]:   <vcpu max='255'/>
Aug 01 13:45:38 user nova-compute[72129]:   <iothreads supported='yes'/>
Aug 01 13:45:38 user nova-compute[72129]:   <os supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:     <enum name='firmware'>
Aug 01 13:45:38 user nova-compute[72129]:       <value>efi</value>
Aug 01 13:45:38 user nova-compute[72129]:     </enum>
Aug 01 13:45:38 user nova-compute[72129]:     <loader supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='type'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>rom</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>pflash</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='readonly'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>yes</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>no</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='secure'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>no</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:     </loader>
Aug 01 13:45:38 user nova-compute[72129]:   </os>
Aug 01 13:45:38 user nova-compute[72129]:   <cpu>
Aug 01 13:45:38 user nova-compute[72129]:     <mode name='host-passthrough' supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='hostPassthroughMigratable'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>on</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>off</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:     </mode>
Aug 01 13:45:38 user nova-compute[72129]:     <mode name='maximum' supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='maximumMigratable'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>on</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>off</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:     </mode>
Aug 01 13:45:38 user nova-compute[72129]:     <mode name='host-model' supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <vendor>Intel</vendor>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='ss'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='vmx'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='pcid'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='hypervisor'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='arat'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='tsc_adjust'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='umip'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='md-clear'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='stibp'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='arch-capabilities'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='ssbd'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='invtsc'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='ibpb'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='ibrs'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='amd-stibp'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='amd-ssbd'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='rsba'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='pschange-mc-no'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='disable' name='erms'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='disable' name='xsaveopt'/>
Aug 01 13:45:38 user nova-compute[72129]:     </mode>
Aug 01 13:45:38 user nova-compute[72129]:     <mode name='custom' supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>qemu64</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>qemu32</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>phenom</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>pentium3</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>pentium2</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>pentium</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>n270</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>kvm64</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>kvm32</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>coreduo</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>core2duo</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>athlon</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>Westmere-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>Westmere</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Snowridge</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Skylake-Server</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Skylake-Client</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>SandyBridge</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>Penryn</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Opteron_G5</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Opteron_G4</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Opteron_G3</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Opteron_G2</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>Opteron_G1</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>Nehalem</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>IvyBridge</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Icelake-Server</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Haswell-noTSX</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Haswell-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Haswell</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>EPYC-Rome</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>EPYC-Milan</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>EPYC-IBPB</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>EPYC</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Dhyana</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Cooperlake</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>Conroe</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Cascadelake-Server</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Broadwell-noTSX</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Broadwell-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Broadwell</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>486</model>
Aug 01 13:45:38 user nova-compute[72129]:     </mode>
Aug 01 13:45:38 user nova-compute[72129]:   </cpu>
Aug 01 13:45:38 user nova-compute[72129]:   <memoryBacking supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:     <enum name='sourceType'>
Aug 01 13:45:38 user nova-compute[72129]:       <value>file</value>
Aug 01 13:45:38 user nova-compute[72129]:       <value>anonymous</value>
Aug 01 13:45:38 user nova-compute[72129]:       <value>memfd</value>
Aug 01 13:45:38 user nova-compute[72129]:     </enum>
Aug 01 13:45:38 user nova-compute[72129]:   </memoryBacking>
Aug 01 13:45:38 user nova-compute[72129]:   <devices>
Aug 01 13:45:38 user nova-compute[72129]:     <disk supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='diskDevice'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>disk</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>cdrom</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>floppy</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>lun</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='bus'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>ide</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>fdc</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>scsi</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>virtio</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>usb</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>sata</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='model'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>virtio</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>virtio-transitional</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>virtio-non-transitional</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:     </disk>
Aug 01 13:45:38 user nova-compute[72129]:     <graphics supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='type'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>sdl</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>vnc</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>spice</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>egl-headless</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:     </graphics>
Aug 01 13:45:38 user nova-compute[72129]:     <video supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='modelType'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>vga</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>cirrus</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>vmvga</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>qxl</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>virtio</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>none</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>bochs</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>ramfb</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:     </video>
Aug 01 13:45:38 user nova-compute[72129]:     <hostdev supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='mode'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>subsystem</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='startupPolicy'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>default</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>mandatory</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>requisite</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>optional</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='subsysType'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>usb</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>pci</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>scsi</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='capsType'/>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='pciBackend'/>
Aug 01 13:45:38 user nova-compute[72129]:     </hostdev>
Aug 01 13:45:38 user nova-compute[72129]:     <rng supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='model'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>virtio</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>virtio-transitional</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>virtio-non-transitional</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='backendModel'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>random</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>egd</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>builtin</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:     </rng>
Aug 01 13:45:38 user nova-compute[72129]:     <filesystem supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='driverType'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>path</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>handle</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>virtiofs</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:     </filesystem>
Aug 01 13:45:38 user nova-compute[72129]:     <tpm supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='model'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>tpm-tis</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>tpm-crb</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='backendModel'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>passthrough</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>emulator</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:     </tpm>
Aug 01 13:45:38 user nova-compute[72129]:   </devices>
Aug 01 13:45:38 user nova-compute[72129]:   <features>
Aug 01 13:45:38 user nova-compute[72129]:     <gic supported='no'/>
Aug 01 13:45:38 user nova-compute[72129]:     <vmcoreinfo supported='yes'/>
Aug 01 13:45:38 user nova-compute[72129]:     <genid supported='yes'/>
Aug 01 13:45:38 user nova-compute[72129]:     <backingStoreInput supported='yes'/>
Aug 01 13:45:38 user nova-compute[72129]:     <backup supported='yes'/>
Aug 01 13:45:38 user nova-compute[72129]:     <sev supported='no'/>
Aug 01 13:45:38 user nova-compute[72129]:   </features>
Aug 01 13:45:38 user nova-compute[72129]: </domainCapabilities>
Aug 01 13:45:38 user nova-compute[72129]:  {{(pid=72129) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 01 13:45:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Aug 01 13:45:38 user nova-compute[72129]: <domainCapabilities>
Aug 01 13:45:38 user nova-compute[72129]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 01 13:45:38 user nova-compute[72129]:   <domain>kvm</domain>
Aug 01 13:45:38 user nova-compute[72129]:   <machine>pc-i440fx-6.2</machine>
Aug 01 13:45:38 user nova-compute[72129]:   <arch>x86_64</arch>
Aug 01 13:45:38 user nova-compute[72129]:   <vcpu max='255'/>
Aug 01 13:45:38 user nova-compute[72129]:   <iothreads supported='yes'/>
Aug 01 13:45:38 user nova-compute[72129]:   <os supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:     <enum name='firmware'>
Aug 01 13:45:38 user nova-compute[72129]:       <value>efi</value>
Aug 01 13:45:38 user nova-compute[72129]:     </enum>
Aug 01 13:45:38 user nova-compute[72129]:     <loader supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='type'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>rom</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>pflash</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='readonly'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>yes</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>no</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='secure'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>no</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:     </loader>
Aug 01 13:45:38 user nova-compute[72129]:   </os>
Aug 01 13:45:38 user nova-compute[72129]:   <cpu>
Aug 01 13:45:38 user nova-compute[72129]:     <mode name='host-passthrough' supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='hostPassthroughMigratable'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>on</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>off</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:     </mode>
Aug 01 13:45:38 user nova-compute[72129]:     <mode name='maximum' supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='maximumMigratable'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>on</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>off</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:     </mode>
Aug 01 13:45:38 user nova-compute[72129]:     <mode name='host-model' supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <vendor>Intel</vendor>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='ss'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='vmx'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='pcid'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='hypervisor'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='arat'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='tsc_adjust'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='umip'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='md-clear'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='stibp'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='arch-capabilities'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='ssbd'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='invtsc'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='ibpb'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='ibrs'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='amd-stibp'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='amd-ssbd'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='rsba'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='pschange-mc-no'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='disable' name='erms'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='disable' name='xsaveopt'/>
Aug 01 13:45:38 user nova-compute[72129]:     </mode>
Aug 01 13:45:38 user nova-compute[72129]:     <mode name='custom' supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>qemu64</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>qemu32</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>phenom</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>pentium3</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>pentium2</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>pentium</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>n270</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>kvm64</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>kvm32</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>coreduo</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>core2duo</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>athlon</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>Westmere-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>Westmere</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Snowridge</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Skylake-Server</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Skylake-Client</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>SandyBridge</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>Penryn</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Opteron_G5</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Opteron_G4</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Opteron_G3</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Opteron_G2</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>Opteron_G1</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>Nehalem</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>IvyBridge</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Icelake-Server</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Haswell-noTSX</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Haswell-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Haswell</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>EPYC-Rome</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>EPYC-Milan</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>EPYC-IBPB</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>EPYC</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Dhyana</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Cooperlake</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>Conroe</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Cascadelake-Server</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Broadwell-noTSX</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Broadwell-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Broadwell</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>486</model>
Aug 01 13:45:38 user nova-compute[72129]:     </mode>
Aug 01 13:45:38 user nova-compute[72129]:   </cpu>
Aug 01 13:45:38 user nova-compute[72129]:   <memoryBacking supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:     <enum name='sourceType'>
Aug 01 13:45:38 user nova-compute[72129]:       <value>file</value>
Aug 01 13:45:38 user nova-compute[72129]:       <value>anonymous</value>
Aug 01 13:45:38 user nova-compute[72129]:       <value>memfd</value>
Aug 01 13:45:38 user nova-compute[72129]:     </enum>
Aug 01 13:45:38 user nova-compute[72129]:   </memoryBacking>
Aug 01 13:45:38 user nova-compute[72129]:   <devices>
Aug 01 13:45:38 user nova-compute[72129]:     <disk supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='diskDevice'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>disk</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>cdrom</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>floppy</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>lun</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='bus'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>ide</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>fdc</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>scsi</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>virtio</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>usb</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>sata</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='model'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>virtio</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>virtio-transitional</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>virtio-non-transitional</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:     </disk>
Aug 01 13:45:38 user nova-compute[72129]:     <graphics supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='type'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>sdl</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>vnc</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>spice</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>egl-headless</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:     </graphics>
Aug 01 13:45:38 user nova-compute[72129]:     <video supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='modelType'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>vga</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>cirrus</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>vmvga</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>qxl</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>virtio</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>none</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>bochs</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>ramfb</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:     </video>
Aug 01 13:45:38 user nova-compute[72129]:     <hostdev supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='mode'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>subsystem</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='startupPolicy'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>default</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>mandatory</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>requisite</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>optional</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='subsysType'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>usb</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>pci</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>scsi</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='capsType'/>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='pciBackend'/>
Aug 01 13:45:38 user nova-compute[72129]:     </hostdev>
Aug 01 13:45:38 user nova-compute[72129]:     <rng supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='model'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>virtio</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>virtio-transitional</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>virtio-non-transitional</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='backendModel'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>random</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>egd</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>builtin</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:     </rng>
Aug 01 13:45:38 user nova-compute[72129]:     <filesystem supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='driverType'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>path</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>handle</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>virtiofs</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:     </filesystem>
Aug 01 13:45:38 user nova-compute[72129]:     <tpm supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='model'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>tpm-tis</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>tpm-crb</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='backendModel'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>passthrough</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>emulator</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:     </tpm>
Aug 01 13:45:38 user nova-compute[72129]:   </devices>
Aug 01 13:45:38 user nova-compute[72129]:   <features>
Aug 01 13:45:38 user nova-compute[72129]:     <gic supported='no'/>
Aug 01 13:45:38 user nova-compute[72129]:     <vmcoreinfo supported='yes'/>
Aug 01 13:45:38 user nova-compute[72129]:     <genid supported='yes'/>
Aug 01 13:45:38 user nova-compute[72129]:     <backingStoreInput supported='yes'/>
Aug 01 13:45:38 user nova-compute[72129]:     <backup supported='yes'/>
Aug 01 13:45:38 user nova-compute[72129]:     <sev supported='no'/>
Aug 01 13:45:38 user nova-compute[72129]:   </features>
Aug 01 13:45:38 user nova-compute[72129]: </domainCapabilities>
Aug 01 13:45:38 user nova-compute[72129]:  {{(pid=72129) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 01 13:45:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Aug 01 13:45:38 user nova-compute[72129]: <domainCapabilities>
Aug 01 13:45:38 user nova-compute[72129]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 01 13:45:38 user nova-compute[72129]:   <domain>kvm</domain>
Aug 01 13:45:38 user nova-compute[72129]:   <machine>pc-q35-6.2</machine>
Aug 01 13:45:38 user nova-compute[72129]:   <arch>x86_64</arch>
Aug 01 13:45:38 user nova-compute[72129]:   <vcpu max='288'/>
Aug 01 13:45:38 user nova-compute[72129]:   <iothreads supported='yes'/>
Aug 01 13:45:38 user nova-compute[72129]:   <os supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:     <enum name='firmware'>
Aug 01 13:45:38 user nova-compute[72129]:       <value>efi</value>
Aug 01 13:45:38 user nova-compute[72129]:     </enum>
Aug 01 13:45:38 user nova-compute[72129]:     <loader supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 01 13:45:38 user nova-compute[72129]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 01 13:45:38 user nova-compute[72129]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='type'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>rom</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>pflash</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='readonly'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>yes</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>no</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='secure'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>yes</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>no</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:     </loader>
Aug 01 13:45:38 user nova-compute[72129]:   </os>
Aug 01 13:45:38 user nova-compute[72129]:   <cpu>
Aug 01 13:45:38 user nova-compute[72129]:     <mode name='host-passthrough' supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='hostPassthroughMigratable'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>on</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>off</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:     </mode>
Aug 01 13:45:38 user nova-compute[72129]:     <mode name='maximum' supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='maximumMigratable'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>on</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>off</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:     </mode>
Aug 01 13:45:38 user nova-compute[72129]:     <mode name='host-model' supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <vendor>Intel</vendor>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='ss'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='vmx'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='pcid'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='hypervisor'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='arat'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='tsc_adjust'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='umip'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='md-clear'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='stibp'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='arch-capabilities'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='ssbd'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='invtsc'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='ibpb'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='ibrs'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='amd-stibp'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='amd-ssbd'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='rsba'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='require' name='pschange-mc-no'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='disable' name='erms'/>
Aug 01 13:45:38 user nova-compute[72129]:       <feature policy='disable' name='xsaveopt'/>
Aug 01 13:45:38 user nova-compute[72129]:     </mode>
Aug 01 13:45:38 user nova-compute[72129]:     <mode name='custom' supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>qemu64</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>qemu32</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>phenom</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>pentium3</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>pentium2</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>pentium</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>n270</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>kvm64</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>kvm32</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>coreduo</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>core2duo</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>athlon</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>Westmere-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>Westmere</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Snowridge</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Skylake-Server</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Skylake-Client</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>SandyBridge</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>Penryn</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Opteron_G5</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Opteron_G4</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Opteron_G3</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Opteron_G2</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>Opteron_G1</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>Nehalem</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>IvyBridge</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Icelake-Server</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Haswell-noTSX</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Haswell-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Haswell</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>EPYC-Rome</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>EPYC-Milan</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>EPYC-IBPB</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>EPYC</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Dhyana</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Cooperlake</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>Conroe</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Cascadelake-Server</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Broadwell-noTSX</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Broadwell-IBRS</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='no'>Broadwell</model>
Aug 01 13:45:38 user nova-compute[72129]:       <model usable='yes'>486</model>
Aug 01 13:45:38 user nova-compute[72129]:     </mode>
Aug 01 13:45:38 user nova-compute[72129]:   </cpu>
Aug 01 13:45:38 user nova-compute[72129]:   <memoryBacking supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:     <enum name='sourceType'>
Aug 01 13:45:38 user nova-compute[72129]:       <value>file</value>
Aug 01 13:45:38 user nova-compute[72129]:       <value>anonymous</value>
Aug 01 13:45:38 user nova-compute[72129]:       <value>memfd</value>
Aug 01 13:45:38 user nova-compute[72129]:     </enum>
Aug 01 13:45:38 user nova-compute[72129]:   </memoryBacking>
Aug 01 13:45:38 user nova-compute[72129]:   <devices>
Aug 01 13:45:38 user nova-compute[72129]:     <disk supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='diskDevice'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>disk</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>cdrom</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>floppy</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>lun</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='bus'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>fdc</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>scsi</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>virtio</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>usb</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>sata</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='model'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>virtio</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>virtio-transitional</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>virtio-non-transitional</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:     </disk>
Aug 01 13:45:38 user nova-compute[72129]:     <graphics supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='type'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>sdl</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>vnc</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>spice</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>egl-headless</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:     </graphics>
Aug 01 13:45:38 user nova-compute[72129]:     <video supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='modelType'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>vga</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>cirrus</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>vmvga</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>qxl</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>virtio</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>none</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>bochs</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>ramfb</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:     </video>
Aug 01 13:45:38 user nova-compute[72129]:     <hostdev supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='mode'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>subsystem</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='startupPolicy'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>default</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>mandatory</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>requisite</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>optional</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='subsysType'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>usb</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>pci</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>scsi</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='capsType'/>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='pciBackend'/>
Aug 01 13:45:38 user nova-compute[72129]:     </hostdev>
Aug 01 13:45:38 user nova-compute[72129]:     <rng supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='model'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>virtio</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>virtio-transitional</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>virtio-non-transitional</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='backendModel'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>random</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>egd</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>builtin</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:     </rng>
Aug 01 13:45:38 user nova-compute[72129]:     <filesystem supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='driverType'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>path</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>handle</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>virtiofs</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:     </filesystem>
Aug 01 13:45:38 user nova-compute[72129]:     <tpm supported='yes'>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='model'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>tpm-tis</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>tpm-crb</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:       <enum name='backendModel'>
Aug 01 13:45:38 user nova-compute[72129]:         <value>passthrough</value>
Aug 01 13:45:38 user nova-compute[72129]:         <value>emulator</value>
Aug 01 13:45:38 user nova-compute[72129]:       </enum>
Aug 01 13:45:38 user nova-compute[72129]:     </tpm>
Aug 01 13:45:38 user nova-compute[72129]:   </devices>
Aug 01 13:45:38 user nova-compute[72129]:   <features>
Aug 01 13:45:38 user nova-compute[72129]:     <gic supported='no'/>
Aug 01 13:45:38 user nova-compute[72129]:     <vmcoreinfo supported='yes'/>
Aug 01 13:45:38 user nova-compute[72129]:     <genid supported='yes'/>
Aug 01 13:45:38 user nova-compute[72129]:     <backingStoreInput supported='yes'/>
Aug 01 13:45:38 user nova-compute[72129]:     <backup supported='yes'/>
Aug 01 13:45:38 user nova-compute[72129]:     <sev supported='no'/>
Aug 01 13:45:38 user nova-compute[72129]:   </features>
Aug 01 13:45:38 user nova-compute[72129]: </domainCapabilities>
Aug 01 13:45:38 user nova-compute[72129]:  {{(pid=72129) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 01 13:45:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=72129) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 13:45:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=72129) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 13:45:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=72129) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 13:45:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=72129) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 13:45:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Checking secure boot support for host arch (x86_64) {{(pid=72129) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 01 13:45:38 user nova-compute[72129]: INFO nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Secure Boot support detected
Aug 01 13:45:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] cpu compare xml: <cpu match="exact">
Aug 01 13:45:38 user nova-compute[72129]:   <model>Nehalem</model>
Aug 01 13:45:38 user nova-compute[72129]: </cpu>
Aug 01 13:45:38 user nova-compute[72129]:  {{(pid=72129) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Aug 01 13:45:38 user nova-compute[72129]: INFO nova.virt.node [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Generated node identity c2f345c3-9b82-4164-b21d-1eef8e661842
Aug 01 13:45:38 user nova-compute[72129]: INFO nova.virt.node [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Wrote node identity c2f345c3-9b82-4164-b21d-1eef8e661842 to /opt/stack/data/nova/compute_id
Aug 01 13:45:38 user nova-compute[72129]: WARNING nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Compute nodes ['c2f345c3-9b82-4164-b21d-1eef8e661842'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Aug 01 13:45:38 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Aug 01 13:45:38 user nova-compute[72129]: WARNING nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 01 13:45:38 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:45:38 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:45:38 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:45:38 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Auditing locally available compute resources for user (node: user) {{(pid=72129) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 13:45:39 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:45:39 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:45:39 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Hypervisor/Node resource view: name=user free_ram=10977MB free_disk=26.234432220458984GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72129) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 13:45:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:45:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:45:39 user nova-compute[72129]: WARNING nova.compute.resource_tracker [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] No compute node record for user:c2f345c3-9b82-4164-b21d-1eef8e661842: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host c2f345c3-9b82-4164-b21d-1eef8e661842 could not be found.
Aug 01 13:45:39 user nova-compute[72129]: INFO nova.compute.resource_tracker [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Compute node record created for user:user with uuid: c2f345c3-9b82-4164-b21d-1eef8e661842
Aug 01 13:45:39 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 13:45:39 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 13:45:39 user nova-compute[72129]: INFO nova.scheduler.client.report [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [req-f1626dee-7f20-4a61-9af8-428525f45365] Created resource provider record via placement API for resource provider with UUID c2f345c3-9b82-4164-b21d-1eef8e661842 and name user.
Aug 01 13:45:39 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=72129) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Aug 01 13:45:39 user nova-compute[72129]: INFO nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] kernel doesn't support AMD SEV
Aug 01 13:45:39 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Updating inventory in ProviderTree for provider c2f345c3-9b82-4164-b21d-1eef8e661842 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 13:45:39 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72129) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 13:45:39 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Libvirt baseline CPU <cpu>
Aug 01 13:45:39 user nova-compute[72129]:   <arch>x86_64</arch>
Aug 01 13:45:39 user nova-compute[72129]:   <model>Nehalem</model>
Aug 01 13:45:39 user nova-compute[72129]:   <vendor>Intel</vendor>
Aug 01 13:45:39 user nova-compute[72129]:   <topology sockets="6" cores="1" threads="1"/>
Aug 01 13:45:39 user nova-compute[72129]: </cpu>
Aug 01 13:45:39 user nova-compute[72129]:  {{(pid=72129) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Aug 01 13:45:39 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Updated inventory for provider c2f345c3-9b82-4164-b21d-1eef8e661842 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Aug 01 13:45:39 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Updating resource provider c2f345c3-9b82-4164-b21d-1eef8e661842 generation from 0 to 1 during operation: update_inventory {{(pid=72129) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 01 13:45:39 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Updating inventory in ProviderTree for provider c2f345c3-9b82-4164-b21d-1eef8e661842 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 13:45:39 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Updating resource provider c2f345c3-9b82-4164-b21d-1eef8e661842 generation from 1 to 2 during operation: update_traits {{(pid=72129) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 01 13:45:39 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Compute_service record updated for user:user {{(pid=72129) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 13:45:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.603s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:45:39 user nova-compute[72129]: DEBUG nova.service [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Creating RPC server for service compute {{(pid=72129) start /opt/stack/nova/nova/service.py:182}}
Aug 01 13:45:39 user nova-compute[72129]: DEBUG nova.service [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Join ServiceGroup membership for this service compute {{(pid=72129) start /opt/stack/nova/nova/service.py:199}}
Aug 01 13:45:39 user nova-compute[72129]: DEBUG nova.servicegroup.drivers.db [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=72129) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Aug 01 13:46:12 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:46:12 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:46:31 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:46:31 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:46:31 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Starting heal instance info cache {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 13:46:31 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Rebuilding the list of instances to heal {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 13:46:31 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Didn't find any instances for network info cache update. {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 13:46:31 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:46:31 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:46:31 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:46:31 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:46:31 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:46:31 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:46:31 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72129) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 13:46:31 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:46:31 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:46:31 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:46:31 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:46:31 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Auditing locally available compute resources for user (node: user) {{(pid=72129) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 13:46:31 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:46:31 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:46:31 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Hypervisor/Node resource view: name=user free_ram=10346MB free_disk=26.138160705566406GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72129) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 13:46:31 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:46:31 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:46:31 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 13:46:31 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 13:46:31 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 13:46:31 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 13:46:31 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Compute_service record updated for user:user {{(pid=72129) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 13:46:31 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.105s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:47:31 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:47:31 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:47:31 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:47:31 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:47:31 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:47:31 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72129) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 13:47:32 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:47:32 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Starting heal instance info cache {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 13:47:32 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Rebuilding the list of instances to heal {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 13:47:32 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Didn't find any instances for network info cache update. {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 13:47:32 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:47:32 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:47:33 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:47:33 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:47:33 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:47:33 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:47:33 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:47:33 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Auditing locally available compute resources for user (node: user) {{(pid=72129) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 13:47:33 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:47:33 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:47:33 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Hypervisor/Node resource view: name=user free_ram=10319MB free_disk=26.183391571044922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72129) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 13:47:33 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:47:33 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:47:33 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 13:47:33 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 13:47:33 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 13:47:33 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 13:47:33 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Compute_service record updated for user:user {{(pid=72129) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 13:47:33 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.124s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:48:32 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:48:32 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:48:32 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:48:32 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72129) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 13:48:33 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:48:33 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:48:33 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Starting heal instance info cache {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 13:48:33 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Rebuilding the list of instances to heal {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 13:48:33 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Didn't find any instances for network info cache update. {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 13:48:33 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:48:33 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:48:33 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:48:33 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:48:33 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.003s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:48:33 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:48:33 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Auditing locally available compute resources for user (node: user) {{(pid=72129) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 13:48:33 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:48:33 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:48:33 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Hypervisor/Node resource view: name=user free_ram=10311MB free_disk=25.957260131835938GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72129) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 13:48:33 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:48:33 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:48:33 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 13:48:33 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 13:48:33 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 13:48:33 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 13:48:33 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Compute_service record updated for user:user {{(pid=72129) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 13:48:33 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.177s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:48:34 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:49:32 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:49:32 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72129) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 13:49:33 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:49:33 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:49:33 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:49:33 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:49:33 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:49:33 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:49:33 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:49:33 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:49:33 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Auditing locally available compute resources for user (node: user) {{(pid=72129) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 13:49:33 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:49:33 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:49:33 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Hypervisor/Node resource view: name=user free_ram=9503MB free_disk=25.949771881103516GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72129) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 13:49:33 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:49:33 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:49:33 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 13:49:33 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 13:49:33 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 13:49:33 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 13:49:33 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Compute_service record updated for user:user {{(pid=72129) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 13:49:33 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.155s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:49:34 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:49:35 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:49:35 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:49:35 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Starting heal instance info cache {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 13:49:35 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Rebuilding the list of instances to heal {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 13:49:35 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Didn't find any instances for network info cache update. {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 13:49:36 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:49:48 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Acquiring lock "d6b336c3-c7d4-4353-8e51-416726833407" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:49:48 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Lock "d6b336c3-c7d4-4353-8e51-416726833407" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:49:48 user nova-compute[72129]: DEBUG nova.compute.manager [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] [instance: d6b336c3-c7d4-4353-8e51-416726833407] Starting instance... {{(pid=72129) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 13:49:48 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:49:48 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:49:48 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72129) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 13:49:48 user nova-compute[72129]: INFO nova.compute.claims [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] [instance: d6b336c3-c7d4-4353-8e51-416726833407] Claim successful on node user
Aug 01 13:49:48 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 13:49:48 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 13:49:48 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.387s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:49:48 user nova-compute[72129]: DEBUG nova.compute.manager [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] [instance: d6b336c3-c7d4-4353-8e51-416726833407] Start building networks asynchronously for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 13:49:48 user nova-compute[72129]: DEBUG nova.compute.manager [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] [instance: d6b336c3-c7d4-4353-8e51-416726833407] Allocating IP information in the background. {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 13:49:48 user nova-compute[72129]: DEBUG nova.network.neutron [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] [instance: d6b336c3-c7d4-4353-8e51-416726833407] allocate_for_instance() {{(pid=72129) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 13:49:48 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] [instance: d6b336c3-c7d4-4353-8e51-416726833407] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 13:49:48 user nova-compute[72129]: DEBUG nova.compute.manager [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] [instance: d6b336c3-c7d4-4353-8e51-416726833407] Start building block device mappings for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 13:49:49 user nova-compute[72129]: DEBUG nova.compute.manager [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] [instance: d6b336c3-c7d4-4353-8e51-416726833407] Start spawning the instance on the hypervisor. {{(pid=72129) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 13:49:49 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] [instance: d6b336c3-c7d4-4353-8e51-416726833407] Creating instance directory {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 13:49:49 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] [instance: d6b336c3-c7d4-4353-8e51-416726833407] Creating image(s)
Aug 01 13:49:49 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Acquiring lock "/opt/stack/data/nova/instances/d6b336c3-c7d4-4353-8e51-416726833407/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:49:49 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Lock "/opt/stack/data/nova/instances/d6b336c3-c7d4-4353-8e51-416726833407/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:49:49 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Lock "/opt/stack/data/nova/instances/d6b336c3-c7d4-4353-8e51-416726833407/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:49:49 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Acquiring lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:49:49 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:49:49 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1.part --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:49:49 user nova-compute[72129]: DEBUG nova.policy [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4d084de1d7a046a889105f56d6222025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c5a30b0df04cfba39fb66d63ff8f85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72129) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 13:49:49 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1.part --force-share --output=json" returned: 0 in 0.131s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:49:49 user nova-compute[72129]: DEBUG nova.virt.images [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] b6472c34-1b0f-4034-ba3a-7e8eb5103715 was qcow2, converting to raw {{(pid=72129) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 13:49:49 user nova-compute[72129]: DEBUG nova.privsep.utils [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72129) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 13:49:49 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1.part /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1.converted {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:49:49 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1.part /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1.converted" returned: 0 in 0.181s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:49:49 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1.converted --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:49:49 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1.converted --force-share --output=json" returned: 0 in 0.141s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:49:49 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.814s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:49:49 user nova-compute[72129]: INFO oslo.privsep.daemon [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp8qcjudi4/privsep.sock']
Aug 01 13:49:49 user sudo[81303]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp8qcjudi4/privsep.sock
Aug 01 13:49:49 user sudo[81303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 01 13:49:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Acquiring lock "63c0c1fe-7e4d-4763-8ede-a7662747a4c0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:49:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Lock "63c0c1fe-7e4d-4763-8ede-a7662747a4c0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:49:51 user nova-compute[72129]: DEBUG nova.compute.manager [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] Starting instance... {{(pid=72129) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 13:49:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:49:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:49:51 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72129) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 13:49:51 user nova-compute[72129]: INFO nova.compute.claims [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] Claim successful on node user
Aug 01 13:49:51 user sudo[81303]: pam_unix(sudo:session): session closed for user root
Aug 01 13:49:51 user nova-compute[72129]: INFO oslo.privsep.daemon [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Spawned new privsep daemon via rootwrap
Aug 01 13:49:51 user nova-compute[72129]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 01 13:49:51 user nova-compute[72129]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 01 13:49:51 user nova-compute[72129]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 01 13:49:51 user nova-compute[72129]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 81315
Aug 01 13:49:51 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 13:49:51 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 13:49:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.331s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:49:51 user nova-compute[72129]: DEBUG nova.compute.manager [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] Start building networks asynchronously for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 13:49:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:49:51 user nova-compute[72129]: DEBUG nova.compute.manager [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] Allocating IP information in the background. {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 13:49:51 user nova-compute[72129]: DEBUG nova.network.neutron [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] allocate_for_instance() {{(pid=72129) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 13:49:51 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 13:49:51 user nova-compute[72129]: DEBUG nova.compute.manager [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] Start building block device mappings for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 13:49:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.130s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:49:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Acquiring lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:49:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:49:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:49:51 user nova-compute[72129]: DEBUG nova.compute.manager [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] Start spawning the instance on the hypervisor. {{(pid=72129) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 13:49:51 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] Creating instance directory {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 13:49:51 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] Creating image(s)
Aug 01 13:49:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Acquiring lock "/opt/stack/data/nova/instances/63c0c1fe-7e4d-4763-8ede-a7662747a4c0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:49:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Lock "/opt/stack/data/nova/instances/63c0c1fe-7e4d-4763-8ede-a7662747a4c0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:49:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Lock "/opt/stack/data/nova/instances/63c0c1fe-7e4d-4763-8ede-a7662747a4c0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:49:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:49:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.179s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:49:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/d6b336c3-c7d4-4353-8e51-416726833407/disk 1073741824 {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:49:52 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/d6b336c3-c7d4-4353-8e51-416726833407/disk 1073741824" returned: 0 in 0.044s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:49:52 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:49:52 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:49:52 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.138s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:49:52 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Acquiring lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:49:52 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:49:52 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:49:52 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.148s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:49:52 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d6b336c3-c7d4-4353-8e51-416726833407/disk. size=1073741824 {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 13:49:52 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b336c3-c7d4-4353-8e51-416726833407/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:49:52 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.133s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:49:52 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/63c0c1fe-7e4d-4763-8ede-a7662747a4c0/disk 1073741824 {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:49:52 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/63c0c1fe-7e4d-4763-8ede-a7662747a4c0/disk 1073741824" returned: 0 in 0.043s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:49:52 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.181s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:49:52 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:49:52 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b336c3-c7d4-4353-8e51-416726833407/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:49:52 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Cannot resize image /opt/stack/data/nova/instances/d6b336c3-c7d4-4353-8e51-416726833407/disk to a smaller size. {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 13:49:52 user nova-compute[72129]: DEBUG nova.objects.instance [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Lazy-loading 'migration_context' on Instance uuid d6b336c3-c7d4-4353-8e51-416726833407 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:49:52 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] [instance: d6b336c3-c7d4-4353-8e51-416726833407] Created local disks {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 13:49:52 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] [instance: d6b336c3-c7d4-4353-8e51-416726833407] Ensure instance console log exists: /opt/stack/data/nova/instances/d6b336c3-c7d4-4353-8e51-416726833407/console.log {{(pid=72129) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 13:49:52 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:49:52 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:49:52 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:49:52 user nova-compute[72129]: DEBUG nova.network.neutron [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] [instance: d6b336c3-c7d4-4353-8e51-416726833407] Successfully created port: 129db8e9-6741-408c-b62c-ae48485fa290 {{(pid=72129) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 13:49:52 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.139s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:49:52 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Checking if we can resize image /opt/stack/data/nova/instances/63c0c1fe-7e4d-4763-8ede-a7662747a4c0/disk. size=1073741824 {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 13:49:52 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63c0c1fe-7e4d-4763-8ede-a7662747a4c0/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:49:52 user nova-compute[72129]: DEBUG nova.policy [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '14a1a4faeffb41a8bcebc292a7d73cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34719c31d18460fa308e1f40130ed24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72129) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 13:49:52 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63c0c1fe-7e4d-4763-8ede-a7662747a4c0/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:49:52 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Cannot resize image /opt/stack/data/nova/instances/63c0c1fe-7e4d-4763-8ede-a7662747a4c0/disk to a smaller size. {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 13:49:52 user nova-compute[72129]: DEBUG nova.objects.instance [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Lazy-loading 'migration_context' on Instance uuid 63c0c1fe-7e4d-4763-8ede-a7662747a4c0 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:49:52 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] Created local disks {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 13:49:52 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] Ensure instance console log exists: /opt/stack/data/nova/instances/63c0c1fe-7e4d-4763-8ede-a7662747a4c0/console.log {{(pid=72129) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 13:49:52 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:49:52 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:49:52 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:49:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Acquiring lock "28115c7d-544a-4504-98da-2398e0e354d8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:49:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Lock "28115c7d-544a-4504-98da-2398e0e354d8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:49:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Acquiring lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:49:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:49:54 user nova-compute[72129]: DEBUG nova.compute.manager [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] Starting instance... {{(pid=72129) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 13:49:54 user nova-compute[72129]: DEBUG nova.compute.manager [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Starting instance... {{(pid=72129) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 13:49:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:49:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:49:54 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72129) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 13:49:54 user nova-compute[72129]: INFO nova.compute.claims [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] Claim successful on node user
Aug 01 13:49:54 user nova-compute[72129]: DEBUG nova.network.neutron [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] [instance: d6b336c3-c7d4-4353-8e51-416726833407] Successfully updated port: 129db8e9-6741-408c-b62c-ae48485fa290 {{(pid=72129) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 13:49:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:49:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Acquiring lock "refresh_cache-d6b336c3-c7d4-4353-8e51-416726833407" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:49:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Acquired lock "refresh_cache-d6b336c3-c7d4-4353-8e51-416726833407" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:49:54 user nova-compute[72129]: DEBUG nova.network.neutron [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] [instance: d6b336c3-c7d4-4353-8e51-416726833407] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 13:49:54 user nova-compute[72129]: DEBUG nova.network.neutron [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] [instance: d6b336c3-c7d4-4353-8e51-416726833407] Instance cache missing network info. {{(pid=72129) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 13:49:54 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 13:49:54 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 13:49:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.361s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:49:54 user nova-compute[72129]: DEBUG nova.compute.manager [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] Start building networks asynchronously for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 13:49:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.324s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:49:54 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72129) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 13:49:54 user nova-compute[72129]: INFO nova.compute.claims [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Claim successful on node user
Aug 01 13:49:54 user nova-compute[72129]: DEBUG nova.compute.manager [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] Allocating IP information in the background. {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 13:49:54 user nova-compute[72129]: DEBUG nova.network.neutron [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] allocate_for_instance() {{(pid=72129) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 13:49:54 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 13:49:54 user nova-compute[72129]: DEBUG nova.compute.manager [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] Start building block device mappings for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 13:49:54 user nova-compute[72129]: DEBUG nova.compute.manager [req-11a98e2a-4423-4c9b-8b19-c00b93e65a2b req-272b47fc-0b3d-4b33-b15e-cabdec9f847c service nova] [instance: d6b336c3-c7d4-4353-8e51-416726833407] Received event network-changed-129db8e9-6741-408c-b62c-ae48485fa290 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:49:54 user nova-compute[72129]: DEBUG nova.compute.manager [req-11a98e2a-4423-4c9b-8b19-c00b93e65a2b req-272b47fc-0b3d-4b33-b15e-cabdec9f847c service nova] [instance: d6b336c3-c7d4-4353-8e51-416726833407] Refreshing instance network info cache due to event network-changed-129db8e9-6741-408c-b62c-ae48485fa290. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 13:49:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-11a98e2a-4423-4c9b-8b19-c00b93e65a2b req-272b47fc-0b3d-4b33-b15e-cabdec9f847c service nova] Acquiring lock "refresh_cache-d6b336c3-c7d4-4353-8e51-416726833407" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:49:54 user nova-compute[72129]: DEBUG nova.compute.manager [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] Start spawning the instance on the hypervisor. {{(pid=72129) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 13:49:54 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] Creating instance directory {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 13:49:54 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] Creating image(s)
Aug 01 13:49:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Acquiring lock "/opt/stack/data/nova/instances/28115c7d-544a-4504-98da-2398e0e354d8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:49:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Lock "/opt/stack/data/nova/instances/28115c7d-544a-4504-98da-2398e0e354d8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:49:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Lock "/opt/stack/data/nova/instances/28115c7d-544a-4504-98da-2398e0e354d8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:49:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:49:54 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 13:49:54 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 13:49:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.349s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:49:54 user nova-compute[72129]: DEBUG nova.compute.manager [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Start building networks asynchronously for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 13:49:54 user nova-compute[72129]: DEBUG nova.network.neutron [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] Successfully created port: 33a9acea-27a3-4a66-a5f9-4be39dc61ae7 {{(pid=72129) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 13:49:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.128s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:49:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Acquiring lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:49:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:49:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:49:54 user nova-compute[72129]: DEBUG nova.compute.manager [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Allocating IP information in the background. {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 13:49:54 user nova-compute[72129]: DEBUG nova.network.neutron [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] allocate_for_instance() {{(pid=72129) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 13:49:54 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 13:49:55 user nova-compute[72129]: DEBUG nova.compute.manager [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Start building block device mappings for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.138s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/28115c7d-544a-4504-98da-2398e0e354d8/disk 1073741824 {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/28115c7d-544a-4504-98da-2398e0e354d8/disk 1073741824" returned: 0 in 0.043s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.184s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG nova.policy [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '37e6bf606d3041d9928c5e5d6f4a9063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebef26e9d3654bf99ecf391ccb263330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72129) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG nova.compute.manager [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Start spawning the instance on the hypervisor. {{(pid=72129) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Creating instance directory {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 13:49:55 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Creating image(s)
Aug 01 13:49:55 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Acquiring lock "/opt/stack/data/nova/instances/2efa87a6-1dd6-4441-a55e-8e86be7f0a35/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Lock "/opt/stack/data/nova/instances/2efa87a6-1dd6-4441-a55e-8e86be7f0a35/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Lock "/opt/stack/data/nova/instances/2efa87a6-1dd6-4441-a55e-8e86be7f0a35/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG nova.policy [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1936f560fd794910af1fa6e9c4fffa90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd693a983e4a44434b64c7983239371a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72129) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.153s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Checking if we can resize image /opt/stack/data/nova/instances/28115c7d-544a-4504-98da-2398e0e354d8/disk. size=1073741824 {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28115c7d-544a-4504-98da-2398e0e354d8/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.147s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Acquiring lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28115c7d-544a-4504-98da-2398e0e354d8/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Cannot resize image /opt/stack/data/nova/instances/28115c7d-544a-4504-98da-2398e0e354d8/disk to a smaller size. {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG nova.objects.instance [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Lazy-loading 'migration_context' on Instance uuid 28115c7d-544a-4504-98da-2398e0e354d8 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] Created local disks {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] Ensure instance console log exists: /opt/stack/data/nova/instances/28115c7d-544a-4504-98da-2398e0e354d8/console.log {{(pid=72129) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.144s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/2efa87a6-1dd6-4441-a55e-8e86be7f0a35/disk 1073741824 {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG nova.network.neutron [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] [instance: d6b336c3-c7d4-4353-8e51-416726833407] Updating instance_info_cache with network_info: [{"id": "129db8e9-6741-408c-b62c-ae48485fa290", "address": "fa:16:3e:a7:96:5a", "network": {"id": "3d94af2c-7df4-4d95-ba9e-8273497eff49", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-50216644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48c5a30b0df04cfba39fb66d63ff8f85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap129db8e9-67", "ovs_interfaceid": "129db8e9-6741-408c-b62c-ae48485fa290", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/2efa87a6-1dd6-4441-a55e-8e86be7f0a35/disk 1073741824" returned: 0 in 0.048s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Releasing lock "refresh_cache-d6b336c3-c7d4-4353-8e51-416726833407" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG nova.compute.manager [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] [instance: d6b336c3-c7d4-4353-8e51-416726833407] Instance network_info: |[{"id": "129db8e9-6741-408c-b62c-ae48485fa290", "address": "fa:16:3e:a7:96:5a", "network": {"id": "3d94af2c-7df4-4d95-ba9e-8273497eff49", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-50216644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48c5a30b0df04cfba39fb66d63ff8f85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap129db8e9-67", "ovs_interfaceid": "129db8e9-6741-408c-b62c-ae48485fa290", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-11a98e2a-4423-4c9b-8b19-c00b93e65a2b req-272b47fc-0b3d-4b33-b15e-cabdec9f847c service nova] Acquired lock "refresh_cache-d6b336c3-c7d4-4353-8e51-416726833407" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG nova.network.neutron [req-11a98e2a-4423-4c9b-8b19-c00b93e65a2b req-272b47fc-0b3d-4b33-b15e-cabdec9f847c service nova] [instance: d6b336c3-c7d4-4353-8e51-416726833407] Refreshing network info cache for port 129db8e9-6741-408c-b62c-ae48485fa290 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] [instance: d6b336c3-c7d4-4353-8e51-416726833407] Start _get_guest_xml network_info=[{"id": "129db8e9-6741-408c-b62c-ae48485fa290", "address": "fa:16:3e:a7:96:5a", "network": {"id": "3d94af2c-7df4-4d95-ba9e-8273497eff49", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-50216644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48c5a30b0df04cfba39fb66d63ff8f85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap129db8e9-67", "ovs_interfaceid": "129db8e9-6741-408c-b62c-ae48485fa290", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'image_id': 'b6472c34-1b0f-4034-ba3a-7e8eb5103715'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 13:49:55 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:49:55 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:49:55 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] CPU controller missing on host. {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] CPU controller found on host. {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72129) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T13:45:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Flavor limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Image limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Flavor pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Image pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Got 1 possible topologies {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG nova.privsep.utils [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72129) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:49:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-2057841141',display_name='tempest-DeleteServersTestJSON-server-2057841141',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-2057841141',id=1,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='48c5a30b0df04cfba39fb66d63ff8f85',ramdisk_id='',reservation_id='r-arueo1z2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-668770508',owner_user_name='tempest-DeleteServersTestJSON-668770508-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:49:49Z,user_data=None,user_id='4d084de1d7a046a889105f56d6222025',uuid=d6b336c3-c7d4-4353-8e51-416726833407,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "129db8e9-6741-408c-b62c-ae48485fa290", "address": "fa:16:3e:a7:96:5a", "network": {"id": "3d94af2c-7df4-4d95-ba9e-8273497eff49", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-50216644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48c5a30b0df04cfba39fb66d63ff8f85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap129db8e9-67", "ovs_interfaceid": "129db8e9-6741-408c-b62c-ae48485fa290", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Converting VIF {"id": "129db8e9-6741-408c-b62c-ae48485fa290", "address": "fa:16:3e:a7:96:5a", "network": {"id": "3d94af2c-7df4-4d95-ba9e-8273497eff49", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-50216644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48c5a30b0df04cfba39fb66d63ff8f85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap129db8e9-67", "ovs_interfaceid": "129db8e9-6741-408c-b62c-ae48485fa290", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:96:5a,bridge_name='br-int',has_traffic_filtering=True,id=129db8e9-6741-408c-b62c-ae48485fa290,network=Network(3d94af2c-7df4-4d95-ba9e-8273497eff49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap129db8e9-67') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG nova.objects.instance [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Lazy-loading 'pci_devices' on Instance uuid d6b336c3-c7d4-4353-8e51-416726833407 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.153s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2efa87a6-1dd6-4441-a55e-8e86be7f0a35/disk. size=1073741824 {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efa87a6-1dd6-4441-a55e-8e86be7f0a35/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] [instance: d6b336c3-c7d4-4353-8e51-416726833407] End _get_guest_xml xml=<domain type="kvm">
Aug 01 13:49:55 user nova-compute[72129]:   <uuid>d6b336c3-c7d4-4353-8e51-416726833407</uuid>
Aug 01 13:49:55 user nova-compute[72129]:   <name>instance-00000001</name>
Aug 01 13:49:55 user nova-compute[72129]:   <memory>524288</memory>
Aug 01 13:49:55 user nova-compute[72129]:   <vcpu>1</vcpu>
Aug 01 13:49:55 user nova-compute[72129]:   <metadata>
Aug 01 13:49:55 user nova-compute[72129]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 13:49:55 user nova-compute[72129]:       <nova:package version="0.0.0"/>
Aug 01 13:49:55 user nova-compute[72129]:       <nova:name>tempest-DeleteServersTestJSON-server-2057841141</nova:name>
Aug 01 13:49:55 user nova-compute[72129]:       <nova:creationTime>2023-08-01 13:49:55</nova:creationTime>
Aug 01 13:49:55 user nova-compute[72129]:       <nova:flavor name="m1.tiny">
Aug 01 13:49:55 user nova-compute[72129]:         <nova:memory>512</nova:memory>
Aug 01 13:49:55 user nova-compute[72129]:         <nova:disk>1</nova:disk>
Aug 01 13:49:55 user nova-compute[72129]:         <nova:swap>0</nova:swap>
Aug 01 13:49:55 user nova-compute[72129]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 13:49:55 user nova-compute[72129]:         <nova:vcpus>1</nova:vcpus>
Aug 01 13:49:55 user nova-compute[72129]:       </nova:flavor>
Aug 01 13:49:55 user nova-compute[72129]:       <nova:owner>
Aug 01 13:49:55 user nova-compute[72129]:         <nova:user uuid="4d084de1d7a046a889105f56d6222025">tempest-DeleteServersTestJSON-668770508-project-member</nova:user>
Aug 01 13:49:55 user nova-compute[72129]:         <nova:project uuid="48c5a30b0df04cfba39fb66d63ff8f85">tempest-DeleteServersTestJSON-668770508</nova:project>
Aug 01 13:49:55 user nova-compute[72129]:       </nova:owner>
Aug 01 13:49:55 user nova-compute[72129]:       <nova:root type="image" uuid="b6472c34-1b0f-4034-ba3a-7e8eb5103715"/>
Aug 01 13:49:55 user nova-compute[72129]:       <nova:ports>
Aug 01 13:49:55 user nova-compute[72129]:         <nova:port uuid="129db8e9-6741-408c-b62c-ae48485fa290">
Aug 01 13:49:55 user nova-compute[72129]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 01 13:49:55 user nova-compute[72129]:         </nova:port>
Aug 01 13:49:55 user nova-compute[72129]:       </nova:ports>
Aug 01 13:49:55 user nova-compute[72129]:     </nova:instance>
Aug 01 13:49:55 user nova-compute[72129]:   </metadata>
Aug 01 13:49:55 user nova-compute[72129]:   <sysinfo type="smbios">
Aug 01 13:49:55 user nova-compute[72129]:     <system>
Aug 01 13:49:55 user nova-compute[72129]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 13:49:55 user nova-compute[72129]:       <entry name="product">OpenStack Nova</entry>
Aug 01 13:49:55 user nova-compute[72129]:       <entry name="version">0.0.0</entry>
Aug 01 13:49:55 user nova-compute[72129]:       <entry name="serial">d6b336c3-c7d4-4353-8e51-416726833407</entry>
Aug 01 13:49:55 user nova-compute[72129]:       <entry name="uuid">d6b336c3-c7d4-4353-8e51-416726833407</entry>
Aug 01 13:49:55 user nova-compute[72129]:       <entry name="family">Virtual Machine</entry>
Aug 01 13:49:55 user nova-compute[72129]:     </system>
Aug 01 13:49:55 user nova-compute[72129]:   </sysinfo>
Aug 01 13:49:55 user nova-compute[72129]:   <os>
Aug 01 13:49:55 user nova-compute[72129]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 13:49:55 user nova-compute[72129]:     <boot dev="hd"/>
Aug 01 13:49:55 user nova-compute[72129]:     <smbios mode="sysinfo"/>
Aug 01 13:49:55 user nova-compute[72129]:   </os>
Aug 01 13:49:55 user nova-compute[72129]:   <features>
Aug 01 13:49:55 user nova-compute[72129]:     <acpi/>
Aug 01 13:49:55 user nova-compute[72129]:     <apic/>
Aug 01 13:49:55 user nova-compute[72129]:     <vmcoreinfo/>
Aug 01 13:49:55 user nova-compute[72129]:   </features>
Aug 01 13:49:55 user nova-compute[72129]:   <clock offset="utc">
Aug 01 13:49:55 user nova-compute[72129]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 13:49:55 user nova-compute[72129]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 13:49:55 user nova-compute[72129]:     <timer name="hpet" present="no"/>
Aug 01 13:49:55 user nova-compute[72129]:   </clock>
Aug 01 13:49:55 user nova-compute[72129]:   <cpu mode="custom" match="exact">
Aug 01 13:49:55 user nova-compute[72129]:     <model>Nehalem</model>
Aug 01 13:49:55 user nova-compute[72129]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 13:49:55 user nova-compute[72129]:   </cpu>
Aug 01 13:49:55 user nova-compute[72129]:   <devices>
Aug 01 13:49:55 user nova-compute[72129]:     <disk type="file" device="disk">
Aug 01 13:49:55 user nova-compute[72129]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 13:49:55 user nova-compute[72129]:       <source file="/opt/stack/data/nova/instances/d6b336c3-c7d4-4353-8e51-416726833407/disk"/>
Aug 01 13:49:55 user nova-compute[72129]:       <target dev="vda" bus="virtio"/>
Aug 01 13:49:55 user nova-compute[72129]:     </disk>
Aug 01 13:49:55 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 13:49:55 user nova-compute[72129]:       <mac address="fa:16:3e:a7:96:5a"/>
Aug 01 13:49:55 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 13:49:55 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 13:49:55 user nova-compute[72129]:       <target dev="tap129db8e9-67"/>
Aug 01 13:49:55 user nova-compute[72129]:     </interface>
Aug 01 13:49:55 user nova-compute[72129]:     <serial type="pty">
Aug 01 13:49:55 user nova-compute[72129]:       <log file="/opt/stack/data/nova/instances/d6b336c3-c7d4-4353-8e51-416726833407/console.log" append="off"/>
Aug 01 13:49:55 user nova-compute[72129]:     </serial>
Aug 01 13:49:55 user nova-compute[72129]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 13:49:55 user nova-compute[72129]:     <video>
Aug 01 13:49:55 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 13:49:55 user nova-compute[72129]:     </video>
Aug 01 13:49:55 user nova-compute[72129]:     <rng model="virtio">
Aug 01 13:49:55 user nova-compute[72129]:       <backend model="random">/dev/urandom</backend>
Aug 01 13:49:55 user nova-compute[72129]:     </rng>
Aug 01 13:49:55 user nova-compute[72129]:     <controller type="usb" index="0" model="none"/>
Aug 01 13:49:55 user nova-compute[72129]:     <memballoon model="virtio">
Aug 01 13:49:55 user nova-compute[72129]:       <stats period="10"/>
Aug 01 13:49:55 user nova-compute[72129]:     </memballoon>
Aug 01 13:49:55 user nova-compute[72129]:   </devices>
Aug 01 13:49:55 user nova-compute[72129]: </domain>
Aug 01 13:49:55 user nova-compute[72129]:  {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:49:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-2057841141',display_name='tempest-DeleteServersTestJSON-server-2057841141',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-2057841141',id=1,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='48c5a30b0df04cfba39fb66d63ff8f85',ramdisk_id='',reservation_id='r-arueo1z2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-668770508',owner_user_name='tempest-DeleteServersTestJSON-668770508-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:49:49Z,user_data=None,user_id='4d084de1d7a046a889105f56d6222025',uuid=d6b336c3-c7d4-4353-8e51-416726833407,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "129db8e9-6741-408c-b62c-ae48485fa290", "address": "fa:16:3e:a7:96:5a", "network": {"id": "3d94af2c-7df4-4d95-ba9e-8273497eff49", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-50216644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48c5a30b0df04cfba39fb66d63ff8f85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap129db8e9-67", "ovs_interfaceid": "129db8e9-6741-408c-b62c-ae48485fa290", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Converting VIF {"id": "129db8e9-6741-408c-b62c-ae48485fa290", "address": "fa:16:3e:a7:96:5a", "network": {"id": "3d94af2c-7df4-4d95-ba9e-8273497eff49", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-50216644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48c5a30b0df04cfba39fb66d63ff8f85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap129db8e9-67", "ovs_interfaceid": "129db8e9-6741-408c-b62c-ae48485fa290", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:96:5a,bridge_name='br-int',has_traffic_filtering=True,id=129db8e9-6741-408c-b62c-ae48485fa290,network=Network(3d94af2c-7df4-4d95-ba9e-8273497eff49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap129db8e9-67') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG os_vif [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:96:5a,bridge_name='br-int',has_traffic_filtering=True,id=129db8e9-6741-408c-b62c-ae48485fa290,network=Network(3d94af2c-7df4-4d95-ba9e-8273497eff49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap129db8e9-67') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Created schema index Interface.name {{(pid=72129) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Created schema index Port.name {{(pid=72129) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Created schema index Bridge.name {{(pid=72129) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] [POLLOUT] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efa87a6-1dd6-4441-a55e-8e86be7f0a35/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Cannot resize image /opt/stack/data/nova/instances/2efa87a6-1dd6-4441-a55e-8e86be7f0a35/disk to a smaller size. {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG nova.objects.instance [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Lazy-loading 'migration_context' on Instance uuid 2efa87a6-1dd6-4441-a55e-8e86be7f0a35 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Created local disks {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Ensure instance console log exists: /opt/stack/data/nova/instances/2efa87a6-1dd6-4441-a55e-8e86be7f0a35/console.log {{(pid=72129) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:49:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 13:49:55 user nova-compute[72129]: INFO oslo.privsep.daemon [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpqcstaxn4/privsep.sock']
Aug 01 13:49:55 user sudo[81499]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpqcstaxn4/privsep.sock
Aug 01 13:49:55 user sudo[81499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 01 13:49:57 user nova-compute[72129]: DEBUG nova.network.neutron [req-11a98e2a-4423-4c9b-8b19-c00b93e65a2b req-272b47fc-0b3d-4b33-b15e-cabdec9f847c service nova] [instance: d6b336c3-c7d4-4353-8e51-416726833407] Updated VIF entry in instance network info cache for port 129db8e9-6741-408c-b62c-ae48485fa290. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 13:49:57 user nova-compute[72129]: DEBUG nova.network.neutron [req-11a98e2a-4423-4c9b-8b19-c00b93e65a2b req-272b47fc-0b3d-4b33-b15e-cabdec9f847c service nova] [instance: d6b336c3-c7d4-4353-8e51-416726833407] Updating instance_info_cache with network_info: [{"id": "129db8e9-6741-408c-b62c-ae48485fa290", "address": "fa:16:3e:a7:96:5a", "network": {"id": "3d94af2c-7df4-4d95-ba9e-8273497eff49", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-50216644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48c5a30b0df04cfba39fb66d63ff8f85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap129db8e9-67", "ovs_interfaceid": "129db8e9-6741-408c-b62c-ae48485fa290", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:49:57 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-11a98e2a-4423-4c9b-8b19-c00b93e65a2b req-272b47fc-0b3d-4b33-b15e-cabdec9f847c service nova] Releasing lock "refresh_cache-d6b336c3-c7d4-4353-8e51-416726833407" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:49:57 user sudo[81499]: pam_unix(sudo:session): session closed for user root
Aug 01 13:49:57 user nova-compute[72129]: INFO oslo.privsep.daemon [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Spawned new privsep daemon via rootwrap
Aug 01 13:49:57 user nova-compute[72129]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 01 13:49:57 user nova-compute[72129]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 01 13:49:57 user nova-compute[72129]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Aug 01 13:49:57 user nova-compute[72129]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 81517
Aug 01 13:49:57 user nova-compute[72129]: DEBUG nova.network.neutron [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] Successfully created port: 85708040-d7bf-4951-a29c-68cd6d3c4c42 {{(pid=72129) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 13:49:57 user nova-compute[72129]: DEBUG nova.network.neutron [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] Successfully updated port: 33a9acea-27a3-4a66-a5f9-4be39dc61ae7 {{(pid=72129) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 13:49:57 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Acquiring lock "refresh_cache-63c0c1fe-7e4d-4763-8ede-a7662747a4c0" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:49:57 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Acquired lock "refresh_cache-63c0c1fe-7e4d-4763-8ede-a7662747a4c0" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:49:57 user nova-compute[72129]: DEBUG nova.network.neutron [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 13:49:57 user nova-compute[72129]: DEBUG nova.network.neutron [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Successfully created port: d59c6949-2748-4a57-b089-6219f9102815 {{(pid=72129) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 13:49:58 user nova-compute[72129]: DEBUG nova.network.neutron [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] Instance cache missing network info. {{(pid=72129) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 13:49:58 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:49:58 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap129db8e9-67, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:49:58 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap129db8e9-67, col_values=(('external_ids', {'iface-id': '129db8e9-6741-408c-b62c-ae48485fa290', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:96:5a', 'vm-uuid': 'd6b336c3-c7d4-4353-8e51-416726833407'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:49:58 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:49:58 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 13:49:58 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:49:58 user nova-compute[72129]: INFO os_vif [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:96:5a,bridge_name='br-int',has_traffic_filtering=True,id=129db8e9-6741-408c-b62c-ae48485fa290,network=Network(3d94af2c-7df4-4d95-ba9e-8273497eff49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap129db8e9-67')
Aug 01 13:49:58 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 13:49:58 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] No VIF found with MAC fa:16:3e:a7:96:5a, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 13:49:58 user nova-compute[72129]: DEBUG nova.compute.manager [req-36e10d8a-7d58-4c15-ba2b-061c344e5c4c req-4815000f-d8b1-4a87-967d-ad950a85ac72 service nova] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] Received event network-changed-33a9acea-27a3-4a66-a5f9-4be39dc61ae7 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:49:58 user nova-compute[72129]: DEBUG nova.compute.manager [req-36e10d8a-7d58-4c15-ba2b-061c344e5c4c req-4815000f-d8b1-4a87-967d-ad950a85ac72 service nova] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] Refreshing instance network info cache due to event network-changed-33a9acea-27a3-4a66-a5f9-4be39dc61ae7. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 13:49:58 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-36e10d8a-7d58-4c15-ba2b-061c344e5c4c req-4815000f-d8b1-4a87-967d-ad950a85ac72 service nova] Acquiring lock "refresh_cache-63c0c1fe-7e4d-4763-8ede-a7662747a4c0" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:49:58 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:49:58 user nova-compute[72129]: DEBUG nova.network.neutron [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] Updating instance_info_cache with network_info: [{"id": "33a9acea-27a3-4a66-a5f9-4be39dc61ae7", "address": "fa:16:3e:65:63:71", "network": {"id": "90839969-290c-4555-ab2f-2215c33e89e9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1983064867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f34719c31d18460fa308e1f40130ed24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33a9acea-27", "ovs_interfaceid": "33a9acea-27a3-4a66-a5f9-4be39dc61ae7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:49:58 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Releasing lock "refresh_cache-63c0c1fe-7e4d-4763-8ede-a7662747a4c0" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:49:58 user nova-compute[72129]: DEBUG nova.compute.manager [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] Instance network_info: |[{"id": "33a9acea-27a3-4a66-a5f9-4be39dc61ae7", "address": "fa:16:3e:65:63:71", "network": {"id": "90839969-290c-4555-ab2f-2215c33e89e9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1983064867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f34719c31d18460fa308e1f40130ed24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33a9acea-27", "ovs_interfaceid": "33a9acea-27a3-4a66-a5f9-4be39dc61ae7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 13:49:58 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-36e10d8a-7d58-4c15-ba2b-061c344e5c4c req-4815000f-d8b1-4a87-967d-ad950a85ac72 service nova] Acquired lock "refresh_cache-63c0c1fe-7e4d-4763-8ede-a7662747a4c0" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:49:58 user nova-compute[72129]: DEBUG nova.network.neutron [req-36e10d8a-7d58-4c15-ba2b-061c344e5c4c req-4815000f-d8b1-4a87-967d-ad950a85ac72 service nova] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] Refreshing network info cache for port 33a9acea-27a3-4a66-a5f9-4be39dc61ae7 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 13:49:58 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] Start _get_guest_xml network_info=[{"id": "33a9acea-27a3-4a66-a5f9-4be39dc61ae7", "address": "fa:16:3e:65:63:71", "network": {"id": "90839969-290c-4555-ab2f-2215c33e89e9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1983064867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f34719c31d18460fa308e1f40130ed24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33a9acea-27", "ovs_interfaceid": "33a9acea-27a3-4a66-a5f9-4be39dc61ae7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'image_id': 'b6472c34-1b0f-4034-ba3a-7e8eb5103715'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 13:49:58 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:49:58 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:49:58 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 13:49:58 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] CPU controller missing on host. {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 13:49:58 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 13:49:58 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] CPU controller found on host. {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 13:49:58 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72129) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 13:49:58 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T13:45:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 13:49:58 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Flavor limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 13:49:58 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Image limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 13:49:58 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Flavor pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 13:49:58 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Image pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 13:49:58 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 13:49:58 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 13:49:58 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 13:49:58 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Got 1 possible topologies {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 13:49:58 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 13:49:58 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 13:49:58 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:49:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-568926671',display_name='tempest-ServersNegativeTestJSON-server-568926671',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-568926671',id=2,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f34719c31d18460fa308e1f40130ed24',ramdisk_id='',reservation_id='r-gax1glqz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-281733508',owner_user_name='tempest-ServersNegativeTestJSON-281733508-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:49:52Z,user_data=None,user_id='14a1a4faeffb41a8bcebc292a7d73cb2',uuid=63c0c1fe-7e4d-4763-8ede-a7662747a4c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33a9acea-27a3-4a66-a5f9-4be39dc61ae7", "address": "fa:16:3e:65:63:71", "network": {"id": "90839969-290c-4555-ab2f-2215c33e89e9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1983064867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f34719c31d18460fa308e1f40130ed24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33a9acea-27", "ovs_interfaceid": "33a9acea-27a3-4a66-a5f9-4be39dc61ae7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 13:49:58 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Converting VIF {"id": "33a9acea-27a3-4a66-a5f9-4be39dc61ae7", "address": "fa:16:3e:65:63:71", "network": {"id": "90839969-290c-4555-ab2f-2215c33e89e9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1983064867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f34719c31d18460fa308e1f40130ed24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33a9acea-27", "ovs_interfaceid": "33a9acea-27a3-4a66-a5f9-4be39dc61ae7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:49:58 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:63:71,bridge_name='br-int',has_traffic_filtering=True,id=33a9acea-27a3-4a66-a5f9-4be39dc61ae7,network=Network(90839969-290c-4555-ab2f-2215c33e89e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33a9acea-27') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:49:58 user nova-compute[72129]: DEBUG nova.objects.instance [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Lazy-loading 'pci_devices' on Instance uuid 63c0c1fe-7e4d-4763-8ede-a7662747a4c0 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:49:58 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] End _get_guest_xml xml=<domain type="kvm">
Aug 01 13:49:58 user nova-compute[72129]:   <uuid>63c0c1fe-7e4d-4763-8ede-a7662747a4c0</uuid>
Aug 01 13:49:58 user nova-compute[72129]:   <name>instance-00000002</name>
Aug 01 13:49:58 user nova-compute[72129]:   <memory>524288</memory>
Aug 01 13:49:58 user nova-compute[72129]:   <vcpu>1</vcpu>
Aug 01 13:49:58 user nova-compute[72129]:   <metadata>
Aug 01 13:49:58 user nova-compute[72129]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 13:49:58 user nova-compute[72129]:       <nova:package version="0.0.0"/>
Aug 01 13:49:58 user nova-compute[72129]:       <nova:name>tempest-ServersNegativeTestJSON-server-568926671</nova:name>
Aug 01 13:49:58 user nova-compute[72129]:       <nova:creationTime>2023-08-01 13:49:58</nova:creationTime>
Aug 01 13:49:58 user nova-compute[72129]:       <nova:flavor name="m1.tiny">
Aug 01 13:49:58 user nova-compute[72129]:         <nova:memory>512</nova:memory>
Aug 01 13:49:58 user nova-compute[72129]:         <nova:disk>1</nova:disk>
Aug 01 13:49:58 user nova-compute[72129]:         <nova:swap>0</nova:swap>
Aug 01 13:49:58 user nova-compute[72129]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 13:49:58 user nova-compute[72129]:         <nova:vcpus>1</nova:vcpus>
Aug 01 13:49:58 user nova-compute[72129]:       </nova:flavor>
Aug 01 13:49:58 user nova-compute[72129]:       <nova:owner>
Aug 01 13:49:58 user nova-compute[72129]:         <nova:user uuid="14a1a4faeffb41a8bcebc292a7d73cb2">tempest-ServersNegativeTestJSON-281733508-project-member</nova:user>
Aug 01 13:49:58 user nova-compute[72129]:         <nova:project uuid="f34719c31d18460fa308e1f40130ed24">tempest-ServersNegativeTestJSON-281733508</nova:project>
Aug 01 13:49:58 user nova-compute[72129]:       </nova:owner>
Aug 01 13:49:58 user nova-compute[72129]:       <nova:root type="image" uuid="b6472c34-1b0f-4034-ba3a-7e8eb5103715"/>
Aug 01 13:49:58 user nova-compute[72129]:       <nova:ports>
Aug 01 13:49:58 user nova-compute[72129]:         <nova:port uuid="33a9acea-27a3-4a66-a5f9-4be39dc61ae7">
Aug 01 13:49:58 user nova-compute[72129]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 01 13:49:58 user nova-compute[72129]:         </nova:port>
Aug 01 13:49:58 user nova-compute[72129]:       </nova:ports>
Aug 01 13:49:58 user nova-compute[72129]:     </nova:instance>
Aug 01 13:49:58 user nova-compute[72129]:   </metadata>
Aug 01 13:49:58 user nova-compute[72129]:   <sysinfo type="smbios">
Aug 01 13:49:58 user nova-compute[72129]:     <system>
Aug 01 13:49:58 user nova-compute[72129]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 13:49:58 user nova-compute[72129]:       <entry name="product">OpenStack Nova</entry>
Aug 01 13:49:58 user nova-compute[72129]:       <entry name="version">0.0.0</entry>
Aug 01 13:49:58 user nova-compute[72129]:       <entry name="serial">63c0c1fe-7e4d-4763-8ede-a7662747a4c0</entry>
Aug 01 13:49:58 user nova-compute[72129]:       <entry name="uuid">63c0c1fe-7e4d-4763-8ede-a7662747a4c0</entry>
Aug 01 13:49:58 user nova-compute[72129]:       <entry name="family">Virtual Machine</entry>
Aug 01 13:49:58 user nova-compute[72129]:     </system>
Aug 01 13:49:58 user nova-compute[72129]:   </sysinfo>
Aug 01 13:49:58 user nova-compute[72129]:   <os>
Aug 01 13:49:58 user nova-compute[72129]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 13:49:58 user nova-compute[72129]:     <boot dev="hd"/>
Aug 01 13:49:58 user nova-compute[72129]:     <smbios mode="sysinfo"/>
Aug 01 13:49:58 user nova-compute[72129]:   </os>
Aug 01 13:49:58 user nova-compute[72129]:   <features>
Aug 01 13:49:58 user nova-compute[72129]:     <acpi/>
Aug 01 13:49:58 user nova-compute[72129]:     <apic/>
Aug 01 13:49:58 user nova-compute[72129]:     <vmcoreinfo/>
Aug 01 13:49:58 user nova-compute[72129]:   </features>
Aug 01 13:49:58 user nova-compute[72129]:   <clock offset="utc">
Aug 01 13:49:58 user nova-compute[72129]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 13:49:58 user nova-compute[72129]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 13:49:58 user nova-compute[72129]:     <timer name="hpet" present="no"/>
Aug 01 13:49:58 user nova-compute[72129]:   </clock>
Aug 01 13:49:58 user nova-compute[72129]:   <cpu mode="custom" match="exact">
Aug 01 13:49:58 user nova-compute[72129]:     <model>Nehalem</model>
Aug 01 13:49:58 user nova-compute[72129]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 13:49:58 user nova-compute[72129]:   </cpu>
Aug 01 13:49:58 user nova-compute[72129]:   <devices>
Aug 01 13:49:58 user nova-compute[72129]:     <disk type="file" device="disk">
Aug 01 13:49:58 user nova-compute[72129]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 13:49:58 user nova-compute[72129]:       <source file="/opt/stack/data/nova/instances/63c0c1fe-7e4d-4763-8ede-a7662747a4c0/disk"/>
Aug 01 13:49:58 user nova-compute[72129]:       <target dev="vda" bus="virtio"/>
Aug 01 13:49:58 user nova-compute[72129]:     </disk>
Aug 01 13:49:58 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 13:49:58 user nova-compute[72129]:       <mac address="fa:16:3e:65:63:71"/>
Aug 01 13:49:58 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 13:49:58 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 13:49:58 user nova-compute[72129]:       <target dev="tap33a9acea-27"/>
Aug 01 13:49:58 user nova-compute[72129]:     </interface>
Aug 01 13:49:58 user nova-compute[72129]:     <serial type="pty">
Aug 01 13:49:58 user nova-compute[72129]:       <log file="/opt/stack/data/nova/instances/63c0c1fe-7e4d-4763-8ede-a7662747a4c0/console.log" append="off"/>
Aug 01 13:49:58 user nova-compute[72129]:     </serial>
Aug 01 13:49:58 user nova-compute[72129]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 13:49:58 user nova-compute[72129]:     <video>
Aug 01 13:49:58 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 13:49:58 user nova-compute[72129]:     </video>
Aug 01 13:49:58 user nova-compute[72129]:     <rng model="virtio">
Aug 01 13:49:58 user nova-compute[72129]:       <backend model="random">/dev/urandom</backend>
Aug 01 13:49:58 user nova-compute[72129]:     </rng>
Aug 01 13:49:58 user nova-compute[72129]:     <controller type="usb" index="0" model="none"/>
Aug 01 13:49:58 user nova-compute[72129]:     <memballoon model="virtio">
Aug 01 13:49:58 user nova-compute[72129]:       <stats period="10"/>
Aug 01 13:49:58 user nova-compute[72129]:     </memballoon>
Aug 01 13:49:58 user nova-compute[72129]:   </devices>
Aug 01 13:49:58 user nova-compute[72129]: </domain>
Aug 01 13:49:58 user nova-compute[72129]:  {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 13:49:58 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:49:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-568926671',display_name='tempest-ServersNegativeTestJSON-server-568926671',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-568926671',id=2,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f34719c31d18460fa308e1f40130ed24',ramdisk_id='',reservation_id='r-gax1glqz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-281733508',owner_user_name='tempest-ServersNegativeTestJSON-281733508-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:49:52Z,user_data=None,user_id='14a1a4faeffb41a8bcebc292a7d73cb2',uuid=63c0c1fe-7e4d-4763-8ede-a7662747a4c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33a9acea-27a3-4a66-a5f9-4be39dc61ae7", "address": "fa:16:3e:65:63:71", "network": {"id": "90839969-290c-4555-ab2f-2215c33e89e9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1983064867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f34719c31d18460fa308e1f40130ed24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33a9acea-27", "ovs_interfaceid": "33a9acea-27a3-4a66-a5f9-4be39dc61ae7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 13:49:58 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Converting VIF {"id": "33a9acea-27a3-4a66-a5f9-4be39dc61ae7", "address": "fa:16:3e:65:63:71", "network": {"id": "90839969-290c-4555-ab2f-2215c33e89e9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1983064867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f34719c31d18460fa308e1f40130ed24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33a9acea-27", "ovs_interfaceid": "33a9acea-27a3-4a66-a5f9-4be39dc61ae7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:49:58 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:63:71,bridge_name='br-int',has_traffic_filtering=True,id=33a9acea-27a3-4a66-a5f9-4be39dc61ae7,network=Network(90839969-290c-4555-ab2f-2215c33e89e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33a9acea-27') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:49:58 user nova-compute[72129]: DEBUG os_vif [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:63:71,bridge_name='br-int',has_traffic_filtering=True,id=33a9acea-27a3-4a66-a5f9-4be39dc61ae7,network=Network(90839969-290c-4555-ab2f-2215c33e89e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33a9acea-27') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 13:49:58 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:49:58 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:49:58 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 13:49:58 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:49:58 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap33a9acea-27, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:49:58 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap33a9acea-27, col_values=(('external_ids', {'iface-id': '33a9acea-27a3-4a66-a5f9-4be39dc61ae7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:63:71', 'vm-uuid': '63c0c1fe-7e4d-4763-8ede-a7662747a4c0'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:49:58 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:49:58 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 13:49:58 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:49:58 user nova-compute[72129]: INFO os_vif [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:63:71,bridge_name='br-int',has_traffic_filtering=True,id=33a9acea-27a3-4a66-a5f9-4be39dc61ae7,network=Network(90839969-290c-4555-ab2f-2215c33e89e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33a9acea-27')
Aug 01 13:49:59 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 13:49:59 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] No VIF found with MAC fa:16:3e:65:63:71, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 13:49:59 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:49:59 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:49:59 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:49:59 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:49:59 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:49:59 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:00 user nova-compute[72129]: DEBUG nova.network.neutron [req-36e10d8a-7d58-4c15-ba2b-061c344e5c4c req-4815000f-d8b1-4a87-967d-ad950a85ac72 service nova] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] Updated VIF entry in instance network info cache for port 33a9acea-27a3-4a66-a5f9-4be39dc61ae7. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 13:50:00 user nova-compute[72129]: DEBUG nova.network.neutron [req-36e10d8a-7d58-4c15-ba2b-061c344e5c4c req-4815000f-d8b1-4a87-967d-ad950a85ac72 service nova] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] Updating instance_info_cache with network_info: [{"id": "33a9acea-27a3-4a66-a5f9-4be39dc61ae7", "address": "fa:16:3e:65:63:71", "network": {"id": "90839969-290c-4555-ab2f-2215c33e89e9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1983064867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f34719c31d18460fa308e1f40130ed24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33a9acea-27", "ovs_interfaceid": "33a9acea-27a3-4a66-a5f9-4be39dc61ae7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:50:00 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:00 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-36e10d8a-7d58-4c15-ba2b-061c344e5c4c req-4815000f-d8b1-4a87-967d-ad950a85ac72 service nova] Releasing lock "refresh_cache-63c0c1fe-7e4d-4763-8ede-a7662747a4c0" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:50:00 user nova-compute[72129]: DEBUG nova.network.neutron [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Successfully updated port: d59c6949-2748-4a57-b089-6219f9102815 {{(pid=72129) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 13:50:00 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:00 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Acquiring lock "refresh_cache-2efa87a6-1dd6-4441-a55e-8e86be7f0a35" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:50:00 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Acquired lock "refresh_cache-2efa87a6-1dd6-4441-a55e-8e86be7f0a35" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:50:00 user nova-compute[72129]: DEBUG nova.network.neutron [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 13:50:00 user nova-compute[72129]: DEBUG nova.compute.manager [req-1f14b51b-4b26-44b8-acbe-eaf33909466c req-92f3ce05-4fd6-4d38-83ef-7010db56bd05 service nova] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Received event network-changed-d59c6949-2748-4a57-b089-6219f9102815 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:50:00 user nova-compute[72129]: DEBUG nova.compute.manager [req-1f14b51b-4b26-44b8-acbe-eaf33909466c req-92f3ce05-4fd6-4d38-83ef-7010db56bd05 service nova] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Refreshing instance network info cache due to event network-changed-d59c6949-2748-4a57-b089-6219f9102815. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 13:50:00 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-1f14b51b-4b26-44b8-acbe-eaf33909466c req-92f3ce05-4fd6-4d38-83ef-7010db56bd05 service nova] Acquiring lock "refresh_cache-2efa87a6-1dd6-4441-a55e-8e86be7f0a35" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:50:00 user nova-compute[72129]: DEBUG nova.network.neutron [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Instance cache missing network info. {{(pid=72129) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 13:50:00 user nova-compute[72129]: DEBUG nova.network.neutron [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] Successfully updated port: 85708040-d7bf-4951-a29c-68cd6d3c4c42 {{(pid=72129) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 13:50:01 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Acquiring lock "refresh_cache-28115c7d-544a-4504-98da-2398e0e354d8" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:50:01 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Acquired lock "refresh_cache-28115c7d-544a-4504-98da-2398e0e354d8" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:50:01 user nova-compute[72129]: DEBUG nova.network.neutron [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 13:50:01 user nova-compute[72129]: DEBUG nova.compute.manager [req-70e293de-d8f8-4452-b2e0-a97c64330c88 req-daa6e94b-8ab1-4010-aee0-7240f126ed7c service nova] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] Received event network-changed-85708040-d7bf-4951-a29c-68cd6d3c4c42 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:50:01 user nova-compute[72129]: DEBUG nova.compute.manager [req-70e293de-d8f8-4452-b2e0-a97c64330c88 req-daa6e94b-8ab1-4010-aee0-7240f126ed7c service nova] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] Refreshing instance network info cache due to event network-changed-85708040-d7bf-4951-a29c-68cd6d3c4c42. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 13:50:01 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-70e293de-d8f8-4452-b2e0-a97c64330c88 req-daa6e94b-8ab1-4010-aee0-7240f126ed7c service nova] Acquiring lock "refresh_cache-28115c7d-544a-4504-98da-2398e0e354d8" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:50:01 user nova-compute[72129]: DEBUG nova.network.neutron [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Updating instance_info_cache with network_info: [{"id": "d59c6949-2748-4a57-b089-6219f9102815", "address": "fa:16:3e:20:eb:cf", "network": {"id": "4de0d3ee-7981-427b-9013-99cf0bc22cf8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-289359635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d693a983e4a44434b64c7983239371a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd59c6949-27", "ovs_interfaceid": "d59c6949-2748-4a57-b089-6219f9102815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:50:01 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Releasing lock "refresh_cache-2efa87a6-1dd6-4441-a55e-8e86be7f0a35" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:50:01 user nova-compute[72129]: DEBUG nova.compute.manager [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Instance network_info: |[{"id": "d59c6949-2748-4a57-b089-6219f9102815", "address": "fa:16:3e:20:eb:cf", "network": {"id": "4de0d3ee-7981-427b-9013-99cf0bc22cf8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-289359635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d693a983e4a44434b64c7983239371a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd59c6949-27", "ovs_interfaceid": "d59c6949-2748-4a57-b089-6219f9102815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 13:50:01 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-1f14b51b-4b26-44b8-acbe-eaf33909466c req-92f3ce05-4fd6-4d38-83ef-7010db56bd05 service nova] Acquired lock "refresh_cache-2efa87a6-1dd6-4441-a55e-8e86be7f0a35" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:50:01 user nova-compute[72129]: DEBUG nova.network.neutron [req-1f14b51b-4b26-44b8-acbe-eaf33909466c req-92f3ce05-4fd6-4d38-83ef-7010db56bd05 service nova] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Refreshing network info cache for port d59c6949-2748-4a57-b089-6219f9102815 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 13:50:01 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Start _get_guest_xml network_info=[{"id": "d59c6949-2748-4a57-b089-6219f9102815", "address": "fa:16:3e:20:eb:cf", "network": {"id": "4de0d3ee-7981-427b-9013-99cf0bc22cf8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-289359635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d693a983e4a44434b64c7983239371a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd59c6949-27", "ovs_interfaceid": "d59c6949-2748-4a57-b089-6219f9102815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'image_id': 'b6472c34-1b0f-4034-ba3a-7e8eb5103715'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 13:50:01 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:50:01 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:50:01 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 13:50:01 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] CPU controller missing on host. {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 13:50:01 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 13:50:01 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] CPU controller found on host. {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 13:50:01 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72129) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 13:50:01 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T13:45:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 13:50:01 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Flavor limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 13:50:01 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Image limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 13:50:01 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Flavor pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 13:50:01 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Image pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 13:50:01 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 13:50:01 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 13:50:01 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 13:50:01 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Got 1 possible topologies {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 13:50:01 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 13:50:01 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 13:50:01 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:49:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1892996256',display_name='tempest-ServerActionsTestOtherB-server-1892996256',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1892996256',id=3,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEv1XQzBjYoYpbhYYzAkxCcHUbemRkkK9uL3KJrV3p8Too9wSnun/4eb7cYSvdSK/lx7EWwYazfwFvI3n8xQWjsYEP2mWFNbGfwKAUlfbILCQIuiMev2z7hB1YDNH/wWXQ==',key_name='tempest-keypair-539050345',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d693a983e4a44434b64c7983239371a4',ramdisk_id='',reservation_id='r-ghzodbos',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-398231514',owner_user_name='tempest-ServerActionsTestOtherB-398231514-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:49:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1936f560fd794910af1fa6e9c4fffa90',uuid=2efa87a6-1dd6-4441-a55e-8e86be7f0a35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d59c6949-2748-4a57-b089-6219f9102815", "address": "fa:16:3e:20:eb:cf", "network": {"id": "4de0d3ee-7981-427b-9013-99cf0bc22cf8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-289359635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d693a983e4a44434b64c7983239371a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd59c6949-27", "ovs_interfaceid": "d59c6949-2748-4a57-b089-6219f9102815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 13:50:01 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Converting VIF {"id": "d59c6949-2748-4a57-b089-6219f9102815", "address": "fa:16:3e:20:eb:cf", "network": {"id": "4de0d3ee-7981-427b-9013-99cf0bc22cf8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-289359635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d693a983e4a44434b64c7983239371a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd59c6949-27", "ovs_interfaceid": "d59c6949-2748-4a57-b089-6219f9102815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:50:01 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:eb:cf,bridge_name='br-int',has_traffic_filtering=True,id=d59c6949-2748-4a57-b089-6219f9102815,network=Network(4de0d3ee-7981-427b-9013-99cf0bc22cf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd59c6949-27') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:50:01 user nova-compute[72129]: DEBUG nova.objects.instance [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Lazy-loading 'pci_devices' on Instance uuid 2efa87a6-1dd6-4441-a55e-8e86be7f0a35 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:50:01 user nova-compute[72129]: DEBUG nova.network.neutron [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] Instance cache missing network info. {{(pid=72129) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 13:50:01 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:01 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] End _get_guest_xml xml=<domain type="kvm">
Aug 01 13:50:01 user nova-compute[72129]:   <uuid>2efa87a6-1dd6-4441-a55e-8e86be7f0a35</uuid>
Aug 01 13:50:01 user nova-compute[72129]:   <name>instance-00000003</name>
Aug 01 13:50:01 user nova-compute[72129]:   <memory>524288</memory>
Aug 01 13:50:01 user nova-compute[72129]:   <vcpu>1</vcpu>
Aug 01 13:50:01 user nova-compute[72129]:   <metadata>
Aug 01 13:50:01 user nova-compute[72129]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 13:50:01 user nova-compute[72129]:       <nova:package version="0.0.0"/>
Aug 01 13:50:01 user nova-compute[72129]:       <nova:name>tempest-ServerActionsTestOtherB-server-1892996256</nova:name>
Aug 01 13:50:01 user nova-compute[72129]:       <nova:creationTime>2023-08-01 13:50:01</nova:creationTime>
Aug 01 13:50:01 user nova-compute[72129]:       <nova:flavor name="m1.tiny">
Aug 01 13:50:01 user nova-compute[72129]:         <nova:memory>512</nova:memory>
Aug 01 13:50:01 user nova-compute[72129]:         <nova:disk>1</nova:disk>
Aug 01 13:50:01 user nova-compute[72129]:         <nova:swap>0</nova:swap>
Aug 01 13:50:01 user nova-compute[72129]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 13:50:01 user nova-compute[72129]:         <nova:vcpus>1</nova:vcpus>
Aug 01 13:50:01 user nova-compute[72129]:       </nova:flavor>
Aug 01 13:50:01 user nova-compute[72129]:       <nova:owner>
Aug 01 13:50:01 user nova-compute[72129]:         <nova:user uuid="1936f560fd794910af1fa6e9c4fffa90">tempest-ServerActionsTestOtherB-398231514-project-member</nova:user>
Aug 01 13:50:01 user nova-compute[72129]:         <nova:project uuid="d693a983e4a44434b64c7983239371a4">tempest-ServerActionsTestOtherB-398231514</nova:project>
Aug 01 13:50:01 user nova-compute[72129]:       </nova:owner>
Aug 01 13:50:01 user nova-compute[72129]:       <nova:root type="image" uuid="b6472c34-1b0f-4034-ba3a-7e8eb5103715"/>
Aug 01 13:50:01 user nova-compute[72129]:       <nova:ports>
Aug 01 13:50:01 user nova-compute[72129]:         <nova:port uuid="d59c6949-2748-4a57-b089-6219f9102815">
Aug 01 13:50:01 user nova-compute[72129]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 01 13:50:01 user nova-compute[72129]:         </nova:port>
Aug 01 13:50:01 user nova-compute[72129]:       </nova:ports>
Aug 01 13:50:01 user nova-compute[72129]:     </nova:instance>
Aug 01 13:50:01 user nova-compute[72129]:   </metadata>
Aug 01 13:50:01 user nova-compute[72129]:   <sysinfo type="smbios">
Aug 01 13:50:01 user nova-compute[72129]:     <system>
Aug 01 13:50:01 user nova-compute[72129]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 13:50:01 user nova-compute[72129]:       <entry name="product">OpenStack Nova</entry>
Aug 01 13:50:01 user nova-compute[72129]:       <entry name="version">0.0.0</entry>
Aug 01 13:50:01 user nova-compute[72129]:       <entry name="serial">2efa87a6-1dd6-4441-a55e-8e86be7f0a35</entry>
Aug 01 13:50:01 user nova-compute[72129]:       <entry name="uuid">2efa87a6-1dd6-4441-a55e-8e86be7f0a35</entry>
Aug 01 13:50:01 user nova-compute[72129]:       <entry name="family">Virtual Machine</entry>
Aug 01 13:50:01 user nova-compute[72129]:     </system>
Aug 01 13:50:01 user nova-compute[72129]:   </sysinfo>
Aug 01 13:50:01 user nova-compute[72129]:   <os>
Aug 01 13:50:01 user nova-compute[72129]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 13:50:01 user nova-compute[72129]:     <boot dev="hd"/>
Aug 01 13:50:01 user nova-compute[72129]:     <smbios mode="sysinfo"/>
Aug 01 13:50:01 user nova-compute[72129]:   </os>
Aug 01 13:50:01 user nova-compute[72129]:   <features>
Aug 01 13:50:01 user nova-compute[72129]:     <acpi/>
Aug 01 13:50:01 user nova-compute[72129]:     <apic/>
Aug 01 13:50:01 user nova-compute[72129]:     <vmcoreinfo/>
Aug 01 13:50:01 user nova-compute[72129]:   </features>
Aug 01 13:50:01 user nova-compute[72129]:   <clock offset="utc">
Aug 01 13:50:01 user nova-compute[72129]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 13:50:01 user nova-compute[72129]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 13:50:01 user nova-compute[72129]:     <timer name="hpet" present="no"/>
Aug 01 13:50:01 user nova-compute[72129]:   </clock>
Aug 01 13:50:01 user nova-compute[72129]:   <cpu mode="custom" match="exact">
Aug 01 13:50:01 user nova-compute[72129]:     <model>Nehalem</model>
Aug 01 13:50:01 user nova-compute[72129]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 13:50:01 user nova-compute[72129]:   </cpu>
Aug 01 13:50:01 user nova-compute[72129]:   <devices>
Aug 01 13:50:01 user nova-compute[72129]:     <disk type="file" device="disk">
Aug 01 13:50:01 user nova-compute[72129]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 13:50:01 user nova-compute[72129]:       <source file="/opt/stack/data/nova/instances/2efa87a6-1dd6-4441-a55e-8e86be7f0a35/disk"/>
Aug 01 13:50:01 user nova-compute[72129]:       <target dev="vda" bus="virtio"/>
Aug 01 13:50:01 user nova-compute[72129]:     </disk>
Aug 01 13:50:01 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 13:50:01 user nova-compute[72129]:       <mac address="fa:16:3e:20:eb:cf"/>
Aug 01 13:50:01 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 13:50:01 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 13:50:01 user nova-compute[72129]:       <target dev="tapd59c6949-27"/>
Aug 01 13:50:01 user nova-compute[72129]:     </interface>
Aug 01 13:50:01 user nova-compute[72129]:     <serial type="pty">
Aug 01 13:50:01 user nova-compute[72129]:       <log file="/opt/stack/data/nova/instances/2efa87a6-1dd6-4441-a55e-8e86be7f0a35/console.log" append="off"/>
Aug 01 13:50:01 user nova-compute[72129]:     </serial>
Aug 01 13:50:01 user nova-compute[72129]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 13:50:01 user nova-compute[72129]:     <video>
Aug 01 13:50:01 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 13:50:01 user nova-compute[72129]:     </video>
Aug 01 13:50:01 user nova-compute[72129]:     <rng model="virtio">
Aug 01 13:50:01 user nova-compute[72129]:       <backend model="random">/dev/urandom</backend>
Aug 01 13:50:01 user nova-compute[72129]:     </rng>
Aug 01 13:50:01 user nova-compute[72129]:     <controller type="usb" index="0" model="none"/>
Aug 01 13:50:01 user nova-compute[72129]:     <memballoon model="virtio">
Aug 01 13:50:01 user nova-compute[72129]:       <stats period="10"/>
Aug 01 13:50:01 user nova-compute[72129]:     </memballoon>
Aug 01 13:50:01 user nova-compute[72129]:   </devices>
Aug 01 13:50:01 user nova-compute[72129]: </domain>
Aug 01 13:50:01 user nova-compute[72129]:  {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 13:50:01 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:49:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1892996256',display_name='tempest-ServerActionsTestOtherB-server-1892996256',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1892996256',id=3,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEv1XQzBjYoYpbhYYzAkxCcHUbemRkkK9uL3KJrV3p8Too9wSnun/4eb7cYSvdSK/lx7EWwYazfwFvI3n8xQWjsYEP2mWFNbGfwKAUlfbILCQIuiMev2z7hB1YDNH/wWXQ==',key_name='tempest-keypair-539050345',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d693a983e4a44434b64c7983239371a4',ramdisk_id='',reservation_id='r-ghzodbos',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-398231514',owner_user_name='tempest-ServerActionsTestOtherB-398231514-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:49:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1936f560fd794910af1fa6e9c4fffa90',uuid=2efa87a6-1dd6-4441-a55e-8e86be7f0a35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d59c6949-2748-4a57-b089-6219f9102815", "address": "fa:16:3e:20:eb:cf", "network": {"id": "4de0d3ee-7981-427b-9013-99cf0bc22cf8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-289359635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d693a983e4a44434b64c7983239371a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd59c6949-27", "ovs_interfaceid": "d59c6949-2748-4a57-b089-6219f9102815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 13:50:01 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Converting VIF {"id": "d59c6949-2748-4a57-b089-6219f9102815", "address": "fa:16:3e:20:eb:cf", "network": {"id": "4de0d3ee-7981-427b-9013-99cf0bc22cf8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-289359635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d693a983e4a44434b64c7983239371a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd59c6949-27", "ovs_interfaceid": "d59c6949-2748-4a57-b089-6219f9102815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:50:01 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:eb:cf,bridge_name='br-int',has_traffic_filtering=True,id=d59c6949-2748-4a57-b089-6219f9102815,network=Network(4de0d3ee-7981-427b-9013-99cf0bc22cf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd59c6949-27') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:50:01 user nova-compute[72129]: DEBUG os_vif [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:eb:cf,bridge_name='br-int',has_traffic_filtering=True,id=d59c6949-2748-4a57-b089-6219f9102815,network=Network(4de0d3ee-7981-427b-9013-99cf0bc22cf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd59c6949-27') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 13:50:01 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:01 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:50:01 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 13:50:01 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:01 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd59c6949-27, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:50:01 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd59c6949-27, col_values=(('external_ids', {'iface-id': 'd59c6949-2748-4a57-b089-6219f9102815', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:eb:cf', 'vm-uuid': '2efa87a6-1dd6-4441-a55e-8e86be7f0a35'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:50:01 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:01 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 13:50:01 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:01 user nova-compute[72129]: INFO os_vif [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:eb:cf,bridge_name='br-int',has_traffic_filtering=True,id=d59c6949-2748-4a57-b089-6219f9102815,network=Network(4de0d3ee-7981-427b-9013-99cf0bc22cf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd59c6949-27')
Aug 01 13:50:01 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 13:50:01 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] No VIF found with MAC fa:16:3e:20:eb:cf, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 13:50:02 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690897802.453893, d6b336c3-c7d4-4353-8e51-416726833407 => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:50:02 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: d6b336c3-c7d4-4353-8e51-416726833407] VM Resumed (Lifecycle Event)
Aug 01 13:50:02 user nova-compute[72129]: DEBUG nova.compute.manager [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] [instance: d6b336c3-c7d4-4353-8e51-416726833407] Instance event wait completed in 0 seconds for  {{(pid=72129) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 13:50:02 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] [instance: d6b336c3-c7d4-4353-8e51-416726833407] Guest created on hypervisor {{(pid=72129) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 13:50:02 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: d6b336c3-c7d4-4353-8e51-416726833407] Instance spawned successfully.
Aug 01 13:50:02 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] [instance: d6b336c3-c7d4-4353-8e51-416726833407] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 13:50:02 user nova-compute[72129]: DEBUG nova.compute.manager [req-21938f0d-d396-4dfd-9559-dca5233fd81c req-7b798fb2-6765-4a02-aa4d-b4ee601e9ecb service nova] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] Received event network-vif-plugged-33a9acea-27a3-4a66-a5f9-4be39dc61ae7 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:50:02 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-21938f0d-d396-4dfd-9559-dca5233fd81c req-7b798fb2-6765-4a02-aa4d-b4ee601e9ecb service nova] Acquiring lock "63c0c1fe-7e4d-4763-8ede-a7662747a4c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:50:02 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-21938f0d-d396-4dfd-9559-dca5233fd81c req-7b798fb2-6765-4a02-aa4d-b4ee601e9ecb service nova] Lock "63c0c1fe-7e4d-4763-8ede-a7662747a4c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:50:02 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-21938f0d-d396-4dfd-9559-dca5233fd81c req-7b798fb2-6765-4a02-aa4d-b4ee601e9ecb service nova] Lock "63c0c1fe-7e4d-4763-8ede-a7662747a4c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:50:02 user nova-compute[72129]: DEBUG nova.compute.manager [req-21938f0d-d396-4dfd-9559-dca5233fd81c req-7b798fb2-6765-4a02-aa4d-b4ee601e9ecb service nova] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] No waiting events found dispatching network-vif-plugged-33a9acea-27a3-4a66-a5f9-4be39dc61ae7 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:50:02 user nova-compute[72129]: WARNING nova.compute.manager [req-21938f0d-d396-4dfd-9559-dca5233fd81c req-7b798fb2-6765-4a02-aa4d-b4ee601e9ecb service nova] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] Received unexpected event network-vif-plugged-33a9acea-27a3-4a66-a5f9-4be39dc61ae7 for instance with vm_state building and task_state spawning.
Aug 01 13:50:02 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: d6b336c3-c7d4-4353-8e51-416726833407] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:50:02 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] [instance: d6b336c3-c7d4-4353-8e51-416726833407] Found default for hw_cdrom_bus of ide {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:50:02 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] [instance: d6b336c3-c7d4-4353-8e51-416726833407] Found default for hw_disk_bus of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:50:02 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] [instance: d6b336c3-c7d4-4353-8e51-416726833407] Found default for hw_input_bus of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:50:02 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] [instance: d6b336c3-c7d4-4353-8e51-416726833407] Found default for hw_pointer_model of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:50:02 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] [instance: d6b336c3-c7d4-4353-8e51-416726833407] Found default for hw_video_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:50:02 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] [instance: d6b336c3-c7d4-4353-8e51-416726833407] Found default for hw_vif_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:50:02 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: d6b336c3-c7d4-4353-8e51-416726833407] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 13:50:02 user nova-compute[72129]: DEBUG nova.network.neutron [req-1f14b51b-4b26-44b8-acbe-eaf33909466c req-92f3ce05-4fd6-4d38-83ef-7010db56bd05 service nova] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Updated VIF entry in instance network info cache for port d59c6949-2748-4a57-b089-6219f9102815. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 13:50:02 user nova-compute[72129]: DEBUG nova.network.neutron [req-1f14b51b-4b26-44b8-acbe-eaf33909466c req-92f3ce05-4fd6-4d38-83ef-7010db56bd05 service nova] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Updating instance_info_cache with network_info: [{"id": "d59c6949-2748-4a57-b089-6219f9102815", "address": "fa:16:3e:20:eb:cf", "network": {"id": "4de0d3ee-7981-427b-9013-99cf0bc22cf8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-289359635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d693a983e4a44434b64c7983239371a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd59c6949-27", "ovs_interfaceid": "d59c6949-2748-4a57-b089-6219f9102815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:50:02 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: d6b336c3-c7d4-4353-8e51-416726833407] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 13:50:02 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690897802.4553592, d6b336c3-c7d4-4353-8e51-416726833407 => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:50:02 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: d6b336c3-c7d4-4353-8e51-416726833407] VM Started (Lifecycle Event)
Aug 01 13:50:02 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-1f14b51b-4b26-44b8-acbe-eaf33909466c req-92f3ce05-4fd6-4d38-83ef-7010db56bd05 service nova] Releasing lock "refresh_cache-2efa87a6-1dd6-4441-a55e-8e86be7f0a35" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:50:02 user nova-compute[72129]: DEBUG nova.network.neutron [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] Updating instance_info_cache with network_info: [{"id": "85708040-d7bf-4951-a29c-68cd6d3c4c42", "address": "fa:16:3e:ed:f5:6f", "network": {"id": "2338fb81-87b6-4976-a6ab-b4ea0218fa9b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-606840206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebef26e9d3654bf99ecf391ccb263330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85708040-d7", "ovs_interfaceid": "85708040-d7bf-4951-a29c-68cd6d3c4c42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:50:02 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Releasing lock "refresh_cache-28115c7d-544a-4504-98da-2398e0e354d8" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:50:02 user nova-compute[72129]: DEBUG nova.compute.manager [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] Instance network_info: |[{"id": "85708040-d7bf-4951-a29c-68cd6d3c4c42", "address": "fa:16:3e:ed:f5:6f", "network": {"id": "2338fb81-87b6-4976-a6ab-b4ea0218fa9b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-606840206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebef26e9d3654bf99ecf391ccb263330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85708040-d7", "ovs_interfaceid": "85708040-d7bf-4951-a29c-68cd6d3c4c42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 13:50:02 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-70e293de-d8f8-4452-b2e0-a97c64330c88 req-daa6e94b-8ab1-4010-aee0-7240f126ed7c service nova] Acquired lock "refresh_cache-28115c7d-544a-4504-98da-2398e0e354d8" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:50:02 user nova-compute[72129]: DEBUG nova.network.neutron [req-70e293de-d8f8-4452-b2e0-a97c64330c88 req-daa6e94b-8ab1-4010-aee0-7240f126ed7c service nova] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] Refreshing network info cache for port 85708040-d7bf-4951-a29c-68cd6d3c4c42 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 13:50:02 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] Start _get_guest_xml network_info=[{"id": "85708040-d7bf-4951-a29c-68cd6d3c4c42", "address": "fa:16:3e:ed:f5:6f", "network": {"id": "2338fb81-87b6-4976-a6ab-b4ea0218fa9b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-606840206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebef26e9d3654bf99ecf391ccb263330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85708040-d7", "ovs_interfaceid": "85708040-d7bf-4951-a29c-68cd6d3c4c42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'image_id': 'b6472c34-1b0f-4034-ba3a-7e8eb5103715'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 13:50:02 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:50:02 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:50:02 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 13:50:02 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] CPU controller missing on host. {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 13:50:02 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: d6b336c3-c7d4-4353-8e51-416726833407] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:50:02 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 13:50:02 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] CPU controller found on host. {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 13:50:02 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72129) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 13:50:02 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T13:45:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 13:50:02 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Flavor limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 13:50:02 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Image limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 13:50:02 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Flavor pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 13:50:02 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Image pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 13:50:02 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 13:50:02 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 13:50:02 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 13:50:02 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Got 1 possible topologies {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 13:50:02 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 13:50:02 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 13:50:02 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:49:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-778819907',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-778819907',id=4,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKvGwo0zjXCNUbYrIi4YEs4rtiDx/9NdwV/Sx7cEd1WUmQMQL0Cvr4BJf7rFX6wTjuFT3Iox4h/+fvNDp2cLdA3kaS9jPaIqGnKwrwaSc0khjL6fklV+VntF7pSPCiAV+A==',key_name='tempest-keypair-1718331991',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ebef26e9d3654bf99ecf391ccb263330',ramdisk_id='',reservation_id='r-yt02zl40',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1852542004',owner_user_name='tempest-ServerActionsV293TestJSON-1852542004-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:49:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37e6bf606d3041d9928c5e5d6f4a9063',uuid=28115c7d-544a-4504-98da-2398e0e354d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85708040-d7bf-4951-a29c-68cd6d3c4c42", "address": "fa:16:3e:ed:f5:6f", "network": {"id": "2338fb81-87b6-4976-a6ab-b4ea0218fa9b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-606840206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebef26e9d3654bf99ecf391ccb263330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85708040-d7", "ovs_interfaceid": "85708040-d7bf-4951-a29c-68cd6d3c4c42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 13:50:02 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Converting VIF {"id": "85708040-d7bf-4951-a29c-68cd6d3c4c42", "address": "fa:16:3e:ed:f5:6f", "network": {"id": "2338fb81-87b6-4976-a6ab-b4ea0218fa9b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-606840206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebef26e9d3654bf99ecf391ccb263330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85708040-d7", "ovs_interfaceid": "85708040-d7bf-4951-a29c-68cd6d3c4c42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:50:02 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:f5:6f,bridge_name='br-int',has_traffic_filtering=True,id=85708040-d7bf-4951-a29c-68cd6d3c4c42,network=Network(2338fb81-87b6-4976-a6ab-b4ea0218fa9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85708040-d7') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:50:02 user nova-compute[72129]: DEBUG nova.objects.instance [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Lazy-loading 'pci_devices' on Instance uuid 28115c7d-544a-4504-98da-2398e0e354d8 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:50:02 user nova-compute[72129]: INFO nova.compute.manager [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] [instance: d6b336c3-c7d4-4353-8e51-416726833407] Took 13.73 seconds to spawn the instance on the hypervisor.
Aug 01 13:50:02 user nova-compute[72129]: DEBUG nova.compute.manager [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] [instance: d6b336c3-c7d4-4353-8e51-416726833407] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:50:02 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] End _get_guest_xml xml=<domain type="kvm">
Aug 01 13:50:02 user nova-compute[72129]:   <uuid>28115c7d-544a-4504-98da-2398e0e354d8</uuid>
Aug 01 13:50:02 user nova-compute[72129]:   <name>instance-00000004</name>
Aug 01 13:50:02 user nova-compute[72129]:   <memory>524288</memory>
Aug 01 13:50:02 user nova-compute[72129]:   <vcpu>1</vcpu>
Aug 01 13:50:02 user nova-compute[72129]:   <metadata>
Aug 01 13:50:02 user nova-compute[72129]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 13:50:02 user nova-compute[72129]:       <nova:package version="0.0.0"/>
Aug 01 13:50:02 user nova-compute[72129]:       <nova:name>tempest-ServerActionsV293TestJSON-server-778819907</nova:name>
Aug 01 13:50:02 user nova-compute[72129]:       <nova:creationTime>2023-08-01 13:50:02</nova:creationTime>
Aug 01 13:50:02 user nova-compute[72129]:       <nova:flavor name="m1.tiny">
Aug 01 13:50:02 user nova-compute[72129]:         <nova:memory>512</nova:memory>
Aug 01 13:50:02 user nova-compute[72129]:         <nova:disk>1</nova:disk>
Aug 01 13:50:02 user nova-compute[72129]:         <nova:swap>0</nova:swap>
Aug 01 13:50:02 user nova-compute[72129]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 13:50:02 user nova-compute[72129]:         <nova:vcpus>1</nova:vcpus>
Aug 01 13:50:02 user nova-compute[72129]:       </nova:flavor>
Aug 01 13:50:02 user nova-compute[72129]:       <nova:owner>
Aug 01 13:50:02 user nova-compute[72129]:         <nova:user uuid="37e6bf606d3041d9928c5e5d6f4a9063">tempest-ServerActionsV293TestJSON-1852542004-project-member</nova:user>
Aug 01 13:50:02 user nova-compute[72129]:         <nova:project uuid="ebef26e9d3654bf99ecf391ccb263330">tempest-ServerActionsV293TestJSON-1852542004</nova:project>
Aug 01 13:50:02 user nova-compute[72129]:       </nova:owner>
Aug 01 13:50:02 user nova-compute[72129]:       <nova:root type="image" uuid="b6472c34-1b0f-4034-ba3a-7e8eb5103715"/>
Aug 01 13:50:02 user nova-compute[72129]:       <nova:ports>
Aug 01 13:50:02 user nova-compute[72129]:         <nova:port uuid="85708040-d7bf-4951-a29c-68cd6d3c4c42">
Aug 01 13:50:02 user nova-compute[72129]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 01 13:50:02 user nova-compute[72129]:         </nova:port>
Aug 01 13:50:02 user nova-compute[72129]:       </nova:ports>
Aug 01 13:50:02 user nova-compute[72129]:     </nova:instance>
Aug 01 13:50:02 user nova-compute[72129]:   </metadata>
Aug 01 13:50:02 user nova-compute[72129]:   <sysinfo type="smbios">
Aug 01 13:50:02 user nova-compute[72129]:     <system>
Aug 01 13:50:02 user nova-compute[72129]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 13:50:02 user nova-compute[72129]:       <entry name="product">OpenStack Nova</entry>
Aug 01 13:50:02 user nova-compute[72129]:       <entry name="version">0.0.0</entry>
Aug 01 13:50:02 user nova-compute[72129]:       <entry name="serial">28115c7d-544a-4504-98da-2398e0e354d8</entry>
Aug 01 13:50:02 user nova-compute[72129]:       <entry name="uuid">28115c7d-544a-4504-98da-2398e0e354d8</entry>
Aug 01 13:50:02 user nova-compute[72129]:       <entry name="family">Virtual Machine</entry>
Aug 01 13:50:02 user nova-compute[72129]:     </system>
Aug 01 13:50:02 user nova-compute[72129]:   </sysinfo>
Aug 01 13:50:02 user nova-compute[72129]:   <os>
Aug 01 13:50:02 user nova-compute[72129]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 13:50:02 user nova-compute[72129]:     <boot dev="hd"/>
Aug 01 13:50:02 user nova-compute[72129]:     <smbios mode="sysinfo"/>
Aug 01 13:50:02 user nova-compute[72129]:   </os>
Aug 01 13:50:02 user nova-compute[72129]:   <features>
Aug 01 13:50:02 user nova-compute[72129]:     <acpi/>
Aug 01 13:50:02 user nova-compute[72129]:     <apic/>
Aug 01 13:50:02 user nova-compute[72129]:     <vmcoreinfo/>
Aug 01 13:50:02 user nova-compute[72129]:   </features>
Aug 01 13:50:02 user nova-compute[72129]:   <clock offset="utc">
Aug 01 13:50:02 user nova-compute[72129]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 13:50:02 user nova-compute[72129]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 13:50:02 user nova-compute[72129]:     <timer name="hpet" present="no"/>
Aug 01 13:50:02 user nova-compute[72129]:   </clock>
Aug 01 13:50:02 user nova-compute[72129]:   <cpu mode="custom" match="exact">
Aug 01 13:50:02 user nova-compute[72129]:     <model>Nehalem</model>
Aug 01 13:50:02 user nova-compute[72129]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 13:50:02 user nova-compute[72129]:   </cpu>
Aug 01 13:50:02 user nova-compute[72129]:   <devices>
Aug 01 13:50:02 user nova-compute[72129]:     <disk type="file" device="disk">
Aug 01 13:50:02 user nova-compute[72129]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 13:50:02 user nova-compute[72129]:       <source file="/opt/stack/data/nova/instances/28115c7d-544a-4504-98da-2398e0e354d8/disk"/>
Aug 01 13:50:02 user nova-compute[72129]:       <target dev="vda" bus="virtio"/>
Aug 01 13:50:02 user nova-compute[72129]:     </disk>
Aug 01 13:50:02 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 13:50:02 user nova-compute[72129]:       <mac address="fa:16:3e:ed:f5:6f"/>
Aug 01 13:50:02 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 13:50:02 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 13:50:02 user nova-compute[72129]:       <target dev="tap85708040-d7"/>
Aug 01 13:50:02 user nova-compute[72129]:     </interface>
Aug 01 13:50:02 user nova-compute[72129]:     <serial type="pty">
Aug 01 13:50:02 user nova-compute[72129]:       <log file="/opt/stack/data/nova/instances/28115c7d-544a-4504-98da-2398e0e354d8/console.log" append="off"/>
Aug 01 13:50:02 user nova-compute[72129]:     </serial>
Aug 01 13:50:02 user nova-compute[72129]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 13:50:02 user nova-compute[72129]:     <video>
Aug 01 13:50:02 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 13:50:02 user nova-compute[72129]:     </video>
Aug 01 13:50:02 user nova-compute[72129]:     <rng model="virtio">
Aug 01 13:50:02 user nova-compute[72129]:       <backend model="random">/dev/urandom</backend>
Aug 01 13:50:02 user nova-compute[72129]:     </rng>
Aug 01 13:50:02 user nova-compute[72129]:     <controller type="usb" index="0" model="none"/>
Aug 01 13:50:02 user nova-compute[72129]:     <memballoon model="virtio">
Aug 01 13:50:02 user nova-compute[72129]:       <stats period="10"/>
Aug 01 13:50:02 user nova-compute[72129]:     </memballoon>
Aug 01 13:50:02 user nova-compute[72129]:   </devices>
Aug 01 13:50:02 user nova-compute[72129]: </domain>
Aug 01 13:50:02 user nova-compute[72129]:  {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 13:50:02 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:49:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-778819907',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-778819907',id=4,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKvGwo0zjXCNUbYrIi4YEs4rtiDx/9NdwV/Sx7cEd1WUmQMQL0Cvr4BJf7rFX6wTjuFT3Iox4h/+fvNDp2cLdA3kaS9jPaIqGnKwrwaSc0khjL6fklV+VntF7pSPCiAV+A==',key_name='tempest-keypair-1718331991',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ebef26e9d3654bf99ecf391ccb263330',ramdisk_id='',reservation_id='r-yt02zl40',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1852542004',owner_user_name='tempest-ServerActionsV293TestJSON-1852542004-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:49:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37e6bf606d3041d9928c5e5d6f4a9063',uuid=28115c7d-544a-4504-98da-2398e0e354d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85708040-d7bf-4951-a29c-68cd6d3c4c42", "address": "fa:16:3e:ed:f5:6f", "network": {"id": "2338fb81-87b6-4976-a6ab-b4ea0218fa9b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-606840206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebef26e9d3654bf99ecf391ccb263330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85708040-d7", "ovs_interfaceid": "85708040-d7bf-4951-a29c-68cd6d3c4c42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 13:50:02 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Converting VIF {"id": "85708040-d7bf-4951-a29c-68cd6d3c4c42", "address": "fa:16:3e:ed:f5:6f", "network": {"id": "2338fb81-87b6-4976-a6ab-b4ea0218fa9b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-606840206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebef26e9d3654bf99ecf391ccb263330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85708040-d7", "ovs_interfaceid": "85708040-d7bf-4951-a29c-68cd6d3c4c42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:50:02 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:f5:6f,bridge_name='br-int',has_traffic_filtering=True,id=85708040-d7bf-4951-a29c-68cd6d3c4c42,network=Network(2338fb81-87b6-4976-a6ab-b4ea0218fa9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85708040-d7') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:50:02 user nova-compute[72129]: DEBUG os_vif [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:f5:6f,bridge_name='br-int',has_traffic_filtering=True,id=85708040-d7bf-4951-a29c-68cd6d3c4c42,network=Network(2338fb81-87b6-4976-a6ab-b4ea0218fa9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85708040-d7') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 13:50:02 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:02 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:50:02 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 13:50:02 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: d6b336c3-c7d4-4353-8e51-416726833407] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 13:50:02 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:02 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap85708040-d7, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:50:02 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap85708040-d7, col_values=(('external_ids', {'iface-id': '85708040-d7bf-4951-a29c-68cd6d3c4c42', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:f5:6f', 'vm-uuid': '28115c7d-544a-4504-98da-2398e0e354d8'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:50:02 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: d6b336c3-c7d4-4353-8e51-416726833407] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 13:50:02 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:02 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 13:50:02 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:02 user nova-compute[72129]: INFO os_vif [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:f5:6f,bridge_name='br-int',has_traffic_filtering=True,id=85708040-d7bf-4951-a29c-68cd6d3c4c42,network=Network(2338fb81-87b6-4976-a6ab-b4ea0218fa9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85708040-d7')
Aug 01 13:50:02 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 13:50:02 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] No VIF found with MAC fa:16:3e:ed:f5:6f, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 13:50:02 user nova-compute[72129]: INFO nova.compute.manager [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] [instance: d6b336c3-c7d4-4353-8e51-416726833407] Took 14.76 seconds to build instance.
Aug 01 13:50:03 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-6b2236ca-4a77-4dd8-84f2-276e12959f77 tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Lock "d6b336c3-c7d4-4353-8e51-416726833407" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.984s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:50:03 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:03 user nova-compute[72129]: DEBUG nova.compute.manager [req-e71e6914-ad4a-43cd-9ead-5cc398804be1 req-506b03a7-0ca7-48f4-b207-8bdd32742d6b service nova] [instance: d6b336c3-c7d4-4353-8e51-416726833407] Received event network-vif-plugged-129db8e9-6741-408c-b62c-ae48485fa290 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:50:03 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-e71e6914-ad4a-43cd-9ead-5cc398804be1 req-506b03a7-0ca7-48f4-b207-8bdd32742d6b service nova] Acquiring lock "d6b336c3-c7d4-4353-8e51-416726833407-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:50:03 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-e71e6914-ad4a-43cd-9ead-5cc398804be1 req-506b03a7-0ca7-48f4-b207-8bdd32742d6b service nova] Lock "d6b336c3-c7d4-4353-8e51-416726833407-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:50:03 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-e71e6914-ad4a-43cd-9ead-5cc398804be1 req-506b03a7-0ca7-48f4-b207-8bdd32742d6b service nova] Lock "d6b336c3-c7d4-4353-8e51-416726833407-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:50:03 user nova-compute[72129]: DEBUG nova.compute.manager [req-e71e6914-ad4a-43cd-9ead-5cc398804be1 req-506b03a7-0ca7-48f4-b207-8bdd32742d6b service nova] [instance: d6b336c3-c7d4-4353-8e51-416726833407] No waiting events found dispatching network-vif-plugged-129db8e9-6741-408c-b62c-ae48485fa290 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:50:03 user nova-compute[72129]: WARNING nova.compute.manager [req-e71e6914-ad4a-43cd-9ead-5cc398804be1 req-506b03a7-0ca7-48f4-b207-8bdd32742d6b service nova] [instance: d6b336c3-c7d4-4353-8e51-416726833407] Received unexpected event network-vif-plugged-129db8e9-6741-408c-b62c-ae48485fa290 for instance with vm_state active and task_state None.
Aug 01 13:50:03 user nova-compute[72129]: DEBUG nova.compute.manager [req-e71e6914-ad4a-43cd-9ead-5cc398804be1 req-506b03a7-0ca7-48f4-b207-8bdd32742d6b service nova] [instance: d6b336c3-c7d4-4353-8e51-416726833407] Received event network-vif-plugged-129db8e9-6741-408c-b62c-ae48485fa290 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:50:03 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-e71e6914-ad4a-43cd-9ead-5cc398804be1 req-506b03a7-0ca7-48f4-b207-8bdd32742d6b service nova] Acquiring lock "d6b336c3-c7d4-4353-8e51-416726833407-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:50:03 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-e71e6914-ad4a-43cd-9ead-5cc398804be1 req-506b03a7-0ca7-48f4-b207-8bdd32742d6b service nova] Lock "d6b336c3-c7d4-4353-8e51-416726833407-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:50:03 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-e71e6914-ad4a-43cd-9ead-5cc398804be1 req-506b03a7-0ca7-48f4-b207-8bdd32742d6b service nova] Lock "d6b336c3-c7d4-4353-8e51-416726833407-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:50:03 user nova-compute[72129]: DEBUG nova.compute.manager [req-e71e6914-ad4a-43cd-9ead-5cc398804be1 req-506b03a7-0ca7-48f4-b207-8bdd32742d6b service nova] [instance: d6b336c3-c7d4-4353-8e51-416726833407] No waiting events found dispatching network-vif-plugged-129db8e9-6741-408c-b62c-ae48485fa290 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:50:03 user nova-compute[72129]: WARNING nova.compute.manager [req-e71e6914-ad4a-43cd-9ead-5cc398804be1 req-506b03a7-0ca7-48f4-b207-8bdd32742d6b service nova] [instance: d6b336c3-c7d4-4353-8e51-416726833407] Received unexpected event network-vif-plugged-129db8e9-6741-408c-b62c-ae48485fa290 for instance with vm_state active and task_state None.
Aug 01 13:50:03 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:03 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:03 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:03 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:03 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:03 user nova-compute[72129]: DEBUG nova.compute.manager [req-a6031c25-85a5-4fa8-b6b2-abe5de1ce647 req-8a9fcae0-5bcb-46d7-961a-75300bbccd40 service nova] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Received event network-vif-plugged-d59c6949-2748-4a57-b089-6219f9102815 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:50:03 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-a6031c25-85a5-4fa8-b6b2-abe5de1ce647 req-8a9fcae0-5bcb-46d7-961a-75300bbccd40 service nova] Acquiring lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:50:03 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-a6031c25-85a5-4fa8-b6b2-abe5de1ce647 req-8a9fcae0-5bcb-46d7-961a-75300bbccd40 service nova] Lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:50:03 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-a6031c25-85a5-4fa8-b6b2-abe5de1ce647 req-8a9fcae0-5bcb-46d7-961a-75300bbccd40 service nova] Lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:50:03 user nova-compute[72129]: DEBUG nova.compute.manager [req-a6031c25-85a5-4fa8-b6b2-abe5de1ce647 req-8a9fcae0-5bcb-46d7-961a-75300bbccd40 service nova] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] No waiting events found dispatching network-vif-plugged-d59c6949-2748-4a57-b089-6219f9102815 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:50:03 user nova-compute[72129]: WARNING nova.compute.manager [req-a6031c25-85a5-4fa8-b6b2-abe5de1ce647 req-8a9fcae0-5bcb-46d7-961a-75300bbccd40 service nova] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Received unexpected event network-vif-plugged-d59c6949-2748-4a57-b089-6219f9102815 for instance with vm_state building and task_state spawning.
Aug 01 13:50:04 user nova-compute[72129]: DEBUG nova.compute.manager [req-c0c3c716-c3f6-4efa-9a0d-5a9abd7480d1 req-60f94770-3cf1-440b-9493-0aed157e10ba service nova] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] Received event network-vif-plugged-33a9acea-27a3-4a66-a5f9-4be39dc61ae7 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:50:04 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-c0c3c716-c3f6-4efa-9a0d-5a9abd7480d1 req-60f94770-3cf1-440b-9493-0aed157e10ba service nova] Acquiring lock "63c0c1fe-7e4d-4763-8ede-a7662747a4c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:50:04 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-c0c3c716-c3f6-4efa-9a0d-5a9abd7480d1 req-60f94770-3cf1-440b-9493-0aed157e10ba service nova] Lock "63c0c1fe-7e4d-4763-8ede-a7662747a4c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:50:04 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-c0c3c716-c3f6-4efa-9a0d-5a9abd7480d1 req-60f94770-3cf1-440b-9493-0aed157e10ba service nova] Lock "63c0c1fe-7e4d-4763-8ede-a7662747a4c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:50:04 user nova-compute[72129]: DEBUG nova.compute.manager [req-c0c3c716-c3f6-4efa-9a0d-5a9abd7480d1 req-60f94770-3cf1-440b-9493-0aed157e10ba service nova] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] No waiting events found dispatching network-vif-plugged-33a9acea-27a3-4a66-a5f9-4be39dc61ae7 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:50:04 user nova-compute[72129]: WARNING nova.compute.manager [req-c0c3c716-c3f6-4efa-9a0d-5a9abd7480d1 req-60f94770-3cf1-440b-9493-0aed157e10ba service nova] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] Received unexpected event network-vif-plugged-33a9acea-27a3-4a66-a5f9-4be39dc61ae7 for instance with vm_state building and task_state spawning.
Aug 01 13:50:05 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:05 user nova-compute[72129]: DEBUG nova.network.neutron [req-70e293de-d8f8-4452-b2e0-a97c64330c88 req-daa6e94b-8ab1-4010-aee0-7240f126ed7c service nova] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] Updated VIF entry in instance network info cache for port 85708040-d7bf-4951-a29c-68cd6d3c4c42. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 13:50:05 user nova-compute[72129]: DEBUG nova.network.neutron [req-70e293de-d8f8-4452-b2e0-a97c64330c88 req-daa6e94b-8ab1-4010-aee0-7240f126ed7c service nova] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] Updating instance_info_cache with network_info: [{"id": "85708040-d7bf-4951-a29c-68cd6d3c4c42", "address": "fa:16:3e:ed:f5:6f", "network": {"id": "2338fb81-87b6-4976-a6ab-b4ea0218fa9b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-606840206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebef26e9d3654bf99ecf391ccb263330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85708040-d7", "ovs_interfaceid": "85708040-d7bf-4951-a29c-68cd6d3c4c42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:50:05 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-70e293de-d8f8-4452-b2e0-a97c64330c88 req-daa6e94b-8ab1-4010-aee0-7240f126ed7c service nova] Releasing lock "refresh_cache-28115c7d-544a-4504-98da-2398e0e354d8" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:50:05 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:05 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:05 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:05 user nova-compute[72129]: DEBUG nova.compute.manager [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] Instance event wait completed in 0 seconds for  {{(pid=72129) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 13:50:05 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] Guest created on hypervisor {{(pid=72129) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 13:50:05 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690897805.4671652, 63c0c1fe-7e4d-4763-8ede-a7662747a4c0 => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:50:05 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] VM Resumed (Lifecycle Event)
Aug 01 13:50:05 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] Instance spawned successfully.
Aug 01 13:50:05 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 13:50:05 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] Found default for hw_cdrom_bus of ide {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:50:05 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] Found default for hw_disk_bus of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:50:05 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] Found default for hw_input_bus of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:50:05 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] Found default for hw_pointer_model of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:50:05 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] Found default for hw_video_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:50:05 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] Found default for hw_vif_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:50:05 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:50:05 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 13:50:05 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 13:50:05 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690897805.4673457, 63c0c1fe-7e4d-4763-8ede-a7662747a4c0 => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:50:05 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] VM Started (Lifecycle Event)
Aug 01 13:50:05 user nova-compute[72129]: DEBUG nova.compute.manager [req-633287ae-47ed-4b20-9730-e91c8234263d req-15bbc679-e907-47e9-ae83-62957cc3d27c service nova] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Received event network-vif-plugged-d59c6949-2748-4a57-b089-6219f9102815 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:50:05 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-633287ae-47ed-4b20-9730-e91c8234263d req-15bbc679-e907-47e9-ae83-62957cc3d27c service nova] Acquiring lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:50:05 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-633287ae-47ed-4b20-9730-e91c8234263d req-15bbc679-e907-47e9-ae83-62957cc3d27c service nova] Lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:50:05 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-633287ae-47ed-4b20-9730-e91c8234263d req-15bbc679-e907-47e9-ae83-62957cc3d27c service nova] Lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:50:05 user nova-compute[72129]: DEBUG nova.compute.manager [req-633287ae-47ed-4b20-9730-e91c8234263d req-15bbc679-e907-47e9-ae83-62957cc3d27c service nova] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] No waiting events found dispatching network-vif-plugged-d59c6949-2748-4a57-b089-6219f9102815 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:50:05 user nova-compute[72129]: WARNING nova.compute.manager [req-633287ae-47ed-4b20-9730-e91c8234263d req-15bbc679-e907-47e9-ae83-62957cc3d27c service nova] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Received unexpected event network-vif-plugged-d59c6949-2748-4a57-b089-6219f9102815 for instance with vm_state building and task_state spawning.
Aug 01 13:50:05 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:50:05 user nova-compute[72129]: INFO nova.compute.manager [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] Took 13.76 seconds to spawn the instance on the hypervisor.
Aug 01 13:50:05 user nova-compute[72129]: DEBUG nova.compute.manager [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:50:05 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 13:50:05 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 13:50:05 user nova-compute[72129]: INFO nova.compute.manager [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] Took 14.54 seconds to build instance.
Aug 01 13:50:05 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-24bac755-0514-419f-9643-3f431e4f7186 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Lock "63c0c1fe-7e4d-4763-8ede-a7662747a4c0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.746s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:50:06 user nova-compute[72129]: DEBUG nova.compute.manager [req-6184806a-f188-4022-a04a-ff689f76f2ee req-b23290ef-654a-462c-baca-f289fabfdd2a service nova] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] Received event network-vif-plugged-85708040-d7bf-4951-a29c-68cd6d3c4c42 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:50:06 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-6184806a-f188-4022-a04a-ff689f76f2ee req-b23290ef-654a-462c-baca-f289fabfdd2a service nova] Acquiring lock "28115c7d-544a-4504-98da-2398e0e354d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:50:06 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-6184806a-f188-4022-a04a-ff689f76f2ee req-b23290ef-654a-462c-baca-f289fabfdd2a service nova] Lock "28115c7d-544a-4504-98da-2398e0e354d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:50:06 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-6184806a-f188-4022-a04a-ff689f76f2ee req-b23290ef-654a-462c-baca-f289fabfdd2a service nova] Lock "28115c7d-544a-4504-98da-2398e0e354d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:50:06 user nova-compute[72129]: DEBUG nova.compute.manager [req-6184806a-f188-4022-a04a-ff689f76f2ee req-b23290ef-654a-462c-baca-f289fabfdd2a service nova] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] No waiting events found dispatching network-vif-plugged-85708040-d7bf-4951-a29c-68cd6d3c4c42 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:50:06 user nova-compute[72129]: WARNING nova.compute.manager [req-6184806a-f188-4022-a04a-ff689f76f2ee req-b23290ef-654a-462c-baca-f289fabfdd2a service nova] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] Received unexpected event network-vif-plugged-85708040-d7bf-4951-a29c-68cd6d3c4c42 for instance with vm_state building and task_state spawning.
Aug 01 13:50:07 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:07 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:07 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:07 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:07 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:07 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:07 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690897807.6505558, 2efa87a6-1dd6-4441-a55e-8e86be7f0a35 => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:50:07 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] VM Resumed (Lifecycle Event)
Aug 01 13:50:07 user nova-compute[72129]: DEBUG nova.compute.manager [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Instance event wait completed in 0 seconds for  {{(pid=72129) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 13:50:07 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Guest created on hypervisor {{(pid=72129) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 13:50:07 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Instance spawned successfully.
Aug 01 13:50:07 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 13:50:07 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:50:07 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 13:50:07 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Found default for hw_cdrom_bus of ide {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:50:07 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Found default for hw_disk_bus of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:50:07 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Found default for hw_input_bus of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:50:07 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Found default for hw_pointer_model of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:50:07 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Found default for hw_video_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:50:07 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Found default for hw_vif_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:50:07 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 13:50:07 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690897807.6541178, 2efa87a6-1dd6-4441-a55e-8e86be7f0a35 => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:50:07 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] VM Started (Lifecycle Event)
Aug 01 13:50:07 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:50:07 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 13:50:07 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 13:50:07 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:07 user nova-compute[72129]: INFO nova.compute.manager [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Took 12.72 seconds to spawn the instance on the hypervisor.
Aug 01 13:50:07 user nova-compute[72129]: DEBUG nova.compute.manager [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:50:08 user nova-compute[72129]: INFO nova.compute.manager [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Took 13.88 seconds to build instance.
Aug 01 13:50:08 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e4938e77-663b-413b-94f0-c21a12a50f75 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.093s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:50:08 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690897808.2035108, 28115c7d-544a-4504-98da-2398e0e354d8 => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:50:08 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] VM Resumed (Lifecycle Event)
Aug 01 13:50:08 user nova-compute[72129]: DEBUG nova.compute.manager [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] Instance event wait completed in 0 seconds for  {{(pid=72129) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 13:50:08 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] Guest created on hypervisor {{(pid=72129) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 13:50:08 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] Instance spawned successfully.
Aug 01 13:50:08 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 13:50:08 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:50:08 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 13:50:08 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] Found default for hw_cdrom_bus of ide {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:50:08 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] Found default for hw_disk_bus of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:50:08 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] Found default for hw_input_bus of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:50:08 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] Found default for hw_pointer_model of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:50:08 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] Found default for hw_video_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:50:08 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] Found default for hw_vif_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:50:08 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 13:50:08 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690897808.2047746, 28115c7d-544a-4504-98da-2398e0e354d8 => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:50:08 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] VM Started (Lifecycle Event)
Aug 01 13:50:08 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:50:08 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 13:50:08 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 13:50:08 user nova-compute[72129]: INFO nova.compute.manager [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] Took 13.67 seconds to spawn the instance on the hypervisor.
Aug 01 13:50:08 user nova-compute[72129]: DEBUG nova.compute.manager [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:50:08 user nova-compute[72129]: INFO nova.compute.manager [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] Took 14.44 seconds to build instance.
Aug 01 13:50:08 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d7c45ec3-fd4e-4624-8697-646c6a4035c8 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Lock "28115c7d-544a-4504-98da-2398e0e354d8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.557s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:50:08 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:08 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:08 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:08 user nova-compute[72129]: DEBUG nova.compute.manager [req-efaa98f3-e0ef-4c27-9a62-213a4b5c320c req-65c2c428-140b-44bb-ba35-3bf3983d686a service nova] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] Received event network-vif-plugged-85708040-d7bf-4951-a29c-68cd6d3c4c42 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:50:08 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-efaa98f3-e0ef-4c27-9a62-213a4b5c320c req-65c2c428-140b-44bb-ba35-3bf3983d686a service nova] Acquiring lock "28115c7d-544a-4504-98da-2398e0e354d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:50:08 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-efaa98f3-e0ef-4c27-9a62-213a4b5c320c req-65c2c428-140b-44bb-ba35-3bf3983d686a service nova] Lock "28115c7d-544a-4504-98da-2398e0e354d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:50:08 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-efaa98f3-e0ef-4c27-9a62-213a4b5c320c req-65c2c428-140b-44bb-ba35-3bf3983d686a service nova] Lock "28115c7d-544a-4504-98da-2398e0e354d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:50:08 user nova-compute[72129]: DEBUG nova.compute.manager [req-efaa98f3-e0ef-4c27-9a62-213a4b5c320c req-65c2c428-140b-44bb-ba35-3bf3983d686a service nova] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] No waiting events found dispatching network-vif-plugged-85708040-d7bf-4951-a29c-68cd6d3c4c42 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:50:08 user nova-compute[72129]: WARNING nova.compute.manager [req-efaa98f3-e0ef-4c27-9a62-213a4b5c320c req-65c2c428-140b-44bb-ba35-3bf3983d686a service nova] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] Received unexpected event network-vif-plugged-85708040-d7bf-4951-a29c-68cd6d3c4c42 for instance with vm_state active and task_state None.
Aug 01 13:50:09 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:09 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:09 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:09 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:10 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:10 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:10 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:10 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:10 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:10 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:10 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:11 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:12 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:14 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Acquiring lock "31105963-52fa-4aff-9270-075cd98f08a5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:50:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Lock "31105963-52fa-4aff-9270-075cd98f08a5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:50:15 user nova-compute[72129]: DEBUG nova.compute.manager [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] Starting instance... {{(pid=72129) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 13:50:15 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:50:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:50:15 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72129) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 13:50:15 user nova-compute[72129]: INFO nova.compute.claims [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] Claim successful on node user
Aug 01 13:50:15 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 13:50:15 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 13:50:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.648s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:50:16 user nova-compute[72129]: DEBUG nova.compute.manager [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] Start building networks asynchronously for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 13:50:16 user nova-compute[72129]: DEBUG nova.compute.manager [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] Allocating IP information in the background. {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 13:50:16 user nova-compute[72129]: DEBUG nova.network.neutron [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] allocate_for_instance() {{(pid=72129) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 13:50:16 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 13:50:16 user nova-compute[72129]: DEBUG nova.compute.manager [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] Start building block device mappings for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 13:50:16 user nova-compute[72129]: DEBUG nova.policy [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '42662c28ee804a399b2ba6467e3c3926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8fd0bc919dc4f39a702173f8be6a847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72129) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 13:50:16 user nova-compute[72129]: DEBUG nova.compute.manager [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] Start spawning the instance on the hypervisor. {{(pid=72129) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 13:50:16 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] Creating instance directory {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 13:50:16 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] Creating image(s)
Aug 01 13:50:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Acquiring lock "/opt/stack/data/nova/instances/31105963-52fa-4aff-9270-075cd98f08a5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:50:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Lock "/opt/stack/data/nova/instances/31105963-52fa-4aff-9270-075cd98f08a5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:50:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Lock "/opt/stack/data/nova/instances/31105963-52fa-4aff-9270-075cd98f08a5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:50:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:50:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.157s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:50:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Acquiring lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:50:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:50:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:50:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.189s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:50:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/31105963-52fa-4aff-9270-075cd98f08a5/disk 1073741824 {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:50:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/31105963-52fa-4aff-9270-075cd98f08a5/disk 1073741824" returned: 0 in 0.074s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:50:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:50:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:50:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.234s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:50:17 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Checking if we can resize image /opt/stack/data/nova/instances/31105963-52fa-4aff-9270-075cd98f08a5/disk. size=1073741824 {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 13:50:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31105963-52fa-4aff-9270-075cd98f08a5/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:50:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31105963-52fa-4aff-9270-075cd98f08a5/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:50:17 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Cannot resize image /opt/stack/data/nova/instances/31105963-52fa-4aff-9270-075cd98f08a5/disk to a smaller size. {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 13:50:17 user nova-compute[72129]: DEBUG nova.objects.instance [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Lazy-loading 'migration_context' on Instance uuid 31105963-52fa-4aff-9270-075cd98f08a5 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:50:17 user nova-compute[72129]: DEBUG nova.network.neutron [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] Successfully created port: a56b8b52-26f1-4e64-b02e-0e46462dfb13 {{(pid=72129) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 13:50:17 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] Created local disks {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 13:50:17 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] Ensure instance console log exists: /opt/stack/data/nova/instances/31105963-52fa-4aff-9270-075cd98f08a5/console.log {{(pid=72129) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 13:50:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:50:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:50:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:50:17 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:18 user nova-compute[72129]: DEBUG nova.network.neutron [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] Successfully updated port: a56b8b52-26f1-4e64-b02e-0e46462dfb13 {{(pid=72129) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 13:50:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Acquiring lock "refresh_cache-31105963-52fa-4aff-9270-075cd98f08a5" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:50:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Acquired lock "refresh_cache-31105963-52fa-4aff-9270-075cd98f08a5" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:50:18 user nova-compute[72129]: DEBUG nova.network.neutron [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 13:50:18 user nova-compute[72129]: DEBUG nova.compute.manager [req-1b681395-94e6-403a-a2d3-a5f28a3593d1 req-424a2c08-3fdb-41af-91dd-bd769450f65e service nova] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] Received event network-changed-a56b8b52-26f1-4e64-b02e-0e46462dfb13 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:50:18 user nova-compute[72129]: DEBUG nova.compute.manager [req-1b681395-94e6-403a-a2d3-a5f28a3593d1 req-424a2c08-3fdb-41af-91dd-bd769450f65e service nova] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] Refreshing instance network info cache due to event network-changed-a56b8b52-26f1-4e64-b02e-0e46462dfb13. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 13:50:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-1b681395-94e6-403a-a2d3-a5f28a3593d1 req-424a2c08-3fdb-41af-91dd-bd769450f65e service nova] Acquiring lock "refresh_cache-31105963-52fa-4aff-9270-075cd98f08a5" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:50:18 user nova-compute[72129]: DEBUG nova.network.neutron [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] Instance cache missing network info. {{(pid=72129) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 13:50:19 user nova-compute[72129]: DEBUG nova.network.neutron [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] Updating instance_info_cache with network_info: [{"id": "a56b8b52-26f1-4e64-b02e-0e46462dfb13", "address": "fa:16:3e:a8:fe:6c", "network": {"id": "8c424a77-2cdc-4519-bad7-e5c4498aa600", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1161619305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8fd0bc919dc4f39a702173f8be6a847", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa56b8b52-26", "ovs_interfaceid": "a56b8b52-26f1-4e64-b02e-0e46462dfb13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:50:19 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Releasing lock "refresh_cache-31105963-52fa-4aff-9270-075cd98f08a5" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:50:19 user nova-compute[72129]: DEBUG nova.compute.manager [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] Instance network_info: |[{"id": "a56b8b52-26f1-4e64-b02e-0e46462dfb13", "address": "fa:16:3e:a8:fe:6c", "network": {"id": "8c424a77-2cdc-4519-bad7-e5c4498aa600", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1161619305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8fd0bc919dc4f39a702173f8be6a847", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa56b8b52-26", "ovs_interfaceid": "a56b8b52-26f1-4e64-b02e-0e46462dfb13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 13:50:19 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-1b681395-94e6-403a-a2d3-a5f28a3593d1 req-424a2c08-3fdb-41af-91dd-bd769450f65e service nova] Acquired lock "refresh_cache-31105963-52fa-4aff-9270-075cd98f08a5" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:50:19 user nova-compute[72129]: DEBUG nova.network.neutron [req-1b681395-94e6-403a-a2d3-a5f28a3593d1 req-424a2c08-3fdb-41af-91dd-bd769450f65e service nova] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] Refreshing network info cache for port a56b8b52-26f1-4e64-b02e-0e46462dfb13 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 13:50:19 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] Start _get_guest_xml network_info=[{"id": "a56b8b52-26f1-4e64-b02e-0e46462dfb13", "address": "fa:16:3e:a8:fe:6c", "network": {"id": "8c424a77-2cdc-4519-bad7-e5c4498aa600", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1161619305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8fd0bc919dc4f39a702173f8be6a847", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa56b8b52-26", "ovs_interfaceid": "a56b8b52-26f1-4e64-b02e-0e46462dfb13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'image_id': 'b6472c34-1b0f-4034-ba3a-7e8eb5103715'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 13:50:19 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:50:19 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:50:19 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 13:50:19 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] CPU controller missing on host. {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 13:50:19 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 13:50:19 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] CPU controller found on host. {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 13:50:19 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72129) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 13:50:19 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T13:45:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 13:50:19 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Flavor limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 13:50:19 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Image limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 13:50:19 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Flavor pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 13:50:19 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Image pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 13:50:19 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 13:50:19 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 13:50:19 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 13:50:19 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Got 1 possible topologies {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 13:50:19 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 13:50:19 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 13:50:19 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:50:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-948526765',display_name='tempest-VolumesAdminNegativeTest-server-948526765',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-948526765',id=5,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDvTmdR3quxrqaiFn45V0Zn2r/L9WMPB0u32Ivu6QbOlnFhjdHNWzSebHlCs67MJfiIDDtM1t045ql0JSTR8D3izyDKWjb3GzGFOTJphl4HPbjAxOzT8ciKpPTL0RGrgng==',key_name='tempest-keypair-1982435248',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e8fd0bc919dc4f39a702173f8be6a847',ramdisk_id='',reservation_id='r-lc6aobxb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1822759437',owner_user_name='tempest-VolumesAdminNegativeTest-1822759437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:50:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='42662c28ee804a399b2ba6467e3c3926',uuid=31105963-52fa-4aff-9270-075cd98f08a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a56b8b52-26f1-4e64-b02e-0e46462dfb13", "address": "fa:16:3e:a8:fe:6c", "network": {"id": "8c424a77-2cdc-4519-bad7-e5c4498aa600", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1161619305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8fd0bc919dc4f39a702173f8be6a847", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa56b8b52-26", "ovs_interfaceid": "a56b8b52-26f1-4e64-b02e-0e46462dfb13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 13:50:19 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Converting VIF {"id": "a56b8b52-26f1-4e64-b02e-0e46462dfb13", "address": "fa:16:3e:a8:fe:6c", "network": {"id": "8c424a77-2cdc-4519-bad7-e5c4498aa600", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1161619305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8fd0bc919dc4f39a702173f8be6a847", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa56b8b52-26", "ovs_interfaceid": "a56b8b52-26f1-4e64-b02e-0e46462dfb13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:50:19 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:fe:6c,bridge_name='br-int',has_traffic_filtering=True,id=a56b8b52-26f1-4e64-b02e-0e46462dfb13,network=Network(8c424a77-2cdc-4519-bad7-e5c4498aa600),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa56b8b52-26') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:50:19 user nova-compute[72129]: DEBUG nova.objects.instance [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Lazy-loading 'pci_devices' on Instance uuid 31105963-52fa-4aff-9270-075cd98f08a5 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:50:19 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] End _get_guest_xml xml=<domain type="kvm">
Aug 01 13:50:19 user nova-compute[72129]:   <uuid>31105963-52fa-4aff-9270-075cd98f08a5</uuid>
Aug 01 13:50:19 user nova-compute[72129]:   <name>instance-00000005</name>
Aug 01 13:50:19 user nova-compute[72129]:   <memory>524288</memory>
Aug 01 13:50:19 user nova-compute[72129]:   <vcpu>1</vcpu>
Aug 01 13:50:19 user nova-compute[72129]:   <metadata>
Aug 01 13:50:19 user nova-compute[72129]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 13:50:19 user nova-compute[72129]:       <nova:package version="0.0.0"/>
Aug 01 13:50:19 user nova-compute[72129]:       <nova:name>tempest-VolumesAdminNegativeTest-server-948526765</nova:name>
Aug 01 13:50:19 user nova-compute[72129]:       <nova:creationTime>2023-08-01 13:50:19</nova:creationTime>
Aug 01 13:50:19 user nova-compute[72129]:       <nova:flavor name="m1.tiny">
Aug 01 13:50:19 user nova-compute[72129]:         <nova:memory>512</nova:memory>
Aug 01 13:50:19 user nova-compute[72129]:         <nova:disk>1</nova:disk>
Aug 01 13:50:19 user nova-compute[72129]:         <nova:swap>0</nova:swap>
Aug 01 13:50:19 user nova-compute[72129]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 13:50:19 user nova-compute[72129]:         <nova:vcpus>1</nova:vcpus>
Aug 01 13:50:19 user nova-compute[72129]:       </nova:flavor>
Aug 01 13:50:19 user nova-compute[72129]:       <nova:owner>
Aug 01 13:50:19 user nova-compute[72129]:         <nova:user uuid="42662c28ee804a399b2ba6467e3c3926">tempest-VolumesAdminNegativeTest-1822759437-project-member</nova:user>
Aug 01 13:50:19 user nova-compute[72129]:         <nova:project uuid="e8fd0bc919dc4f39a702173f8be6a847">tempest-VolumesAdminNegativeTest-1822759437</nova:project>
Aug 01 13:50:19 user nova-compute[72129]:       </nova:owner>
Aug 01 13:50:19 user nova-compute[72129]:       <nova:root type="image" uuid="b6472c34-1b0f-4034-ba3a-7e8eb5103715"/>
Aug 01 13:50:19 user nova-compute[72129]:       <nova:ports>
Aug 01 13:50:19 user nova-compute[72129]:         <nova:port uuid="a56b8b52-26f1-4e64-b02e-0e46462dfb13">
Aug 01 13:50:19 user nova-compute[72129]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 01 13:50:19 user nova-compute[72129]:         </nova:port>
Aug 01 13:50:19 user nova-compute[72129]:       </nova:ports>
Aug 01 13:50:19 user nova-compute[72129]:     </nova:instance>
Aug 01 13:50:19 user nova-compute[72129]:   </metadata>
Aug 01 13:50:19 user nova-compute[72129]:   <sysinfo type="smbios">
Aug 01 13:50:19 user nova-compute[72129]:     <system>
Aug 01 13:50:19 user nova-compute[72129]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 13:50:19 user nova-compute[72129]:       <entry name="product">OpenStack Nova</entry>
Aug 01 13:50:19 user nova-compute[72129]:       <entry name="version">0.0.0</entry>
Aug 01 13:50:19 user nova-compute[72129]:       <entry name="serial">31105963-52fa-4aff-9270-075cd98f08a5</entry>
Aug 01 13:50:19 user nova-compute[72129]:       <entry name="uuid">31105963-52fa-4aff-9270-075cd98f08a5</entry>
Aug 01 13:50:19 user nova-compute[72129]:       <entry name="family">Virtual Machine</entry>
Aug 01 13:50:19 user nova-compute[72129]:     </system>
Aug 01 13:50:19 user nova-compute[72129]:   </sysinfo>
Aug 01 13:50:19 user nova-compute[72129]:   <os>
Aug 01 13:50:19 user nova-compute[72129]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 13:50:19 user nova-compute[72129]:     <boot dev="hd"/>
Aug 01 13:50:19 user nova-compute[72129]:     <smbios mode="sysinfo"/>
Aug 01 13:50:19 user nova-compute[72129]:   </os>
Aug 01 13:50:19 user nova-compute[72129]:   <features>
Aug 01 13:50:19 user nova-compute[72129]:     <acpi/>
Aug 01 13:50:19 user nova-compute[72129]:     <apic/>
Aug 01 13:50:19 user nova-compute[72129]:     <vmcoreinfo/>
Aug 01 13:50:19 user nova-compute[72129]:   </features>
Aug 01 13:50:19 user nova-compute[72129]:   <clock offset="utc">
Aug 01 13:50:19 user nova-compute[72129]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 13:50:19 user nova-compute[72129]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 13:50:19 user nova-compute[72129]:     <timer name="hpet" present="no"/>
Aug 01 13:50:19 user nova-compute[72129]:   </clock>
Aug 01 13:50:19 user nova-compute[72129]:   <cpu mode="custom" match="exact">
Aug 01 13:50:19 user nova-compute[72129]:     <model>Nehalem</model>
Aug 01 13:50:19 user nova-compute[72129]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 13:50:19 user nova-compute[72129]:   </cpu>
Aug 01 13:50:19 user nova-compute[72129]:   <devices>
Aug 01 13:50:19 user nova-compute[72129]:     <disk type="file" device="disk">
Aug 01 13:50:19 user nova-compute[72129]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 13:50:19 user nova-compute[72129]:       <source file="/opt/stack/data/nova/instances/31105963-52fa-4aff-9270-075cd98f08a5/disk"/>
Aug 01 13:50:19 user nova-compute[72129]:       <target dev="vda" bus="virtio"/>
Aug 01 13:50:19 user nova-compute[72129]:     </disk>
Aug 01 13:50:19 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 13:50:19 user nova-compute[72129]:       <mac address="fa:16:3e:a8:fe:6c"/>
Aug 01 13:50:19 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 13:50:19 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 13:50:19 user nova-compute[72129]:       <target dev="tapa56b8b52-26"/>
Aug 01 13:50:19 user nova-compute[72129]:     </interface>
Aug 01 13:50:19 user nova-compute[72129]:     <serial type="pty">
Aug 01 13:50:19 user nova-compute[72129]:       <log file="/opt/stack/data/nova/instances/31105963-52fa-4aff-9270-075cd98f08a5/console.log" append="off"/>
Aug 01 13:50:19 user nova-compute[72129]:     </serial>
Aug 01 13:50:19 user nova-compute[72129]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 13:50:19 user nova-compute[72129]:     <video>
Aug 01 13:50:19 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 13:50:19 user nova-compute[72129]:     </video>
Aug 01 13:50:19 user nova-compute[72129]:     <rng model="virtio">
Aug 01 13:50:19 user nova-compute[72129]:       <backend model="random">/dev/urandom</backend>
Aug 01 13:50:19 user nova-compute[72129]:     </rng>
Aug 01 13:50:19 user nova-compute[72129]:     <controller type="usb" index="0" model="none"/>
Aug 01 13:50:19 user nova-compute[72129]:     <memballoon model="virtio">
Aug 01 13:50:19 user nova-compute[72129]:       <stats period="10"/>
Aug 01 13:50:19 user nova-compute[72129]:     </memballoon>
Aug 01 13:50:19 user nova-compute[72129]:   </devices>
Aug 01 13:50:19 user nova-compute[72129]: </domain>
Aug 01 13:50:19 user nova-compute[72129]:  {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 13:50:19 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:50:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-948526765',display_name='tempest-VolumesAdminNegativeTest-server-948526765',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-948526765',id=5,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDvTmdR3quxrqaiFn45V0Zn2r/L9WMPB0u32Ivu6QbOlnFhjdHNWzSebHlCs67MJfiIDDtM1t045ql0JSTR8D3izyDKWjb3GzGFOTJphl4HPbjAxOzT8ciKpPTL0RGrgng==',key_name='tempest-keypair-1982435248',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e8fd0bc919dc4f39a702173f8be6a847',ramdisk_id='',reservation_id='r-lc6aobxb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1822759437',owner_user_name='tempest-VolumesAdminNegativeTest-1822759437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:50:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='42662c28ee804a399b2ba6467e3c3926',uuid=31105963-52fa-4aff-9270-075cd98f08a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a56b8b52-26f1-4e64-b02e-0e46462dfb13", "address": "fa:16:3e:a8:fe:6c", "network": {"id": "8c424a77-2cdc-4519-bad7-e5c4498aa600", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1161619305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8fd0bc919dc4f39a702173f8be6a847", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa56b8b52-26", "ovs_interfaceid": "a56b8b52-26f1-4e64-b02e-0e46462dfb13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 13:50:19 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Converting VIF {"id": "a56b8b52-26f1-4e64-b02e-0e46462dfb13", "address": "fa:16:3e:a8:fe:6c", "network": {"id": "8c424a77-2cdc-4519-bad7-e5c4498aa600", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1161619305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8fd0bc919dc4f39a702173f8be6a847", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa56b8b52-26", "ovs_interfaceid": "a56b8b52-26f1-4e64-b02e-0e46462dfb13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:50:19 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:fe:6c,bridge_name='br-int',has_traffic_filtering=True,id=a56b8b52-26f1-4e64-b02e-0e46462dfb13,network=Network(8c424a77-2cdc-4519-bad7-e5c4498aa600),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa56b8b52-26') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:50:19 user nova-compute[72129]: DEBUG os_vif [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:fe:6c,bridge_name='br-int',has_traffic_filtering=True,id=a56b8b52-26f1-4e64-b02e-0e46462dfb13,network=Network(8c424a77-2cdc-4519-bad7-e5c4498aa600),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa56b8b52-26') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 13:50:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:50:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 13:50:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa56b8b52-26, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:50:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa56b8b52-26, col_values=(('external_ids', {'iface-id': 'a56b8b52-26f1-4e64-b02e-0e46462dfb13', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:fe:6c', 'vm-uuid': '31105963-52fa-4aff-9270-075cd98f08a5'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:50:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 13:50:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:19 user nova-compute[72129]: INFO os_vif [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:fe:6c,bridge_name='br-int',has_traffic_filtering=True,id=a56b8b52-26f1-4e64-b02e-0e46462dfb13,network=Network(8c424a77-2cdc-4519-bad7-e5c4498aa600),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa56b8b52-26')
Aug 01 13:50:19 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 13:50:19 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] No VIF found with MAC fa:16:3e:a8:fe:6c, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 13:50:20 user nova-compute[72129]: DEBUG nova.network.neutron [req-1b681395-94e6-403a-a2d3-a5f28a3593d1 req-424a2c08-3fdb-41af-91dd-bd769450f65e service nova] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] Updated VIF entry in instance network info cache for port a56b8b52-26f1-4e64-b02e-0e46462dfb13. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 13:50:20 user nova-compute[72129]: DEBUG nova.network.neutron [req-1b681395-94e6-403a-a2d3-a5f28a3593d1 req-424a2c08-3fdb-41af-91dd-bd769450f65e service nova] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] Updating instance_info_cache with network_info: [{"id": "a56b8b52-26f1-4e64-b02e-0e46462dfb13", "address": "fa:16:3e:a8:fe:6c", "network": {"id": "8c424a77-2cdc-4519-bad7-e5c4498aa600", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1161619305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8fd0bc919dc4f39a702173f8be6a847", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa56b8b52-26", "ovs_interfaceid": "a56b8b52-26f1-4e64-b02e-0e46462dfb13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:50:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-1b681395-94e6-403a-a2d3-a5f28a3593d1 req-424a2c08-3fdb-41af-91dd-bd769450f65e service nova] Releasing lock "refresh_cache-31105963-52fa-4aff-9270-075cd98f08a5" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:50:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:21 user nova-compute[72129]: DEBUG nova.compute.manager [req-b4bfb1f9-f165-45ed-bf7e-bf65e51131b9 req-eeaae634-7237-4cca-a5e6-b26d4a4ebf42 service nova] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] Received event network-vif-plugged-a56b8b52-26f1-4e64-b02e-0e46462dfb13 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:50:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-b4bfb1f9-f165-45ed-bf7e-bf65e51131b9 req-eeaae634-7237-4cca-a5e6-b26d4a4ebf42 service nova] Acquiring lock "31105963-52fa-4aff-9270-075cd98f08a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:50:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-b4bfb1f9-f165-45ed-bf7e-bf65e51131b9 req-eeaae634-7237-4cca-a5e6-b26d4a4ebf42 service nova] Lock "31105963-52fa-4aff-9270-075cd98f08a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:50:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-b4bfb1f9-f165-45ed-bf7e-bf65e51131b9 req-eeaae634-7237-4cca-a5e6-b26d4a4ebf42 service nova] Lock "31105963-52fa-4aff-9270-075cd98f08a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:50:21 user nova-compute[72129]: DEBUG nova.compute.manager [req-b4bfb1f9-f165-45ed-bf7e-bf65e51131b9 req-eeaae634-7237-4cca-a5e6-b26d4a4ebf42 service nova] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] No waiting events found dispatching network-vif-plugged-a56b8b52-26f1-4e64-b02e-0e46462dfb13 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:50:21 user nova-compute[72129]: WARNING nova.compute.manager [req-b4bfb1f9-f165-45ed-bf7e-bf65e51131b9 req-eeaae634-7237-4cca-a5e6-b26d4a4ebf42 service nova] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] Received unexpected event network-vif-plugged-a56b8b52-26f1-4e64-b02e-0e46462dfb13 for instance with vm_state building and task_state spawning.
Aug 01 13:50:22 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Acquiring lock "78b77b93-6f25-447f-80a7-d64374fee14d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:50:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Lock "78b77b93-6f25-447f-80a7-d64374fee14d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:50:22 user nova-compute[72129]: DEBUG nova.compute.manager [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] Starting instance... {{(pid=72129) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 13:50:22 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:50:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:50:22 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72129) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 13:50:22 user nova-compute[72129]: INFO nova.compute.claims [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] Claim successful on node user
Aug 01 13:50:22 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:22 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:22 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 13:50:22 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 13:50:23 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.760s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:50:23 user nova-compute[72129]: DEBUG nova.compute.manager [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] Start building networks asynchronously for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 13:50:23 user nova-compute[72129]: DEBUG nova.compute.manager [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] Allocating IP information in the background. {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 13:50:23 user nova-compute[72129]: DEBUG nova.network.neutron [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] allocate_for_instance() {{(pid=72129) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 13:50:23 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Aug 01 13:50:23 user nova-compute[72129]: DEBUG nova.compute.manager [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] Start building block device mappings for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 13:50:23 user nova-compute[72129]: DEBUG nova.policy [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cc93ae7498d64699b3fbd76cacb94cd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b05bc50bbd461296d701a4b3a58edc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72129) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 13:50:23 user nova-compute[72129]: DEBUG nova.compute.manager [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] Start spawning the instance on the hypervisor. {{(pid=72129) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 13:50:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] Creating instance directory {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 13:50:23 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] Creating image(s)
Aug 01 13:50:23 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Acquiring lock "/opt/stack/data/nova/instances/78b77b93-6f25-447f-80a7-d64374fee14d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:50:23 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Lock "/opt/stack/data/nova/instances/78b77b93-6f25-447f-80a7-d64374fee14d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:50:23 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Lock "/opt/stack/data/nova/instances/78b77b93-6f25-447f-80a7-d64374fee14d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:50:23 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Acquiring lock "4c85195f9633235cb138a12b8940a80f69ff2671" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:50:23 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Lock "4c85195f9633235cb138a12b8940a80f69ff2671" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:50:23 user nova-compute[72129]: DEBUG nova.compute.manager [req-5e9d8413-0606-4b05-9918-0f92a1ced902 req-57bebf35-20be-4005-aa53-13a545819a1f service nova] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] Received event network-vif-plugged-a56b8b52-26f1-4e64-b02e-0e46462dfb13 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:50:23 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-5e9d8413-0606-4b05-9918-0f92a1ced902 req-57bebf35-20be-4005-aa53-13a545819a1f service nova] Acquiring lock "31105963-52fa-4aff-9270-075cd98f08a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:50:23 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-5e9d8413-0606-4b05-9918-0f92a1ced902 req-57bebf35-20be-4005-aa53-13a545819a1f service nova] Lock "31105963-52fa-4aff-9270-075cd98f08a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:50:23 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-5e9d8413-0606-4b05-9918-0f92a1ced902 req-57bebf35-20be-4005-aa53-13a545819a1f service nova] Lock "31105963-52fa-4aff-9270-075cd98f08a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:50:23 user nova-compute[72129]: DEBUG nova.compute.manager [req-5e9d8413-0606-4b05-9918-0f92a1ced902 req-57bebf35-20be-4005-aa53-13a545819a1f service nova] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] No waiting events found dispatching network-vif-plugged-a56b8b52-26f1-4e64-b02e-0e46462dfb13 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:50:23 user nova-compute[72129]: WARNING nova.compute.manager [req-5e9d8413-0606-4b05-9918-0f92a1ced902 req-57bebf35-20be-4005-aa53-13a545819a1f service nova] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] Received unexpected event network-vif-plugged-a56b8b52-26f1-4e64-b02e-0e46462dfb13 for instance with vm_state building and task_state spawning.
Aug 01 13:50:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4c85195f9633235cb138a12b8940a80f69ff2671.part --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:50:24 user nova-compute[72129]: DEBUG nova.compute.manager [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] Instance event wait completed in 0 seconds for  {{(pid=72129) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 13:50:24 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] Guest created on hypervisor {{(pid=72129) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 13:50:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4c85195f9633235cb138a12b8940a80f69ff2671.part --force-share --output=json" returned: 0 in 0.181s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:50:24 user nova-compute[72129]: DEBUG nova.virt.images [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] 6854a249-a918-42d1-ba04-b804de43a465 was qcow2, converting to raw {{(pid=72129) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 13:50:24 user nova-compute[72129]: DEBUG nova.privsep.utils [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72129) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 13:50:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4c85195f9633235cb138a12b8940a80f69ff2671.part /opt/stack/data/nova/instances/_base/4c85195f9633235cb138a12b8940a80f69ff2671.converted {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:50:24 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690897824.245087, 31105963-52fa-4aff-9270-075cd98f08a5 => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:50:24 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] VM Resumed (Lifecycle Event)
Aug 01 13:50:24 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] Instance spawned successfully.
Aug 01 13:50:24 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 13:50:24 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] Found default for hw_cdrom_bus of ide {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:50:24 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] Found default for hw_disk_bus of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:50:24 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] Found default for hw_input_bus of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:50:24 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] Found default for hw_pointer_model of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:50:24 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] Found default for hw_video_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:50:24 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] Found default for hw_vif_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:50:24 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:50:24 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 13:50:24 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 13:50:24 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690897824.2494113, 31105963-52fa-4aff-9270-075cd98f08a5 => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:50:24 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] VM Started (Lifecycle Event)
Aug 01 13:50:24 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:24 user nova-compute[72129]: INFO nova.compute.manager [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] Took 7.99 seconds to spawn the instance on the hypervisor.
Aug 01 13:50:24 user nova-compute[72129]: DEBUG nova.compute.manager [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:50:24 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:50:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4c85195f9633235cb138a12b8940a80f69ff2671.part /opt/stack/data/nova/instances/_base/4c85195f9633235cb138a12b8940a80f69ff2671.converted" returned: 0 in 0.313s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:50:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4c85195f9633235cb138a12b8940a80f69ff2671.converted --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:50:24 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 13:50:24 user nova-compute[72129]: INFO nova.compute.manager [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] Took 9.36 seconds to build instance.
Aug 01 13:50:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-f29b7555-8032-44a3-9a8c-cc4455926b45 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Lock "31105963-52fa-4aff-9270-075cd98f08a5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.582s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:50:24 user nova-compute[72129]: DEBUG nova.network.neutron [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] Successfully created port: 31519672-974b-48c8-a361-e36ef1177d4e {{(pid=72129) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 13:50:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4c85195f9633235cb138a12b8940a80f69ff2671.converted --force-share --output=json" returned: 0 in 0.196s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:50:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Lock "4c85195f9633235cb138a12b8940a80f69ff2671" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.471s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:50:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4c85195f9633235cb138a12b8940a80f69ff2671 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:50:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4c85195f9633235cb138a12b8940a80f69ff2671 --force-share --output=json" returned: 0 in 0.171s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:50:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Acquiring lock "4c85195f9633235cb138a12b8940a80f69ff2671" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:50:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Lock "4c85195f9633235cb138a12b8940a80f69ff2671" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:50:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4c85195f9633235cb138a12b8940a80f69ff2671 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:50:25 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] Acquiring lock "0ce22ea1-b01c-47c6-b9e4-bf28aebc125c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:50:25 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] Lock "0ce22ea1-b01c-47c6-b9e4-bf28aebc125c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:50:25 user nova-compute[72129]: DEBUG nova.compute.manager [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] [instance: 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c] Starting instance... {{(pid=72129) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 13:50:25 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4c85195f9633235cb138a12b8940a80f69ff2671 --force-share --output=json" returned: 0 in 0.156s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:50:25 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4c85195f9633235cb138a12b8940a80f69ff2671,backing_fmt=raw /opt/stack/data/nova/instances/78b77b93-6f25-447f-80a7-d64374fee14d/disk 1073741824 {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:50:25 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4c85195f9633235cb138a12b8940a80f69ff2671,backing_fmt=raw /opt/stack/data/nova/instances/78b77b93-6f25-447f-80a7-d64374fee14d/disk 1073741824" returned: 0 in 0.072s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:50:25 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:25 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Lock "4c85195f9633235cb138a12b8940a80f69ff2671" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:50:25 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4c85195f9633235cb138a12b8940a80f69ff2671 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:50:25 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:50:25 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:50:25 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72129) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 13:50:25 user nova-compute[72129]: INFO nova.compute.claims [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] [instance: 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c] Claim successful on node user
Aug 01 13:50:25 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4c85195f9633235cb138a12b8940a80f69ff2671 --force-share --output=json" returned: 0 in 0.177s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:50:25 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Checking if we can resize image /opt/stack/data/nova/instances/78b77b93-6f25-447f-80a7-d64374fee14d/disk. size=1073741824 {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 13:50:25 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b77b93-6f25-447f-80a7-d64374fee14d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:50:25 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b77b93-6f25-447f-80a7-d64374fee14d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:50:25 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Cannot resize image /opt/stack/data/nova/instances/78b77b93-6f25-447f-80a7-d64374fee14d/disk to a smaller size. {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 13:50:25 user nova-compute[72129]: DEBUG nova.objects.instance [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Lazy-loading 'migration_context' on Instance uuid 78b77b93-6f25-447f-80a7-d64374fee14d {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:50:25 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] Created local disks {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 13:50:25 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] Ensure instance console log exists: /opt/stack/data/nova/instances/78b77b93-6f25-447f-80a7-d64374fee14d/console.log {{(pid=72129) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 13:50:25 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:50:25 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:50:25 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:50:25 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 13:50:25 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 13:50:25 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.569s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:50:25 user nova-compute[72129]: DEBUG nova.compute.manager [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] [instance: 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c] Start building networks asynchronously for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 13:50:25 user nova-compute[72129]: DEBUG nova.network.neutron [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] Successfully updated port: 31519672-974b-48c8-a361-e36ef1177d4e {{(pid=72129) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 13:50:25 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Acquiring lock "refresh_cache-78b77b93-6f25-447f-80a7-d64374fee14d" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:50:25 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Acquired lock "refresh_cache-78b77b93-6f25-447f-80a7-d64374fee14d" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:50:25 user nova-compute[72129]: DEBUG nova.network.neutron [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 13:50:25 user nova-compute[72129]: DEBUG nova.compute.manager [req-ff9596ee-3382-47b8-8225-b39060a4f330 req-9cce7735-2b4e-4060-b8a6-d1e92c2c4dab service nova] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] Received event network-changed-31519672-974b-48c8-a361-e36ef1177d4e {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:50:25 user nova-compute[72129]: DEBUG nova.compute.manager [req-ff9596ee-3382-47b8-8225-b39060a4f330 req-9cce7735-2b4e-4060-b8a6-d1e92c2c4dab service nova] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] Refreshing instance network info cache due to event network-changed-31519672-974b-48c8-a361-e36ef1177d4e. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 13:50:25 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ff9596ee-3382-47b8-8225-b39060a4f330 req-9cce7735-2b4e-4060-b8a6-d1e92c2c4dab service nova] Acquiring lock "refresh_cache-78b77b93-6f25-447f-80a7-d64374fee14d" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:50:25 user nova-compute[72129]: DEBUG nova.compute.manager [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] [instance: 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c] Allocating IP information in the background. {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 13:50:25 user nova-compute[72129]: DEBUG nova.network.neutron [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] [instance: 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c] allocate_for_instance() {{(pid=72129) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 13:50:25 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] [instance: 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 13:50:26 user nova-compute[72129]: DEBUG nova.compute.manager [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] [instance: 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c] Start building block device mappings for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 13:50:26 user nova-compute[72129]: DEBUG nova.network.neutron [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] Instance cache missing network info. {{(pid=72129) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 13:50:26 user nova-compute[72129]: DEBUG nova.policy [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6a2f94718731466aa9d2b7fad712cee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c98827f5c4643448756c4f155066c4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72129) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 13:50:26 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Acquiring lock "3c1f751a-e2aa-4447-b72f-9dc88c4c1a84" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:50:26 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Lock "3c1f751a-e2aa-4447-b72f-9dc88c4c1a84" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:50:26 user nova-compute[72129]: DEBUG nova.compute.manager [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Starting instance... {{(pid=72129) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 13:50:26 user nova-compute[72129]: DEBUG nova.compute.manager [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] [instance: 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c] Start spawning the instance on the hypervisor. {{(pid=72129) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 13:50:26 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] [instance: 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c] Creating instance directory {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 13:50:26 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] [instance: 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c] Creating image(s)
Aug 01 13:50:26 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] Acquiring lock "/opt/stack/data/nova/instances/0ce22ea1-b01c-47c6-b9e4-bf28aebc125c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:50:26 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] Lock "/opt/stack/data/nova/instances/0ce22ea1-b01c-47c6-b9e4-bf28aebc125c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:50:26 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] Lock "/opt/stack/data/nova/instances/0ce22ea1-b01c-47c6-b9e4-bf28aebc125c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:50:26 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:50:26 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:50:26 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:50:26 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72129) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 13:50:26 user nova-compute[72129]: INFO nova.compute.claims [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Claim successful on node user
Aug 01 13:50:26 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.176s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:50:26 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] Acquiring lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:50:26 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:50:26 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:50:26 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.169s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:50:26 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/0ce22ea1-b01c-47c6-b9e4-bf28aebc125c/disk 1073741824 {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:50:26 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/0ce22ea1-b01c-47c6-b9e4-bf28aebc125c/disk 1073741824" returned: 0 in 0.050s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:50:26 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:50:26 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:50:26 user nova-compute[72129]: DEBUG nova.network.neutron [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] Updating instance_info_cache with network_info: [{"id": "31519672-974b-48c8-a361-e36ef1177d4e", "address": "fa:16:3e:4c:0e:3b", "network": {"id": "2bfb447a-e137-4844-8659-2d8d008da293", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-168024472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70b05bc50bbd461296d701a4b3a58edc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31519672-97", "ovs_interfaceid": "31519672-974b-48c8-a361-e36ef1177d4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:50:26 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Releasing lock "refresh_cache-78b77b93-6f25-447f-80a7-d64374fee14d" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:50:26 user nova-compute[72129]: DEBUG nova.compute.manager [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] Instance network_info: |[{"id": "31519672-974b-48c8-a361-e36ef1177d4e", "address": "fa:16:3e:4c:0e:3b", "network": {"id": "2bfb447a-e137-4844-8659-2d8d008da293", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-168024472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70b05bc50bbd461296d701a4b3a58edc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31519672-97", "ovs_interfaceid": "31519672-974b-48c8-a361-e36ef1177d4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 13:50:26 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ff9596ee-3382-47b8-8225-b39060a4f330 req-9cce7735-2b4e-4060-b8a6-d1e92c2c4dab service nova] Acquired lock "refresh_cache-78b77b93-6f25-447f-80a7-d64374fee14d" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:50:26 user nova-compute[72129]: DEBUG nova.network.neutron [req-ff9596ee-3382-47b8-8225-b39060a4f330 req-9cce7735-2b4e-4060-b8a6-d1e92c2c4dab service nova] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] Refreshing network info cache for port 31519672-974b-48c8-a361-e36ef1177d4e {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 13:50:26 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] Start _get_guest_xml network_info=[{"id": "31519672-974b-48c8-a361-e36ef1177d4e", "address": "fa:16:3e:4c:0e:3b", "network": {"id": "2bfb447a-e137-4844-8659-2d8d008da293", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-168024472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70b05bc50bbd461296d701a4b3a58edc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31519672-97", "ovs_interfaceid": "31519672-974b-48c8-a361-e36ef1177d4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:50:13Z,direct_url=<?>,disk_format='qcow2',id=6854a249-a918-42d1-ba04-b804de43a465,min_disk=0,min_ram=0,name='',owner='b19c88ff44024350ad8766c2e4a8f3b7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:50:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'boot_index': 0, 'device_name': '/dev/sda', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'disk_bus': 'scsi', 'size': 0, 'image_id': '6854a249-a918-42d1-ba04-b804de43a465'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 13:50:26 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:50:26 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:50:26 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 13:50:26 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] CPU controller missing on host. {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 13:50:26 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 13:50:26 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] CPU controller found on host. {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 13:50:26 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72129) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 13:50:26 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T13:45:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:50:13Z,direct_url=<?>,disk_format='qcow2',id=6854a249-a918-42d1-ba04-b804de43a465,min_disk=0,min_ram=0,name='',owner='b19c88ff44024350ad8766c2e4a8f3b7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:50:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 13:50:26 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Flavor limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 13:50:26 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Image limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 13:50:26 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Flavor pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 13:50:26 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Image pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 13:50:26 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 13:50:26 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 13:50:26 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 13:50:26 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Got 1 possible topologies {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 13:50:26 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 13:50:26 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 13:50:26 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T13:50:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1874739145',display_name='tempest-AttachSCSIVolumeTestJSON-server-1874739145',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1874739145',id=6,image_ref='6854a249-a918-42d1-ba04-b804de43a465',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzyL1bToxqc1hbexph3GbnXjiGaTrpfZqwZA2ih43noBPQ5JFRGckVi7zGChnA7fYGHpAJ6ft2MiR8Uv4wYWcw+5QnVtjIPbX949zQIlYwg3ygtbSeGr5jjiqAbyzrTWw==',key_name='tempest-keypair-338556798',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70b05bc50bbd461296d701a4b3a58edc',ramdisk_id='',reservation_id='r-t0eq4f0y',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6854a249-a918-42d1-ba04-b804de43a465',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1269943649',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1269943649-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:50:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc93ae7498d64699b3fbd76cacb94cd4',uuid=78b77b93-6f25-447f-80a7-d64374fee14d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "31519672-974b-48c8-a361-e36ef1177d4e", "address": "fa:16:3e:4c:0e:3b", "network": {"id": "2bfb447a-e137-4844-8659-2d8d008da293", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-168024472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70b05bc50bbd461296d701a4b3a58edc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31519672-97", "ovs_interfaceid": "31519672-974b-48c8-a361-e36ef1177d4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 13:50:26 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Converting VIF {"id": "31519672-974b-48c8-a361-e36ef1177d4e", "address": "fa:16:3e:4c:0e:3b", "network": {"id": "2bfb447a-e137-4844-8659-2d8d008da293", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-168024472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70b05bc50bbd461296d701a4b3a58edc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31519672-97", "ovs_interfaceid": "31519672-974b-48c8-a361-e36ef1177d4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:50:26 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:0e:3b,bridge_name='br-int',has_traffic_filtering=True,id=31519672-974b-48c8-a361-e36ef1177d4e,network=Network(2bfb447a-e137-4844-8659-2d8d008da293),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31519672-97') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:50:26 user nova-compute[72129]: DEBUG nova.objects.instance [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Lazy-loading 'pci_devices' on Instance uuid 78b77b93-6f25-447f-80a7-d64374fee14d {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:50:26 user nova-compute[72129]: DEBUG nova.network.neutron [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] [instance: 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c] Successfully created port: 9d5e1d9d-528d-460c-9bd0-c35925eba4d5 {{(pid=72129) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 13:50:26 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.264s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:50:26 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0ce22ea1-b01c-47c6-b9e4-bf28aebc125c/disk. size=1073741824 {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 13:50:26 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ce22ea1-b01c-47c6-b9e4-bf28aebc125c/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:50:26 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] End _get_guest_xml xml=<domain type="kvm">
Aug 01 13:50:26 user nova-compute[72129]:   <uuid>78b77b93-6f25-447f-80a7-d64374fee14d</uuid>
Aug 01 13:50:26 user nova-compute[72129]:   <name>instance-00000006</name>
Aug 01 13:50:26 user nova-compute[72129]:   <memory>524288</memory>
Aug 01 13:50:26 user nova-compute[72129]:   <vcpu>1</vcpu>
Aug 01 13:50:26 user nova-compute[72129]:   <metadata>
Aug 01 13:50:26 user nova-compute[72129]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 13:50:26 user nova-compute[72129]:       <nova:package version="0.0.0"/>
Aug 01 13:50:26 user nova-compute[72129]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1874739145</nova:name>
Aug 01 13:50:26 user nova-compute[72129]:       <nova:creationTime>2023-08-01 13:50:26</nova:creationTime>
Aug 01 13:50:26 user nova-compute[72129]:       <nova:flavor name="m1.tiny">
Aug 01 13:50:26 user nova-compute[72129]:         <nova:memory>512</nova:memory>
Aug 01 13:50:26 user nova-compute[72129]:         <nova:disk>1</nova:disk>
Aug 01 13:50:26 user nova-compute[72129]:         <nova:swap>0</nova:swap>
Aug 01 13:50:26 user nova-compute[72129]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 13:50:26 user nova-compute[72129]:         <nova:vcpus>1</nova:vcpus>
Aug 01 13:50:26 user nova-compute[72129]:       </nova:flavor>
Aug 01 13:50:26 user nova-compute[72129]:       <nova:owner>
Aug 01 13:50:26 user nova-compute[72129]:         <nova:user uuid="cc93ae7498d64699b3fbd76cacb94cd4">tempest-AttachSCSIVolumeTestJSON-1269943649-project-member</nova:user>
Aug 01 13:50:26 user nova-compute[72129]:         <nova:project uuid="70b05bc50bbd461296d701a4b3a58edc">tempest-AttachSCSIVolumeTestJSON-1269943649</nova:project>
Aug 01 13:50:26 user nova-compute[72129]:       </nova:owner>
Aug 01 13:50:26 user nova-compute[72129]:       <nova:root type="image" uuid="6854a249-a918-42d1-ba04-b804de43a465"/>
Aug 01 13:50:26 user nova-compute[72129]:       <nova:ports>
Aug 01 13:50:26 user nova-compute[72129]:         <nova:port uuid="31519672-974b-48c8-a361-e36ef1177d4e">
Aug 01 13:50:26 user nova-compute[72129]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 01 13:50:26 user nova-compute[72129]:         </nova:port>
Aug 01 13:50:26 user nova-compute[72129]:       </nova:ports>
Aug 01 13:50:26 user nova-compute[72129]:     </nova:instance>
Aug 01 13:50:26 user nova-compute[72129]:   </metadata>
Aug 01 13:50:26 user nova-compute[72129]:   <sysinfo type="smbios">
Aug 01 13:50:26 user nova-compute[72129]:     <system>
Aug 01 13:50:26 user nova-compute[72129]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 13:50:26 user nova-compute[72129]:       <entry name="product">OpenStack Nova</entry>
Aug 01 13:50:26 user nova-compute[72129]:       <entry name="version">0.0.0</entry>
Aug 01 13:50:26 user nova-compute[72129]:       <entry name="serial">78b77b93-6f25-447f-80a7-d64374fee14d</entry>
Aug 01 13:50:26 user nova-compute[72129]:       <entry name="uuid">78b77b93-6f25-447f-80a7-d64374fee14d</entry>
Aug 01 13:50:26 user nova-compute[72129]:       <entry name="family">Virtual Machine</entry>
Aug 01 13:50:26 user nova-compute[72129]:     </system>
Aug 01 13:50:26 user nova-compute[72129]:   </sysinfo>
Aug 01 13:50:26 user nova-compute[72129]:   <os>
Aug 01 13:50:26 user nova-compute[72129]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 13:50:26 user nova-compute[72129]:     <boot dev="hd"/>
Aug 01 13:50:26 user nova-compute[72129]:     <smbios mode="sysinfo"/>
Aug 01 13:50:26 user nova-compute[72129]:   </os>
Aug 01 13:50:26 user nova-compute[72129]:   <features>
Aug 01 13:50:26 user nova-compute[72129]:     <acpi/>
Aug 01 13:50:26 user nova-compute[72129]:     <apic/>
Aug 01 13:50:26 user nova-compute[72129]:     <vmcoreinfo/>
Aug 01 13:50:26 user nova-compute[72129]:   </features>
Aug 01 13:50:26 user nova-compute[72129]:   <clock offset="utc">
Aug 01 13:50:26 user nova-compute[72129]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 13:50:26 user nova-compute[72129]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 13:50:26 user nova-compute[72129]:     <timer name="hpet" present="no"/>
Aug 01 13:50:26 user nova-compute[72129]:   </clock>
Aug 01 13:50:26 user nova-compute[72129]:   <cpu mode="custom" match="exact">
Aug 01 13:50:26 user nova-compute[72129]:     <model>Nehalem</model>
Aug 01 13:50:26 user nova-compute[72129]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 13:50:26 user nova-compute[72129]:   </cpu>
Aug 01 13:50:26 user nova-compute[72129]:   <devices>
Aug 01 13:50:26 user nova-compute[72129]:     <disk type="file" device="disk">
Aug 01 13:50:26 user nova-compute[72129]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 13:50:26 user nova-compute[72129]:       <source file="/opt/stack/data/nova/instances/78b77b93-6f25-447f-80a7-d64374fee14d/disk"/>
Aug 01 13:50:26 user nova-compute[72129]:       <target dev="sda" bus="scsi"/>
Aug 01 13:50:26 user nova-compute[72129]:       <address type="drive" controller="0" unit="0"/>
Aug 01 13:50:26 user nova-compute[72129]:     </disk>
Aug 01 13:50:26 user nova-compute[72129]:     <disk type="file" device="cdrom">
Aug 01 13:50:26 user nova-compute[72129]:       <driver name="qemu" type="raw" cache="none"/>
Aug 01 13:50:26 user nova-compute[72129]:       <source file="/opt/stack/data/nova/instances/78b77b93-6f25-447f-80a7-d64374fee14d/disk.config"/>
Aug 01 13:50:26 user nova-compute[72129]:       <target dev="sdb" bus="scsi"/>
Aug 01 13:50:26 user nova-compute[72129]:       <address type="drive" controller="0" unit="1"/>
Aug 01 13:50:26 user nova-compute[72129]:     </disk>
Aug 01 13:50:26 user nova-compute[72129]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Aug 01 13:50:26 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 13:50:26 user nova-compute[72129]:       <mac address="fa:16:3e:4c:0e:3b"/>
Aug 01 13:50:26 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 13:50:26 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 13:50:26 user nova-compute[72129]:       <target dev="tap31519672-97"/>
Aug 01 13:50:26 user nova-compute[72129]:     </interface>
Aug 01 13:50:26 user nova-compute[72129]:     <serial type="pty">
Aug 01 13:50:26 user nova-compute[72129]:       <log file="/opt/stack/data/nova/instances/78b77b93-6f25-447f-80a7-d64374fee14d/console.log" append="off"/>
Aug 01 13:50:26 user nova-compute[72129]:     </serial>
Aug 01 13:50:26 user nova-compute[72129]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 13:50:26 user nova-compute[72129]:     <video>
Aug 01 13:50:26 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 13:50:26 user nova-compute[72129]:     </video>
Aug 01 13:50:26 user nova-compute[72129]:     <rng model="virtio">
Aug 01 13:50:26 user nova-compute[72129]:       <backend model="random">/dev/urandom</backend>
Aug 01 13:50:26 user nova-compute[72129]:     </rng>
Aug 01 13:50:26 user nova-compute[72129]:     <controller type="usb" index="0" model="none"/>
Aug 01 13:50:26 user nova-compute[72129]:     <memballoon model="virtio">
Aug 01 13:50:26 user nova-compute[72129]:       <stats period="10"/>
Aug 01 13:50:26 user nova-compute[72129]:     </memballoon>
Aug 01 13:50:26 user nova-compute[72129]:   </devices>
Aug 01 13:50:26 user nova-compute[72129]: </domain>
Aug 01 13:50:26 user nova-compute[72129]:  {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 13:50:26 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T13:50:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1874739145',display_name='tempest-AttachSCSIVolumeTestJSON-server-1874739145',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1874739145',id=6,image_ref='6854a249-a918-42d1-ba04-b804de43a465',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzyL1bToxqc1hbexph3GbnXjiGaTrpfZqwZA2ih43noBPQ5JFRGckVi7zGChnA7fYGHpAJ6ft2MiR8Uv4wYWcw+5QnVtjIPbX949zQIlYwg3ygtbSeGr5jjiqAbyzrTWw==',key_name='tempest-keypair-338556798',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70b05bc50bbd461296d701a4b3a58edc',ramdisk_id='',reservation_id='r-t0eq4f0y',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6854a249-a918-42d1-ba04-b804de43a465',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1269943649',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1269943649-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:50:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc93ae7498d64699b3fbd76cacb94cd4',uuid=78b77b93-6f25-447f-80a7-d64374fee14d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "31519672-974b-48c8-a361-e36ef1177d4e", "address": "fa:16:3e:4c:0e:3b", "network": {"id": "2bfb447a-e137-4844-8659-2d8d008da293", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-168024472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70b05bc50bbd461296d701a4b3a58edc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31519672-97", "ovs_interfaceid": "31519672-974b-48c8-a361-e36ef1177d4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 13:50:26 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Converting VIF {"id": "31519672-974b-48c8-a361-e36ef1177d4e", "address": "fa:16:3e:4c:0e:3b", "network": {"id": "2bfb447a-e137-4844-8659-2d8d008da293", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-168024472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70b05bc50bbd461296d701a4b3a58edc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31519672-97", "ovs_interfaceid": "31519672-974b-48c8-a361-e36ef1177d4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:50:26 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:0e:3b,bridge_name='br-int',has_traffic_filtering=True,id=31519672-974b-48c8-a361-e36ef1177d4e,network=Network(2bfb447a-e137-4844-8659-2d8d008da293),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31519672-97') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:50:26 user nova-compute[72129]: DEBUG os_vif [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:0e:3b,bridge_name='br-int',has_traffic_filtering=True,id=31519672-974b-48c8-a361-e36ef1177d4e,network=Network(2bfb447a-e137-4844-8659-2d8d008da293),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31519672-97') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 13:50:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:50:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 13:50:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap31519672-97, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:50:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap31519672-97, col_values=(('external_ids', {'iface-id': '31519672-974b-48c8-a361-e36ef1177d4e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:0e:3b', 'vm-uuid': '78b77b93-6f25-447f-80a7-d64374fee14d'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:50:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 13:50:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:26 user nova-compute[72129]: INFO os_vif [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:0e:3b,bridge_name='br-int',has_traffic_filtering=True,id=31519672-974b-48c8-a361-e36ef1177d4e,network=Network(2bfb447a-e137-4844-8659-2d8d008da293),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31519672-97')
Aug 01 13:50:27 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ce22ea1-b01c-47c6-b9e4-bf28aebc125c/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:50:27 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] Cannot resize image /opt/stack/data/nova/instances/0ce22ea1-b01c-47c6-b9e4-bf28aebc125c/disk to a smaller size. {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 13:50:27 user nova-compute[72129]: DEBUG nova.objects.instance [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] Lazy-loading 'migration_context' on Instance uuid 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:50:27 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] [instance: 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c] Created local disks {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 13:50:27 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] [instance: 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c] Ensure instance console log exists: /opt/stack/data/nova/instances/0ce22ea1-b01c-47c6-b9e4-bf28aebc125c/console.log {{(pid=72129) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 13:50:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:50:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:50:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:50:27 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] No BDM found with device name sda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 13:50:27 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 13:50:27 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] No VIF found with MAC fa:16:3e:4c:0e:3b, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 13:50:27 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] Using config drive
Aug 01 13:50:27 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 13:50:27 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 13:50:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.098s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:50:27 user nova-compute[72129]: DEBUG nova.compute.manager [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Start building networks asynchronously for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 13:50:27 user nova-compute[72129]: DEBUG nova.compute.manager [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Allocating IP information in the background. {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 13:50:27 user nova-compute[72129]: DEBUG nova.network.neutron [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] allocate_for_instance() {{(pid=72129) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 13:50:27 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 13:50:27 user nova-compute[72129]: DEBUG nova.compute.manager [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Start building block device mappings for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 13:50:27 user nova-compute[72129]: DEBUG nova.network.neutron [req-ff9596ee-3382-47b8-8225-b39060a4f330 req-9cce7735-2b4e-4060-b8a6-d1e92c2c4dab service nova] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] Updated VIF entry in instance network info cache for port 31519672-974b-48c8-a361-e36ef1177d4e. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 13:50:27 user nova-compute[72129]: DEBUG nova.network.neutron [req-ff9596ee-3382-47b8-8225-b39060a4f330 req-9cce7735-2b4e-4060-b8a6-d1e92c2c4dab service nova] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] Updating instance_info_cache with network_info: [{"id": "31519672-974b-48c8-a361-e36ef1177d4e", "address": "fa:16:3e:4c:0e:3b", "network": {"id": "2bfb447a-e137-4844-8659-2d8d008da293", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-168024472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70b05bc50bbd461296d701a4b3a58edc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31519672-97", "ovs_interfaceid": "31519672-974b-48c8-a361-e36ef1177d4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:50:27 user nova-compute[72129]: DEBUG nova.compute.manager [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Start spawning the instance on the hypervisor. {{(pid=72129) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 13:50:27 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Creating instance directory {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 13:50:27 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Creating image(s)
Aug 01 13:50:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Acquiring lock "/opt/stack/data/nova/instances/3c1f751a-e2aa-4447-b72f-9dc88c4c1a84/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:50:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Lock "/opt/stack/data/nova/instances/3c1f751a-e2aa-4447-b72f-9dc88c4c1a84/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:50:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Lock "/opt/stack/data/nova/instances/3c1f751a-e2aa-4447-b72f-9dc88c4c1a84/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:50:27 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:50:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ff9596ee-3382-47b8-8225-b39060a4f330 req-9cce7735-2b4e-4060-b8a6-d1e92c2c4dab service nova] Releasing lock "refresh_cache-78b77b93-6f25-447f-80a7-d64374fee14d" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:50:27 user nova-compute[72129]: DEBUG nova.policy [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ded159a3c395418d9e4d699ed249eabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2184fb8ab16d482ea3ca397fbb5515ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72129) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 13:50:28 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] Creating config drive at /opt/stack/data/nova/instances/78b77b93-6f25-447f-80a7-d64374fee14d/disk.config
Aug 01 13:50:28 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/78b77b93-6f25-447f-80a7-d64374fee14d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp_wze7uxi {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:50:28 user nova-compute[72129]: DEBUG nova.network.neutron [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] [instance: 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c] Successfully updated port: 9d5e1d9d-528d-460c-9bd0-c35925eba4d5 {{(pid=72129) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 13:50:28 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.210s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:50:28 user nova-compute[72129]: DEBUG nova.compute.manager [req-6daea41e-3a85-4c0a-a853-56f686408b7c req-991e2911-3d2a-4428-814e-accd79f679bd service nova] [instance: 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c] Received event network-changed-9d5e1d9d-528d-460c-9bd0-c35925eba4d5 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:50:28 user nova-compute[72129]: DEBUG nova.compute.manager [req-6daea41e-3a85-4c0a-a853-56f686408b7c req-991e2911-3d2a-4428-814e-accd79f679bd service nova] [instance: 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c] Refreshing instance network info cache due to event network-changed-9d5e1d9d-528d-460c-9bd0-c35925eba4d5. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 13:50:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-6daea41e-3a85-4c0a-a853-56f686408b7c req-991e2911-3d2a-4428-814e-accd79f679bd service nova] Acquiring lock "refresh_cache-0ce22ea1-b01c-47c6-b9e4-bf28aebc125c" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:50:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-6daea41e-3a85-4c0a-a853-56f686408b7c req-991e2911-3d2a-4428-814e-accd79f679bd service nova] Acquired lock "refresh_cache-0ce22ea1-b01c-47c6-b9e4-bf28aebc125c" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:50:28 user nova-compute[72129]: DEBUG nova.network.neutron [req-6daea41e-3a85-4c0a-a853-56f686408b7c req-991e2911-3d2a-4428-814e-accd79f679bd service nova] [instance: 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c] Refreshing network info cache for port 9d5e1d9d-528d-460c-9bd0-c35925eba4d5 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 13:50:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Acquiring lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:50:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:50:28 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:50:28 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/78b77b93-6f25-447f-80a7-d64374fee14d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp_wze7uxi" returned: 0 in 0.137s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:50:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] Acquiring lock "refresh_cache-0ce22ea1-b01c-47c6-b9e4-bf28aebc125c" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:50:28 user nova-compute[72129]: DEBUG nova.network.neutron [req-6daea41e-3a85-4c0a-a853-56f686408b7c req-991e2911-3d2a-4428-814e-accd79f679bd service nova] [instance: 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c] Instance cache missing network info. {{(pid=72129) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 13:50:28 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.164s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:50:28 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/3c1f751a-e2aa-4447-b72f-9dc88c4c1a84/disk 1073741824 {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:50:28 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/3c1f751a-e2aa-4447-b72f-9dc88c4c1a84/disk 1073741824" returned: 0 in 0.049s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:50:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.219s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:50:28 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:50:28 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.167s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:50:28 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3c1f751a-e2aa-4447-b72f-9dc88c4c1a84/disk. size=1073741824 {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 13:50:28 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c1f751a-e2aa-4447-b72f-9dc88c4c1a84/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:50:28 user nova-compute[72129]: DEBUG nova.network.neutron [req-6daea41e-3a85-4c0a-a853-56f686408b7c req-991e2911-3d2a-4428-814e-accd79f679bd service nova] [instance: 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:50:28 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c1f751a-e2aa-4447-b72f-9dc88c4c1a84/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:50:28 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Cannot resize image /opt/stack/data/nova/instances/3c1f751a-e2aa-4447-b72f-9dc88c4c1a84/disk to a smaller size. {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 13:50:28 user nova-compute[72129]: DEBUG nova.objects.instance [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Lazy-loading 'migration_context' on Instance uuid 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:50:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-6daea41e-3a85-4c0a-a853-56f686408b7c req-991e2911-3d2a-4428-814e-accd79f679bd service nova] Releasing lock "refresh_cache-0ce22ea1-b01c-47c6-b9e4-bf28aebc125c" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:50:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] Acquired lock "refresh_cache-0ce22ea1-b01c-47c6-b9e4-bf28aebc125c" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:50:28 user nova-compute[72129]: DEBUG nova.network.neutron [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] [instance: 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 13:50:28 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Created local disks {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 13:50:28 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Ensure instance console log exists: /opt/stack/data/nova/instances/3c1f751a-e2aa-4447-b72f-9dc88c4c1a84/console.log {{(pid=72129) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 13:50:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:50:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:50:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:50:28 user nova-compute[72129]: DEBUG nova.network.neutron [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] [instance: 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c] Instance cache missing network info. {{(pid=72129) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 13:50:29 user nova-compute[72129]: DEBUG nova.network.neutron [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Successfully created port: 7b1167ce-d40a-4355-8411-6a1dd005465f {{(pid=72129) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 13:50:29 user nova-compute[72129]: DEBUG nova.network.neutron [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] [instance: 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c] Updating instance_info_cache with network_info: [{"id": "9d5e1d9d-528d-460c-9bd0-c35925eba4d5", "address": "fa:16:3e:95:b4:31", "network": {"id": "645f47df-6143-48ce-880f-38bacfbfd6a8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1771698777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c98827f5c4643448756c4f155066c4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d5e1d9d-52", "ovs_interfaceid": "9d5e1d9d-528d-460c-9bd0-c35925eba4d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:50:29 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] Releasing lock "refresh_cache-0ce22ea1-b01c-47c6-b9e4-bf28aebc125c" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:50:29 user nova-compute[72129]: DEBUG nova.compute.manager [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] [instance: 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c] Instance network_info: |[{"id": "9d5e1d9d-528d-460c-9bd0-c35925eba4d5", "address": "fa:16:3e:95:b4:31", "network": {"id": "645f47df-6143-48ce-880f-38bacfbfd6a8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1771698777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c98827f5c4643448756c4f155066c4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d5e1d9d-52", "ovs_interfaceid": "9d5e1d9d-528d-460c-9bd0-c35925eba4d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 13:50:29 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] [instance: 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c] Start _get_guest_xml network_info=[{"id": "9d5e1d9d-528d-460c-9bd0-c35925eba4d5", "address": "fa:16:3e:95:b4:31", "network": {"id": "645f47df-6143-48ce-880f-38bacfbfd6a8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1771698777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c98827f5c4643448756c4f155066c4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d5e1d9d-52", "ovs_interfaceid": "9d5e1d9d-528d-460c-9bd0-c35925eba4d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'image_id': 'b6472c34-1b0f-4034-ba3a-7e8eb5103715'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 13:50:29 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:50:29 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:50:29 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 13:50:29 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] CPU controller missing on host. {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 13:50:29 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 13:50:29 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] CPU controller found on host. {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 13:50:29 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72129) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 13:50:29 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T13:45:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 13:50:29 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] Flavor limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 13:50:29 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] Image limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 13:50:29 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] Flavor pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 13:50:29 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] Image pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 13:50:29 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 13:50:29 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 13:50:29 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 13:50:29 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] Got 1 possible topologies {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 13:50:29 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 13:50:29 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 13:50:29 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:50:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-687052976',display_name='tempest-VolumesActionsTest-instance-687052976',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-687052976',id=7,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c98827f5c4643448756c4f155066c4f',ramdisk_id='',reservation_id='r-pnxdvoix',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1598482940',owner_user_name='tempest-VolumesActionsTest-1598482940-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:50:26Z,user_data=None,user_id='6a2f94718731466aa9d2b7fad712cee4',uuid=0ce22ea1-b01c-47c6-b9e4-bf28aebc125c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d5e1d9d-528d-460c-9bd0-c35925eba4d5", "address": "fa:16:3e:95:b4:31", "network": {"id": "645f47df-6143-48ce-880f-38bacfbfd6a8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1771698777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c98827f5c4643448756c4f155066c4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d5e1d9d-52", "ovs_interfaceid": "9d5e1d9d-528d-460c-9bd0-c35925eba4d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 13:50:29 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] Converting VIF {"id": "9d5e1d9d-528d-460c-9bd0-c35925eba4d5", "address": "fa:16:3e:95:b4:31", "network": {"id": "645f47df-6143-48ce-880f-38bacfbfd6a8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1771698777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c98827f5c4643448756c4f155066c4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d5e1d9d-52", "ovs_interfaceid": "9d5e1d9d-528d-460c-9bd0-c35925eba4d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:50:29 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:b4:31,bridge_name='br-int',has_traffic_filtering=True,id=9d5e1d9d-528d-460c-9bd0-c35925eba4d5,network=Network(645f47df-6143-48ce-880f-38bacfbfd6a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d5e1d9d-52') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:50:29 user nova-compute[72129]: DEBUG nova.objects.instance [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] Lazy-loading 'pci_devices' on Instance uuid 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:50:29 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] [instance: 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c] End _get_guest_xml xml=<domain type="kvm">
Aug 01 13:50:29 user nova-compute[72129]:   <uuid>0ce22ea1-b01c-47c6-b9e4-bf28aebc125c</uuid>
Aug 01 13:50:29 user nova-compute[72129]:   <name>instance-00000007</name>
Aug 01 13:50:29 user nova-compute[72129]:   <memory>524288</memory>
Aug 01 13:50:29 user nova-compute[72129]:   <vcpu>1</vcpu>
Aug 01 13:50:29 user nova-compute[72129]:   <metadata>
Aug 01 13:50:29 user nova-compute[72129]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 13:50:29 user nova-compute[72129]:       <nova:package version="0.0.0"/>
Aug 01 13:50:29 user nova-compute[72129]:       <nova:name>tempest-VolumesActionsTest-instance-687052976</nova:name>
Aug 01 13:50:29 user nova-compute[72129]:       <nova:creationTime>2023-08-01 13:50:29</nova:creationTime>
Aug 01 13:50:29 user nova-compute[72129]:       <nova:flavor name="m1.tiny">
Aug 01 13:50:29 user nova-compute[72129]:         <nova:memory>512</nova:memory>
Aug 01 13:50:29 user nova-compute[72129]:         <nova:disk>1</nova:disk>
Aug 01 13:50:29 user nova-compute[72129]:         <nova:swap>0</nova:swap>
Aug 01 13:50:29 user nova-compute[72129]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 13:50:29 user nova-compute[72129]:         <nova:vcpus>1</nova:vcpus>
Aug 01 13:50:29 user nova-compute[72129]:       </nova:flavor>
Aug 01 13:50:29 user nova-compute[72129]:       <nova:owner>
Aug 01 13:50:29 user nova-compute[72129]:         <nova:user uuid="6a2f94718731466aa9d2b7fad712cee4">tempest-VolumesActionsTest-1598482940-project-member</nova:user>
Aug 01 13:50:29 user nova-compute[72129]:         <nova:project uuid="4c98827f5c4643448756c4f155066c4f">tempest-VolumesActionsTest-1598482940</nova:project>
Aug 01 13:50:29 user nova-compute[72129]:       </nova:owner>
Aug 01 13:50:29 user nova-compute[72129]:       <nova:root type="image" uuid="b6472c34-1b0f-4034-ba3a-7e8eb5103715"/>
Aug 01 13:50:29 user nova-compute[72129]:       <nova:ports>
Aug 01 13:50:29 user nova-compute[72129]:         <nova:port uuid="9d5e1d9d-528d-460c-9bd0-c35925eba4d5">
Aug 01 13:50:29 user nova-compute[72129]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 01 13:50:29 user nova-compute[72129]:         </nova:port>
Aug 01 13:50:29 user nova-compute[72129]:       </nova:ports>
Aug 01 13:50:29 user nova-compute[72129]:     </nova:instance>
Aug 01 13:50:29 user nova-compute[72129]:   </metadata>
Aug 01 13:50:29 user nova-compute[72129]:   <sysinfo type="smbios">
Aug 01 13:50:29 user nova-compute[72129]:     <system>
Aug 01 13:50:29 user nova-compute[72129]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 13:50:29 user nova-compute[72129]:       <entry name="product">OpenStack Nova</entry>
Aug 01 13:50:29 user nova-compute[72129]:       <entry name="version">0.0.0</entry>
Aug 01 13:50:29 user nova-compute[72129]:       <entry name="serial">0ce22ea1-b01c-47c6-b9e4-bf28aebc125c</entry>
Aug 01 13:50:29 user nova-compute[72129]:       <entry name="uuid">0ce22ea1-b01c-47c6-b9e4-bf28aebc125c</entry>
Aug 01 13:50:29 user nova-compute[72129]:       <entry name="family">Virtual Machine</entry>
Aug 01 13:50:29 user nova-compute[72129]:     </system>
Aug 01 13:50:29 user nova-compute[72129]:   </sysinfo>
Aug 01 13:50:29 user nova-compute[72129]:   <os>
Aug 01 13:50:29 user nova-compute[72129]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 13:50:29 user nova-compute[72129]:     <boot dev="hd"/>
Aug 01 13:50:29 user nova-compute[72129]:     <smbios mode="sysinfo"/>
Aug 01 13:50:29 user nova-compute[72129]:   </os>
Aug 01 13:50:29 user nova-compute[72129]:   <features>
Aug 01 13:50:29 user nova-compute[72129]:     <acpi/>
Aug 01 13:50:29 user nova-compute[72129]:     <apic/>
Aug 01 13:50:29 user nova-compute[72129]:     <vmcoreinfo/>
Aug 01 13:50:29 user nova-compute[72129]:   </features>
Aug 01 13:50:29 user nova-compute[72129]:   <clock offset="utc">
Aug 01 13:50:29 user nova-compute[72129]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 13:50:29 user nova-compute[72129]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 13:50:29 user nova-compute[72129]:     <timer name="hpet" present="no"/>
Aug 01 13:50:29 user nova-compute[72129]:   </clock>
Aug 01 13:50:29 user nova-compute[72129]:   <cpu mode="custom" match="exact">
Aug 01 13:50:29 user nova-compute[72129]:     <model>Nehalem</model>
Aug 01 13:50:29 user nova-compute[72129]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 13:50:29 user nova-compute[72129]:   </cpu>
Aug 01 13:50:29 user nova-compute[72129]:   <devices>
Aug 01 13:50:29 user nova-compute[72129]:     <disk type="file" device="disk">
Aug 01 13:50:29 user nova-compute[72129]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 13:50:29 user nova-compute[72129]:       <source file="/opt/stack/data/nova/instances/0ce22ea1-b01c-47c6-b9e4-bf28aebc125c/disk"/>
Aug 01 13:50:29 user nova-compute[72129]:       <target dev="vda" bus="virtio"/>
Aug 01 13:50:29 user nova-compute[72129]:     </disk>
Aug 01 13:50:29 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 13:50:29 user nova-compute[72129]:       <mac address="fa:16:3e:95:b4:31"/>
Aug 01 13:50:29 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 13:50:29 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 13:50:29 user nova-compute[72129]:       <target dev="tap9d5e1d9d-52"/>
Aug 01 13:50:29 user nova-compute[72129]:     </interface>
Aug 01 13:50:29 user nova-compute[72129]:     <serial type="pty">
Aug 01 13:50:29 user nova-compute[72129]:       <log file="/opt/stack/data/nova/instances/0ce22ea1-b01c-47c6-b9e4-bf28aebc125c/console.log" append="off"/>
Aug 01 13:50:29 user nova-compute[72129]:     </serial>
Aug 01 13:50:29 user nova-compute[72129]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 13:50:29 user nova-compute[72129]:     <video>
Aug 01 13:50:29 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 13:50:29 user nova-compute[72129]:     </video>
Aug 01 13:50:29 user nova-compute[72129]:     <rng model="virtio">
Aug 01 13:50:29 user nova-compute[72129]:       <backend model="random">/dev/urandom</backend>
Aug 01 13:50:29 user nova-compute[72129]:     </rng>
Aug 01 13:50:29 user nova-compute[72129]:     <controller type="usb" index="0" model="none"/>
Aug 01 13:50:29 user nova-compute[72129]:     <memballoon model="virtio">
Aug 01 13:50:29 user nova-compute[72129]:       <stats period="10"/>
Aug 01 13:50:29 user nova-compute[72129]:     </memballoon>
Aug 01 13:50:29 user nova-compute[72129]:   </devices>
Aug 01 13:50:29 user nova-compute[72129]: </domain>
Aug 01 13:50:29 user nova-compute[72129]:  {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 13:50:29 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:50:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-687052976',display_name='tempest-VolumesActionsTest-instance-687052976',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-687052976',id=7,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c98827f5c4643448756c4f155066c4f',ramdisk_id='',reservation_id='r-pnxdvoix',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1598482940',owner_user_name='tempest-VolumesActionsTest-1598482940-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:50:26Z,user_data=None,user_id='6a2f94718731466aa9d2b7fad712cee4',uuid=0ce22ea1-b01c-47c6-b9e4-bf28aebc125c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d5e1d9d-528d-460c-9bd0-c35925eba4d5", "address": "fa:16:3e:95:b4:31", "network": {"id": "645f47df-6143-48ce-880f-38bacfbfd6a8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1771698777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c98827f5c4643448756c4f155066c4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d5e1d9d-52", "ovs_interfaceid": "9d5e1d9d-528d-460c-9bd0-c35925eba4d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 13:50:29 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] Converting VIF {"id": "9d5e1d9d-528d-460c-9bd0-c35925eba4d5", "address": "fa:16:3e:95:b4:31", "network": {"id": "645f47df-6143-48ce-880f-38bacfbfd6a8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1771698777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c98827f5c4643448756c4f155066c4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d5e1d9d-52", "ovs_interfaceid": "9d5e1d9d-528d-460c-9bd0-c35925eba4d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:50:29 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:b4:31,bridge_name='br-int',has_traffic_filtering=True,id=9d5e1d9d-528d-460c-9bd0-c35925eba4d5,network=Network(645f47df-6143-48ce-880f-38bacfbfd6a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d5e1d9d-52') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:50:29 user nova-compute[72129]: DEBUG os_vif [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:b4:31,bridge_name='br-int',has_traffic_filtering=True,id=9d5e1d9d-528d-460c-9bd0-c35925eba4d5,network=Network(645f47df-6143-48ce-880f-38bacfbfd6a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d5e1d9d-52') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 13:50:29 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:29 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:50:29 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 13:50:29 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:29 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9d5e1d9d-52, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:50:29 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9d5e1d9d-52, col_values=(('external_ids', {'iface-id': '9d5e1d9d-528d-460c-9bd0-c35925eba4d5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:b4:31', 'vm-uuid': '0ce22ea1-b01c-47c6-b9e4-bf28aebc125c'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:50:29 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:29 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 13:50:29 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:29 user nova-compute[72129]: INFO os_vif [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:b4:31,bridge_name='br-int',has_traffic_filtering=True,id=9d5e1d9d-528d-460c-9bd0-c35925eba4d5,network=Network(645f47df-6143-48ce-880f-38bacfbfd6a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d5e1d9d-52')
Aug 01 13:50:29 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:29 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:29 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:29 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 13:50:29 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] No VIF found with MAC fa:16:3e:95:b4:31, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 13:50:30 user nova-compute[72129]: DEBUG nova.compute.manager [req-0399daa9-767f-4656-ae77-c4d86096d1ff req-226096ee-b9f9-4b11-903a-bc6b963f00d7 service nova] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] Received event network-vif-plugged-31519672-974b-48c8-a361-e36ef1177d4e {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:50:30 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-0399daa9-767f-4656-ae77-c4d86096d1ff req-226096ee-b9f9-4b11-903a-bc6b963f00d7 service nova] Acquiring lock "78b77b93-6f25-447f-80a7-d64374fee14d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:50:30 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-0399daa9-767f-4656-ae77-c4d86096d1ff req-226096ee-b9f9-4b11-903a-bc6b963f00d7 service nova] Lock "78b77b93-6f25-447f-80a7-d64374fee14d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:50:30 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-0399daa9-767f-4656-ae77-c4d86096d1ff req-226096ee-b9f9-4b11-903a-bc6b963f00d7 service nova] Lock "78b77b93-6f25-447f-80a7-d64374fee14d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:50:30 user nova-compute[72129]: DEBUG nova.compute.manager [req-0399daa9-767f-4656-ae77-c4d86096d1ff req-226096ee-b9f9-4b11-903a-bc6b963f00d7 service nova] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] No waiting events found dispatching network-vif-plugged-31519672-974b-48c8-a361-e36ef1177d4e {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:50:30 user nova-compute[72129]: WARNING nova.compute.manager [req-0399daa9-767f-4656-ae77-c4d86096d1ff req-226096ee-b9f9-4b11-903a-bc6b963f00d7 service nova] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] Received unexpected event network-vif-plugged-31519672-974b-48c8-a361-e36ef1177d4e for instance with vm_state building and task_state spawning.
Aug 01 13:50:30 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:30 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:30 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:30 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:30 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:30 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:30 user nova-compute[72129]: DEBUG nova.network.neutron [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Successfully updated port: 7b1167ce-d40a-4355-8411-6a1dd005465f {{(pid=72129) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 13:50:30 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Acquiring lock "refresh_cache-3c1f751a-e2aa-4447-b72f-9dc88c4c1a84" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:50:30 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Acquired lock "refresh_cache-3c1f751a-e2aa-4447-b72f-9dc88c4c1a84" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:50:30 user nova-compute[72129]: DEBUG nova.network.neutron [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 13:50:30 user nova-compute[72129]: DEBUG nova.compute.manager [req-01089036-3880-404d-943a-6b9567a16846 req-a0e0d3f5-31e1-4d82-9f0b-b2bb44429120 service nova] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Received event network-changed-7b1167ce-d40a-4355-8411-6a1dd005465f {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:50:30 user nova-compute[72129]: DEBUG nova.compute.manager [req-01089036-3880-404d-943a-6b9567a16846 req-a0e0d3f5-31e1-4d82-9f0b-b2bb44429120 service nova] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Refreshing instance network info cache due to event network-changed-7b1167ce-d40a-4355-8411-6a1dd005465f. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 13:50:30 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-01089036-3880-404d-943a-6b9567a16846 req-a0e0d3f5-31e1-4d82-9f0b-b2bb44429120 service nova] Acquiring lock "refresh_cache-3c1f751a-e2aa-4447-b72f-9dc88c4c1a84" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:50:30 user nova-compute[72129]: DEBUG nova.network.neutron [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Instance cache missing network info. {{(pid=72129) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 13:50:31 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:50:31 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Cleaning up deleted instances {{(pid=72129) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 13:50:31 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] There are 0 instances to clean {{(pid=72129) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 13:50:31 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:50:31 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72129) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 13:50:31 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:50:31 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:31 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:31 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:31 user nova-compute[72129]: DEBUG nova.network.neutron [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Updating instance_info_cache with network_info: [{"id": "7b1167ce-d40a-4355-8411-6a1dd005465f", "address": "fa:16:3e:58:10:73", "network": {"id": "5ae4ed86-1215-49ba-97b9-b9ca5b7d90ba", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-461203891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2184fb8ab16d482ea3ca397fbb5515ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b1167ce-d4", "ovs_interfaceid": "7b1167ce-d40a-4355-8411-6a1dd005465f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:50:31 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Releasing lock "refresh_cache-3c1f751a-e2aa-4447-b72f-9dc88c4c1a84" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:50:31 user nova-compute[72129]: DEBUG nova.compute.manager [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Instance network_info: |[{"id": "7b1167ce-d40a-4355-8411-6a1dd005465f", "address": "fa:16:3e:58:10:73", "network": {"id": "5ae4ed86-1215-49ba-97b9-b9ca5b7d90ba", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-461203891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2184fb8ab16d482ea3ca397fbb5515ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b1167ce-d4", "ovs_interfaceid": "7b1167ce-d40a-4355-8411-6a1dd005465f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 13:50:31 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-01089036-3880-404d-943a-6b9567a16846 req-a0e0d3f5-31e1-4d82-9f0b-b2bb44429120 service nova] Acquired lock "refresh_cache-3c1f751a-e2aa-4447-b72f-9dc88c4c1a84" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:50:31 user nova-compute[72129]: DEBUG nova.network.neutron [req-01089036-3880-404d-943a-6b9567a16846 req-a0e0d3f5-31e1-4d82-9f0b-b2bb44429120 service nova] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Refreshing network info cache for port 7b1167ce-d40a-4355-8411-6a1dd005465f {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 13:50:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Start _get_guest_xml network_info=[{"id": "7b1167ce-d40a-4355-8411-6a1dd005465f", "address": "fa:16:3e:58:10:73", "network": {"id": "5ae4ed86-1215-49ba-97b9-b9ca5b7d90ba", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-461203891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2184fb8ab16d482ea3ca397fbb5515ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b1167ce-d4", "ovs_interfaceid": "7b1167ce-d40a-4355-8411-6a1dd005465f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'image_id': 'b6472c34-1b0f-4034-ba3a-7e8eb5103715'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 13:50:31 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:50:31 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:50:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 13:50:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] CPU controller missing on host. {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 13:50:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 13:50:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] CPU controller found on host. {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 13:50:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72129) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 13:50:31 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T13:45:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 13:50:31 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Flavor limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 13:50:31 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Image limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 13:50:31 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Flavor pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 13:50:31 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Image pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 13:50:31 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 13:50:31 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 13:50:31 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 13:50:31 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Got 1 possible topologies {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 13:50:31 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 13:50:31 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 13:50:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T13:50:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1732967996',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1732967996',id=8,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLV9A0exWrqx9JsfbE2qI31l+qAJAoY1ILqBBhJy25PwbbuJ9xEqV3MLcWWfDrGgYOcUOAwPrjT+u/vasbyQv8o1AhTEdbBmNL+fkWaNh0TGgFByD46Z+LnLlJ94XdbvJQ==',key_name='tempest-keypair-1026124919',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2184fb8ab16d482ea3ca397fbb5515ff',ramdisk_id='',reservation_id='r-qogqtpk0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1582776521',owner_user_name='tempest-TaggedAttachmentsTest-1582776521-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:50:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ded159a3c395418d9e4d699ed249eabb',uuid=3c1f751a-e2aa-4447-b72f-9dc88c4c1a84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b1167ce-d40a-4355-8411-6a1dd005465f", "address": "fa:16:3e:58:10:73", "network": {"id": "5ae4ed86-1215-49ba-97b9-b9ca5b7d90ba", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-461203891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2184fb8ab16d482ea3ca397fbb5515ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b1167ce-d4", "ovs_interfaceid": "7b1167ce-d40a-4355-8411-6a1dd005465f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 13:50:31 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Converting VIF {"id": "7b1167ce-d40a-4355-8411-6a1dd005465f", "address": "fa:16:3e:58:10:73", "network": {"id": "5ae4ed86-1215-49ba-97b9-b9ca5b7d90ba", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-461203891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2184fb8ab16d482ea3ca397fbb5515ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b1167ce-d4", "ovs_interfaceid": "7b1167ce-d40a-4355-8411-6a1dd005465f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:50:31 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:10:73,bridge_name='br-int',has_traffic_filtering=True,id=7b1167ce-d40a-4355-8411-6a1dd005465f,network=Network(5ae4ed86-1215-49ba-97b9-b9ca5b7d90ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b1167ce-d4') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:50:31 user nova-compute[72129]: DEBUG nova.objects.instance [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Lazy-loading 'pci_devices' on Instance uuid 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:50:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] End _get_guest_xml xml=<domain type="kvm">
Aug 01 13:50:31 user nova-compute[72129]:   <uuid>3c1f751a-e2aa-4447-b72f-9dc88c4c1a84</uuid>
Aug 01 13:50:31 user nova-compute[72129]:   <name>instance-00000008</name>
Aug 01 13:50:31 user nova-compute[72129]:   <memory>524288</memory>
Aug 01 13:50:31 user nova-compute[72129]:   <vcpu>1</vcpu>
Aug 01 13:50:31 user nova-compute[72129]:   <metadata>
Aug 01 13:50:31 user nova-compute[72129]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 13:50:31 user nova-compute[72129]:       <nova:package version="0.0.0"/>
Aug 01 13:50:31 user nova-compute[72129]:       <nova:name>tempest-device-tagging-server-1732967996</nova:name>
Aug 01 13:50:31 user nova-compute[72129]:       <nova:creationTime>2023-08-01 13:50:31</nova:creationTime>
Aug 01 13:50:31 user nova-compute[72129]:       <nova:flavor name="m1.tiny">
Aug 01 13:50:31 user nova-compute[72129]:         <nova:memory>512</nova:memory>
Aug 01 13:50:31 user nova-compute[72129]:         <nova:disk>1</nova:disk>
Aug 01 13:50:31 user nova-compute[72129]:         <nova:swap>0</nova:swap>
Aug 01 13:50:31 user nova-compute[72129]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 13:50:31 user nova-compute[72129]:         <nova:vcpus>1</nova:vcpus>
Aug 01 13:50:31 user nova-compute[72129]:       </nova:flavor>
Aug 01 13:50:31 user nova-compute[72129]:       <nova:owner>
Aug 01 13:50:31 user nova-compute[72129]:         <nova:user uuid="ded159a3c395418d9e4d699ed249eabb">tempest-TaggedAttachmentsTest-1582776521-project-member</nova:user>
Aug 01 13:50:31 user nova-compute[72129]:         <nova:project uuid="2184fb8ab16d482ea3ca397fbb5515ff">tempest-TaggedAttachmentsTest-1582776521</nova:project>
Aug 01 13:50:31 user nova-compute[72129]:       </nova:owner>
Aug 01 13:50:31 user nova-compute[72129]:       <nova:root type="image" uuid="b6472c34-1b0f-4034-ba3a-7e8eb5103715"/>
Aug 01 13:50:31 user nova-compute[72129]:       <nova:ports>
Aug 01 13:50:31 user nova-compute[72129]:         <nova:port uuid="7b1167ce-d40a-4355-8411-6a1dd005465f">
Aug 01 13:50:31 user nova-compute[72129]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 01 13:50:31 user nova-compute[72129]:         </nova:port>
Aug 01 13:50:31 user nova-compute[72129]:       </nova:ports>
Aug 01 13:50:31 user nova-compute[72129]:     </nova:instance>
Aug 01 13:50:31 user nova-compute[72129]:   </metadata>
Aug 01 13:50:31 user nova-compute[72129]:   <sysinfo type="smbios">
Aug 01 13:50:31 user nova-compute[72129]:     <system>
Aug 01 13:50:31 user nova-compute[72129]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 13:50:31 user nova-compute[72129]:       <entry name="product">OpenStack Nova</entry>
Aug 01 13:50:31 user nova-compute[72129]:       <entry name="version">0.0.0</entry>
Aug 01 13:50:31 user nova-compute[72129]:       <entry name="serial">3c1f751a-e2aa-4447-b72f-9dc88c4c1a84</entry>
Aug 01 13:50:31 user nova-compute[72129]:       <entry name="uuid">3c1f751a-e2aa-4447-b72f-9dc88c4c1a84</entry>
Aug 01 13:50:31 user nova-compute[72129]:       <entry name="family">Virtual Machine</entry>
Aug 01 13:50:31 user nova-compute[72129]:     </system>
Aug 01 13:50:31 user nova-compute[72129]:   </sysinfo>
Aug 01 13:50:31 user nova-compute[72129]:   <os>
Aug 01 13:50:31 user nova-compute[72129]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 13:50:31 user nova-compute[72129]:     <boot dev="hd"/>
Aug 01 13:50:31 user nova-compute[72129]:     <smbios mode="sysinfo"/>
Aug 01 13:50:31 user nova-compute[72129]:   </os>
Aug 01 13:50:31 user nova-compute[72129]:   <features>
Aug 01 13:50:31 user nova-compute[72129]:     <acpi/>
Aug 01 13:50:31 user nova-compute[72129]:     <apic/>
Aug 01 13:50:31 user nova-compute[72129]:     <vmcoreinfo/>
Aug 01 13:50:31 user nova-compute[72129]:   </features>
Aug 01 13:50:31 user nova-compute[72129]:   <clock offset="utc">
Aug 01 13:50:31 user nova-compute[72129]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 13:50:31 user nova-compute[72129]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 13:50:31 user nova-compute[72129]:     <timer name="hpet" present="no"/>
Aug 01 13:50:31 user nova-compute[72129]:   </clock>
Aug 01 13:50:31 user nova-compute[72129]:   <cpu mode="custom" match="exact">
Aug 01 13:50:31 user nova-compute[72129]:     <model>Nehalem</model>
Aug 01 13:50:31 user nova-compute[72129]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 13:50:31 user nova-compute[72129]:   </cpu>
Aug 01 13:50:31 user nova-compute[72129]:   <devices>
Aug 01 13:50:31 user nova-compute[72129]:     <disk type="file" device="disk">
Aug 01 13:50:31 user nova-compute[72129]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 13:50:31 user nova-compute[72129]:       <source file="/opt/stack/data/nova/instances/3c1f751a-e2aa-4447-b72f-9dc88c4c1a84/disk"/>
Aug 01 13:50:31 user nova-compute[72129]:       <target dev="vda" bus="virtio"/>
Aug 01 13:50:31 user nova-compute[72129]:     </disk>
Aug 01 13:50:31 user nova-compute[72129]:     <disk type="file" device="cdrom">
Aug 01 13:50:31 user nova-compute[72129]:       <driver name="qemu" type="raw" cache="none"/>
Aug 01 13:50:31 user nova-compute[72129]:       <source file="/opt/stack/data/nova/instances/3c1f751a-e2aa-4447-b72f-9dc88c4c1a84/disk.config"/>
Aug 01 13:50:31 user nova-compute[72129]:       <target dev="hda" bus="ide"/>
Aug 01 13:50:31 user nova-compute[72129]:     </disk>
Aug 01 13:50:31 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 13:50:31 user nova-compute[72129]:       <mac address="fa:16:3e:58:10:73"/>
Aug 01 13:50:31 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 13:50:31 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 13:50:31 user nova-compute[72129]:       <target dev="tap7b1167ce-d4"/>
Aug 01 13:50:31 user nova-compute[72129]:     </interface>
Aug 01 13:50:31 user nova-compute[72129]:     <serial type="pty">
Aug 01 13:50:31 user nova-compute[72129]:       <log file="/opt/stack/data/nova/instances/3c1f751a-e2aa-4447-b72f-9dc88c4c1a84/console.log" append="off"/>
Aug 01 13:50:31 user nova-compute[72129]:     </serial>
Aug 01 13:50:31 user nova-compute[72129]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 13:50:31 user nova-compute[72129]:     <video>
Aug 01 13:50:31 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 13:50:31 user nova-compute[72129]:     </video>
Aug 01 13:50:31 user nova-compute[72129]:     <rng model="virtio">
Aug 01 13:50:31 user nova-compute[72129]:       <backend model="random">/dev/urandom</backend>
Aug 01 13:50:31 user nova-compute[72129]:     </rng>
Aug 01 13:50:31 user nova-compute[72129]:     <controller type="usb" index="0" model="none"/>
Aug 01 13:50:31 user nova-compute[72129]:     <memballoon model="virtio">
Aug 01 13:50:31 user nova-compute[72129]:       <stats period="10"/>
Aug 01 13:50:31 user nova-compute[72129]:     </memballoon>
Aug 01 13:50:31 user nova-compute[72129]:   </devices>
Aug 01 13:50:31 user nova-compute[72129]: </domain>
Aug 01 13:50:31 user nova-compute[72129]:  {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 13:50:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T13:50:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1732967996',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1732967996',id=8,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLV9A0exWrqx9JsfbE2qI31l+qAJAoY1ILqBBhJy25PwbbuJ9xEqV3MLcWWfDrGgYOcUOAwPrjT+u/vasbyQv8o1AhTEdbBmNL+fkWaNh0TGgFByD46Z+LnLlJ94XdbvJQ==',key_name='tempest-keypair-1026124919',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2184fb8ab16d482ea3ca397fbb5515ff',ramdisk_id='',reservation_id='r-qogqtpk0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1582776521',owner_user_name='tempest-TaggedAttachmentsTest-1582776521-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:50:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ded159a3c395418d9e4d699ed249eabb',uuid=3c1f751a-e2aa-4447-b72f-9dc88c4c1a84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b1167ce-d40a-4355-8411-6a1dd005465f", "address": "fa:16:3e:58:10:73", "network": {"id": "5ae4ed86-1215-49ba-97b9-b9ca5b7d90ba", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-461203891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2184fb8ab16d482ea3ca397fbb5515ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b1167ce-d4", "ovs_interfaceid": "7b1167ce-d40a-4355-8411-6a1dd005465f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 13:50:31 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Converting VIF {"id": "7b1167ce-d40a-4355-8411-6a1dd005465f", "address": "fa:16:3e:58:10:73", "network": {"id": "5ae4ed86-1215-49ba-97b9-b9ca5b7d90ba", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-461203891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2184fb8ab16d482ea3ca397fbb5515ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b1167ce-d4", "ovs_interfaceid": "7b1167ce-d40a-4355-8411-6a1dd005465f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:50:31 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:10:73,bridge_name='br-int',has_traffic_filtering=True,id=7b1167ce-d40a-4355-8411-6a1dd005465f,network=Network(5ae4ed86-1215-49ba-97b9-b9ca5b7d90ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b1167ce-d4') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:50:31 user nova-compute[72129]: DEBUG os_vif [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:10:73,bridge_name='br-int',has_traffic_filtering=True,id=7b1167ce-d40a-4355-8411-6a1dd005465f,network=Network(5ae4ed86-1215-49ba-97b9-b9ca5b7d90ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b1167ce-d4') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 13:50:31 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:31 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:50:31 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 13:50:31 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:31 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7b1167ce-d4, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:50:31 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7b1167ce-d4, col_values=(('external_ids', {'iface-id': '7b1167ce-d40a-4355-8411-6a1dd005465f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:10:73', 'vm-uuid': '3c1f751a-e2aa-4447-b72f-9dc88c4c1a84'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:50:31 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:31 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:31 user nova-compute[72129]: INFO os_vif [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:10:73,bridge_name='br-int',has_traffic_filtering=True,id=7b1167ce-d40a-4355-8411-6a1dd005465f,network=Network(5ae4ed86-1215-49ba-97b9-b9ca5b7d90ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b1167ce-d4')
Aug 01 13:50:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 13:50:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] No BDM found with device name hda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 13:50:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] No VIF found with MAC fa:16:3e:58:10:73, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 13:50:31 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Using config drive
Aug 01 13:50:32 user nova-compute[72129]: DEBUG nova.compute.manager [req-e6d510e9-a705-4151-8fe8-b05837c07ce7 req-fba445d4-bf95-4f3c-8b4d-72eb6d479e1b service nova] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] Received event network-vif-plugged-31519672-974b-48c8-a361-e36ef1177d4e {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:50:32 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-e6d510e9-a705-4151-8fe8-b05837c07ce7 req-fba445d4-bf95-4f3c-8b4d-72eb6d479e1b service nova] Acquiring lock "78b77b93-6f25-447f-80a7-d64374fee14d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:50:32 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-e6d510e9-a705-4151-8fe8-b05837c07ce7 req-fba445d4-bf95-4f3c-8b4d-72eb6d479e1b service nova] Lock "78b77b93-6f25-447f-80a7-d64374fee14d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:50:32 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-e6d510e9-a705-4151-8fe8-b05837c07ce7 req-fba445d4-bf95-4f3c-8b4d-72eb6d479e1b service nova] Lock "78b77b93-6f25-447f-80a7-d64374fee14d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:50:32 user nova-compute[72129]: DEBUG nova.compute.manager [req-e6d510e9-a705-4151-8fe8-b05837c07ce7 req-fba445d4-bf95-4f3c-8b4d-72eb6d479e1b service nova] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] No waiting events found dispatching network-vif-plugged-31519672-974b-48c8-a361-e36ef1177d4e {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:50:32 user nova-compute[72129]: WARNING nova.compute.manager [req-e6d510e9-a705-4151-8fe8-b05837c07ce7 req-fba445d4-bf95-4f3c-8b4d-72eb6d479e1b service nova] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] Received unexpected event network-vif-plugged-31519672-974b-48c8-a361-e36ef1177d4e for instance with vm_state building and task_state spawning.
Aug 01 13:50:32 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Creating config drive at /opt/stack/data/nova/instances/3c1f751a-e2aa-4447-b72f-9dc88c4c1a84/disk.config
Aug 01 13:50:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3c1f751a-e2aa-4447-b72f-9dc88c4c1a84/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpw0_t8qpz {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:50:32 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3c1f751a-e2aa-4447-b72f-9dc88c4c1a84/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpw0_t8qpz" returned: 0 in 0.118s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:50:32 user nova-compute[72129]: DEBUG nova.compute.manager [req-6df9c4f1-4125-4485-9670-20130e77e4b3 req-2c0d1cf4-de37-49f5-b5f2-f80f044f04f3 service nova] [instance: 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c] Received event network-vif-plugged-9d5e1d9d-528d-460c-9bd0-c35925eba4d5 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:50:32 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-6df9c4f1-4125-4485-9670-20130e77e4b3 req-2c0d1cf4-de37-49f5-b5f2-f80f044f04f3 service nova] Acquiring lock "0ce22ea1-b01c-47c6-b9e4-bf28aebc125c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:50:32 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-6df9c4f1-4125-4485-9670-20130e77e4b3 req-2c0d1cf4-de37-49f5-b5f2-f80f044f04f3 service nova] Lock "0ce22ea1-b01c-47c6-b9e4-bf28aebc125c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:50:32 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-6df9c4f1-4125-4485-9670-20130e77e4b3 req-2c0d1cf4-de37-49f5-b5f2-f80f044f04f3 service nova] Lock "0ce22ea1-b01c-47c6-b9e4-bf28aebc125c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:50:32 user nova-compute[72129]: DEBUG nova.compute.manager [req-6df9c4f1-4125-4485-9670-20130e77e4b3 req-2c0d1cf4-de37-49f5-b5f2-f80f044f04f3 service nova] [instance: 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c] No waiting events found dispatching network-vif-plugged-9d5e1d9d-528d-460c-9bd0-c35925eba4d5 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:50:32 user nova-compute[72129]: WARNING nova.compute.manager [req-6df9c4f1-4125-4485-9670-20130e77e4b3 req-2c0d1cf4-de37-49f5-b5f2-f80f044f04f3 service nova] [instance: 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c] Received unexpected event network-vif-plugged-9d5e1d9d-528d-460c-9bd0-c35925eba4d5 for instance with vm_state building and task_state spawning.
Aug 01 13:50:32 user nova-compute[72129]: DEBUG nova.compute.manager [req-6df9c4f1-4125-4485-9670-20130e77e4b3 req-2c0d1cf4-de37-49f5-b5f2-f80f044f04f3 service nova] [instance: 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c] Received event network-vif-plugged-9d5e1d9d-528d-460c-9bd0-c35925eba4d5 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:50:32 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-6df9c4f1-4125-4485-9670-20130e77e4b3 req-2c0d1cf4-de37-49f5-b5f2-f80f044f04f3 service nova] Acquiring lock "0ce22ea1-b01c-47c6-b9e4-bf28aebc125c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:50:32 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-6df9c4f1-4125-4485-9670-20130e77e4b3 req-2c0d1cf4-de37-49f5-b5f2-f80f044f04f3 service nova] Lock "0ce22ea1-b01c-47c6-b9e4-bf28aebc125c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:50:32 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-6df9c4f1-4125-4485-9670-20130e77e4b3 req-2c0d1cf4-de37-49f5-b5f2-f80f044f04f3 service nova] Lock "0ce22ea1-b01c-47c6-b9e4-bf28aebc125c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:50:32 user nova-compute[72129]: DEBUG nova.compute.manager [req-6df9c4f1-4125-4485-9670-20130e77e4b3 req-2c0d1cf4-de37-49f5-b5f2-f80f044f04f3 service nova] [instance: 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c] No waiting events found dispatching network-vif-plugged-9d5e1d9d-528d-460c-9bd0-c35925eba4d5 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:50:32 user nova-compute[72129]: WARNING nova.compute.manager [req-6df9c4f1-4125-4485-9670-20130e77e4b3 req-2c0d1cf4-de37-49f5-b5f2-f80f044f04f3 service nova] [instance: 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c] Received unexpected event network-vif-plugged-9d5e1d9d-528d-460c-9bd0-c35925eba4d5 for instance with vm_state building and task_state spawning.
Aug 01 13:50:32 user nova-compute[72129]: DEBUG nova.network.neutron [req-01089036-3880-404d-943a-6b9567a16846 req-a0e0d3f5-31e1-4d82-9f0b-b2bb44429120 service nova] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Updated VIF entry in instance network info cache for port 7b1167ce-d40a-4355-8411-6a1dd005465f. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 13:50:32 user nova-compute[72129]: DEBUG nova.network.neutron [req-01089036-3880-404d-943a-6b9567a16846 req-a0e0d3f5-31e1-4d82-9f0b-b2bb44429120 service nova] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Updating instance_info_cache with network_info: [{"id": "7b1167ce-d40a-4355-8411-6a1dd005465f", "address": "fa:16:3e:58:10:73", "network": {"id": "5ae4ed86-1215-49ba-97b9-b9ca5b7d90ba", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-461203891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2184fb8ab16d482ea3ca397fbb5515ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b1167ce-d4", "ovs_interfaceid": "7b1167ce-d40a-4355-8411-6a1dd005465f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:50:32 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-01089036-3880-404d-943a-6b9567a16846 req-a0e0d3f5-31e1-4d82-9f0b-b2bb44429120 service nova] Releasing lock "refresh_cache-3c1f751a-e2aa-4447-b72f-9dc88c4c1a84" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:50:33 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:50:33 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72129) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 13:50:33 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690897833.3336487, 78b77b93-6f25-447f-80a7-d64374fee14d => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:50:33 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] VM Resumed (Lifecycle Event)
Aug 01 13:50:33 user nova-compute[72129]: DEBUG nova.compute.manager [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] Instance event wait completed in 0 seconds for  {{(pid=72129) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 13:50:33 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] Guest created on hypervisor {{(pid=72129) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 13:50:33 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] Instance spawned successfully.
Aug 01 13:50:33 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 13:50:33 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] Found default for hw_input_bus of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:50:33 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] Found default for hw_pointer_model of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:50:33 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] Found default for hw_video_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:50:33 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] Found default for hw_vif_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:50:33 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:50:33 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 13:50:33 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 13:50:33 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690897833.3352609, 78b77b93-6f25-447f-80a7-d64374fee14d => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:50:33 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] VM Started (Lifecycle Event)
Aug 01 13:50:33 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:50:33 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 13:50:33 user nova-compute[72129]: INFO nova.compute.manager [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] Took 10.21 seconds to spawn the instance on the hypervisor.
Aug 01 13:50:33 user nova-compute[72129]: DEBUG nova.compute.manager [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:50:33 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 13:50:33 user nova-compute[72129]: INFO nova.compute.manager [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] Took 11.41 seconds to build instance.
Aug 01 13:50:33 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e91c79ec-668a-4506-9472-be633556b62a tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Lock "78b77b93-6f25-447f-80a7-d64374fee14d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.591s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:50:33 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:33 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:33 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:33 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:33 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Acquiring lock "33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:50:33 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Lock "33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:50:33 user nova-compute[72129]: DEBUG nova.compute.manager [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Starting instance... {{(pid=72129) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 13:50:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:50:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:50:34 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:50:34 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:50:34 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:50:34 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:50:34 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:50:34 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72129) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 13:50:34 user nova-compute[72129]: INFO nova.compute.claims [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Claim successful on node user
Aug 01 13:50:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:50:34 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690897834.095022, 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:50:34 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c] VM Resumed (Lifecycle Event)
Aug 01 13:50:34 user nova-compute[72129]: DEBUG nova.compute.manager [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] [instance: 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c] Instance event wait completed in 0 seconds for  {{(pid=72129) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 13:50:34 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] [instance: 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c] Guest created on hypervisor {{(pid=72129) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 13:50:34 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:50:34 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c] Instance spawned successfully.
Aug 01 13:50:34 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] [instance: 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 13:50:34 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 13:50:34 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 13:50:34 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690897834.0951416, 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:50:34 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c] VM Started (Lifecycle Event)
Aug 01 13:50:34 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:50:34 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] [instance: 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c] Found default for hw_cdrom_bus of ide {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:50:34 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] [instance: 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c] Found default for hw_disk_bus of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:50:34 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] [instance: 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c] Found default for hw_input_bus of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:50:34 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] [instance: 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c] Found default for hw_pointer_model of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:50:34 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] [instance: 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c] Found default for hw_video_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:50:34 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] [instance: 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c] Found default for hw_vif_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:50:34 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 13:50:34 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 13:50:34 user nova-compute[72129]: DEBUG nova.compute.manager [req-d9f9d584-39ae-4552-b671-94a2a499d494 req-40074e90-d254-4191-b133-0f8d41f791d0 service nova] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Received event network-vif-plugged-7b1167ce-d40a-4355-8411-6a1dd005465f {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:50:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-d9f9d584-39ae-4552-b671-94a2a499d494 req-40074e90-d254-4191-b133-0f8d41f791d0 service nova] Acquiring lock "3c1f751a-e2aa-4447-b72f-9dc88c4c1a84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:50:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-d9f9d584-39ae-4552-b671-94a2a499d494 req-40074e90-d254-4191-b133-0f8d41f791d0 service nova] Lock "3c1f751a-e2aa-4447-b72f-9dc88c4c1a84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:50:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-d9f9d584-39ae-4552-b671-94a2a499d494 req-40074e90-d254-4191-b133-0f8d41f791d0 service nova] Lock "3c1f751a-e2aa-4447-b72f-9dc88c4c1a84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:50:34 user nova-compute[72129]: DEBUG nova.compute.manager [req-d9f9d584-39ae-4552-b671-94a2a499d494 req-40074e90-d254-4191-b133-0f8d41f791d0 service nova] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] No waiting events found dispatching network-vif-plugged-7b1167ce-d40a-4355-8411-6a1dd005465f {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:50:34 user nova-compute[72129]: WARNING nova.compute.manager [req-d9f9d584-39ae-4552-b671-94a2a499d494 req-40074e90-d254-4191-b133-0f8d41f791d0 service nova] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Received unexpected event network-vif-plugged-7b1167ce-d40a-4355-8411-6a1dd005465f for instance with vm_state building and task_state spawning.
Aug 01 13:50:34 user nova-compute[72129]: INFO nova.compute.manager [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] [instance: 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c] Took 8.13 seconds to spawn the instance on the hypervisor.
Aug 01 13:50:34 user nova-compute[72129]: DEBUG nova.compute.manager [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] [instance: 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:50:34 user nova-compute[72129]: INFO nova.compute.manager [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] [instance: 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c] Took 9.37 seconds to build instance.
Aug 01 13:50:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-95dfbe03-148e-4e8c-9d6a-295fc7cd0b02 tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] Lock "0ce22ea1-b01c-47c6-b9e4-bf28aebc125c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.551s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:50:34 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:34 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:34 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 13:50:34 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 13:50:34 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.773s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:50:34 user nova-compute[72129]: DEBUG nova.compute.manager [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Start building networks asynchronously for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 13:50:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.720s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:50:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:50:34 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Auditing locally available compute resources for user (node: user) {{(pid=72129) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 13:50:34 user nova-compute[72129]: DEBUG nova.compute.manager [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Allocating IP information in the background. {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 13:50:34 user nova-compute[72129]: DEBUG nova.network.neutron [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] allocate_for_instance() {{(pid=72129) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 13:50:34 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 13:50:34 user nova-compute[72129]: DEBUG nova.compute.manager [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Start building block device mappings for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 13:50:35 user nova-compute[72129]: DEBUG nova.compute.manager [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Start spawning the instance on the hypervisor. {{(pid=72129) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 13:50:35 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Creating instance directory {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 13:50:35 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Creating image(s)
Aug 01 13:50:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Acquiring lock "/opt/stack/data/nova/instances/33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:50:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Lock "/opt/stack/data/nova/instances/33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:50:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Lock "/opt/stack/data/nova/instances/33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:50:35 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:50:35 user nova-compute[72129]: DEBUG nova.policy [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f1347c68080c4de88a24ee9058a2ddc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0177e373be24a209f050b7fd6cd646a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72129) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 13:50:35 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:35 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c1f751a-e2aa-4447-b72f-9dc88c4c1a84/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:50:35 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.146s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:50:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Acquiring lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:50:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:50:35 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:50:35 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c1f751a-e2aa-4447-b72f-9dc88c4c1a84/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:50:35 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c1f751a-e2aa-4447-b72f-9dc88c4c1a84/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:50:35 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.186s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:50:35 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0/disk 1073741824 {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:50:35 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0/disk 1073741824" returned: 0 in 0.063s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:50:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:50:35 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:50:35 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c1f751a-e2aa-4447-b72f-9dc88c4c1a84/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:50:35 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28115c7d-544a-4504-98da-2398e0e354d8/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:50:35 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.205s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:50:35 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Checking if we can resize image /opt/stack/data/nova/instances/33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0/disk. size=1073741824 {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 13:50:35 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:50:35 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28115c7d-544a-4504-98da-2398e0e354d8/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:50:35 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28115c7d-544a-4504-98da-2398e0e354d8/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:50:35 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:50:35 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Cannot resize image /opt/stack/data/nova/instances/33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0/disk to a smaller size. {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 13:50:35 user nova-compute[72129]: DEBUG nova.objects.instance [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Lazy-loading 'migration_context' on Instance uuid 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:50:35 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Created local disks {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 13:50:35 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Ensure instance console log exists: /opt/stack/data/nova/instances/33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0/console.log {{(pid=72129) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 13:50:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:50:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:50:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:50:35 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28115c7d-544a-4504-98da-2398e0e354d8/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:50:35 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b77b93-6f25-447f-80a7-d64374fee14d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:50:36 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b77b93-6f25-447f-80a7-d64374fee14d/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:50:36 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b77b93-6f25-447f-80a7-d64374fee14d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:50:36 user nova-compute[72129]: DEBUG nova.compute.manager [req-791b6bdc-511a-48bc-a0f5-c4de716d671b req-9355a7ae-5356-4431-b0f7-6e39f4069137 service nova] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Received event network-vif-plugged-7b1167ce-d40a-4355-8411-6a1dd005465f {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:50:36 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-791b6bdc-511a-48bc-a0f5-c4de716d671b req-9355a7ae-5356-4431-b0f7-6e39f4069137 service nova] Acquiring lock "3c1f751a-e2aa-4447-b72f-9dc88c4c1a84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:50:36 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-791b6bdc-511a-48bc-a0f5-c4de716d671b req-9355a7ae-5356-4431-b0f7-6e39f4069137 service nova] Lock "3c1f751a-e2aa-4447-b72f-9dc88c4c1a84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:50:36 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-791b6bdc-511a-48bc-a0f5-c4de716d671b req-9355a7ae-5356-4431-b0f7-6e39f4069137 service nova] Lock "3c1f751a-e2aa-4447-b72f-9dc88c4c1a84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:50:36 user nova-compute[72129]: DEBUG nova.compute.manager [req-791b6bdc-511a-48bc-a0f5-c4de716d671b req-9355a7ae-5356-4431-b0f7-6e39f4069137 service nova] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] No waiting events found dispatching network-vif-plugged-7b1167ce-d40a-4355-8411-6a1dd005465f {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:50:36 user nova-compute[72129]: WARNING nova.compute.manager [req-791b6bdc-511a-48bc-a0f5-c4de716d671b req-9355a7ae-5356-4431-b0f7-6e39f4069137 service nova] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Received unexpected event network-vif-plugged-7b1167ce-d40a-4355-8411-6a1dd005465f for instance with vm_state building and task_state spawning.
Aug 01 13:50:36 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b77b93-6f25-447f-80a7-d64374fee14d/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:50:36 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b336c3-c7d4-4353-8e51-416726833407/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:50:36 user nova-compute[72129]: DEBUG nova.compute.manager [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Instance event wait completed in 0 seconds for  {{(pid=72129) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 13:50:36 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Guest created on hypervisor {{(pid=72129) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 13:50:36 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690897836.473439, 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84 => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:50:36 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] VM Resumed (Lifecycle Event)
Aug 01 13:50:36 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Instance spawned successfully.
Aug 01 13:50:36 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 13:50:36 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:50:36 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 13:50:36 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Found default for hw_cdrom_bus of ide {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:50:36 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Found default for hw_disk_bus of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:50:36 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Found default for hw_input_bus of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:50:36 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Found default for hw_pointer_model of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:50:36 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Found default for hw_video_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:50:36 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Found default for hw_vif_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:50:36 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b336c3-c7d4-4353-8e51-416726833407/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:50:36 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b336c3-c7d4-4353-8e51-416726833407/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:50:36 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 13:50:36 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690897836.4737175, 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84 => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:50:36 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] VM Started (Lifecycle Event)
Aug 01 13:50:36 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:50:36 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 13:50:36 user nova-compute[72129]: INFO nova.compute.manager [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Took 8.81 seconds to spawn the instance on the hypervisor.
Aug 01 13:50:36 user nova-compute[72129]: DEBUG nova.compute.manager [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:50:36 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 13:50:36 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:36 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b336c3-c7d4-4353-8e51-416726833407/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:50:36 user nova-compute[72129]: INFO nova.compute.manager [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Took 10.53 seconds to build instance.
Aug 01 13:50:36 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31105963-52fa-4aff-9270-075cd98f08a5/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:50:36 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-cb6de9a8-c336-49f6-bac4-48c121e721ec tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Lock "3c1f751a-e2aa-4447-b72f-9dc88c4c1a84" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.719s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:50:36 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31105963-52fa-4aff-9270-075cd98f08a5/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:50:36 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31105963-52fa-4aff-9270-075cd98f08a5/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:50:37 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31105963-52fa-4aff-9270-075cd98f08a5/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:50:37 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ce22ea1-b01c-47c6-b9e4-bf28aebc125c/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:50:37 user nova-compute[72129]: DEBUG nova.network.neutron [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Successfully created port: 027152b9-a97b-4756-8618-25d27e5c6e2f {{(pid=72129) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 13:50:37 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ce22ea1-b01c-47c6-b9e4-bf28aebc125c/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:50:37 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ce22ea1-b01c-47c6-b9e4-bf28aebc125c/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:50:37 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ce22ea1-b01c-47c6-b9e4-bf28aebc125c/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:50:37 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63c0c1fe-7e4d-4763-8ede-a7662747a4c0/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:50:37 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63c0c1fe-7e4d-4763-8ede-a7662747a4c0/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:50:37 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63c0c1fe-7e4d-4763-8ede-a7662747a4c0/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:50:37 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63c0c1fe-7e4d-4763-8ede-a7662747a4c0/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:50:37 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efa87a6-1dd6-4441-a55e-8e86be7f0a35/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:50:38 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efa87a6-1dd6-4441-a55e-8e86be7f0a35/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:50:38 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efa87a6-1dd6-4441-a55e-8e86be7f0a35/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:50:38 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efa87a6-1dd6-4441-a55e-8e86be7f0a35/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:50:38 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:50:38 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:50:38 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Hypervisor/Node resource view: name=user free_ram=7791MB free_disk=25.732547760009766GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72129) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 13:50:38 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:50:38 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:50:39 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance d6b336c3-c7d4-4353-8e51-416726833407 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:50:39 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 63c0c1fe-7e4d-4763-8ede-a7662747a4c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:50:39 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 2efa87a6-1dd6-4441-a55e-8e86be7f0a35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:50:39 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 28115c7d-544a-4504-98da-2398e0e354d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:50:39 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 31105963-52fa-4aff-9270-075cd98f08a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:50:39 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 78b77b93-6f25-447f-80a7-d64374fee14d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:50:39 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:50:39 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:50:39 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:50:39 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 13:50:39 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 13:50:39 user nova-compute[72129]: DEBUG nova.network.neutron [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Successfully updated port: 027152b9-a97b-4756-8618-25d27e5c6e2f {{(pid=72129) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 13:50:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Acquiring lock "refresh_cache-33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:50:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Acquired lock "refresh_cache-33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:50:39 user nova-compute[72129]: DEBUG nova.network.neutron [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 13:50:39 user nova-compute[72129]: DEBUG nova.compute.manager [req-6b76a782-576b-4833-a298-bcd6b6b36b9a req-0caac090-6402-40b0-84d7-25d11260e854 service nova] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Received event network-changed-027152b9-a97b-4756-8618-25d27e5c6e2f {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:50:39 user nova-compute[72129]: DEBUG nova.compute.manager [req-6b76a782-576b-4833-a298-bcd6b6b36b9a req-0caac090-6402-40b0-84d7-25d11260e854 service nova] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Refreshing instance network info cache due to event network-changed-027152b9-a97b-4756-8618-25d27e5c6e2f. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 13:50:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-6b76a782-576b-4833-a298-bcd6b6b36b9a req-0caac090-6402-40b0-84d7-25d11260e854 service nova] Acquiring lock "refresh_cache-33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:50:39 user nova-compute[72129]: DEBUG nova.network.neutron [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Instance cache missing network info. {{(pid=72129) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 13:50:39 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 13:50:39 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 13:50:39 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Compute_service record updated for user:user {{(pid=72129) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 13:50:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.915s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:50:40 user nova-compute[72129]: DEBUG nova.network.neutron [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Updating instance_info_cache with network_info: [{"id": "027152b9-a97b-4756-8618-25d27e5c6e2f", "address": "fa:16:3e:a2:d0:6d", "network": {"id": "934b1a56-2f37-418b-bce9-a6cdc8a2083b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1371342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0177e373be24a209f050b7fd6cd646a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap027152b9-a9", "ovs_interfaceid": "027152b9-a97b-4756-8618-25d27e5c6e2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:50:40 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:40 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Releasing lock "refresh_cache-33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:50:40 user nova-compute[72129]: DEBUG nova.compute.manager [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Instance network_info: |[{"id": "027152b9-a97b-4756-8618-25d27e5c6e2f", "address": "fa:16:3e:a2:d0:6d", "network": {"id": "934b1a56-2f37-418b-bce9-a6cdc8a2083b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1371342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0177e373be24a209f050b7fd6cd646a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap027152b9-a9", "ovs_interfaceid": "027152b9-a97b-4756-8618-25d27e5c6e2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 13:50:40 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-6b76a782-576b-4833-a298-bcd6b6b36b9a req-0caac090-6402-40b0-84d7-25d11260e854 service nova] Acquired lock "refresh_cache-33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:50:40 user nova-compute[72129]: DEBUG nova.network.neutron [req-6b76a782-576b-4833-a298-bcd6b6b36b9a req-0caac090-6402-40b0-84d7-25d11260e854 service nova] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Refreshing network info cache for port 027152b9-a97b-4756-8618-25d27e5c6e2f {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 13:50:40 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Start _get_guest_xml network_info=[{"id": "027152b9-a97b-4756-8618-25d27e5c6e2f", "address": "fa:16:3e:a2:d0:6d", "network": {"id": "934b1a56-2f37-418b-bce9-a6cdc8a2083b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1371342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0177e373be24a209f050b7fd6cd646a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap027152b9-a9", "ovs_interfaceid": "027152b9-a97b-4756-8618-25d27e5c6e2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'image_id': 'b6472c34-1b0f-4034-ba3a-7e8eb5103715'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 13:50:40 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:50:40 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:50:40 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 13:50:40 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] CPU controller missing on host. {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 13:50:40 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 13:50:40 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] CPU controller found on host. {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 13:50:40 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72129) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 13:50:40 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T13:45:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 13:50:40 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Flavor limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 13:50:40 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Image limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 13:50:40 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Flavor pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 13:50:40 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Image pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 13:50:40 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 13:50:40 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 13:50:40 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 13:50:40 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Got 1 possible topologies {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 13:50:40 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 13:50:40 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 13:50:40 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:50:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1580756567',display_name='tempest-TestVolumeSwap-server-1580756567',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1580756567',id=9,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIX0PncPB4iHhAad3IYIQknouaB0tnAE5SYwdpjCFrRabL2BxexYvgcMxJlpUohCkK82O1NsIeovqvUiwGSBwUqE8DB3wfsyroWfo3gDa558EY1DaPOlnlmtnrlUE8+VIg==',key_name='tempest-keypair-851366275',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0177e373be24a209f050b7fd6cd646a',ramdisk_id='',reservation_id='r-wc0z4roe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-2086711919',owner_user_name='tempest-TestVolumeSwap-2086711919-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:50:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f1347c68080c4de88a24ee9058a2ddc2',uuid=33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "027152b9-a97b-4756-8618-25d27e5c6e2f", "address": "fa:16:3e:a2:d0:6d", "network": {"id": "934b1a56-2f37-418b-bce9-a6cdc8a2083b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1371342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0177e373be24a209f050b7fd6cd646a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap027152b9-a9", "ovs_interfaceid": "027152b9-a97b-4756-8618-25d27e5c6e2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 13:50:40 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Converting VIF {"id": "027152b9-a97b-4756-8618-25d27e5c6e2f", "address": "fa:16:3e:a2:d0:6d", "network": {"id": "934b1a56-2f37-418b-bce9-a6cdc8a2083b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1371342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0177e373be24a209f050b7fd6cd646a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap027152b9-a9", "ovs_interfaceid": "027152b9-a97b-4756-8618-25d27e5c6e2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:50:40 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:d0:6d,bridge_name='br-int',has_traffic_filtering=True,id=027152b9-a97b-4756-8618-25d27e5c6e2f,network=Network(934b1a56-2f37-418b-bce9-a6cdc8a2083b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap027152b9-a9') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:50:40 user nova-compute[72129]: DEBUG nova.objects.instance [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Lazy-loading 'pci_devices' on Instance uuid 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:50:40 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] End _get_guest_xml xml=<domain type="kvm">
Aug 01 13:50:40 user nova-compute[72129]:   <uuid>33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0</uuid>
Aug 01 13:50:40 user nova-compute[72129]:   <name>instance-00000009</name>
Aug 01 13:50:40 user nova-compute[72129]:   <memory>524288</memory>
Aug 01 13:50:40 user nova-compute[72129]:   <vcpu>1</vcpu>
Aug 01 13:50:40 user nova-compute[72129]:   <metadata>
Aug 01 13:50:40 user nova-compute[72129]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 13:50:40 user nova-compute[72129]:       <nova:package version="0.0.0"/>
Aug 01 13:50:40 user nova-compute[72129]:       <nova:name>tempest-TestVolumeSwap-server-1580756567</nova:name>
Aug 01 13:50:40 user nova-compute[72129]:       <nova:creationTime>2023-08-01 13:50:40</nova:creationTime>
Aug 01 13:50:40 user nova-compute[72129]:       <nova:flavor name="m1.tiny">
Aug 01 13:50:40 user nova-compute[72129]:         <nova:memory>512</nova:memory>
Aug 01 13:50:40 user nova-compute[72129]:         <nova:disk>1</nova:disk>
Aug 01 13:50:40 user nova-compute[72129]:         <nova:swap>0</nova:swap>
Aug 01 13:50:40 user nova-compute[72129]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 13:50:40 user nova-compute[72129]:         <nova:vcpus>1</nova:vcpus>
Aug 01 13:50:40 user nova-compute[72129]:       </nova:flavor>
Aug 01 13:50:40 user nova-compute[72129]:       <nova:owner>
Aug 01 13:50:40 user nova-compute[72129]:         <nova:user uuid="f1347c68080c4de88a24ee9058a2ddc2">tempest-TestVolumeSwap-2086711919-project-member</nova:user>
Aug 01 13:50:40 user nova-compute[72129]:         <nova:project uuid="a0177e373be24a209f050b7fd6cd646a">tempest-TestVolumeSwap-2086711919</nova:project>
Aug 01 13:50:40 user nova-compute[72129]:       </nova:owner>
Aug 01 13:50:40 user nova-compute[72129]:       <nova:root type="image" uuid="b6472c34-1b0f-4034-ba3a-7e8eb5103715"/>
Aug 01 13:50:40 user nova-compute[72129]:       <nova:ports>
Aug 01 13:50:40 user nova-compute[72129]:         <nova:port uuid="027152b9-a97b-4756-8618-25d27e5c6e2f">
Aug 01 13:50:40 user nova-compute[72129]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 01 13:50:40 user nova-compute[72129]:         </nova:port>
Aug 01 13:50:40 user nova-compute[72129]:       </nova:ports>
Aug 01 13:50:40 user nova-compute[72129]:     </nova:instance>
Aug 01 13:50:40 user nova-compute[72129]:   </metadata>
Aug 01 13:50:40 user nova-compute[72129]:   <sysinfo type="smbios">
Aug 01 13:50:40 user nova-compute[72129]:     <system>
Aug 01 13:50:40 user nova-compute[72129]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 13:50:40 user nova-compute[72129]:       <entry name="product">OpenStack Nova</entry>
Aug 01 13:50:40 user nova-compute[72129]:       <entry name="version">0.0.0</entry>
Aug 01 13:50:40 user nova-compute[72129]:       <entry name="serial">33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0</entry>
Aug 01 13:50:40 user nova-compute[72129]:       <entry name="uuid">33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0</entry>
Aug 01 13:50:40 user nova-compute[72129]:       <entry name="family">Virtual Machine</entry>
Aug 01 13:50:40 user nova-compute[72129]:     </system>
Aug 01 13:50:40 user nova-compute[72129]:   </sysinfo>
Aug 01 13:50:40 user nova-compute[72129]:   <os>
Aug 01 13:50:40 user nova-compute[72129]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 13:50:40 user nova-compute[72129]:     <boot dev="hd"/>
Aug 01 13:50:40 user nova-compute[72129]:     <smbios mode="sysinfo"/>
Aug 01 13:50:40 user nova-compute[72129]:   </os>
Aug 01 13:50:40 user nova-compute[72129]:   <features>
Aug 01 13:50:40 user nova-compute[72129]:     <acpi/>
Aug 01 13:50:40 user nova-compute[72129]:     <apic/>
Aug 01 13:50:40 user nova-compute[72129]:     <vmcoreinfo/>
Aug 01 13:50:40 user nova-compute[72129]:   </features>
Aug 01 13:50:40 user nova-compute[72129]:   <clock offset="utc">
Aug 01 13:50:40 user nova-compute[72129]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 13:50:40 user nova-compute[72129]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 13:50:40 user nova-compute[72129]:     <timer name="hpet" present="no"/>
Aug 01 13:50:40 user nova-compute[72129]:   </clock>
Aug 01 13:50:40 user nova-compute[72129]:   <cpu mode="custom" match="exact">
Aug 01 13:50:40 user nova-compute[72129]:     <model>Nehalem</model>
Aug 01 13:50:40 user nova-compute[72129]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 13:50:40 user nova-compute[72129]:   </cpu>
Aug 01 13:50:40 user nova-compute[72129]:   <devices>
Aug 01 13:50:40 user nova-compute[72129]:     <disk type="file" device="disk">
Aug 01 13:50:40 user nova-compute[72129]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 13:50:40 user nova-compute[72129]:       <source file="/opt/stack/data/nova/instances/33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0/disk"/>
Aug 01 13:50:40 user nova-compute[72129]:       <target dev="vda" bus="virtio"/>
Aug 01 13:50:40 user nova-compute[72129]:     </disk>
Aug 01 13:50:40 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 13:50:40 user nova-compute[72129]:       <mac address="fa:16:3e:a2:d0:6d"/>
Aug 01 13:50:40 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 13:50:40 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 13:50:40 user nova-compute[72129]:       <target dev="tap027152b9-a9"/>
Aug 01 13:50:40 user nova-compute[72129]:     </interface>
Aug 01 13:50:40 user nova-compute[72129]:     <serial type="pty">
Aug 01 13:50:40 user nova-compute[72129]:       <log file="/opt/stack/data/nova/instances/33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0/console.log" append="off"/>
Aug 01 13:50:40 user nova-compute[72129]:     </serial>
Aug 01 13:50:40 user nova-compute[72129]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 13:50:40 user nova-compute[72129]:     <video>
Aug 01 13:50:40 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 13:50:40 user nova-compute[72129]:     </video>
Aug 01 13:50:40 user nova-compute[72129]:     <rng model="virtio">
Aug 01 13:50:40 user nova-compute[72129]:       <backend model="random">/dev/urandom</backend>
Aug 01 13:50:40 user nova-compute[72129]:     </rng>
Aug 01 13:50:40 user nova-compute[72129]:     <controller type="usb" index="0" model="none"/>
Aug 01 13:50:40 user nova-compute[72129]:     <memballoon model="virtio">
Aug 01 13:50:40 user nova-compute[72129]:       <stats period="10"/>
Aug 01 13:50:40 user nova-compute[72129]:     </memballoon>
Aug 01 13:50:40 user nova-compute[72129]:   </devices>
Aug 01 13:50:40 user nova-compute[72129]: </domain>
Aug 01 13:50:40 user nova-compute[72129]:  {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 13:50:40 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:50:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1580756567',display_name='tempest-TestVolumeSwap-server-1580756567',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1580756567',id=9,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIX0PncPB4iHhAad3IYIQknouaB0tnAE5SYwdpjCFrRabL2BxexYvgcMxJlpUohCkK82O1NsIeovqvUiwGSBwUqE8DB3wfsyroWfo3gDa558EY1DaPOlnlmtnrlUE8+VIg==',key_name='tempest-keypair-851366275',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0177e373be24a209f050b7fd6cd646a',ramdisk_id='',reservation_id='r-wc0z4roe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-2086711919',owner_user_name='tempest-TestVolumeSwap-2086711919-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:50:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f1347c68080c4de88a24ee9058a2ddc2',uuid=33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "027152b9-a97b-4756-8618-25d27e5c6e2f", "address": "fa:16:3e:a2:d0:6d", "network": {"id": "934b1a56-2f37-418b-bce9-a6cdc8a2083b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1371342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0177e373be24a209f050b7fd6cd646a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap027152b9-a9", "ovs_interfaceid": "027152b9-a97b-4756-8618-25d27e5c6e2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 13:50:40 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Converting VIF {"id": "027152b9-a97b-4756-8618-25d27e5c6e2f", "address": "fa:16:3e:a2:d0:6d", "network": {"id": "934b1a56-2f37-418b-bce9-a6cdc8a2083b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1371342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0177e373be24a209f050b7fd6cd646a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap027152b9-a9", "ovs_interfaceid": "027152b9-a97b-4756-8618-25d27e5c6e2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:50:40 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:d0:6d,bridge_name='br-int',has_traffic_filtering=True,id=027152b9-a97b-4756-8618-25d27e5c6e2f,network=Network(934b1a56-2f37-418b-bce9-a6cdc8a2083b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap027152b9-a9') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:50:40 user nova-compute[72129]: DEBUG os_vif [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:d0:6d,bridge_name='br-int',has_traffic_filtering=True,id=027152b9-a97b-4756-8618-25d27e5c6e2f,network=Network(934b1a56-2f37-418b-bce9-a6cdc8a2083b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap027152b9-a9') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 13:50:40 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:40 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:50:40 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 13:50:40 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:40 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap027152b9-a9, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:50:40 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap027152b9-a9, col_values=(('external_ids', {'iface-id': '027152b9-a97b-4756-8618-25d27e5c6e2f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:d0:6d', 'vm-uuid': '33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:50:40 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:40 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 13:50:40 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:40 user nova-compute[72129]: INFO os_vif [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:d0:6d,bridge_name='br-int',has_traffic_filtering=True,id=027152b9-a97b-4756-8618-25d27e5c6e2f,network=Network(934b1a56-2f37-418b-bce9-a6cdc8a2083b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap027152b9-a9')
Aug 01 13:50:40 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 13:50:40 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] No VIF found with MAC fa:16:3e:a2:d0:6d, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 13:50:40 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:50:40 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:50:40 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Starting heal instance info cache {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 13:50:40 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Rebuilding the list of instances to heal {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 13:50:40 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Skipping network cache update for instance because it is Building. {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 01 13:50:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "refresh_cache-d6b336c3-c7d4-4353-8e51-416726833407" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:50:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquired lock "refresh_cache-d6b336c3-c7d4-4353-8e51-416726833407" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:50:41 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: d6b336c3-c7d4-4353-8e51-416726833407] Forcefully refreshing network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 13:50:41 user nova-compute[72129]: DEBUG nova.objects.instance [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lazy-loading 'info_cache' on Instance uuid d6b336c3-c7d4-4353-8e51-416726833407 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:50:41 user nova-compute[72129]: DEBUG nova.network.neutron [req-6b76a782-576b-4833-a298-bcd6b6b36b9a req-0caac090-6402-40b0-84d7-25d11260e854 service nova] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Updated VIF entry in instance network info cache for port 027152b9-a97b-4756-8618-25d27e5c6e2f. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 13:50:41 user nova-compute[72129]: DEBUG nova.network.neutron [req-6b76a782-576b-4833-a298-bcd6b6b36b9a req-0caac090-6402-40b0-84d7-25d11260e854 service nova] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Updating instance_info_cache with network_info: [{"id": "027152b9-a97b-4756-8618-25d27e5c6e2f", "address": "fa:16:3e:a2:d0:6d", "network": {"id": "934b1a56-2f37-418b-bce9-a6cdc8a2083b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1371342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0177e373be24a209f050b7fd6cd646a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap027152b9-a9", "ovs_interfaceid": "027152b9-a97b-4756-8618-25d27e5c6e2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:50:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-6b76a782-576b-4833-a298-bcd6b6b36b9a req-0caac090-6402-40b0-84d7-25d11260e854 service nova] Releasing lock "refresh_cache-33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:50:41 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: d6b336c3-c7d4-4353-8e51-416726833407] Updating instance_info_cache with network_info: [{"id": "129db8e9-6741-408c-b62c-ae48485fa290", "address": "fa:16:3e:a7:96:5a", "network": {"id": "3d94af2c-7df4-4d95-ba9e-8273497eff49", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-50216644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48c5a30b0df04cfba39fb66d63ff8f85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap129db8e9-67", "ovs_interfaceid": "129db8e9-6741-408c-b62c-ae48485fa290", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:50:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Releasing lock "refresh_cache-d6b336c3-c7d4-4353-8e51-416726833407" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:50:41 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: d6b336c3-c7d4-4353-8e51-416726833407] Updated the network info_cache for instance {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 13:50:41 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:50:42 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:42 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:42 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:42 user nova-compute[72129]: DEBUG nova.compute.manager [req-0e152042-04b4-4c83-8f02-c47d808cd023 req-0a4d6206-b2ca-46ea-812b-c38a5bc7f116 service nova] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Received event network-vif-plugged-027152b9-a97b-4756-8618-25d27e5c6e2f {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:50:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-0e152042-04b4-4c83-8f02-c47d808cd023 req-0a4d6206-b2ca-46ea-812b-c38a5bc7f116 service nova] Acquiring lock "33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:50:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-0e152042-04b4-4c83-8f02-c47d808cd023 req-0a4d6206-b2ca-46ea-812b-c38a5bc7f116 service nova] Lock "33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:50:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-0e152042-04b4-4c83-8f02-c47d808cd023 req-0a4d6206-b2ca-46ea-812b-c38a5bc7f116 service nova] Lock "33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:50:42 user nova-compute[72129]: DEBUG nova.compute.manager [req-0e152042-04b4-4c83-8f02-c47d808cd023 req-0a4d6206-b2ca-46ea-812b-c38a5bc7f116 service nova] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] No waiting events found dispatching network-vif-plugged-027152b9-a97b-4756-8618-25d27e5c6e2f {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:50:42 user nova-compute[72129]: WARNING nova.compute.manager [req-0e152042-04b4-4c83-8f02-c47d808cd023 req-0a4d6206-b2ca-46ea-812b-c38a5bc7f116 service nova] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Received unexpected event network-vif-plugged-027152b9-a97b-4756-8618-25d27e5c6e2f for instance with vm_state building and task_state spawning.
Aug 01 13:50:42 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:42 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:42 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Acquiring lock "1490f922-a4b0-43be-8826-ab527f66a350" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:50:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Lock "1490f922-a4b0-43be-8826-ab527f66a350" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:50:43 user nova-compute[72129]: DEBUG nova.compute.manager [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Starting instance... {{(pid=72129) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 13:50:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:50:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:50:43 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72129) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 13:50:43 user nova-compute[72129]: INFO nova.compute.claims [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Claim successful on node user
Aug 01 13:50:43 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Refreshing inventories for resource provider c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 13:50:43 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Updating ProviderTree inventory for provider c2f345c3-9b82-4164-b21d-1eef8e661842 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 13:50:43 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Updating inventory in ProviderTree for provider c2f345c3-9b82-4164-b21d-1eef8e661842 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 13:50:43 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Refreshing aggregate associations for resource provider c2f345c3-9b82-4164-b21d-1eef8e661842, aggregates: None {{(pid=72129) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 13:50:43 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Refreshing trait associations for resource provider c2f345c3-9b82-4164-b21d-1eef8e661842, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE {{(pid=72129) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 13:50:44 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 13:50:44 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 13:50:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.598s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:50:44 user nova-compute[72129]: DEBUG nova.compute.manager [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Start building networks asynchronously for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 13:50:44 user nova-compute[72129]: DEBUG nova.compute.manager [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Allocating IP information in the background. {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 13:50:44 user nova-compute[72129]: DEBUG nova.network.neutron [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] allocate_for_instance() {{(pid=72129) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 13:50:44 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 13:50:44 user nova-compute[72129]: DEBUG nova.compute.manager [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Start building block device mappings for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 13:50:44 user nova-compute[72129]: INFO nova.virt.block_device [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Booting with volume 698306a3-291f-4aba-8f16-5068cd476b86 at /dev/vda
Aug 01 13:50:44 user nova-compute[72129]: DEBUG nova.policy [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b4057f22dc0c4e3dbdc55a6a0decebd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12210d07b1b040b192bdbf59bf952a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72129) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 13:50:44 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690897844.434761, 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0 => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:50:44 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] VM Resumed (Lifecycle Event)
Aug 01 13:50:44 user nova-compute[72129]: DEBUG nova.compute.manager [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Instance event wait completed in 0 seconds for  {{(pid=72129) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 13:50:44 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Guest created on hypervisor {{(pid=72129) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 13:50:44 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:50:44 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Instance spawned successfully.
Aug 01 13:50:44 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 13:50:44 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 13:50:44 user nova-compute[72129]: DEBUG nova.compute.manager [req-c96d9f81-1ad6-40b3-966a-dc6162b1d34f req-223ff423-3bff-478f-a096-b1d4ae31ba10 service nova] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Received event network-vif-plugged-027152b9-a97b-4756-8618-25d27e5c6e2f {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:50:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-c96d9f81-1ad6-40b3-966a-dc6162b1d34f req-223ff423-3bff-478f-a096-b1d4ae31ba10 service nova] Acquiring lock "33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:50:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-c96d9f81-1ad6-40b3-966a-dc6162b1d34f req-223ff423-3bff-478f-a096-b1d4ae31ba10 service nova] Lock "33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:50:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-c96d9f81-1ad6-40b3-966a-dc6162b1d34f req-223ff423-3bff-478f-a096-b1d4ae31ba10 service nova] Lock "33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:50:44 user nova-compute[72129]: DEBUG nova.compute.manager [req-c96d9f81-1ad6-40b3-966a-dc6162b1d34f req-223ff423-3bff-478f-a096-b1d4ae31ba10 service nova] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] No waiting events found dispatching network-vif-plugged-027152b9-a97b-4756-8618-25d27e5c6e2f {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:50:44 user nova-compute[72129]: WARNING nova.compute.manager [req-c96d9f81-1ad6-40b3-966a-dc6162b1d34f req-223ff423-3bff-478f-a096-b1d4ae31ba10 service nova] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Received unexpected event network-vif-plugged-027152b9-a97b-4756-8618-25d27e5c6e2f for instance with vm_state building and task_state spawning.
Aug 01 13:50:44 user nova-compute[72129]: DEBUG os_brick.utils [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:50:44 user nova-compute[72129]: INFO oslo.privsep.daemon [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp_vtucodt/privsep.sock']
Aug 01 13:50:44 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Found default for hw_cdrom_bus of ide {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:50:44 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Found default for hw_disk_bus of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:50:44 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Found default for hw_input_bus of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:50:44 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Found default for hw_pointer_model of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:50:44 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Found default for hw_video_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:50:44 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Found default for hw_vif_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:50:44 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 13:50:44 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690897844.4360332, 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0 => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:50:44 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] VM Started (Lifecycle Event)
Aug 01 13:50:44 user sudo[82883]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp_vtucodt/privsep.sock
Aug 01 13:50:44 user sudo[82883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 01 13:50:44 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:50:44 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 13:50:44 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 13:50:44 user nova-compute[72129]: INFO nova.compute.manager [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Took 9.50 seconds to spawn the instance on the hypervisor.
Aug 01 13:50:44 user nova-compute[72129]: DEBUG nova.compute.manager [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:50:44 user nova-compute[72129]: INFO nova.compute.manager [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Took 10.73 seconds to build instance.
Aug 01 13:50:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e319beef-5ea5-4f7d-b22f-72bb8848e17c tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Lock "33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.847s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:50:45 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:45 user nova-compute[72129]: DEBUG nova.network.neutron [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Successfully created port: 9d03baea-c746-4c97-9661-07d0e2e03291 {{(pid=72129) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 13:50:45 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Acquiring lock "e1ee9e5e-0bd8-4986-8641-d44680f97724" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:50:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Lock "e1ee9e5e-0bd8-4986-8641-d44680f97724" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:50:45 user nova-compute[72129]: DEBUG nova.compute.manager [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Starting instance... {{(pid=72129) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 13:50:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:50:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:50:45 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72129) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 13:50:45 user nova-compute[72129]: INFO nova.compute.claims [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Claim successful on node user
Aug 01 13:50:45 user nova-compute[72129]: DEBUG nova.network.neutron [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Successfully created port: 71c06aee-1c23-4a9b-9d91-73cc48cb7c23 {{(pid=72129) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 13:50:46 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 13:50:46 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 13:50:46 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.507s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:50:46 user nova-compute[72129]: DEBUG nova.compute.manager [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Start building networks asynchronously for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 13:50:46 user nova-compute[72129]: DEBUG nova.compute.manager [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Allocating IP information in the background. {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 13:50:46 user nova-compute[72129]: DEBUG nova.network.neutron [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] allocate_for_instance() {{(pid=72129) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 13:50:46 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 13:50:46 user nova-compute[72129]: DEBUG nova.compute.manager [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Start building block device mappings for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 13:50:46 user sudo[82883]: pam_unix(sudo:session): session closed for user root
Aug 01 13:50:46 user nova-compute[72129]: INFO oslo.privsep.daemon [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Spawned new privsep daemon via rootwrap
Aug 01 13:50:46 user nova-compute[72129]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 01 13:50:46 user nova-compute[72129]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 01 13:50:46 user nova-compute[72129]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Aug 01 13:50:46 user nova-compute[72129]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82887
Aug 01 13:50:46 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca8de4c-14ac-4ddd-b2ab-e66ef713c535]: (2,) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:50:46 user nova-compute[72129]: INFO nova.virt.block_device [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Booting with volume b931025d-0e61-46c7-8838-619aeff58f08 at /dev/vda
Aug 01 13:50:46 user nova-compute[72129]: DEBUG os_brick.utils [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:50:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:50:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:50:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:50:46 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4559d44-b1f0-4fb2-ae3c-de36eb54263f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f9b449c2cd3d\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:50:46 user nova-compute[72129]: WARNING os_brick.initiator.connectors.nvmeof [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Aug 01 13:50:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.025s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:50:46 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7b403f-d675-4a68-a4e8-8e09aa0a3c5b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f9b449c2cd3d\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:50:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:50:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:50:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:50:46 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad48c3c7-ef58-49a6-8413-789b454dd021]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:50:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:50:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:50:46 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[676a6df6-22d9-4c5e-9999-7f0174add188]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:50:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:50:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:50:46 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10ec452-a542-4cb0-8d2a-4c968a9908be]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:50:46 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5cb72d1-d000-4151-aee4-437c17c24f15]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:50:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Running cmd (subprocess): nvme version {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:50:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] 'nvme version' failed. Not Retrying. {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 13:50:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:50:46 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09f0976-8f80-4160-a25e-fd4a9877546e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:50:46 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] nvme not present on system {{(pid=72129) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 13:50:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:50:46 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c5acca-c2f2-42a5-9f90-e7e366a5ee4d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:50:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Running cmd (subprocess): nvme version {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:50:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] 'nvme version' failed. Not Retrying. {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 13:50:46 user nova-compute[72129]: DEBUG nova.policy [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1283f74fc4f74184a36fddf17c319ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3a8ce92ea64365b59ae1e4cd450941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72129) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 13:50:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 13:50:46 user nova-compute[72129]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 13:50:46 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[997addf2-74d6-4cfe-863d-69c288a85e99]: (4, '') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:50:46 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.nvmeof [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] nvme not present on system {{(pid=72129) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 13:50:46 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72129) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 13:50:46 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 13:50:46 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] LIGHTOS: no hostnqn found. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 13:50:46 user nova-compute[72129]: DEBUG os_brick.utils [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] <== get_connector_properties: return (2301ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f9b449c2cd3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:50:46 user nova-compute[72129]: DEBUG nova.virt.block_device [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Updating existing volume attachment record: 5e7ac4e2-2906-4886-b97a-546dfe319b4d {{(pid=72129) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 13:50:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:50:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 13:50:46 user nova-compute[72129]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 13:50:46 user nova-compute[72129]: DEBUG nova.network.neutron [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Successfully created port: 17974af1-27e5-41f4-9c13-31fb31cd6cc2 {{(pid=72129) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 13:50:46 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b64b857-e350-413a-8e33-cfbdbdfb0bf7]: (4, '') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:50:46 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72129) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 13:50:46 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 13:50:46 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] LIGHTOS: no hostnqn found. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 13:50:46 user nova-compute[72129]: DEBUG os_brick.utils [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] <== get_connector_properties: return (281ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f9b449c2cd3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:50:46 user nova-compute[72129]: DEBUG nova.virt.block_device [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Updating existing volume attachment record: 3c090e82-3c16-49fa-8041-269f9b6396bb {{(pid=72129) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 13:50:48 user nova-compute[72129]: DEBUG nova.network.neutron [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Successfully created port: 4856f394-91dc-4fd0-9fff-8a45f53f0e01 {{(pid=72129) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 13:50:48 user nova-compute[72129]: DEBUG nova.network.neutron [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Successfully created port: a3697523-c958-4f9f-92a2-ec52e2ee249b {{(pid=72129) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 13:50:49 user nova-compute[72129]: DEBUG nova.network.neutron [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Successfully created port: 1a10af43-8f79-43a4-b847-2c4471576097 {{(pid=72129) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 13:50:49 user nova-compute[72129]: DEBUG nova.network.neutron [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Successfully created port: b23e74f7-64a8-466e-840b-0365e486355f {{(pid=72129) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 13:50:50 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:50 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:51 user nova-compute[72129]: DEBUG nova.network.neutron [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Successfully updated port: 9d03baea-c746-4c97-9661-07d0e2e03291 {{(pid=72129) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 13:50:51 user nova-compute[72129]: DEBUG nova.network.neutron [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Successfully created port: e4a333bd-6565-4da1-ae2c-4953c3a14f53 {{(pid=72129) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 13:50:51 user nova-compute[72129]: DEBUG nova.compute.manager [req-352f276d-7603-4018-940b-1791af86cfd0 req-e0726534-b080-4593-99dd-d418441400f7 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Received event network-changed-9d03baea-c746-4c97-9661-07d0e2e03291 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:50:51 user nova-compute[72129]: DEBUG nova.compute.manager [req-352f276d-7603-4018-940b-1791af86cfd0 req-e0726534-b080-4593-99dd-d418441400f7 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Refreshing instance network info cache due to event network-changed-9d03baea-c746-4c97-9661-07d0e2e03291. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 13:50:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-352f276d-7603-4018-940b-1791af86cfd0 req-e0726534-b080-4593-99dd-d418441400f7 service nova] Acquiring lock "refresh_cache-1490f922-a4b0-43be-8826-ab527f66a350" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:50:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-352f276d-7603-4018-940b-1791af86cfd0 req-e0726534-b080-4593-99dd-d418441400f7 service nova] Acquired lock "refresh_cache-1490f922-a4b0-43be-8826-ab527f66a350" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:50:51 user nova-compute[72129]: DEBUG nova.network.neutron [req-352f276d-7603-4018-940b-1791af86cfd0 req-e0726534-b080-4593-99dd-d418441400f7 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Refreshing network info cache for port 9d03baea-c746-4c97-9661-07d0e2e03291 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 13:50:51 user nova-compute[72129]: DEBUG nova.network.neutron [req-352f276d-7603-4018-940b-1791af86cfd0 req-e0726534-b080-4593-99dd-d418441400f7 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Instance cache missing network info. {{(pid=72129) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 13:50:51 user nova-compute[72129]: DEBUG nova.network.neutron [req-352f276d-7603-4018-940b-1791af86cfd0 req-e0726534-b080-4593-99dd-d418441400f7 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:50:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-352f276d-7603-4018-940b-1791af86cfd0 req-e0726534-b080-4593-99dd-d418441400f7 service nova] Releasing lock "refresh_cache-1490f922-a4b0-43be-8826-ab527f66a350" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:50:52 user nova-compute[72129]: DEBUG nova.network.neutron [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Successfully created port: e1d5b511-b4c8-4d81-8b78-e58ffdfb3015 {{(pid=72129) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 13:50:52 user nova-compute[72129]: DEBUG nova.network.neutron [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Successfully updated port: 7ee53caa-f8d2-4ff3-b29f-131d386cbc14 {{(pid=72129) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 13:50:53 user nova-compute[72129]: DEBUG nova.compute.manager [req-ef1064f6-7afd-49cd-8349-15108b3fba32 req-9da7c52c-1a43-4c3e-90ae-48595051328a service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Received event network-changed-7ee53caa-f8d2-4ff3-b29f-131d386cbc14 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:50:53 user nova-compute[72129]: DEBUG nova.compute.manager [req-ef1064f6-7afd-49cd-8349-15108b3fba32 req-9da7c52c-1a43-4c3e-90ae-48595051328a service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Refreshing instance network info cache due to event network-changed-7ee53caa-f8d2-4ff3-b29f-131d386cbc14. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 13:50:53 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ef1064f6-7afd-49cd-8349-15108b3fba32 req-9da7c52c-1a43-4c3e-90ae-48595051328a service nova] Acquiring lock "refresh_cache-1490f922-a4b0-43be-8826-ab527f66a350" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:50:53 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ef1064f6-7afd-49cd-8349-15108b3fba32 req-9da7c52c-1a43-4c3e-90ae-48595051328a service nova] Acquired lock "refresh_cache-1490f922-a4b0-43be-8826-ab527f66a350" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:50:53 user nova-compute[72129]: DEBUG nova.network.neutron [req-ef1064f6-7afd-49cd-8349-15108b3fba32 req-9da7c52c-1a43-4c3e-90ae-48595051328a service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Refreshing network info cache for port 7ee53caa-f8d2-4ff3-b29f-131d386cbc14 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 13:50:53 user nova-compute[72129]: DEBUG nova.network.neutron [req-ef1064f6-7afd-49cd-8349-15108b3fba32 req-9da7c52c-1a43-4c3e-90ae-48595051328a service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Instance cache missing network info. {{(pid=72129) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 13:50:53 user nova-compute[72129]: DEBUG nova.network.neutron [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Successfully created port: 4bb0a232-3a92-4b85-9a12-29f8d822362e {{(pid=72129) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 13:50:53 user nova-compute[72129]: DEBUG nova.network.neutron [req-ef1064f6-7afd-49cd-8349-15108b3fba32 req-9da7c52c-1a43-4c3e-90ae-48595051328a service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:50:53 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ef1064f6-7afd-49cd-8349-15108b3fba32 req-9da7c52c-1a43-4c3e-90ae-48595051328a service nova] Releasing lock "refresh_cache-1490f922-a4b0-43be-8826-ab527f66a350" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:50:54 user nova-compute[72129]: DEBUG nova.network.neutron [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Successfully updated port: 13cf26e5-e302-48ae-abeb-d63bbf4c0572 {{(pid=72129) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 13:50:55 user nova-compute[72129]: INFO nova.virt.block_device [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Booting with volume e57b1e53-283d-4411-8bba-a7e82c1fb350 at /dev/vdb
Aug 01 13:50:55 user nova-compute[72129]: DEBUG nova.network.neutron [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Successfully updated port: 4856f394-91dc-4fd0-9fff-8a45f53f0e01 {{(pid=72129) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 13:50:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:55 user nova-compute[72129]: DEBUG os_brick.utils [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:50:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:50:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:50:55 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[45be756c-f175-4364-9be9-51b5ea35a240]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f9b449c2cd3d\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:50:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:50:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:50:55 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[de06b7fb-3017-4124-95e7-d4e0ca738c78]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:50:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:50:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:50:55 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[128806a0-cef2-4622-bcd6-94ad1c8bf436]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:50:55 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65eee08-c4eb-47b3-833c-0340ed34675f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:50:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Running cmd (subprocess): nvme version {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:50:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] 'nvme version' failed. Not Retrying. {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 13:50:55 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] nvme not present on system {{(pid=72129) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 13:50:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:50:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 13:50:55 user nova-compute[72129]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 13:50:55 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[343f1843-5ac8-41be-893c-ad798106cf49]: (4, '') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:50:55 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72129) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 13:50:55 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 13:50:55 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] LIGHTOS: no hostnqn found. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 13:50:55 user nova-compute[72129]: DEBUG os_brick.utils [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f9b449c2cd3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:50:55 user nova-compute[72129]: DEBUG nova.virt.block_device [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Updating existing volume attachment record: 08d5b377-52f1-4a1c-8c82-44a6d7a8280a {{(pid=72129) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 13:50:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:50:55 user nova-compute[72129]: DEBUG nova.compute.manager [req-52aceb58-c164-4394-b329-ca4b2aa7036e req-e2e0c850-61d7-4f8c-8219-808aa2242907 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Received event network-changed-13cf26e5-e302-48ae-abeb-d63bbf4c0572 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:50:55 user nova-compute[72129]: DEBUG nova.compute.manager [req-52aceb58-c164-4394-b329-ca4b2aa7036e req-e2e0c850-61d7-4f8c-8219-808aa2242907 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Refreshing instance network info cache due to event network-changed-13cf26e5-e302-48ae-abeb-d63bbf4c0572. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 13:50:55 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-52aceb58-c164-4394-b329-ca4b2aa7036e req-e2e0c850-61d7-4f8c-8219-808aa2242907 service nova] Acquiring lock "refresh_cache-1490f922-a4b0-43be-8826-ab527f66a350" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:50:55 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-52aceb58-c164-4394-b329-ca4b2aa7036e req-e2e0c850-61d7-4f8c-8219-808aa2242907 service nova] Acquired lock "refresh_cache-1490f922-a4b0-43be-8826-ab527f66a350" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:50:55 user nova-compute[72129]: DEBUG nova.network.neutron [req-52aceb58-c164-4394-b329-ca4b2aa7036e req-e2e0c850-61d7-4f8c-8219-808aa2242907 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Refreshing network info cache for port 13cf26e5-e302-48ae-abeb-d63bbf4c0572 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 13:50:55 user nova-compute[72129]: DEBUG nova.network.neutron [req-52aceb58-c164-4394-b329-ca4b2aa7036e req-e2e0c850-61d7-4f8c-8219-808aa2242907 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Instance cache missing network info. {{(pid=72129) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 13:50:55 user nova-compute[72129]: DEBUG nova.network.neutron [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Successfully updated port: 71c06aee-1c23-4a9b-9d91-73cc48cb7c23 {{(pid=72129) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 13:50:56 user nova-compute[72129]: DEBUG nova.network.neutron [req-52aceb58-c164-4394-b329-ca4b2aa7036e req-e2e0c850-61d7-4f8c-8219-808aa2242907 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:50:56 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-52aceb58-c164-4394-b329-ca4b2aa7036e req-e2e0c850-61d7-4f8c-8219-808aa2242907 service nova] Releasing lock "refresh_cache-1490f922-a4b0-43be-8826-ab527f66a350" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:50:56 user nova-compute[72129]: DEBUG nova.compute.manager [req-52aceb58-c164-4394-b329-ca4b2aa7036e req-e2e0c850-61d7-4f8c-8219-808aa2242907 service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Received event network-changed-4856f394-91dc-4fd0-9fff-8a45f53f0e01 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:50:56 user nova-compute[72129]: DEBUG nova.compute.manager [req-52aceb58-c164-4394-b329-ca4b2aa7036e req-e2e0c850-61d7-4f8c-8219-808aa2242907 service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Refreshing instance network info cache due to event network-changed-4856f394-91dc-4fd0-9fff-8a45f53f0e01. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 13:50:56 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-52aceb58-c164-4394-b329-ca4b2aa7036e req-e2e0c850-61d7-4f8c-8219-808aa2242907 service nova] Acquiring lock "refresh_cache-e1ee9e5e-0bd8-4986-8641-d44680f97724" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:50:56 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-52aceb58-c164-4394-b329-ca4b2aa7036e req-e2e0c850-61d7-4f8c-8219-808aa2242907 service nova] Acquired lock "refresh_cache-e1ee9e5e-0bd8-4986-8641-d44680f97724" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:50:56 user nova-compute[72129]: DEBUG nova.network.neutron [req-52aceb58-c164-4394-b329-ca4b2aa7036e req-e2e0c850-61d7-4f8c-8219-808aa2242907 service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Refreshing network info cache for port 4856f394-91dc-4fd0-9fff-8a45f53f0e01 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 13:50:56 user nova-compute[72129]: DEBUG nova.network.neutron [req-52aceb58-c164-4394-b329-ca4b2aa7036e req-e2e0c850-61d7-4f8c-8219-808aa2242907 service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Instance cache missing network info. {{(pid=72129) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 13:50:56 user nova-compute[72129]: DEBUG nova.network.neutron [req-52aceb58-c164-4394-b329-ca4b2aa7036e req-e2e0c850-61d7-4f8c-8219-808aa2242907 service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:50:56 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-52aceb58-c164-4394-b329-ca4b2aa7036e req-e2e0c850-61d7-4f8c-8219-808aa2242907 service nova] Releasing lock "refresh_cache-e1ee9e5e-0bd8-4986-8641-d44680f97724" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:50:56 user nova-compute[72129]: DEBUG nova.network.neutron [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Successfully updated port: 3da4a68a-4d20-4f36-bf85-e74a93a6c9f2 {{(pid=72129) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 13:50:57 user nova-compute[72129]: DEBUG nova.network.neutron [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Successfully updated port: 17974af1-27e5-41f4-9c13-31fb31cd6cc2 {{(pid=72129) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 13:50:57 user nova-compute[72129]: DEBUG nova.compute.manager [req-8bca129c-b0c7-4df3-804a-c3742c535874 req-04b3c3fd-d97c-4ce1-89c8-71657e12c11d service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Received event network-changed-71c06aee-1c23-4a9b-9d91-73cc48cb7c23 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:50:57 user nova-compute[72129]: DEBUG nova.compute.manager [req-8bca129c-b0c7-4df3-804a-c3742c535874 req-04b3c3fd-d97c-4ce1-89c8-71657e12c11d service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Refreshing instance network info cache due to event network-changed-71c06aee-1c23-4a9b-9d91-73cc48cb7c23. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 13:50:57 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-8bca129c-b0c7-4df3-804a-c3742c535874 req-04b3c3fd-d97c-4ce1-89c8-71657e12c11d service nova] Acquiring lock "refresh_cache-1490f922-a4b0-43be-8826-ab527f66a350" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:50:57 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-8bca129c-b0c7-4df3-804a-c3742c535874 req-04b3c3fd-d97c-4ce1-89c8-71657e12c11d service nova] Acquired lock "refresh_cache-1490f922-a4b0-43be-8826-ab527f66a350" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:50:57 user nova-compute[72129]: DEBUG nova.network.neutron [req-8bca129c-b0c7-4df3-804a-c3742c535874 req-04b3c3fd-d97c-4ce1-89c8-71657e12c11d service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Refreshing network info cache for port 71c06aee-1c23-4a9b-9d91-73cc48cb7c23 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 13:50:57 user nova-compute[72129]: DEBUG nova.network.neutron [req-8bca129c-b0c7-4df3-804a-c3742c535874 req-04b3c3fd-d97c-4ce1-89c8-71657e12c11d service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Instance cache missing network info. {{(pid=72129) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 13:50:58 user nova-compute[72129]: DEBUG nova.network.neutron [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Successfully updated port: c3fc041a-b39f-448a-a5d6-3e2b67368d50 {{(pid=72129) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 13:50:58 user nova-compute[72129]: DEBUG nova.network.neutron [req-8bca129c-b0c7-4df3-804a-c3742c535874 req-04b3c3fd-d97c-4ce1-89c8-71657e12c11d service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:50:58 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-8bca129c-b0c7-4df3-804a-c3742c535874 req-04b3c3fd-d97c-4ce1-89c8-71657e12c11d service nova] Releasing lock "refresh_cache-1490f922-a4b0-43be-8826-ab527f66a350" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:50:58 user nova-compute[72129]: DEBUG nova.compute.manager [req-8bca129c-b0c7-4df3-804a-c3742c535874 req-04b3c3fd-d97c-4ce1-89c8-71657e12c11d service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Received event network-changed-3da4a68a-4d20-4f36-bf85-e74a93a6c9f2 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:50:58 user nova-compute[72129]: DEBUG nova.compute.manager [req-8bca129c-b0c7-4df3-804a-c3742c535874 req-04b3c3fd-d97c-4ce1-89c8-71657e12c11d service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Refreshing instance network info cache due to event network-changed-3da4a68a-4d20-4f36-bf85-e74a93a6c9f2. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 13:50:58 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-8bca129c-b0c7-4df3-804a-c3742c535874 req-04b3c3fd-d97c-4ce1-89c8-71657e12c11d service nova] Acquiring lock "refresh_cache-e1ee9e5e-0bd8-4986-8641-d44680f97724" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:50:58 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-8bca129c-b0c7-4df3-804a-c3742c535874 req-04b3c3fd-d97c-4ce1-89c8-71657e12c11d service nova] Acquired lock "refresh_cache-e1ee9e5e-0bd8-4986-8641-d44680f97724" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:50:58 user nova-compute[72129]: DEBUG nova.network.neutron [req-8bca129c-b0c7-4df3-804a-c3742c535874 req-04b3c3fd-d97c-4ce1-89c8-71657e12c11d service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Refreshing network info cache for port 3da4a68a-4d20-4f36-bf85-e74a93a6c9f2 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 13:50:58 user nova-compute[72129]: DEBUG nova.network.neutron [req-8bca129c-b0c7-4df3-804a-c3742c535874 req-04b3c3fd-d97c-4ce1-89c8-71657e12c11d service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Instance cache missing network info. {{(pid=72129) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 13:50:58 user nova-compute[72129]: DEBUG nova.network.neutron [req-8bca129c-b0c7-4df3-804a-c3742c535874 req-04b3c3fd-d97c-4ce1-89c8-71657e12c11d service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:50:58 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-8bca129c-b0c7-4df3-804a-c3742c535874 req-04b3c3fd-d97c-4ce1-89c8-71657e12c11d service nova] Releasing lock "refresh_cache-e1ee9e5e-0bd8-4986-8641-d44680f97724" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:50:58 user nova-compute[72129]: DEBUG nova.compute.manager [req-8bca129c-b0c7-4df3-804a-c3742c535874 req-04b3c3fd-d97c-4ce1-89c8-71657e12c11d service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Received event network-changed-17974af1-27e5-41f4-9c13-31fb31cd6cc2 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:50:58 user nova-compute[72129]: DEBUG nova.compute.manager [req-8bca129c-b0c7-4df3-804a-c3742c535874 req-04b3c3fd-d97c-4ce1-89c8-71657e12c11d service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Refreshing instance network info cache due to event network-changed-17974af1-27e5-41f4-9c13-31fb31cd6cc2. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 13:50:58 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-8bca129c-b0c7-4df3-804a-c3742c535874 req-04b3c3fd-d97c-4ce1-89c8-71657e12c11d service nova] Acquiring lock "refresh_cache-1490f922-a4b0-43be-8826-ab527f66a350" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:50:58 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-8bca129c-b0c7-4df3-804a-c3742c535874 req-04b3c3fd-d97c-4ce1-89c8-71657e12c11d service nova] Acquired lock "refresh_cache-1490f922-a4b0-43be-8826-ab527f66a350" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:50:58 user nova-compute[72129]: DEBUG nova.network.neutron [req-8bca129c-b0c7-4df3-804a-c3742c535874 req-04b3c3fd-d97c-4ce1-89c8-71657e12c11d service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Refreshing network info cache for port 17974af1-27e5-41f4-9c13-31fb31cd6cc2 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 13:50:58 user nova-compute[72129]: DEBUG nova.network.neutron [req-8bca129c-b0c7-4df3-804a-c3742c535874 req-04b3c3fd-d97c-4ce1-89c8-71657e12c11d service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Instance cache missing network info. {{(pid=72129) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 13:50:58 user nova-compute[72129]: DEBUG nova.network.neutron [req-8bca129c-b0c7-4df3-804a-c3742c535874 req-04b3c3fd-d97c-4ce1-89c8-71657e12c11d service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:50:58 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-8bca129c-b0c7-4df3-804a-c3742c535874 req-04b3c3fd-d97c-4ce1-89c8-71657e12c11d service nova] Releasing lock "refresh_cache-1490f922-a4b0-43be-8826-ab527f66a350" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:50:58 user nova-compute[72129]: DEBUG nova.network.neutron [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Successfully updated port: a3697523-c958-4f9f-92a2-ec52e2ee249b {{(pid=72129) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 13:50:59 user nova-compute[72129]: DEBUG nova.network.neutron [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Successfully updated port: 1a10af43-8f79-43a4-b847-2c4471576097 {{(pid=72129) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 13:50:59 user nova-compute[72129]: DEBUG nova.compute.manager [req-ec7fe732-311f-4fb5-afff-a1d282a18446 req-61221fc2-e8e9-4273-b3fa-eb3f954b09b6 service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Received event network-changed-c3fc041a-b39f-448a-a5d6-3e2b67368d50 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:50:59 user nova-compute[72129]: DEBUG nova.compute.manager [req-ec7fe732-311f-4fb5-afff-a1d282a18446 req-61221fc2-e8e9-4273-b3fa-eb3f954b09b6 service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Refreshing instance network info cache due to event network-changed-c3fc041a-b39f-448a-a5d6-3e2b67368d50. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 13:50:59 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ec7fe732-311f-4fb5-afff-a1d282a18446 req-61221fc2-e8e9-4273-b3fa-eb3f954b09b6 service nova] Acquiring lock "refresh_cache-e1ee9e5e-0bd8-4986-8641-d44680f97724" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:50:59 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ec7fe732-311f-4fb5-afff-a1d282a18446 req-61221fc2-e8e9-4273-b3fa-eb3f954b09b6 service nova] Acquired lock "refresh_cache-e1ee9e5e-0bd8-4986-8641-d44680f97724" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:50:59 user nova-compute[72129]: DEBUG nova.network.neutron [req-ec7fe732-311f-4fb5-afff-a1d282a18446 req-61221fc2-e8e9-4273-b3fa-eb3f954b09b6 service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Refreshing network info cache for port c3fc041a-b39f-448a-a5d6-3e2b67368d50 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 13:50:59 user nova-compute[72129]: DEBUG nova.network.neutron [req-ec7fe732-311f-4fb5-afff-a1d282a18446 req-61221fc2-e8e9-4273-b3fa-eb3f954b09b6 service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Instance cache missing network info. {{(pid=72129) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 13:51:00 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:00 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:00 user nova-compute[72129]: DEBUG nova.network.neutron [req-ec7fe732-311f-4fb5-afff-a1d282a18446 req-61221fc2-e8e9-4273-b3fa-eb3f954b09b6 service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:51:00 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ec7fe732-311f-4fb5-afff-a1d282a18446 req-61221fc2-e8e9-4273-b3fa-eb3f954b09b6 service nova] Releasing lock "refresh_cache-e1ee9e5e-0bd8-4986-8641-d44680f97724" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:51:00 user nova-compute[72129]: DEBUG nova.compute.manager [req-ec7fe732-311f-4fb5-afff-a1d282a18446 req-61221fc2-e8e9-4273-b3fa-eb3f954b09b6 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Received event network-changed-a3697523-c958-4f9f-92a2-ec52e2ee249b {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:51:00 user nova-compute[72129]: DEBUG nova.compute.manager [req-ec7fe732-311f-4fb5-afff-a1d282a18446 req-61221fc2-e8e9-4273-b3fa-eb3f954b09b6 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Refreshing instance network info cache due to event network-changed-a3697523-c958-4f9f-92a2-ec52e2ee249b. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 13:51:00 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ec7fe732-311f-4fb5-afff-a1d282a18446 req-61221fc2-e8e9-4273-b3fa-eb3f954b09b6 service nova] Acquiring lock "refresh_cache-1490f922-a4b0-43be-8826-ab527f66a350" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:51:00 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ec7fe732-311f-4fb5-afff-a1d282a18446 req-61221fc2-e8e9-4273-b3fa-eb3f954b09b6 service nova] Acquired lock "refresh_cache-1490f922-a4b0-43be-8826-ab527f66a350" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:51:00 user nova-compute[72129]: DEBUG nova.network.neutron [req-ec7fe732-311f-4fb5-afff-a1d282a18446 req-61221fc2-e8e9-4273-b3fa-eb3f954b09b6 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Refreshing network info cache for port a3697523-c958-4f9f-92a2-ec52e2ee249b {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 13:51:00 user nova-compute[72129]: DEBUG nova.network.neutron [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Successfully updated port: b23e74f7-64a8-466e-840b-0365e486355f {{(pid=72129) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 13:51:00 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Acquiring lock "refresh_cache-1490f922-a4b0-43be-8826-ab527f66a350" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:51:00 user nova-compute[72129]: DEBUG nova.network.neutron [req-ec7fe732-311f-4fb5-afff-a1d282a18446 req-61221fc2-e8e9-4273-b3fa-eb3f954b09b6 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Instance cache missing network info. {{(pid=72129) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 13:51:01 user nova-compute[72129]: DEBUG nova.network.neutron [req-ec7fe732-311f-4fb5-afff-a1d282a18446 req-61221fc2-e8e9-4273-b3fa-eb3f954b09b6 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:51:01 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ec7fe732-311f-4fb5-afff-a1d282a18446 req-61221fc2-e8e9-4273-b3fa-eb3f954b09b6 service nova] Releasing lock "refresh_cache-1490f922-a4b0-43be-8826-ab527f66a350" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:51:01 user nova-compute[72129]: DEBUG nova.compute.manager [req-ec7fe732-311f-4fb5-afff-a1d282a18446 req-61221fc2-e8e9-4273-b3fa-eb3f954b09b6 service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Received event network-changed-1a10af43-8f79-43a4-b847-2c4471576097 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:51:01 user nova-compute[72129]: DEBUG nova.compute.manager [req-ec7fe732-311f-4fb5-afff-a1d282a18446 req-61221fc2-e8e9-4273-b3fa-eb3f954b09b6 service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Refreshing instance network info cache due to event network-changed-1a10af43-8f79-43a4-b847-2c4471576097. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 13:51:01 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ec7fe732-311f-4fb5-afff-a1d282a18446 req-61221fc2-e8e9-4273-b3fa-eb3f954b09b6 service nova] Acquiring lock "refresh_cache-e1ee9e5e-0bd8-4986-8641-d44680f97724" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:51:01 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ec7fe732-311f-4fb5-afff-a1d282a18446 req-61221fc2-e8e9-4273-b3fa-eb3f954b09b6 service nova] Acquired lock "refresh_cache-e1ee9e5e-0bd8-4986-8641-d44680f97724" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:51:01 user nova-compute[72129]: DEBUG nova.network.neutron [req-ec7fe732-311f-4fb5-afff-a1d282a18446 req-61221fc2-e8e9-4273-b3fa-eb3f954b09b6 service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Refreshing network info cache for port 1a10af43-8f79-43a4-b847-2c4471576097 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 13:51:01 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Acquired lock "refresh_cache-1490f922-a4b0-43be-8826-ab527f66a350" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:51:01 user nova-compute[72129]: DEBUG nova.network.neutron [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 13:51:01 user nova-compute[72129]: DEBUG nova.network.neutron [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Instance cache missing network info. {{(pid=72129) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 13:51:01 user nova-compute[72129]: DEBUG nova.network.neutron [req-ec7fe732-311f-4fb5-afff-a1d282a18446 req-61221fc2-e8e9-4273-b3fa-eb3f954b09b6 service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Instance cache missing network info. {{(pid=72129) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 13:51:01 user nova-compute[72129]: DEBUG nova.network.neutron [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Successfully updated port: e4a333bd-6565-4da1-ae2c-4953c3a14f53 {{(pid=72129) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 13:51:01 user nova-compute[72129]: DEBUG nova.network.neutron [req-ec7fe732-311f-4fb5-afff-a1d282a18446 req-61221fc2-e8e9-4273-b3fa-eb3f954b09b6 service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:51:01 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ec7fe732-311f-4fb5-afff-a1d282a18446 req-61221fc2-e8e9-4273-b3fa-eb3f954b09b6 service nova] Releasing lock "refresh_cache-e1ee9e5e-0bd8-4986-8641-d44680f97724" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:51:01 user nova-compute[72129]: INFO nova.virt.block_device [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Booting with volume f0565343-ef40-41a1-bb6a-d7d01d463a61 at /dev/vdb
Aug 01 13:51:01 user nova-compute[72129]: DEBUG nova.compute.manager [req-6af2b684-3bab-4ca8-9f8d-2f39a27f30c7 req-365da289-5779-47bd-90a5-9288c8a37ff7 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Received event network-changed-b23e74f7-64a8-466e-840b-0365e486355f {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:51:01 user nova-compute[72129]: DEBUG nova.compute.manager [req-6af2b684-3bab-4ca8-9f8d-2f39a27f30c7 req-365da289-5779-47bd-90a5-9288c8a37ff7 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Refreshing instance network info cache due to event network-changed-b23e74f7-64a8-466e-840b-0365e486355f. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 13:51:01 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-6af2b684-3bab-4ca8-9f8d-2f39a27f30c7 req-365da289-5779-47bd-90a5-9288c8a37ff7 service nova] Acquiring lock "refresh_cache-1490f922-a4b0-43be-8826-ab527f66a350" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:51:01 user nova-compute[72129]: DEBUG os_brick.utils [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:51:01 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:02 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82c8e6b-980c-4514-ae7d-3fdf4e2afff3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f9b449c2cd3d\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:02 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[28cda989-6ab9-4d9e-a0b4-4670bdc13888]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:02 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d40aea-5812-4887-a298-55181b7cc15f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:02 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[092309c1-958a-4c9a-88de-7284b7ddb9e6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Running cmd (subprocess): nvme version {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] 'nvme version' failed. Not Retrying. {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 13:51:02 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.nvmeof [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] nvme not present on system {{(pid=72129) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 13:51:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 13:51:02 user nova-compute[72129]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 13:51:02 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[120e86b0-31b8-4aa4-b9bc-19ead2bb6386]: (4, '') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:02 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72129) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 13:51:02 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 13:51:02 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] LIGHTOS: no hostnqn found. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 13:51:02 user nova-compute[72129]: DEBUG os_brick.utils [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f9b449c2cd3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:51:02 user nova-compute[72129]: DEBUG nova.virt.block_device [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Updating existing volume attachment record: a9815c6b-f33c-4522-8b9f-6c31194531d0 {{(pid=72129) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 13:51:02 user nova-compute[72129]: DEBUG nova.network.neutron [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Successfully updated port: e1d5b511-b4c8-4d81-8b78-e58ffdfb3015 {{(pid=72129) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 13:51:03 user nova-compute[72129]: DEBUG nova.network.neutron [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Successfully updated port: 4bb0a232-3a92-4b85-9a12-29f8d822362e {{(pid=72129) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 13:51:03 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Acquiring lock "refresh_cache-e1ee9e5e-0bd8-4986-8641-d44680f97724" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:51:03 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Acquired lock "refresh_cache-e1ee9e5e-0bd8-4986-8641-d44680f97724" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:51:03 user nova-compute[72129]: DEBUG nova.network.neutron [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 13:51:03 user nova-compute[72129]: DEBUG nova.network.neutron [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Instance cache missing network info. {{(pid=72129) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 13:51:03 user nova-compute[72129]: DEBUG nova.network.neutron [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Updating instance_info_cache with network_info: [{"id": "9d03baea-c746-4c97-9661-07d0e2e03291", "address": "fa:16:3e:92:fb:0d", "network": {"id": "9c8a1041-95f3-463f-a449-858dfa63c555", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-88919181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d03baea-c7", "ovs_interfaceid": "9d03baea-c746-4c97-9661-07d0e2e03291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7ee53caa-f8d2-4ff3-b29f-131d386cbc14", "address": "fa:16:3e:f6:0d:dc", "network": {"id": "5a66b974-bfc2-4121-92e0-4c22ae1e3290", "bridge": "br-int", "label": "tempest-device-tagging-net1-1666088374", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee53caa-f8", "ovs_interfaceid": "7ee53caa-f8d2-4ff3-b29f-131d386cbc14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "13cf26e5-e302-48ae-abeb-d63bbf4c0572", "address": "fa:16:3e:97:83:19", "network": {"id": "5a66b974-bfc2-4121-92e0-4c22ae1e3290", "bridge": "br-int", "label": "tempest-device-tagging-net1-1666088374", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13cf26e5-e3", "ovs_interfaceid": "13cf26e5-e302-48ae-abeb-d63bbf4c0572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "71c06aee-1c23-4a9b-9d91-73cc48cb7c23", "address": "fa:16:3e:98:bf:66", "network": {"id": "5a66b974-bfc2-4121-92e0-4c22ae1e3290", "bridge": "br-int", "label": "tempest-device-tagging-net1-1666088374", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71c06aee-1c", "ovs_interfaceid": "71c06aee-1c23-4a9b-9d91-73cc48cb7c23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "17974af1-27e5-41f4-9c13-31fb31cd6cc2", "address": "fa:16:3e:a1:d7:1f", "network": {"id": "5a66b974-bfc2-4121-92e0-4c22ae1e3290", "bridge": "br-int", "label": "tempest-device-tagging-net1-1666088374", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17974af1-27", "ovs_interfaceid": "17974af1-27e5-41f4-9c13-31fb31cd6cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a3697523-c958-4f9f-92a2-ec52e2ee249b", "address": "fa:16:3e:9f:03:16", "network": {"id": "ce8bea02-998e-4055-9ac6-e226a89f103c", "bridge": "br-int", "label": "tempest-device-tagging-net2-808946084", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3697523-c9", "ovs_interfaceid": "a3697523-c958-4f9f-92a2-ec52e2ee249b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b23e74f7-64a8-466e-840b-0365e486355f", "address": "fa:16:3e:4f:8b:2c", "network": {"id": "ce8bea02-998e-4055-9ac6-e226a89f103c", "bridge": "br-int", "label": "tempest-device-tagging-net2-808946084", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb23e74f7-64", "ovs_interfaceid": "b23e74f7-64a8-466e-840b-0365e486355f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:51:03 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Releasing lock "refresh_cache-1490f922-a4b0-43be-8826-ab527f66a350" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:51:03 user nova-compute[72129]: DEBUG nova.compute.manager [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Instance network_info: |[{"id": "9d03baea-c746-4c97-9661-07d0e2e03291", "address": "fa:16:3e:92:fb:0d", "network": {"id": "9c8a1041-95f3-463f-a449-858dfa63c555", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-88919181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d03baea-c7", "ovs_interfaceid": "9d03baea-c746-4c97-9661-07d0e2e03291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7ee53caa-f8d2-4ff3-b29f-131d386cbc14", "address": "fa:16:3e:f6:0d:dc", "network": {"id": "5a66b974-bfc2-4121-92e0-4c22ae1e3290", "bridge": "br-int", "label": "tempest-device-tagging-net1-1666088374", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee53caa-f8", "ovs_interfaceid": "7ee53caa-f8d2-4ff3-b29f-131d386cbc14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "13cf26e5-e302-48ae-abeb-d63bbf4c0572", "address": "fa:16:3e:97:83:19", "network": {"id": "5a66b974-bfc2-4121-92e0-4c22ae1e3290", "bridge": "br-int", "label": "tempest-device-tagging-net1-1666088374", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13cf26e5-e3", "ovs_interfaceid": "13cf26e5-e302-48ae-abeb-d63bbf4c0572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "71c06aee-1c23-4a9b-9d91-73cc48cb7c23", "address": "fa:16:3e:98:bf:66", "network": {"id": "5a66b974-bfc2-4121-92e0-4c22ae1e3290", "bridge": "br-int", "label": "tempest-device-tagging-net1-1666088374", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71c06aee-1c", "ovs_interfaceid": "71c06aee-1c23-4a9b-9d91-73cc48cb7c23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "17974af1-27e5-41f4-9c13-31fb31cd6cc2", "address": "fa:16:3e:a1:d7:1f", "network": {"id": "5a66b974-bfc2-4121-92e0-4c22ae1e3290", "bridge": "br-int", "label": "tempest-device-tagging-net1-1666088374", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17974af1-27", "ovs_interfaceid": "17974af1-27e5-41f4-9c13-31fb31cd6cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a3697523-c958-4f9f-92a2-ec52e2ee249b", "address": "fa:16:3e:9f:03:16", "network": {"id": "ce8bea02-998e-4055-9ac6-e226a89f103c", "bridge": "br-int", "label": "tempest-device-tagging-net2-808946084", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3697523-c9", "ovs_interfaceid": "a3697523-c958-4f9f-92a2-ec52e2ee249b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b23e74f7-64a8-466e-840b-0365e486355f", "address": "fa:16:3e:4f:8b:2c", "network": {"id": "ce8bea02-998e-4055-9ac6-e226a89f103c", "bridge": "br-int", "label": "tempest-device-tagging-net2-808946084", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb23e74f7-64", "ovs_interfaceid": "b23e74f7-64a8-466e-840b-0365e486355f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 13:51:03 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-6af2b684-3bab-4ca8-9f8d-2f39a27f30c7 req-365da289-5779-47bd-90a5-9288c8a37ff7 service nova] Acquired lock "refresh_cache-1490f922-a4b0-43be-8826-ab527f66a350" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:51:03 user nova-compute[72129]: DEBUG nova.network.neutron [req-6af2b684-3bab-4ca8-9f8d-2f39a27f30c7 req-365da289-5779-47bd-90a5-9288c8a37ff7 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Refreshing network info cache for port b23e74f7-64a8-466e-840b-0365e486355f {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 13:51:03 user nova-compute[72129]: INFO nova.virt.block_device [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Booting with volume 66fe3cf1-a10e-4af9-b3ac-fe234b59a512 at /dev/vdc
Aug 01 13:51:03 user nova-compute[72129]: DEBUG os_brick.utils [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:51:03 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:03 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:03 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[68bdc043-4e26-434f-b0ed-19074260edb8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f9b449c2cd3d\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:03 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:04 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:04 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb756ac-2377-431b-ab93-136251a6f300]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:04 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:04 user nova-compute[72129]: DEBUG nova.network.neutron [req-6af2b684-3bab-4ca8-9f8d-2f39a27f30c7 req-365da289-5779-47bd-90a5-9288c8a37ff7 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Updated VIF entry in instance network info cache for port b23e74f7-64a8-466e-840b-0365e486355f. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 13:51:04 user nova-compute[72129]: DEBUG nova.network.neutron [req-6af2b684-3bab-4ca8-9f8d-2f39a27f30c7 req-365da289-5779-47bd-90a5-9288c8a37ff7 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Updating instance_info_cache with network_info: [{"id": "9d03baea-c746-4c97-9661-07d0e2e03291", "address": "fa:16:3e:92:fb:0d", "network": {"id": "9c8a1041-95f3-463f-a449-858dfa63c555", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-88919181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d03baea-c7", "ovs_interfaceid": "9d03baea-c746-4c97-9661-07d0e2e03291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7ee53caa-f8d2-4ff3-b29f-131d386cbc14", "address": "fa:16:3e:f6:0d:dc", "network": {"id": "5a66b974-bfc2-4121-92e0-4c22ae1e3290", "bridge": "br-int", "label": "tempest-device-tagging-net1-1666088374", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee53caa-f8", "ovs_interfaceid": "7ee53caa-f8d2-4ff3-b29f-131d386cbc14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "13cf26e5-e302-48ae-abeb-d63bbf4c0572", "address": "fa:16:3e:97:83:19", "network": {"id": "5a66b974-bfc2-4121-92e0-4c22ae1e3290", "bridge": "br-int", "label": "tempest-device-tagging-net1-1666088374", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13cf26e5-e3", "ovs_interfaceid": "13cf26e5-e302-48ae-abeb-d63bbf4c0572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "71c06aee-1c23-4a9b-9d91-73cc48cb7c23", "address": "fa:16:3e:98:bf:66", "network": {"id": "5a66b974-bfc2-4121-92e0-4c22ae1e3290", "bridge": "br-int", "label": "tempest-device-tagging-net1-1666088374", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71c06aee-1c", "ovs_interfaceid": "71c06aee-1c23-4a9b-9d91-73cc48cb7c23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "17974af1-27e5-41f4-9c13-31fb31cd6cc2", "address": "fa:16:3e:a1:d7:1f", "network": {"id": "5a66b974-bfc2-4121-92e0-4c22ae1e3290", "bridge": "br-int", "label": "tempest-device-tagging-net1-1666088374", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17974af1-27", "ovs_interfaceid": "17974af1-27e5-41f4-9c13-31fb31cd6cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a3697523-c958-4f9f-92a2-ec52e2ee249b", "address": "fa:16:3e:9f:03:16", "network": {"id": "ce8bea02-998e-4055-9ac6-e226a89f103c", "bridge": "br-int", "label": "tempest-device-tagging-net2-808946084", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3697523-c9", "ovs_interfaceid": "a3697523-c958-4f9f-92a2-ec52e2ee249b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b23e74f7-64a8-466e-840b-0365e486355f", "address": "fa:16:3e:4f:8b:2c", "network": {"id": "ce8bea02-998e-4055-9ac6-e226a89f103c", "bridge": "br-int", "label": "tempest-device-tagging-net2-808946084", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb23e74f7-64", "ovs_interfaceid": "b23e74f7-64a8-466e-840b-0365e486355f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:51:04 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:04 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc82a3d2-7935-41ed-8675-72f85453153a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:04 user nova-compute[72129]: DEBUG nova.compute.manager [req-f4e1f8c7-a90a-4b08-84b6-784d72f35248 req-4575c7fb-2113-4e3f-b5ac-5c7dd1cf45f3 service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Received event network-changed-e1d5b511-b4c8-4d81-8b78-e58ffdfb3015 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:51:04 user nova-compute[72129]: DEBUG nova.compute.manager [req-f4e1f8c7-a90a-4b08-84b6-784d72f35248 req-4575c7fb-2113-4e3f-b5ac-5c7dd1cf45f3 service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Refreshing instance network info cache due to event network-changed-e1d5b511-b4c8-4d81-8b78-e58ffdfb3015. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 13:51:04 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f4e1f8c7-a90a-4b08-84b6-784d72f35248 req-4575c7fb-2113-4e3f-b5ac-5c7dd1cf45f3 service nova] Acquiring lock "refresh_cache-e1ee9e5e-0bd8-4986-8641-d44680f97724" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:51:04 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[2131a8c2-7710-4352-8e14-9392a2d5ca7e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:04 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Running cmd (subprocess): nvme version {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:04 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] 'nvme version' failed. Not Retrying. {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 13:51:04 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] nvme not present on system {{(pid=72129) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 13:51:04 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-6af2b684-3bab-4ca8-9f8d-2f39a27f30c7 req-365da289-5779-47bd-90a5-9288c8a37ff7 service nova] Releasing lock "refresh_cache-1490f922-a4b0-43be-8826-ab527f66a350" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:51:04 user nova-compute[72129]: DEBUG nova.compute.manager [req-6af2b684-3bab-4ca8-9f8d-2f39a27f30c7 req-365da289-5779-47bd-90a5-9288c8a37ff7 service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Received event network-changed-e4a333bd-6565-4da1-ae2c-4953c3a14f53 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:51:04 user nova-compute[72129]: DEBUG nova.compute.manager [req-6af2b684-3bab-4ca8-9f8d-2f39a27f30c7 req-365da289-5779-47bd-90a5-9288c8a37ff7 service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Refreshing instance network info cache due to event network-changed-e4a333bd-6565-4da1-ae2c-4953c3a14f53. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 13:51:04 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-6af2b684-3bab-4ca8-9f8d-2f39a27f30c7 req-365da289-5779-47bd-90a5-9288c8a37ff7 service nova] Acquiring lock "refresh_cache-e1ee9e5e-0bd8-4986-8641-d44680f97724" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:51:04 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:04 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 13:51:04 user nova-compute[72129]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 13:51:04 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[74509bef-f776-462e-9ddb-238465bd9265]: (4, '') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:04 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72129) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 13:51:04 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 13:51:04 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] LIGHTOS: no hostnqn found. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 13:51:04 user nova-compute[72129]: DEBUG os_brick.utils [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f9b449c2cd3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:51:04 user nova-compute[72129]: DEBUG nova.virt.block_device [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Updating existing volume attachment record: 497fe5f4-7e56-4fa6-99ca-2372ffc6f1e4 {{(pid=72129) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 13:51:05 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:05 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:05 user nova-compute[72129]: DEBUG nova.network.neutron [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Updating instance_info_cache with network_info: [{"id": "4856f394-91dc-4fd0-9fff-8a45f53f0e01", "address": "fa:16:3e:39:15:ba", "network": {"id": "2dfa2891-a873-4a7a-8460-b78ee7a967e1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1716980837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4856f394-91", "ovs_interfaceid": "4856f394-91dc-4fd0-9fff-8a45f53f0e01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3da4a68a-4d20-4f36-bf85-e74a93a6c9f2", "address": "fa:16:3e:3a:cf:74", "network": {"id": "0238d661-fbc1-4955-8933-92891b6a621e", "bridge": "br-int", "label": "tempest-device-tagging-net1-78670494", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3da4a68a-4d", "ovs_interfaceid": "3da4a68a-4d20-4f36-bf85-e74a93a6c9f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c3fc041a-b39f-448a-a5d6-3e2b67368d50", "address": "fa:16:3e:31:e8:5e", "network": {"id": "0238d661-fbc1-4955-8933-92891b6a621e", "bridge": "br-int", "label": "tempest-device-tagging-net1-78670494", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3fc041a-b3", "ovs_interfaceid": "c3fc041a-b39f-448a-a5d6-3e2b67368d50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1a10af43-8f79-43a4-b847-2c4471576097", "address": "fa:16:3e:d9:f3:84", "network": {"id": "0238d661-fbc1-4955-8933-92891b6a621e", "bridge": "br-int", "label": "tempest-device-tagging-net1-78670494", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a10af43-8f", "ovs_interfaceid": "1a10af43-8f79-43a4-b847-2c4471576097", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e4a333bd-6565-4da1-ae2c-4953c3a14f53", "address": "fa:16:3e:06:c9:e4", "network": {"id": "0238d661-fbc1-4955-8933-92891b6a621e", "bridge": "br-int", "label": "tempest-device-tagging-net1-78670494", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4a333bd-65", "ovs_interfaceid": "e4a333bd-6565-4da1-ae2c-4953c3a14f53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e1d5b511-b4c8-4d81-8b78-e58ffdfb3015", "address": "fa:16:3e:e1:69:b3", "network": {"id": "a7073672-c19c-45cb-8549-4c0e25c52255", "bridge": "br-int", "label": "tempest-device-tagging-net2-1432218036", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d5b511-b4", "ovs_interfaceid": "e1d5b511-b4c8-4d81-8b78-e58ffdfb3015", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4bb0a232-3a92-4b85-9a12-29f8d822362e", "address": "fa:16:3e:a2:99:fb", "network": {"id": "a7073672-c19c-45cb-8549-4c0e25c52255", "bridge": "br-int", "label": "tempest-device-tagging-net2-1432218036", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bb0a232-3a", "ovs_interfaceid": "4bb0a232-3a92-4b85-9a12-29f8d822362e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:51:05 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Releasing lock "refresh_cache-e1ee9e5e-0bd8-4986-8641-d44680f97724" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:51:05 user nova-compute[72129]: DEBUG nova.compute.manager [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Instance network_info: |[{"id": "4856f394-91dc-4fd0-9fff-8a45f53f0e01", "address": "fa:16:3e:39:15:ba", "network": {"id": "2dfa2891-a873-4a7a-8460-b78ee7a967e1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1716980837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4856f394-91", "ovs_interfaceid": "4856f394-91dc-4fd0-9fff-8a45f53f0e01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3da4a68a-4d20-4f36-bf85-e74a93a6c9f2", "address": "fa:16:3e:3a:cf:74", "network": {"id": "0238d661-fbc1-4955-8933-92891b6a621e", "bridge": "br-int", "label": "tempest-device-tagging-net1-78670494", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3da4a68a-4d", "ovs_interfaceid": "3da4a68a-4d20-4f36-bf85-e74a93a6c9f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c3fc041a-b39f-448a-a5d6-3e2b67368d50", "address": "fa:16:3e:31:e8:5e", "network": {"id": "0238d661-fbc1-4955-8933-92891b6a621e", "bridge": "br-int", "label": "tempest-device-tagging-net1-78670494", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3fc041a-b3", "ovs_interfaceid": "c3fc041a-b39f-448a-a5d6-3e2b67368d50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1a10af43-8f79-43a4-b847-2c4471576097", "address": "fa:16:3e:d9:f3:84", "network": {"id": "0238d661-fbc1-4955-8933-92891b6a621e", "bridge": "br-int", "label": "tempest-device-tagging-net1-78670494", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a10af43-8f", "ovs_interfaceid": "1a10af43-8f79-43a4-b847-2c4471576097", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e4a333bd-6565-4da1-ae2c-4953c3a14f53", "address": "fa:16:3e:06:c9:e4", "network": {"id": "0238d661-fbc1-4955-8933-92891b6a621e", "bridge": "br-int", "label": "tempest-device-tagging-net1-78670494", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4a333bd-65", "ovs_interfaceid": "e4a333bd-6565-4da1-ae2c-4953c3a14f53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e1d5b511-b4c8-4d81-8b78-e58ffdfb3015", "address": "fa:16:3e:e1:69:b3", "network": {"id": "a7073672-c19c-45cb-8549-4c0e25c52255", "bridge": "br-int", "label": "tempest-device-tagging-net2-1432218036", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d5b511-b4", "ovs_interfaceid": "e1d5b511-b4c8-4d81-8b78-e58ffdfb3015", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4bb0a232-3a92-4b85-9a12-29f8d822362e", "address": "fa:16:3e:a2:99:fb", "network": {"id": "a7073672-c19c-45cb-8549-4c0e25c52255", "bridge": "br-int", "label": "tempest-device-tagging-net2-1432218036", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bb0a232-3a", "ovs_interfaceid": "4bb0a232-3a92-4b85-9a12-29f8d822362e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 13:51:05 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f4e1f8c7-a90a-4b08-84b6-784d72f35248 req-4575c7fb-2113-4e3f-b5ac-5c7dd1cf45f3 service nova] Acquired lock "refresh_cache-e1ee9e5e-0bd8-4986-8641-d44680f97724" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:51:05 user nova-compute[72129]: DEBUG nova.network.neutron [req-f4e1f8c7-a90a-4b08-84b6-784d72f35248 req-4575c7fb-2113-4e3f-b5ac-5c7dd1cf45f3 service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Refreshing network info cache for port e1d5b511-b4c8-4d81-8b78-e58ffdfb3015 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 13:51:06 user nova-compute[72129]: DEBUG nova.network.neutron [req-f4e1f8c7-a90a-4b08-84b6-784d72f35248 req-4575c7fb-2113-4e3f-b5ac-5c7dd1cf45f3 service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Updated VIF entry in instance network info cache for port e1d5b511-b4c8-4d81-8b78-e58ffdfb3015. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 13:51:06 user nova-compute[72129]: DEBUG nova.network.neutron [req-f4e1f8c7-a90a-4b08-84b6-784d72f35248 req-4575c7fb-2113-4e3f-b5ac-5c7dd1cf45f3 service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Updating instance_info_cache with network_info: [{"id": "4856f394-91dc-4fd0-9fff-8a45f53f0e01", "address": "fa:16:3e:39:15:ba", "network": {"id": "2dfa2891-a873-4a7a-8460-b78ee7a967e1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1716980837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4856f394-91", "ovs_interfaceid": "4856f394-91dc-4fd0-9fff-8a45f53f0e01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3da4a68a-4d20-4f36-bf85-e74a93a6c9f2", "address": "fa:16:3e:3a:cf:74", "network": {"id": "0238d661-fbc1-4955-8933-92891b6a621e", "bridge": "br-int", "label": "tempest-device-tagging-net1-78670494", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3da4a68a-4d", "ovs_interfaceid": "3da4a68a-4d20-4f36-bf85-e74a93a6c9f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c3fc041a-b39f-448a-a5d6-3e2b67368d50", "address": "fa:16:3e:31:e8:5e", "network": {"id": "0238d661-fbc1-4955-8933-92891b6a621e", "bridge": "br-int", "label": "tempest-device-tagging-net1-78670494", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3fc041a-b3", "ovs_interfaceid": "c3fc041a-b39f-448a-a5d6-3e2b67368d50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1a10af43-8f79-43a4-b847-2c4471576097", "address": "fa:16:3e:d9:f3:84", "network": {"id": "0238d661-fbc1-4955-8933-92891b6a621e", "bridge": "br-int", "label": "tempest-device-tagging-net1-78670494", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a10af43-8f", "ovs_interfaceid": "1a10af43-8f79-43a4-b847-2c4471576097", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e4a333bd-6565-4da1-ae2c-4953c3a14f53", "address": "fa:16:3e:06:c9:e4", "network": {"id": "0238d661-fbc1-4955-8933-92891b6a621e", "bridge": "br-int", "label": "tempest-device-tagging-net1-78670494", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4a333bd-65", "ovs_interfaceid": "e4a333bd-6565-4da1-ae2c-4953c3a14f53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e1d5b511-b4c8-4d81-8b78-e58ffdfb3015", "address": "fa:16:3e:e1:69:b3", "network": {"id": "a7073672-c19c-45cb-8549-4c0e25c52255", "bridge": "br-int", "label": "tempest-device-tagging-net2-1432218036", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d5b511-b4", "ovs_interfaceid": "e1d5b511-b4c8-4d81-8b78-e58ffdfb3015", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4bb0a232-3a92-4b85-9a12-29f8d822362e", "address": "fa:16:3e:a2:99:fb", "network": {"id": "a7073672-c19c-45cb-8549-4c0e25c52255", "bridge": "br-int", "label": "tempest-device-tagging-net2-1432218036", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bb0a232-3a", "ovs_interfaceid": "4bb0a232-3a92-4b85-9a12-29f8d822362e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:51:06 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f4e1f8c7-a90a-4b08-84b6-784d72f35248 req-4575c7fb-2113-4e3f-b5ac-5c7dd1cf45f3 service nova] Releasing lock "refresh_cache-e1ee9e5e-0bd8-4986-8641-d44680f97724" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:51:06 user nova-compute[72129]: DEBUG nova.compute.manager [req-f4e1f8c7-a90a-4b08-84b6-784d72f35248 req-4575c7fb-2113-4e3f-b5ac-5c7dd1cf45f3 service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Received event network-changed-4bb0a232-3a92-4b85-9a12-29f8d822362e {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:51:06 user nova-compute[72129]: DEBUG nova.compute.manager [req-f4e1f8c7-a90a-4b08-84b6-784d72f35248 req-4575c7fb-2113-4e3f-b5ac-5c7dd1cf45f3 service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Refreshing instance network info cache due to event network-changed-4bb0a232-3a92-4b85-9a12-29f8d822362e. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 13:51:06 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f4e1f8c7-a90a-4b08-84b6-784d72f35248 req-4575c7fb-2113-4e3f-b5ac-5c7dd1cf45f3 service nova] Acquiring lock "refresh_cache-e1ee9e5e-0bd8-4986-8641-d44680f97724" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:51:06 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f4e1f8c7-a90a-4b08-84b6-784d72f35248 req-4575c7fb-2113-4e3f-b5ac-5c7dd1cf45f3 service nova] Acquired lock "refresh_cache-e1ee9e5e-0bd8-4986-8641-d44680f97724" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:51:06 user nova-compute[72129]: DEBUG nova.network.neutron [req-f4e1f8c7-a90a-4b08-84b6-784d72f35248 req-4575c7fb-2113-4e3f-b5ac-5c7dd1cf45f3 service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Refreshing network info cache for port 4bb0a232-3a92-4b85-9a12-29f8d822362e {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 13:51:07 user nova-compute[72129]: DEBUG nova.network.neutron [req-f4e1f8c7-a90a-4b08-84b6-784d72f35248 req-4575c7fb-2113-4e3f-b5ac-5c7dd1cf45f3 service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Updated VIF entry in instance network info cache for port 4bb0a232-3a92-4b85-9a12-29f8d822362e. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 13:51:07 user nova-compute[72129]: DEBUG nova.network.neutron [req-f4e1f8c7-a90a-4b08-84b6-784d72f35248 req-4575c7fb-2113-4e3f-b5ac-5c7dd1cf45f3 service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Updating instance_info_cache with network_info: [{"id": "4856f394-91dc-4fd0-9fff-8a45f53f0e01", "address": "fa:16:3e:39:15:ba", "network": {"id": "2dfa2891-a873-4a7a-8460-b78ee7a967e1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1716980837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4856f394-91", "ovs_interfaceid": "4856f394-91dc-4fd0-9fff-8a45f53f0e01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3da4a68a-4d20-4f36-bf85-e74a93a6c9f2", "address": "fa:16:3e:3a:cf:74", "network": {"id": "0238d661-fbc1-4955-8933-92891b6a621e", "bridge": "br-int", "label": "tempest-device-tagging-net1-78670494", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3da4a68a-4d", "ovs_interfaceid": "3da4a68a-4d20-4f36-bf85-e74a93a6c9f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c3fc041a-b39f-448a-a5d6-3e2b67368d50", "address": "fa:16:3e:31:e8:5e", "network": {"id": "0238d661-fbc1-4955-8933-92891b6a621e", "bridge": "br-int", "label": "tempest-device-tagging-net1-78670494", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3fc041a-b3", "ovs_interfaceid": "c3fc041a-b39f-448a-a5d6-3e2b67368d50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1a10af43-8f79-43a4-b847-2c4471576097", "address": "fa:16:3e:d9:f3:84", "network": {"id": "0238d661-fbc1-4955-8933-92891b6a621e", "bridge": "br-int", "label": "tempest-device-tagging-net1-78670494", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a10af43-8f", "ovs_interfaceid": "1a10af43-8f79-43a4-b847-2c4471576097", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e4a333bd-6565-4da1-ae2c-4953c3a14f53", "address": "fa:16:3e:06:c9:e4", "network": {"id": "0238d661-fbc1-4955-8933-92891b6a621e", "bridge": "br-int", "label": "tempest-device-tagging-net1-78670494", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4a333bd-65", "ovs_interfaceid": "e4a333bd-6565-4da1-ae2c-4953c3a14f53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e1d5b511-b4c8-4d81-8b78-e58ffdfb3015", "address": "fa:16:3e:e1:69:b3", "network": {"id": "a7073672-c19c-45cb-8549-4c0e25c52255", "bridge": "br-int", "label": "tempest-device-tagging-net2-1432218036", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d5b511-b4", "ovs_interfaceid": "e1d5b511-b4c8-4d81-8b78-e58ffdfb3015", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4bb0a232-3a92-4b85-9a12-29f8d822362e", "address": "fa:16:3e:a2:99:fb", "network": {"id": "a7073672-c19c-45cb-8549-4c0e25c52255", "bridge": "br-int", "label": "tempest-device-tagging-net2-1432218036", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bb0a232-3a", "ovs_interfaceid": "4bb0a232-3a92-4b85-9a12-29f8d822362e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:51:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f4e1f8c7-a90a-4b08-84b6-784d72f35248 req-4575c7fb-2113-4e3f-b5ac-5c7dd1cf45f3 service nova] Releasing lock "refresh_cache-e1ee9e5e-0bd8-4986-8641-d44680f97724" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:51:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-6af2b684-3bab-4ca8-9f8d-2f39a27f30c7 req-365da289-5779-47bd-90a5-9288c8a37ff7 service nova] Acquired lock "refresh_cache-e1ee9e5e-0bd8-4986-8641-d44680f97724" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:51:07 user nova-compute[72129]: DEBUG nova.network.neutron [req-6af2b684-3bab-4ca8-9f8d-2f39a27f30c7 req-365da289-5779-47bd-90a5-9288c8a37ff7 service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Refreshing network info cache for port e4a333bd-6565-4da1-ae2c-4953c3a14f53 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 13:51:07 user nova-compute[72129]: DEBUG nova.network.neutron [req-6af2b684-3bab-4ca8-9f8d-2f39a27f30c7 req-365da289-5779-47bd-90a5-9288c8a37ff7 service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Updated VIF entry in instance network info cache for port e4a333bd-6565-4da1-ae2c-4953c3a14f53. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 13:51:07 user nova-compute[72129]: DEBUG nova.network.neutron [req-6af2b684-3bab-4ca8-9f8d-2f39a27f30c7 req-365da289-5779-47bd-90a5-9288c8a37ff7 service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Updating instance_info_cache with network_info: [{"id": "4856f394-91dc-4fd0-9fff-8a45f53f0e01", "address": "fa:16:3e:39:15:ba", "network": {"id": "2dfa2891-a873-4a7a-8460-b78ee7a967e1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1716980837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4856f394-91", "ovs_interfaceid": "4856f394-91dc-4fd0-9fff-8a45f53f0e01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3da4a68a-4d20-4f36-bf85-e74a93a6c9f2", "address": "fa:16:3e:3a:cf:74", "network": {"id": "0238d661-fbc1-4955-8933-92891b6a621e", "bridge": "br-int", "label": "tempest-device-tagging-net1-78670494", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3da4a68a-4d", "ovs_interfaceid": "3da4a68a-4d20-4f36-bf85-e74a93a6c9f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c3fc041a-b39f-448a-a5d6-3e2b67368d50", "address": "fa:16:3e:31:e8:5e", "network": {"id": "0238d661-fbc1-4955-8933-92891b6a621e", "bridge": "br-int", "label": "tempest-device-tagging-net1-78670494", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3fc041a-b3", "ovs_interfaceid": "c3fc041a-b39f-448a-a5d6-3e2b67368d50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1a10af43-8f79-43a4-b847-2c4471576097", "address": "fa:16:3e:d9:f3:84", "network": {"id": "0238d661-fbc1-4955-8933-92891b6a621e", "bridge": "br-int", "label": "tempest-device-tagging-net1-78670494", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a10af43-8f", "ovs_interfaceid": "1a10af43-8f79-43a4-b847-2c4471576097", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e4a333bd-6565-4da1-ae2c-4953c3a14f53", "address": "fa:16:3e:06:c9:e4", "network": {"id": "0238d661-fbc1-4955-8933-92891b6a621e", "bridge": "br-int", "label": "tempest-device-tagging-net1-78670494", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4a333bd-65", "ovs_interfaceid": "e4a333bd-6565-4da1-ae2c-4953c3a14f53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e1d5b511-b4c8-4d81-8b78-e58ffdfb3015", "address": "fa:16:3e:e1:69:b3", "network": {"id": "a7073672-c19c-45cb-8549-4c0e25c52255", "bridge": "br-int", "label": "tempest-device-tagging-net2-1432218036", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d5b511-b4", "ovs_interfaceid": "e1d5b511-b4c8-4d81-8b78-e58ffdfb3015", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4bb0a232-3a92-4b85-9a12-29f8d822362e", "address": "fa:16:3e:a2:99:fb", "network": {"id": "a7073672-c19c-45cb-8549-4c0e25c52255", "bridge": "br-int", "label": "tempest-device-tagging-net2-1432218036", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bb0a232-3a", "ovs_interfaceid": "4bb0a232-3a92-4b85-9a12-29f8d822362e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:51:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-6af2b684-3bab-4ca8-9f8d-2f39a27f30c7 req-365da289-5779-47bd-90a5-9288c8a37ff7 service nova] Releasing lock "refresh_cache-e1ee9e5e-0bd8-4986-8641-d44680f97724" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:51:10 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:10 user nova-compute[72129]: INFO nova.virt.block_device [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Booting with volume 04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 at /dev/vdc
Aug 01 13:51:10 user nova-compute[72129]: DEBUG os_brick.utils [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:51:10 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:10 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:10 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[194e992d-1135-4d33-8795-1eaa24d1fa0b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f9b449c2cd3d\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:10 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:10 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:10 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a866a754-a366-4f2a-a272-dbad149aa199]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:10 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:10 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:10 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb5eda9-f8ec-4927-a0d1-ff271a3eefdb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:10 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aaab88b-5760-403e-83f2-9a78a3541b47]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:10 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Running cmd (subprocess): nvme version {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:10 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] 'nvme version' failed. Not Retrying. {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 13:51:10 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:10 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.nvmeof [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] nvme not present on system {{(pid=72129) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 13:51:10 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:10 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 13:51:10 user nova-compute[72129]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 13:51:10 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f8136b-d00a-4a2d-8bab-b8b7367de8ab]: (4, '') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:10 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72129) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 13:51:10 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 13:51:10 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] LIGHTOS: no hostnqn found. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 13:51:10 user nova-compute[72129]: DEBUG os_brick.utils [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f9b449c2cd3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:51:10 user nova-compute[72129]: DEBUG nova.virt.block_device [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Updating existing volume attachment record: a6604907-99ae-4d33-97f8-8fca1d85f9dd {{(pid=72129) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG nova.compute.manager [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Start spawning the instance on the hypervisor. {{(pid=72129) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Creating instance directory {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 13:51:12 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Creating image(s)
Aug 01 13:51:12 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Did not create local disks {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Ensure instance console log exists: /opt/stack/data/nova/instances/1490f922-a4b0-43be-8826-ab527f66a350/console.log {{(pid=72129) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Start _get_guest_xml network_info=[{"id": "9d03baea-c746-4c97-9661-07d0e2e03291", "address": "fa:16:3e:92:fb:0d", "network": {"id": "9c8a1041-95f3-463f-a449-858dfa63c555", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-88919181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d03baea-c7", "ovs_interfaceid": "9d03baea-c746-4c97-9661-07d0e2e03291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7ee53caa-f8d2-4ff3-b29f-131d386cbc14", "address": "fa:16:3e:f6:0d:dc", "network": {"id": "5a66b974-bfc2-4121-92e0-4c22ae1e3290", "bridge": "br-int", "label": "tempest-device-tagging-net1-1666088374", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee53caa-f8", "ovs_interfaceid": "7ee53caa-f8d2-4ff3-b29f-131d386cbc14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "13cf26e5-e302-48ae-abeb-d63bbf4c0572", "address": "fa:16:3e:97:83:19", "network": {"id": "5a66b974-bfc2-4121-92e0-4c22ae1e3290", "bridge": "br-int", "label": "tempest-device-tagging-net1-1666088374", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13cf26e5-e3", "ovs_interfaceid": "13cf26e5-e302-48ae-abeb-d63bbf4c0572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "71c06aee-1c23-4a9b-9d91-73cc48cb7c23", "address": "fa:16:3e:98:bf:66", "network": {"id": "5a66b974-bfc2-4121-92e0-4c22ae1e3290", "bridge": "br-int", "label": "tempest-device-tagging-net1-1666088374", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71c06aee-1c", "ovs_interfaceid": "71c06aee-1c23-4a9b-9d91-73cc48cb7c23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "17974af1-27e5-41f4-9c13-31fb31cd6cc2", "address": "fa:16:3e:a1:d7:1f", "network": {"id": "5a66b974-bfc2-4121-92e0-4c22ae1e3290", "bridge": "br-int", "label": "tempest-device-tagging-net1-1666088374", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17974af1-27", "ovs_interfaceid": "17974af1-27e5-41f4-9c13-31fb31cd6cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a3697523-c958-4f9f-92a2-ec52e2ee249b", "address": "fa:16:3e:9f:03:16", "network": {"id": "ce8bea02-998e-4055-9ac6-e226a89f103c", "bridge": "br-int", "label": "tempest-device-tagging-net2-808946084", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3697523-c9", "ovs_interfaceid": "a3697523-c958-4f9f-92a2-ec52e2ee249b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b23e74f7-64a8-466e-840b-0365e486355f", "address": "fa:16:3e:4f:8b:2c", "network": {"id": "ce8bea02-998e-4055-9ac6-e226a89f103c", "bridge": "br-int", "label": "tempest-device-tagging-net2-808946084", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb23e74f7-64", "ovs_interfaceid": "b23e74f7-64a8-466e-840b-0365e486355f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '5e7ac4e2-2906-4886-b97a-546dfe319b4d', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vbtHKUSY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1490f922-a4b0-43be-8826-ab527f66a350', 'attached_at': '', 'detached_at': '', 'volume_id': '698306a3-291f-4aba-8f16-5068cd476b86', 'serial': '698306a3-291f-4aba-8f16-5068cd476b86'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None}, {'boot_index': 1, 'attachment_id': '08d5b377-52f1-4a1c-8c82-44a6d7a8280a', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uJFKvesp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1490f922-a4b0-43be-8826-ab527f66a350', 'attached_at': '', 'detached_at': '', 'volume_id': 'e57b1e53-283d-4411-8bba-a7e82c1fb350', 'serial': 'e57b1e53-283d-4411-8bba-a7e82c1fb350'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vdb', 'volume_type': None}, {'boot_index': 2, 'attachment_id': '497fe5f4-7e56-4fa6-99ca-2372ffc6f1e4', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sCyiUNRF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1490f922-a4b0-43be-8826-ab527f66a350', 'attached_at': '', 'detached_at': '', 'volume_id': '66fe3cf1-a10e-4af9-b3ac-fe234b59a512', 'serial': '66fe3cf1-a10e-4af9-b3ac-fe234b59a512'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 13:51:12 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:51:12 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:51:12 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] CPU controller missing on host. {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] CPU controller found on host. {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72129) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T13:45:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Flavor limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Image limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Flavor pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Image pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Got 1 possible topologies {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG os_brick.initiator.connector [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Factory for ISCSI on None {{(pid=72129) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Calling os-brick to attach iSCSI Volume {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vbtHKUSY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:51:12 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 13:51:12 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:51:12 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 13:51:12 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:51:12 user nova-compute[72129]: INFO os_brick.initiator.connectors.iscsi [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 13:51:12 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 -p 172.16.0.220:3260 {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[854a0486-4e68-4d3d-a74e-eb16d67467a8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 13:51:12 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 -p 172.16.0.220:3260 --interface default --op new {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[3160b548-f1c9-4315-86fd-b1ecba831b6a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86] added\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86] added
Aug 01 13:51:12 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa1f8f32-ef1d-4ecd-b099-ed2fd810acae]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f4080f-1e33-4ea7-8059-4bb3398a4295]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vbtHKUSY {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vbtHKUSY" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f3f95a-54e1-4aa8-b935-0e3cc9591c25]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vbtHKUSY'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[6066e1f9-1303-4a24-bc50-fa11aa00bc88]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[4359ccbb-ac5c-4e1d-abcc-ecc2d2d3c044]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 13:51:12 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 13:51:12 user nova-compute[72129]:  {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:51:12 user nova-compute[72129]: WARNING os_brick.initiator.connectors.iscsi [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 13:51:12 user nova-compute[72129]: 
Aug 01 13:51:12 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 -p 172.16.0.220:3260 --login {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63cff1a-0157-4155-bd9b-64f29d426590]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86, portal: 172.16.0.220,3260]
Aug 01 13:51:12 user nova-compute[72129]: Login to [iface: default, target: iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86, portal: 172.16.0.220,3260] successful.
Aug 01 13:51:12 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[51899702-4136-40e1-956b-ec0eee4522d2]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9caee40-ebde-4efc-8ff6-104837c344a9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)
Aug 01 13:51:12 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)
Aug 01 13:51:12 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.241s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Connected to 172.16.0.220:3260 {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=72129) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72129) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.025s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[8887a3bc-855c-48b4-a24c-e3d7942e681d]: (4, ('- - 0', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 13:51:12 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vbtHKUSY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 13:51:13 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.281s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:51:13 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] <== connect_volume: return (1283ms) {'type': 'block', 'scsi_wwn': '26664373463646531', 'path': '/dev/sdb'} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:51:13 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26664373463646531', 'path': '/dev/sdb'} {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 13:51:13 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Calling os-brick to attach iSCSI Volume {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 13:51:13 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uJFKvesp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:51:13 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 13:51:13 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:51:13 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:51:13 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 13:51:13 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:51:13 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:51:13 user nova-compute[72129]: INFO os_brick.initiator.connectors.iscsi [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 13:51:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 -p 172.16.0.220:3260 {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:13 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[97545742-c371-44bd-8cc8-3cd746290590]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:13 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 13:51:13 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:51:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 -p 172.16.0.220:3260 --interface default --op new {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:13 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[6991e8d7-cd16-4e6d-b3fd-c05a27df2ad1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350] added\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:13 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350] added
Aug 01 13:51:13 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:51:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:13 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf57151-ee22-40d8-a928-ef1c6c506b08]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:13 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:51:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:13 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[5931aa93-d307-4e0f-bf60-cb1490a4b169]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:13 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:51:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uJFKvesp {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uJFKvesp" returned: 0 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:13 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d7cc2f-af00-4b27-90e2-1fb661cff418]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:13 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uJFKvesp'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:51:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:13 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ccf96b8-00e6-4965-9ed0-fa509fa089b3]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:13 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:51:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:13 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[84088c07-ef7a-409a-b8a2-6aa665bd3078]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:13 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)
Aug 01 13:51:13 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:51:13 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)
Aug 01 13:51:13 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:51:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 -p 172.16.0.220:3260 --login {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:13 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[782700f3-4560-4bf7-a689-0ae3585c022f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:13 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350, portal: 172.16.0.220,3260]
Aug 01 13:51:13 user nova-compute[72129]: Login to [iface: default, target: iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350, portal: 172.16.0.220,3260] successful.
Aug 01 13:51:13 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:51:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:13 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b554d6ab-9a7b-4400-a24b-92d19d6c69b3]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:13 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:51:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:13 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c61c6b-524d-48e6-9c6d-a89436f26053]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:13 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)
Aug 01 13:51:13 user nova-compute[72129]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)
Aug 01 13:51:13 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:51:13 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)
Aug 01 13:51:13 user nova-compute[72129]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)
Aug 01 13:51:13 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:51:13 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:51:13 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Connected to 172.16.0.220:3260 {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 13:51:13 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=72129) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 13:51:13 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72129) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 13:51:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:13 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc7c0463-52bd-4fbe-888c-2bc45ddefefd]: (4, ('- - 0', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:13 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: None {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 13:51:14 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 13:51:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uJFKvesp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 13:51:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:51:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '23034353339653661', 'path': '/dev/sdc'} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:51:14 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23034353339653661', 'path': '/dev/sdc'} {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 13:51:14 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Calling os-brick to attach iSCSI Volume {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 13:51:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sCyiUNRF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:51:14 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 13:51:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:51:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:51:14 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 13:51:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:51:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:51:14 user nova-compute[72129]: INFO os_brick.initiator.connectors.iscsi [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 13:51:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 -p 172.16.0.220:3260 {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:14 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0b5bb8-0050-427f-b15d-65e9c5339ef7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 13:51:14 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:51:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 -p 172.16.0.220:3260 --interface default --op new {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:14 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e60bc36-d589-402c-9c3b-9b188da40689]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512] added\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512] added
Aug 01 13:51:14 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:51:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:14 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[db53766b-cf8d-412e-8dc9-80b5368e9e06]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:51:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:14 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac036802-a640-4d0b-9d46-c1551e900c6e]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:51:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sCyiUNRF {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sCyiUNRF" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:14 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e2b09e-ca2e-4ba6-9e3e-12b1f744e609]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sCyiUNRF'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:51:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:14 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b6b0ce-d496-4ddd-9979-9860fa7ab0c7]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:51:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:14 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[8561d775-3b72-4b68-b6ae-9f94c4b149e2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)
Aug 01 13:51:14 user nova-compute[72129]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)
Aug 01 13:51:14 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:51:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)
Aug 01 13:51:14 user nova-compute[72129]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)
Aug 01 13:51:14 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:51:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 -p 172.16.0.220:3260 --login {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:14 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[776846cd-bd4b-41ad-93b8-2e93bed17ea6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512, portal: 172.16.0.220,3260]
Aug 01 13:51:14 user nova-compute[72129]: Login to [iface: default, target: iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512, portal: 172.16.0.220,3260] successful.
Aug 01 13:51:14 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:51:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:14 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[059903d3-f084-4cbb-983a-c32374386c68]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:51:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:14 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[9146e4b3-3211-4c73-94e4-a88643ed3e00]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)
Aug 01 13:51:14 user nova-compute[72129]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)
Aug 01 13:51:14 user nova-compute[72129]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)
Aug 01 13:51:14 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:51:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)
Aug 01 13:51:14 user nova-compute[72129]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)
Aug 01 13:51:14 user nova-compute[72129]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)
Aug 01 13:51:14 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:51:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:51:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Connected to 172.16.0.220:3260 {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 13:51:15 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=72129) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 13:51:15 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72129) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 13:51:15 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:15 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:15 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84c7c2d-4e2b-428e-9fa3-0a5df8996269]: (4, ('- - 0', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:15 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 13:51:15 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sCyiUNRF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 13:51:15 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:15 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '26164633266356232', 'path': '/dev/sdd'} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26164633266356232', 'path': '/dev/sdd'} {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T13:50:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1928450351',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1928450351',id=10,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtHDuqy+Nzk7emhGVzyG8Atlb399fl8z1ienNkLDirkAyqlRTHVGlJWt3v5Ylsze6Lfcjp3h4DkXA64Z4aXGVM7KBd/eKPTCqWIQv8vR8ce9fDSbLU6nYkdK54CW21tJw==',key_name='tempest-keypair-1892312772',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12210d07b1b040b192bdbf59bf952a8b',ramdisk_id='',reservation_id='r-go2wk8ji',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1903474152',owner_user_name='tempest-TaggedBootDevicesTest_v242-1903474152-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:50:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4057f22dc0c4e3dbdc55a6a0decebd8',uuid=1490f922-a4b0-43be-8826-ab527f66a350,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d03baea-c746-4c97-9661-07d0e2e03291", "address": "fa:16:3e:92:fb:0d", "network": {"id": "9c8a1041-95f3-463f-a449-858dfa63c555", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-88919181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d03baea-c7", "ovs_interfaceid": "9d03baea-c746-4c97-9661-07d0e2e03291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Converting VIF {"id": "9d03baea-c746-4c97-9661-07d0e2e03291", "address": "fa:16:3e:92:fb:0d", "network": {"id": "9c8a1041-95f3-463f-a449-858dfa63c555", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-88919181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d03baea-c7", "ovs_interfaceid": "9d03baea-c746-4c97-9661-07d0e2e03291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:fb:0d,bridge_name='br-int',has_traffic_filtering=True,id=9d03baea-c746-4c97-9661-07d0e2e03291,network=Network(9c8a1041-95f3-463f-a449-858dfa63c555),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d03baea-c7') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T13:50:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1928450351',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1928450351',id=10,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtHDuqy+Nzk7emhGVzyG8Atlb399fl8z1ienNkLDirkAyqlRTHVGlJWt3v5Ylsze6Lfcjp3h4DkXA64Z4aXGVM7KBd/eKPTCqWIQv8vR8ce9fDSbLU6nYkdK54CW21tJw==',key_name='tempest-keypair-1892312772',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12210d07b1b040b192bdbf59bf952a8b',ramdisk_id='',reservation_id='r-go2wk8ji',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1903474152',owner_user_name='tempest-TaggedBootDevicesTest_v242-1903474152-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:50:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4057f22dc0c4e3dbdc55a6a0decebd8',uuid=1490f922-a4b0-43be-8826-ab527f66a350,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ee53caa-f8d2-4ff3-b29f-131d386cbc14", "address": "fa:16:3e:f6:0d:dc", "network": {"id": "5a66b974-bfc2-4121-92e0-4c22ae1e3290", "bridge": "br-int", "label": "tempest-device-tagging-net1-1666088374", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee53caa-f8", "ovs_interfaceid": "7ee53caa-f8d2-4ff3-b29f-131d386cbc14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Converting VIF {"id": "7ee53caa-f8d2-4ff3-b29f-131d386cbc14", "address": "fa:16:3e:f6:0d:dc", "network": {"id": "5a66b974-bfc2-4121-92e0-4c22ae1e3290", "bridge": "br-int", "label": "tempest-device-tagging-net1-1666088374", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee53caa-f8", "ovs_interfaceid": "7ee53caa-f8d2-4ff3-b29f-131d386cbc14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:0d:dc,bridge_name='br-int',has_traffic_filtering=True,id=7ee53caa-f8d2-4ff3-b29f-131d386cbc14,network=Network(5a66b974-bfc2-4121-92e0-4c22ae1e3290),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7ee53caa-f8') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T13:50:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1928450351',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1928450351',id=10,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtHDuqy+Nzk7emhGVzyG8Atlb399fl8z1ienNkLDirkAyqlRTHVGlJWt3v5Ylsze6Lfcjp3h4DkXA64Z4aXGVM7KBd/eKPTCqWIQv8vR8ce9fDSbLU6nYkdK54CW21tJw==',key_name='tempest-keypair-1892312772',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12210d07b1b040b192bdbf59bf952a8b',ramdisk_id='',reservation_id='r-go2wk8ji',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1903474152',owner_user_name='tempest-TaggedBootDevicesTest_v242-1903474152-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:50:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4057f22dc0c4e3dbdc55a6a0decebd8',uuid=1490f922-a4b0-43be-8826-ab527f66a350,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13cf26e5-e302-48ae-abeb-d63bbf4c0572", "address": "fa:16:3e:97:83:19", "network": {"id": "5a66b974-bfc2-4121-92e0-4c22ae1e3290", "bridge": "br-int", "label": "tempest-device-tagging-net1-1666088374", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13cf26e5-e3", "ovs_interfaceid": "13cf26e5-e302-48ae-abeb-d63bbf4c0572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Converting VIF {"id": "13cf26e5-e302-48ae-abeb-d63bbf4c0572", "address": "fa:16:3e:97:83:19", "network": {"id": "5a66b974-bfc2-4121-92e0-4c22ae1e3290", "bridge": "br-int", "label": "tempest-device-tagging-net1-1666088374", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13cf26e5-e3", "ovs_interfaceid": "13cf26e5-e302-48ae-abeb-d63bbf4c0572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:83:19,bridge_name='br-int',has_traffic_filtering=True,id=13cf26e5-e302-48ae-abeb-d63bbf4c0572,network=Network(5a66b974-bfc2-4121-92e0-4c22ae1e3290),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap13cf26e5-e3') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T13:50:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1928450351',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1928450351',id=10,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtHDuqy+Nzk7emhGVzyG8Atlb399fl8z1ienNkLDirkAyqlRTHVGlJWt3v5Ylsze6Lfcjp3h4DkXA64Z4aXGVM7KBd/eKPTCqWIQv8vR8ce9fDSbLU6nYkdK54CW21tJw==',key_name='tempest-keypair-1892312772',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12210d07b1b040b192bdbf59bf952a8b',ramdisk_id='',reservation_id='r-go2wk8ji',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1903474152',owner_user_name='tempest-TaggedBootDevicesTest_v242-1903474152-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:50:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4057f22dc0c4e3dbdc55a6a0decebd8',uuid=1490f922-a4b0-43be-8826-ab527f66a350,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71c06aee-1c23-4a9b-9d91-73cc48cb7c23", "address": "fa:16:3e:98:bf:66", "network": {"id": "5a66b974-bfc2-4121-92e0-4c22ae1e3290", "bridge": "br-int", "label": "tempest-device-tagging-net1-1666088374", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71c06aee-1c", "ovs_interfaceid": "71c06aee-1c23-4a9b-9d91-73cc48cb7c23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Converting VIF {"id": "71c06aee-1c23-4a9b-9d91-73cc48cb7c23", "address": "fa:16:3e:98:bf:66", "network": {"id": "5a66b974-bfc2-4121-92e0-4c22ae1e3290", "bridge": "br-int", "label": "tempest-device-tagging-net1-1666088374", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71c06aee-1c", "ovs_interfaceid": "71c06aee-1c23-4a9b-9d91-73cc48cb7c23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:bf:66,bridge_name='br-int',has_traffic_filtering=True,id=71c06aee-1c23-4a9b-9d91-73cc48cb7c23,network=Network(5a66b974-bfc2-4121-92e0-4c22ae1e3290),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71c06aee-1c') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T13:50:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1928450351',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1928450351',id=10,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtHDuqy+Nzk7emhGVzyG8Atlb399fl8z1ienNkLDirkAyqlRTHVGlJWt3v5Ylsze6Lfcjp3h4DkXA64Z4aXGVM7KBd/eKPTCqWIQv8vR8ce9fDSbLU6nYkdK54CW21tJw==',key_name='tempest-keypair-1892312772',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12210d07b1b040b192bdbf59bf952a8b',ramdisk_id='',reservation_id='r-go2wk8ji',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1903474152',owner_user_name='tempest-TaggedBootDevicesTest_v242-1903474152-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:50:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4057f22dc0c4e3dbdc55a6a0decebd8',uuid=1490f922-a4b0-43be-8826-ab527f66a350,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "17974af1-27e5-41f4-9c13-31fb31cd6cc2", "address": "fa:16:3e:a1:d7:1f", "network": {"id": "5a66b974-bfc2-4121-92e0-4c22ae1e3290", "bridge": "br-int", "label": "tempest-device-tagging-net1-1666088374", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17974af1-27", "ovs_interfaceid": "17974af1-27e5-41f4-9c13-31fb31cd6cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Converting VIF {"id": "17974af1-27e5-41f4-9c13-31fb31cd6cc2", "address": "fa:16:3e:a1:d7:1f", "network": {"id": "5a66b974-bfc2-4121-92e0-4c22ae1e3290", "bridge": "br-int", "label": "tempest-device-tagging-net1-1666088374", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17974af1-27", "ovs_interfaceid": "17974af1-27e5-41f4-9c13-31fb31cd6cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:d7:1f,bridge_name='br-int',has_traffic_filtering=True,id=17974af1-27e5-41f4-9c13-31fb31cd6cc2,network=Network(5a66b974-bfc2-4121-92e0-4c22ae1e3290),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17974af1-27') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T13:50:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1928450351',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1928450351',id=10,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtHDuqy+Nzk7emhGVzyG8Atlb399fl8z1ienNkLDirkAyqlRTHVGlJWt3v5Ylsze6Lfcjp3h4DkXA64Z4aXGVM7KBd/eKPTCqWIQv8vR8ce9fDSbLU6nYkdK54CW21tJw==',key_name='tempest-keypair-1892312772',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12210d07b1b040b192bdbf59bf952a8b',ramdisk_id='',reservation_id='r-go2wk8ji',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1903474152',owner_user_name='tempest-TaggedBootDevicesTest_v242-1903474152-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:50:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4057f22dc0c4e3dbdc55a6a0decebd8',uuid=1490f922-a4b0-43be-8826-ab527f66a350,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3697523-c958-4f9f-92a2-ec52e2ee249b", "address": "fa:16:3e:9f:03:16", "network": {"id": "ce8bea02-998e-4055-9ac6-e226a89f103c", "bridge": "br-int", "label": "tempest-device-tagging-net2-808946084", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3697523-c9", "ovs_interfaceid": "a3697523-c958-4f9f-92a2-ec52e2ee249b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Converting VIF {"id": "a3697523-c958-4f9f-92a2-ec52e2ee249b", "address": "fa:16:3e:9f:03:16", "network": {"id": "ce8bea02-998e-4055-9ac6-e226a89f103c", "bridge": "br-int", "label": "tempest-device-tagging-net2-808946084", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3697523-c9", "ovs_interfaceid": "a3697523-c958-4f9f-92a2-ec52e2ee249b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:03:16,bridge_name='br-int',has_traffic_filtering=True,id=a3697523-c958-4f9f-92a2-ec52e2ee249b,network=Network(ce8bea02-998e-4055-9ac6-e226a89f103c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3697523-c9') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T13:50:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1928450351',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1928450351',id=10,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtHDuqy+Nzk7emhGVzyG8Atlb399fl8z1ienNkLDirkAyqlRTHVGlJWt3v5Ylsze6Lfcjp3h4DkXA64Z4aXGVM7KBd/eKPTCqWIQv8vR8ce9fDSbLU6nYkdK54CW21tJw==',key_name='tempest-keypair-1892312772',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12210d07b1b040b192bdbf59bf952a8b',ramdisk_id='',reservation_id='r-go2wk8ji',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1903474152',owner_user_name='tempest-TaggedBootDevicesTest_v242-1903474152-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:50:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4057f22dc0c4e3dbdc55a6a0decebd8',uuid=1490f922-a4b0-43be-8826-ab527f66a350,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b23e74f7-64a8-466e-840b-0365e486355f", "address": "fa:16:3e:4f:8b:2c", "network": {"id": "ce8bea02-998e-4055-9ac6-e226a89f103c", "bridge": "br-int", "label": "tempest-device-tagging-net2-808946084", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb23e74f7-64", "ovs_interfaceid": "b23e74f7-64a8-466e-840b-0365e486355f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Converting VIF {"id": "b23e74f7-64a8-466e-840b-0365e486355f", "address": "fa:16:3e:4f:8b:2c", "network": {"id": "ce8bea02-998e-4055-9ac6-e226a89f103c", "bridge": "br-int", "label": "tempest-device-tagging-net2-808946084", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb23e74f7-64", "ovs_interfaceid": "b23e74f7-64a8-466e-840b-0365e486355f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:8b:2c,bridge_name='br-int',has_traffic_filtering=True,id=b23e74f7-64a8-466e-840b-0365e486355f,network=Network(ce8bea02-998e-4055-9ac6-e226a89f103c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb23e74f7-64') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG nova.objects.instance [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Lazy-loading 'pci_devices' on Instance uuid 1490f922-a4b0-43be-8826-ab527f66a350 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] End _get_guest_xml xml=<domain type="kvm">
Aug 01 13:51:16 user nova-compute[72129]:   <uuid>1490f922-a4b0-43be-8826-ab527f66a350</uuid>
Aug 01 13:51:16 user nova-compute[72129]:   <name>instance-0000000a</name>
Aug 01 13:51:16 user nova-compute[72129]:   <memory>524288</memory>
Aug 01 13:51:16 user nova-compute[72129]:   <vcpu>1</vcpu>
Aug 01 13:51:16 user nova-compute[72129]:   <metadata>
Aug 01 13:51:16 user nova-compute[72129]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 13:51:16 user nova-compute[72129]:       <nova:package version="0.0.0"/>
Aug 01 13:51:16 user nova-compute[72129]:       <nova:name>tempest-device-tagging-server-1928450351</nova:name>
Aug 01 13:51:16 user nova-compute[72129]:       <nova:creationTime>2023-08-01 13:51:12</nova:creationTime>
Aug 01 13:51:16 user nova-compute[72129]:       <nova:flavor name="m1.tiny">
Aug 01 13:51:16 user nova-compute[72129]:         <nova:memory>512</nova:memory>
Aug 01 13:51:16 user nova-compute[72129]:         <nova:disk>1</nova:disk>
Aug 01 13:51:16 user nova-compute[72129]:         <nova:swap>0</nova:swap>
Aug 01 13:51:16 user nova-compute[72129]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 13:51:16 user nova-compute[72129]:         <nova:vcpus>1</nova:vcpus>
Aug 01 13:51:16 user nova-compute[72129]:       </nova:flavor>
Aug 01 13:51:16 user nova-compute[72129]:       <nova:owner>
Aug 01 13:51:16 user nova-compute[72129]:         <nova:user uuid="b4057f22dc0c4e3dbdc55a6a0decebd8">tempest-TaggedBootDevicesTest_v242-1903474152-project-member</nova:user>
Aug 01 13:51:16 user nova-compute[72129]:         <nova:project uuid="12210d07b1b040b192bdbf59bf952a8b">tempest-TaggedBootDevicesTest_v242-1903474152</nova:project>
Aug 01 13:51:16 user nova-compute[72129]:       </nova:owner>
Aug 01 13:51:16 user nova-compute[72129]:       <nova:root type="image" uuid="b6472c34-1b0f-4034-ba3a-7e8eb5103715"/>
Aug 01 13:51:16 user nova-compute[72129]:       <nova:ports>
Aug 01 13:51:16 user nova-compute[72129]:         <nova:port uuid="9d03baea-c746-4c97-9661-07d0e2e03291">
Aug 01 13:51:16 user nova-compute[72129]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 01 13:51:16 user nova-compute[72129]:         </nova:port>
Aug 01 13:51:16 user nova-compute[72129]:         <nova:port uuid="7ee53caa-f8d2-4ff3-b29f-131d386cbc14">
Aug 01 13:51:16 user nova-compute[72129]:           <nova:ip type="fixed" address="10.1.1.205" ipVersion="4"/>
Aug 01 13:51:16 user nova-compute[72129]:         </nova:port>
Aug 01 13:51:16 user nova-compute[72129]:         <nova:port uuid="13cf26e5-e302-48ae-abeb-d63bbf4c0572">
Aug 01 13:51:16 user nova-compute[72129]:           <nova:ip type="fixed" address="10.1.1.241" ipVersion="4"/>
Aug 01 13:51:16 user nova-compute[72129]:         </nova:port>
Aug 01 13:51:16 user nova-compute[72129]:         <nova:port uuid="71c06aee-1c23-4a9b-9d91-73cc48cb7c23">
Aug 01 13:51:16 user nova-compute[72129]:           <nova:ip type="fixed" address="10.1.1.11" ipVersion="4"/>
Aug 01 13:51:16 user nova-compute[72129]:         </nova:port>
Aug 01 13:51:16 user nova-compute[72129]:         <nova:port uuid="17974af1-27e5-41f4-9c13-31fb31cd6cc2">
Aug 01 13:51:16 user nova-compute[72129]:           <nova:ip type="fixed" address="10.1.1.175" ipVersion="4"/>
Aug 01 13:51:16 user nova-compute[72129]:         </nova:port>
Aug 01 13:51:16 user nova-compute[72129]:         <nova:port uuid="a3697523-c958-4f9f-92a2-ec52e2ee249b">
Aug 01 13:51:16 user nova-compute[72129]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 01 13:51:16 user nova-compute[72129]:         </nova:port>
Aug 01 13:51:16 user nova-compute[72129]:         <nova:port uuid="b23e74f7-64a8-466e-840b-0365e486355f">
Aug 01 13:51:16 user nova-compute[72129]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 01 13:51:16 user nova-compute[72129]:         </nova:port>
Aug 01 13:51:16 user nova-compute[72129]:       </nova:ports>
Aug 01 13:51:16 user nova-compute[72129]:     </nova:instance>
Aug 01 13:51:16 user nova-compute[72129]:   </metadata>
Aug 01 13:51:16 user nova-compute[72129]:   <sysinfo type="smbios">
Aug 01 13:51:16 user nova-compute[72129]:     <system>
Aug 01 13:51:16 user nova-compute[72129]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 13:51:16 user nova-compute[72129]:       <entry name="product">OpenStack Nova</entry>
Aug 01 13:51:16 user nova-compute[72129]:       <entry name="version">0.0.0</entry>
Aug 01 13:51:16 user nova-compute[72129]:       <entry name="serial">1490f922-a4b0-43be-8826-ab527f66a350</entry>
Aug 01 13:51:16 user nova-compute[72129]:       <entry name="uuid">1490f922-a4b0-43be-8826-ab527f66a350</entry>
Aug 01 13:51:16 user nova-compute[72129]:       <entry name="family">Virtual Machine</entry>
Aug 01 13:51:16 user nova-compute[72129]:     </system>
Aug 01 13:51:16 user nova-compute[72129]:   </sysinfo>
Aug 01 13:51:16 user nova-compute[72129]:   <os>
Aug 01 13:51:16 user nova-compute[72129]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 13:51:16 user nova-compute[72129]:     <boot dev="hd"/>
Aug 01 13:51:16 user nova-compute[72129]:     <smbios mode="sysinfo"/>
Aug 01 13:51:16 user nova-compute[72129]:   </os>
Aug 01 13:51:16 user nova-compute[72129]:   <features>
Aug 01 13:51:16 user nova-compute[72129]:     <acpi/>
Aug 01 13:51:16 user nova-compute[72129]:     <apic/>
Aug 01 13:51:16 user nova-compute[72129]:     <vmcoreinfo/>
Aug 01 13:51:16 user nova-compute[72129]:   </features>
Aug 01 13:51:16 user nova-compute[72129]:   <clock offset="utc">
Aug 01 13:51:16 user nova-compute[72129]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 13:51:16 user nova-compute[72129]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 13:51:16 user nova-compute[72129]:     <timer name="hpet" present="no"/>
Aug 01 13:51:16 user nova-compute[72129]:   </clock>
Aug 01 13:51:16 user nova-compute[72129]:   <cpu mode="custom" match="exact">
Aug 01 13:51:16 user nova-compute[72129]:     <model>Nehalem</model>
Aug 01 13:51:16 user nova-compute[72129]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 13:51:16 user nova-compute[72129]:   </cpu>
Aug 01 13:51:16 user nova-compute[72129]:   <devices>
Aug 01 13:51:16 user nova-compute[72129]:     <disk type="file" device="cdrom">
Aug 01 13:51:16 user nova-compute[72129]:       <driver name="qemu" type="raw" cache="none"/>
Aug 01 13:51:16 user nova-compute[72129]:       <source file="/opt/stack/data/nova/instances/1490f922-a4b0-43be-8826-ab527f66a350/disk.config"/>
Aug 01 13:51:16 user nova-compute[72129]:       <target dev="hda" bus="ide"/>
Aug 01 13:51:16 user nova-compute[72129]:     </disk>
Aug 01 13:51:16 user nova-compute[72129]:     <disk type="block" device="disk">
Aug 01 13:51:16 user nova-compute[72129]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 13:51:16 user nova-compute[72129]:       <source dev="/dev/sdb"/>
Aug 01 13:51:16 user nova-compute[72129]:       <target dev="vda" bus="virtio"/>
Aug 01 13:51:16 user nova-compute[72129]:       <serial>698306a3-291f-4aba-8f16-5068cd476b86</serial>
Aug 01 13:51:16 user nova-compute[72129]:     </disk>
Aug 01 13:51:16 user nova-compute[72129]:     <disk type="block" device="disk">
Aug 01 13:51:16 user nova-compute[72129]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 13:51:16 user nova-compute[72129]:       <source dev="/dev/sdc"/>
Aug 01 13:51:16 user nova-compute[72129]:       <target dev="vdb" bus="virtio"/>
Aug 01 13:51:16 user nova-compute[72129]:       <serial>e57b1e53-283d-4411-8bba-a7e82c1fb350</serial>
Aug 01 13:51:16 user nova-compute[72129]:     </disk>
Aug 01 13:51:16 user nova-compute[72129]:     <disk type="block" device="disk">
Aug 01 13:51:16 user nova-compute[72129]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 13:51:16 user nova-compute[72129]:       <source dev="/dev/sdd"/>
Aug 01 13:51:16 user nova-compute[72129]:       <target dev="vdc" bus="virtio"/>
Aug 01 13:51:16 user nova-compute[72129]:       <serial>66fe3cf1-a10e-4af9-b3ac-fe234b59a512</serial>
Aug 01 13:51:16 user nova-compute[72129]:     </disk>
Aug 01 13:51:16 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 13:51:16 user nova-compute[72129]:       <mac address="fa:16:3e:92:fb:0d"/>
Aug 01 13:51:16 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 13:51:16 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 13:51:16 user nova-compute[72129]:       <target dev="tap9d03baea-c7"/>
Aug 01 13:51:16 user nova-compute[72129]:     </interface>
Aug 01 13:51:16 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 13:51:16 user nova-compute[72129]:       <mac address="fa:16:3e:f6:0d:dc"/>
Aug 01 13:51:16 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 13:51:16 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 13:51:16 user nova-compute[72129]:       <target dev="tap7ee53caa-f8"/>
Aug 01 13:51:16 user nova-compute[72129]:     </interface>
Aug 01 13:51:16 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 13:51:16 user nova-compute[72129]:       <mac address="fa:16:3e:97:83:19"/>
Aug 01 13:51:16 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 13:51:16 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 13:51:16 user nova-compute[72129]:       <target dev="tap13cf26e5-e3"/>
Aug 01 13:51:16 user nova-compute[72129]:     </interface>
Aug 01 13:51:16 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 13:51:16 user nova-compute[72129]:       <mac address="fa:16:3e:98:bf:66"/>
Aug 01 13:51:16 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 13:51:16 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 13:51:16 user nova-compute[72129]:       <target dev="tap71c06aee-1c"/>
Aug 01 13:51:16 user nova-compute[72129]:     </interface>
Aug 01 13:51:16 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 13:51:16 user nova-compute[72129]:       <mac address="fa:16:3e:a1:d7:1f"/>
Aug 01 13:51:16 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 13:51:16 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 13:51:16 user nova-compute[72129]:       <target dev="tap17974af1-27"/>
Aug 01 13:51:16 user nova-compute[72129]:     </interface>
Aug 01 13:51:16 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 13:51:16 user nova-compute[72129]:       <mac address="fa:16:3e:9f:03:16"/>
Aug 01 13:51:16 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 13:51:16 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 13:51:16 user nova-compute[72129]:       <target dev="tapa3697523-c9"/>
Aug 01 13:51:16 user nova-compute[72129]:     </interface>
Aug 01 13:51:16 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 13:51:16 user nova-compute[72129]:       <mac address="fa:16:3e:4f:8b:2c"/>
Aug 01 13:51:16 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 13:51:16 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 13:51:16 user nova-compute[72129]:       <target dev="tapb23e74f7-64"/>
Aug 01 13:51:16 user nova-compute[72129]:     </interface>
Aug 01 13:51:16 user nova-compute[72129]:     <serial type="pty">
Aug 01 13:51:16 user nova-compute[72129]:       <log file="/opt/stack/data/nova/instances/1490f922-a4b0-43be-8826-ab527f66a350/console.log" append="off"/>
Aug 01 13:51:16 user nova-compute[72129]:     </serial>
Aug 01 13:51:16 user nova-compute[72129]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 13:51:16 user nova-compute[72129]:     <video>
Aug 01 13:51:16 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 13:51:16 user nova-compute[72129]:     </video>
Aug 01 13:51:16 user nova-compute[72129]:     <rng model="virtio">
Aug 01 13:51:16 user nova-compute[72129]:       <backend model="random">/dev/urandom</backend>
Aug 01 13:51:16 user nova-compute[72129]:     </rng>
Aug 01 13:51:16 user nova-compute[72129]:     <controller type="usb" index="0" model="none"/>
Aug 01 13:51:16 user nova-compute[72129]:     <memballoon model="virtio">
Aug 01 13:51:16 user nova-compute[72129]:       <stats period="10"/>
Aug 01 13:51:16 user nova-compute[72129]:     </memballoon>
Aug 01 13:51:16 user nova-compute[72129]:   </devices>
Aug 01 13:51:16 user nova-compute[72129]: </domain>
Aug 01 13:51:16 user nova-compute[72129]:  {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T13:50:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1928450351',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1928450351',id=10,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtHDuqy+Nzk7emhGVzyG8Atlb399fl8z1ienNkLDirkAyqlRTHVGlJWt3v5Ylsze6Lfcjp3h4DkXA64Z4aXGVM7KBd/eKPTCqWIQv8vR8ce9fDSbLU6nYkdK54CW21tJw==',key_name='tempest-keypair-1892312772',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12210d07b1b040b192bdbf59bf952a8b',ramdisk_id='',reservation_id='r-go2wk8ji',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1903474152',owner_user_name='tempest-TaggedBootDevicesTest_v242-1903474152-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:50:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4057f22dc0c4e3dbdc55a6a0decebd8',uuid=1490f922-a4b0-43be-8826-ab527f66a350,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d03baea-c746-4c97-9661-07d0e2e03291", "address": "fa:16:3e:92:fb:0d", "network": {"id": "9c8a1041-95f3-463f-a449-858dfa63c555", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-88919181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d03baea-c7", "ovs_interfaceid": "9d03baea-c746-4c97-9661-07d0e2e03291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Converting VIF {"id": "9d03baea-c746-4c97-9661-07d0e2e03291", "address": "fa:16:3e:92:fb:0d", "network": {"id": "9c8a1041-95f3-463f-a449-858dfa63c555", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-88919181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d03baea-c7", "ovs_interfaceid": "9d03baea-c746-4c97-9661-07d0e2e03291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:fb:0d,bridge_name='br-int',has_traffic_filtering=True,id=9d03baea-c746-4c97-9661-07d0e2e03291,network=Network(9c8a1041-95f3-463f-a449-858dfa63c555),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d03baea-c7') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG os_vif [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:fb:0d,bridge_name='br-int',has_traffic_filtering=True,id=9d03baea-c746-4c97-9661-07d0e2e03291,network=Network(9c8a1041-95f3-463f-a449-858dfa63c555),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d03baea-c7') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9d03baea-c7, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9d03baea-c7, col_values=(('external_ids', {'iface-id': '9d03baea-c746-4c97-9661-07d0e2e03291', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:fb:0d', 'vm-uuid': '1490f922-a4b0-43be-8826-ab527f66a350'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:16 user nova-compute[72129]: INFO os_vif [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:fb:0d,bridge_name='br-int',has_traffic_filtering=True,id=9d03baea-c746-4c97-9661-07d0e2e03291,network=Network(9c8a1041-95f3-463f-a449-858dfa63c555),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d03baea-c7')
Aug 01 13:51:16 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T13:50:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1928450351',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1928450351',id=10,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtHDuqy+Nzk7emhGVzyG8Atlb399fl8z1ienNkLDirkAyqlRTHVGlJWt3v5Ylsze6Lfcjp3h4DkXA64Z4aXGVM7KBd/eKPTCqWIQv8vR8ce9fDSbLU6nYkdK54CW21tJw==',key_name='tempest-keypair-1892312772',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12210d07b1b040b192bdbf59bf952a8b',ramdisk_id='',reservation_id='r-go2wk8ji',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1903474152',owner_user_name='tempest-TaggedBootDevicesTest_v242-1903474152-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:50:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4057f22dc0c4e3dbdc55a6a0decebd8',uuid=1490f922-a4b0-43be-8826-ab527f66a350,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ee53caa-f8d2-4ff3-b29f-131d386cbc14", "address": "fa:16:3e:f6:0d:dc", "network": {"id": "5a66b974-bfc2-4121-92e0-4c22ae1e3290", "bridge": "br-int", "label": "tempest-device-tagging-net1-1666088374", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee53caa-f8", "ovs_interfaceid": "7ee53caa-f8d2-4ff3-b29f-131d386cbc14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Converting VIF {"id": "7ee53caa-f8d2-4ff3-b29f-131d386cbc14", "address": "fa:16:3e:f6:0d:dc", "network": {"id": "5a66b974-bfc2-4121-92e0-4c22ae1e3290", "bridge": "br-int", "label": "tempest-device-tagging-net1-1666088374", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee53caa-f8", "ovs_interfaceid": "7ee53caa-f8d2-4ff3-b29f-131d386cbc14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:0d:dc,bridge_name='br-int',has_traffic_filtering=True,id=7ee53caa-f8d2-4ff3-b29f-131d386cbc14,network=Network(5a66b974-bfc2-4121-92e0-4c22ae1e3290),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7ee53caa-f8') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG os_vif [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:0d:dc,bridge_name='br-int',has_traffic_filtering=True,id=7ee53caa-f8d2-4ff3-b29f-131d386cbc14,network=Network(5a66b974-bfc2-4121-92e0-4c22ae1e3290),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7ee53caa-f8') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7ee53caa-f8, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7ee53caa-f8, col_values=(('external_ids', {'iface-id': '7ee53caa-f8d2-4ff3-b29f-131d386cbc14', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:0d:dc', 'vm-uuid': '1490f922-a4b0-43be-8826-ab527f66a350'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:16 user nova-compute[72129]: INFO os_vif [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:0d:dc,bridge_name='br-int',has_traffic_filtering=True,id=7ee53caa-f8d2-4ff3-b29f-131d386cbc14,network=Network(5a66b974-bfc2-4121-92e0-4c22ae1e3290),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7ee53caa-f8')
Aug 01 13:51:16 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T13:50:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1928450351',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1928450351',id=10,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtHDuqy+Nzk7emhGVzyG8Atlb399fl8z1ienNkLDirkAyqlRTHVGlJWt3v5Ylsze6Lfcjp3h4DkXA64Z4aXGVM7KBd/eKPTCqWIQv8vR8ce9fDSbLU6nYkdK54CW21tJw==',key_name='tempest-keypair-1892312772',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12210d07b1b040b192bdbf59bf952a8b',ramdisk_id='',reservation_id='r-go2wk8ji',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1903474152',owner_user_name='tempest-TaggedBootDevicesTest_v242-1903474152-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:50:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4057f22dc0c4e3dbdc55a6a0decebd8',uuid=1490f922-a4b0-43be-8826-ab527f66a350,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13cf26e5-e302-48ae-abeb-d63bbf4c0572", "address": "fa:16:3e:97:83:19", "network": {"id": "5a66b974-bfc2-4121-92e0-4c22ae1e3290", "bridge": "br-int", "label": "tempest-device-tagging-net1-1666088374", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13cf26e5-e3", "ovs_interfaceid": "13cf26e5-e302-48ae-abeb-d63bbf4c0572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Converting VIF {"id": "13cf26e5-e302-48ae-abeb-d63bbf4c0572", "address": "fa:16:3e:97:83:19", "network": {"id": "5a66b974-bfc2-4121-92e0-4c22ae1e3290", "bridge": "br-int", "label": "tempest-device-tagging-net1-1666088374", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13cf26e5-e3", "ovs_interfaceid": "13cf26e5-e302-48ae-abeb-d63bbf4c0572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:83:19,bridge_name='br-int',has_traffic_filtering=True,id=13cf26e5-e302-48ae-abeb-d63bbf4c0572,network=Network(5a66b974-bfc2-4121-92e0-4c22ae1e3290),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap13cf26e5-e3') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG os_vif [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:83:19,bridge_name='br-int',has_traffic_filtering=True,id=13cf26e5-e302-48ae-abeb-d63bbf4c0572,network=Network(5a66b974-bfc2-4121-92e0-4c22ae1e3290),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap13cf26e5-e3') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap13cf26e5-e3, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap13cf26e5-e3, col_values=(('external_ids', {'iface-id': '13cf26e5-e302-48ae-abeb-d63bbf4c0572', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:83:19', 'vm-uuid': '1490f922-a4b0-43be-8826-ab527f66a350'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:16 user nova-compute[72129]: INFO os_vif [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:83:19,bridge_name='br-int',has_traffic_filtering=True,id=13cf26e5-e302-48ae-abeb-d63bbf4c0572,network=Network(5a66b974-bfc2-4121-92e0-4c22ae1e3290),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap13cf26e5-e3')
Aug 01 13:51:16 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T13:50:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1928450351',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1928450351',id=10,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtHDuqy+Nzk7emhGVzyG8Atlb399fl8z1ienNkLDirkAyqlRTHVGlJWt3v5Ylsze6Lfcjp3h4DkXA64Z4aXGVM7KBd/eKPTCqWIQv8vR8ce9fDSbLU6nYkdK54CW21tJw==',key_name='tempest-keypair-1892312772',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12210d07b1b040b192bdbf59bf952a8b',ramdisk_id='',reservation_id='r-go2wk8ji',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1903474152',owner_user_name='tempest-TaggedBootDevicesTest_v242-1903474152-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:50:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4057f22dc0c4e3dbdc55a6a0decebd8',uuid=1490f922-a4b0-43be-8826-ab527f66a350,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71c06aee-1c23-4a9b-9d91-73cc48cb7c23", "address": "fa:16:3e:98:bf:66", "network": {"id": "5a66b974-bfc2-4121-92e0-4c22ae1e3290", "bridge": "br-int", "label": "tempest-device-tagging-net1-1666088374", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71c06aee-1c", "ovs_interfaceid": "71c06aee-1c23-4a9b-9d91-73cc48cb7c23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Converting VIF {"id": "71c06aee-1c23-4a9b-9d91-73cc48cb7c23", "address": "fa:16:3e:98:bf:66", "network": {"id": "5a66b974-bfc2-4121-92e0-4c22ae1e3290", "bridge": "br-int", "label": "tempest-device-tagging-net1-1666088374", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71c06aee-1c", "ovs_interfaceid": "71c06aee-1c23-4a9b-9d91-73cc48cb7c23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:bf:66,bridge_name='br-int',has_traffic_filtering=True,id=71c06aee-1c23-4a9b-9d91-73cc48cb7c23,network=Network(5a66b974-bfc2-4121-92e0-4c22ae1e3290),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71c06aee-1c') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG os_vif [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:bf:66,bridge_name='br-int',has_traffic_filtering=True,id=71c06aee-1c23-4a9b-9d91-73cc48cb7c23,network=Network(5a66b974-bfc2-4121-92e0-4c22ae1e3290),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71c06aee-1c') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap71c06aee-1c, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap71c06aee-1c, col_values=(('external_ids', {'iface-id': '71c06aee-1c23-4a9b-9d91-73cc48cb7c23', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:bf:66', 'vm-uuid': '1490f922-a4b0-43be-8826-ab527f66a350'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:16 user nova-compute[72129]: INFO os_vif [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:bf:66,bridge_name='br-int',has_traffic_filtering=True,id=71c06aee-1c23-4a9b-9d91-73cc48cb7c23,network=Network(5a66b974-bfc2-4121-92e0-4c22ae1e3290),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71c06aee-1c')
Aug 01 13:51:16 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T13:50:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1928450351',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1928450351',id=10,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtHDuqy+Nzk7emhGVzyG8Atlb399fl8z1ienNkLDirkAyqlRTHVGlJWt3v5Ylsze6Lfcjp3h4DkXA64Z4aXGVM7KBd/eKPTCqWIQv8vR8ce9fDSbLU6nYkdK54CW21tJw==',key_name='tempest-keypair-1892312772',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12210d07b1b040b192bdbf59bf952a8b',ramdisk_id='',reservation_id='r-go2wk8ji',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1903474152',owner_user_name='tempest-TaggedBootDevicesTest_v242-1903474152-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:50:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4057f22dc0c4e3dbdc55a6a0decebd8',uuid=1490f922-a4b0-43be-8826-ab527f66a350,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "17974af1-27e5-41f4-9c13-31fb31cd6cc2", "address": "fa:16:3e:a1:d7:1f", "network": {"id": "5a66b974-bfc2-4121-92e0-4c22ae1e3290", "bridge": "br-int", "label": "tempest-device-tagging-net1-1666088374", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17974af1-27", "ovs_interfaceid": "17974af1-27e5-41f4-9c13-31fb31cd6cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Converting VIF {"id": "17974af1-27e5-41f4-9c13-31fb31cd6cc2", "address": "fa:16:3e:a1:d7:1f", "network": {"id": "5a66b974-bfc2-4121-92e0-4c22ae1e3290", "bridge": "br-int", "label": "tempest-device-tagging-net1-1666088374", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17974af1-27", "ovs_interfaceid": "17974af1-27e5-41f4-9c13-31fb31cd6cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:d7:1f,bridge_name='br-int',has_traffic_filtering=True,id=17974af1-27e5-41f4-9c13-31fb31cd6cc2,network=Network(5a66b974-bfc2-4121-92e0-4c22ae1e3290),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17974af1-27') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG os_vif [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:d7:1f,bridge_name='br-int',has_traffic_filtering=True,id=17974af1-27e5-41f4-9c13-31fb31cd6cc2,network=Network(5a66b974-bfc2-4121-92e0-4c22ae1e3290),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17974af1-27') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap17974af1-27, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap17974af1-27, col_values=(('external_ids', {'iface-id': '17974af1-27e5-41f4-9c13-31fb31cd6cc2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:d7:1f', 'vm-uuid': '1490f922-a4b0-43be-8826-ab527f66a350'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:16 user nova-compute[72129]: INFO os_vif [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:d7:1f,bridge_name='br-int',has_traffic_filtering=True,id=17974af1-27e5-41f4-9c13-31fb31cd6cc2,network=Network(5a66b974-bfc2-4121-92e0-4c22ae1e3290),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17974af1-27')
Aug 01 13:51:16 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T13:50:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1928450351',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1928450351',id=10,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtHDuqy+Nzk7emhGVzyG8Atlb399fl8z1ienNkLDirkAyqlRTHVGlJWt3v5Ylsze6Lfcjp3h4DkXA64Z4aXGVM7KBd/eKPTCqWIQv8vR8ce9fDSbLU6nYkdK54CW21tJw==',key_name='tempest-keypair-1892312772',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12210d07b1b040b192bdbf59bf952a8b',ramdisk_id='',reservation_id='r-go2wk8ji',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1903474152',owner_user_name='tempest-TaggedBootDevicesTest_v242-1903474152-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:50:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4057f22dc0c4e3dbdc55a6a0decebd8',uuid=1490f922-a4b0-43be-8826-ab527f66a350,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3697523-c958-4f9f-92a2-ec52e2ee249b", "address": "fa:16:3e:9f:03:16", "network": {"id": "ce8bea02-998e-4055-9ac6-e226a89f103c", "bridge": "br-int", "label": "tempest-device-tagging-net2-808946084", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3697523-c9", "ovs_interfaceid": "a3697523-c958-4f9f-92a2-ec52e2ee249b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Converting VIF {"id": "a3697523-c958-4f9f-92a2-ec52e2ee249b", "address": "fa:16:3e:9f:03:16", "network": {"id": "ce8bea02-998e-4055-9ac6-e226a89f103c", "bridge": "br-int", "label": "tempest-device-tagging-net2-808946084", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3697523-c9", "ovs_interfaceid": "a3697523-c958-4f9f-92a2-ec52e2ee249b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:03:16,bridge_name='br-int',has_traffic_filtering=True,id=a3697523-c958-4f9f-92a2-ec52e2ee249b,network=Network(ce8bea02-998e-4055-9ac6-e226a89f103c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3697523-c9') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG os_vif [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:03:16,bridge_name='br-int',has_traffic_filtering=True,id=a3697523-c958-4f9f-92a2-ec52e2ee249b,network=Network(ce8bea02-998e-4055-9ac6-e226a89f103c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3697523-c9') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa3697523-c9, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa3697523-c9, col_values=(('external_ids', {'iface-id': 'a3697523-c958-4f9f-92a2-ec52e2ee249b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:03:16', 'vm-uuid': '1490f922-a4b0-43be-8826-ab527f66a350'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:16 user nova-compute[72129]: INFO os_vif [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:03:16,bridge_name='br-int',has_traffic_filtering=True,id=a3697523-c958-4f9f-92a2-ec52e2ee249b,network=Network(ce8bea02-998e-4055-9ac6-e226a89f103c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3697523-c9')
Aug 01 13:51:16 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T13:50:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1928450351',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1928450351',id=10,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtHDuqy+Nzk7emhGVzyG8Atlb399fl8z1ienNkLDirkAyqlRTHVGlJWt3v5Ylsze6Lfcjp3h4DkXA64Z4aXGVM7KBd/eKPTCqWIQv8vR8ce9fDSbLU6nYkdK54CW21tJw==',key_name='tempest-keypair-1892312772',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12210d07b1b040b192bdbf59bf952a8b',ramdisk_id='',reservation_id='r-go2wk8ji',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1903474152',owner_user_name='tempest-TaggedBootDevicesTest_v242-1903474152-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:50:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4057f22dc0c4e3dbdc55a6a0decebd8',uuid=1490f922-a4b0-43be-8826-ab527f66a350,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b23e74f7-64a8-466e-840b-0365e486355f", "address": "fa:16:3e:4f:8b:2c", "network": {"id": "ce8bea02-998e-4055-9ac6-e226a89f103c", "bridge": "br-int", "label": "tempest-device-tagging-net2-808946084", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb23e74f7-64", "ovs_interfaceid": "b23e74f7-64a8-466e-840b-0365e486355f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Converting VIF {"id": "b23e74f7-64a8-466e-840b-0365e486355f", "address": "fa:16:3e:4f:8b:2c", "network": {"id": "ce8bea02-998e-4055-9ac6-e226a89f103c", "bridge": "br-int", "label": "tempest-device-tagging-net2-808946084", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb23e74f7-64", "ovs_interfaceid": "b23e74f7-64a8-466e-840b-0365e486355f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:8b:2c,bridge_name='br-int',has_traffic_filtering=True,id=b23e74f7-64a8-466e-840b-0365e486355f,network=Network(ce8bea02-998e-4055-9ac6-e226a89f103c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb23e74f7-64') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG os_vif [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:8b:2c,bridge_name='br-int',has_traffic_filtering=True,id=b23e74f7-64a8-466e-840b-0365e486355f,network=Network(ce8bea02-998e-4055-9ac6-e226a89f103c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb23e74f7-64') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb23e74f7-64, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb23e74f7-64, col_values=(('external_ids', {'iface-id': 'b23e74f7-64a8-466e-840b-0365e486355f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:8b:2c', 'vm-uuid': '1490f922-a4b0-43be-8826-ab527f66a350'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:16 user nova-compute[72129]: INFO os_vif [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:8b:2c,bridge_name='br-int',has_traffic_filtering=True,id=b23e74f7-64a8-466e-840b-0365e486355f,network=Network(ce8bea02-998e-4055-9ac6-e226a89f103c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb23e74f7-64')
Aug 01 13:51:16 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] No BDM found with device name hda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] No VIF found with MAC fa:16:3e:92:fb:0d, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] No VIF found with MAC fa:16:3e:a1:d7:1f, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 13:51:16 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Using config drive
Aug 01 13:51:16 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Creating config drive at /opt/stack/data/nova/instances/1490f922-a4b0-43be-8826-ab527f66a350/disk.config
Aug 01 13:51:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1490f922-a4b0-43be-8826-ab527f66a350/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpvhwdtdt1 {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1490f922-a4b0-43be-8826-ab527f66a350/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpvhwdtdt1" returned: 0 in 0.057s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:18 user nova-compute[72129]: DEBUG nova.compute.manager [req-9d2642c1-e58b-4487-92c6-3bdf2083625c req-ca3653a6-4a2d-4e29-9090-b329057d142e service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Received event network-vif-plugged-9d03baea-c746-4c97-9661-07d0e2e03291 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:51:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-9d2642c1-e58b-4487-92c6-3bdf2083625c req-ca3653a6-4a2d-4e29-9090-b329057d142e service nova] Acquiring lock "1490f922-a4b0-43be-8826-ab527f66a350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:51:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-9d2642c1-e58b-4487-92c6-3bdf2083625c req-ca3653a6-4a2d-4e29-9090-b329057d142e service nova] Lock "1490f922-a4b0-43be-8826-ab527f66a350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:51:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-9d2642c1-e58b-4487-92c6-3bdf2083625c req-ca3653a6-4a2d-4e29-9090-b329057d142e service nova] Lock "1490f922-a4b0-43be-8826-ab527f66a350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:51:18 user nova-compute[72129]: DEBUG nova.compute.manager [req-9d2642c1-e58b-4487-92c6-3bdf2083625c req-ca3653a6-4a2d-4e29-9090-b329057d142e service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] No waiting events found dispatching network-vif-plugged-9d03baea-c746-4c97-9661-07d0e2e03291 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:51:18 user nova-compute[72129]: WARNING nova.compute.manager [req-9d2642c1-e58b-4487-92c6-3bdf2083625c req-ca3653a6-4a2d-4e29-9090-b329057d142e service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Received unexpected event network-vif-plugged-9d03baea-c746-4c97-9661-07d0e2e03291 for instance with vm_state building and task_state spawning.
Aug 01 13:51:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:18 user nova-compute[72129]: DEBUG nova.compute.manager [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Start spawning the instance on the hypervisor. {{(pid=72129) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 13:51:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Creating instance directory {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 13:51:18 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Creating image(s)
Aug 01 13:51:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Did not create local disks {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 13:51:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Ensure instance console log exists: /opt/stack/data/nova/instances/e1ee9e5e-0bd8-4986-8641-d44680f97724/console.log {{(pid=72129) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 13:51:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:51:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:51:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:51:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Start _get_guest_xml network_info=[{"id": "4856f394-91dc-4fd0-9fff-8a45f53f0e01", "address": "fa:16:3e:39:15:ba", "network": {"id": "2dfa2891-a873-4a7a-8460-b78ee7a967e1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1716980837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4856f394-91", "ovs_interfaceid": "4856f394-91dc-4fd0-9fff-8a45f53f0e01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3da4a68a-4d20-4f36-bf85-e74a93a6c9f2", "address": "fa:16:3e:3a:cf:74", "network": {"id": "0238d661-fbc1-4955-8933-92891b6a621e", "bridge": "br-int", "label": "tempest-device-tagging-net1-78670494", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3da4a68a-4d", "ovs_interfaceid": "3da4a68a-4d20-4f36-bf85-e74a93a6c9f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c3fc041a-b39f-448a-a5d6-3e2b67368d50", "address": "fa:16:3e:31:e8:5e", "network": {"id": "0238d661-fbc1-4955-8933-92891b6a621e", "bridge": "br-int", "label": "tempest-device-tagging-net1-78670494", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3fc041a-b3", "ovs_interfaceid": "c3fc041a-b39f-448a-a5d6-3e2b67368d50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1a10af43-8f79-43a4-b847-2c4471576097", "address": "fa:16:3e:d9:f3:84", "network": {"id": "0238d661-fbc1-4955-8933-92891b6a621e", "bridge": "br-int", "label": "tempest-device-tagging-net1-78670494", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a10af43-8f", "ovs_interfaceid": "1a10af43-8f79-43a4-b847-2c4471576097", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e4a333bd-6565-4da1-ae2c-4953c3a14f53", "address": "fa:16:3e:06:c9:e4", "network": {"id": "0238d661-fbc1-4955-8933-92891b6a621e", "bridge": "br-int", "label": "tempest-device-tagging-net1-78670494", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4a333bd-65", "ovs_interfaceid": "e4a333bd-6565-4da1-ae2c-4953c3a14f53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e1d5b511-b4c8-4d81-8b78-e58ffdfb3015", "address": "fa:16:3e:e1:69:b3", "network": {"id": "a7073672-c19c-45cb-8549-4c0e25c52255", "bridge": "br-int", "label": "tempest-device-tagging-net2-1432218036", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d5b511-b4", "ovs_interfaceid": "e1d5b511-b4c8-4d81-8b78-e58ffdfb3015", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4bb0a232-3a92-4b85-9a12-29f8d822362e", "address": "fa:16:3e:a2:99:fb", "network": {"id": "a7073672-c19c-45cb-8549-4c0e25c52255", "bridge": "br-int", "label": "tempest-device-tagging-net2-1432218036", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bb0a232-3a", "ovs_interfaceid": "4bb0a232-3a92-4b85-9a12-29f8d822362e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '3c090e82-3c16-49fa-8041-269f9b6396bb', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WjrNARPV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e1ee9e5e-0bd8-4986-8641-d44680f97724', 'attached_at': '', 'detached_at': '', 'volume_id': 'b931025d-0e61-46c7-8838-619aeff58f08', 'serial': 'b931025d-0e61-46c7-8838-619aeff58f08'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None}, {'boot_index': 1, 'attachment_id': 'a9815c6b-f33c-4522-8b9f-6c31194531d0', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ONpRYLvh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e1ee9e5e-0bd8-4986-8641-d44680f97724', 'attached_at': '', 'detached_at': '', 'volume_id': 'f0565343-ef40-41a1-bb6a-d7d01d463a61', 'serial': 'f0565343-ef40-41a1-bb6a-d7d01d463a61'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vdb', 'volume_type': None}, {'boot_index': 2, 'attachment_id': 'a6604907-99ae-4d33-97f8-8fca1d85f9dd', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SQziXWIc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e1ee9e5e-0bd8-4986-8641-d44680f97724', 'attached_at': '', 'detached_at': '', 'volume_id': '04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23', 'serial': '04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 13:51:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:18 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:51:18 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:51:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 13:51:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] CPU controller missing on host. {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 13:51:18 user nova-compute[72129]: DEBUG nova.compute.manager [req-787422da-07bd-4bbf-8dfb-44561c1db247 req-dab43c07-bcb6-49cc-8c4f-d75aa08e0638 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Received event network-vif-plugged-7ee53caa-f8d2-4ff3-b29f-131d386cbc14 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:51:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-787422da-07bd-4bbf-8dfb-44561c1db247 req-dab43c07-bcb6-49cc-8c4f-d75aa08e0638 service nova] Acquiring lock "1490f922-a4b0-43be-8826-ab527f66a350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:51:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-787422da-07bd-4bbf-8dfb-44561c1db247 req-dab43c07-bcb6-49cc-8c4f-d75aa08e0638 service nova] Lock "1490f922-a4b0-43be-8826-ab527f66a350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:51:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-787422da-07bd-4bbf-8dfb-44561c1db247 req-dab43c07-bcb6-49cc-8c4f-d75aa08e0638 service nova] Lock "1490f922-a4b0-43be-8826-ab527f66a350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:51:18 user nova-compute[72129]: DEBUG nova.compute.manager [req-787422da-07bd-4bbf-8dfb-44561c1db247 req-dab43c07-bcb6-49cc-8c4f-d75aa08e0638 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] No waiting events found dispatching network-vif-plugged-7ee53caa-f8d2-4ff3-b29f-131d386cbc14 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:51:18 user nova-compute[72129]: WARNING nova.compute.manager [req-787422da-07bd-4bbf-8dfb-44561c1db247 req-dab43c07-bcb6-49cc-8c4f-d75aa08e0638 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Received unexpected event network-vif-plugged-7ee53caa-f8d2-4ff3-b29f-131d386cbc14 for instance with vm_state building and task_state spawning.
Aug 01 13:51:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 13:51:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] CPU controller found on host. {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 13:51:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72129) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 13:51:18 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T13:45:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 13:51:18 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Flavor limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 13:51:18 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Image limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 13:51:18 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Flavor pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 13:51:18 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Image pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 13:51:18 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 13:51:18 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 13:51:18 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 13:51:18 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Got 1 possible topologies {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 13:51:18 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 13:51:18 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 13:51:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Calling os-brick to attach iSCSI Volume {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 13:51:18 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WjrNARPV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:51:18 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 13:51:18 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:51:18 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:51:18 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 13:51:18 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:51:18 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:51:18 user nova-compute[72129]: INFO os_brick.initiator.connectors.iscsi [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 13:51:18 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 -p 172.16.0.220:3260 {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:18 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:18 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f46b523-f359-4a80-bba3-d2fbd629a43f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:18 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 13:51:18 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:51:18 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 -p 172.16.0.220:3260 --interface default --op new {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:18 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:18 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2f1b4e-3251-439c-8094-04717c44e39c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08] added\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:18 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08] added
Aug 01 13:51:18 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:51:18 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:19 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[710b061c-0209-464e-83a0-f272d46eae6d]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:19 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:51:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:19 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10f25e7-7087-4b44-898b-8976a50a70b3]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:19 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:51:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WjrNARPV {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WjrNARPV" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:19 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[de77f97b-8c2e-4e3d-ac43-79eef0811201]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:19 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WjrNARPV'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:51:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:19 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f19e9f5-d1b7-4888-9f7d-d78a63d6e6f6]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:19 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:51:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:19 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[93019eb7-8d68-4824-a298-5b79fd85e487]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:19 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)
Aug 01 13:51:19 user nova-compute[72129]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)
Aug 01 13:51:19 user nova-compute[72129]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)
Aug 01 13:51:19 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:51:19 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)
Aug 01 13:51:19 user nova-compute[72129]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)
Aug 01 13:51:19 user nova-compute[72129]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)
Aug 01 13:51:19 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:51:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 -p 172.16.0.220:3260 --login {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:19 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c79cfe8-976c-473a-91a1-45284f435c97]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:19 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08, portal: 172.16.0.220,3260]
Aug 01 13:51:19 user nova-compute[72129]: Login to [iface: default, target: iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08, portal: 172.16.0.220,3260] successful.
Aug 01 13:51:19 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:51:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:19 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[2823653a-eccb-4b4d-a213-d4b259425b40]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:19 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:51:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:19 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[23868806-9bf7-4a4a-9f2f-6e4dc8f09067]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:19 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)
Aug 01 13:51:19 user nova-compute[72129]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)
Aug 01 13:51:19 user nova-compute[72129]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)
Aug 01 13:51:19 user nova-compute[72129]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)
Aug 01 13:51:19 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:51:19 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)
Aug 01 13:51:19 user nova-compute[72129]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)
Aug 01 13:51:19 user nova-compute[72129]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)
Aug 01 13:51:19 user nova-compute[72129]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)
Aug 01 13:51:19 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:51:19 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.358s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:51:19 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Connected to 172.16.0.220:3260 {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 13:51:19 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=72129) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 13:51:19 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72129) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 13:51:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.028s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:19 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc29e43-5687-415b-9cd9-599e5f9bdd0f]: (4, ('- - 0', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:19 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 13:51:19 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WjrNARPV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 13:51:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.417s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] <== connect_volume: return (1418ms) {'type': 'block', 'scsi_wwn': '23031616639393663', 'path': '/dev/sde'} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031616639393663', 'path': '/dev/sde'} {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Calling os-brick to attach iSCSI Volume {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ONpRYLvh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:51:20 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 13:51:20 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:51:20 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 13:51:20 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:51:20 user nova-compute[72129]: INFO os_brick.initiator.connectors.iscsi [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 13:51:20 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 -p 172.16.0.220:3260 {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[4249aa2d-ef21-4e8e-ace2-9a70497ab20f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 13:51:20 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 -p 172.16.0.220:3260 --interface default --op new {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d05a25-a0dd-417b-b43f-aecae8021a80]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61] added\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61] added
Aug 01 13:51:20 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae3c434-7e9a-464d-a329-45756ca823aa]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb1a141-9f69-4561-b4c2-7a995e05cfab]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ONpRYLvh {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ONpRYLvh" returned: 0 in 0.023s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[de609b95-f161-4934-8d26-81a9579a0710]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ONpRYLvh'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[7059fbe1-c859-436b-b797-225a3ddcca5b]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e615801-0e37-43ca-bb09-a08ee32d5339]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)
Aug 01 13:51:20 user nova-compute[72129]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)
Aug 01 13:51:20 user nova-compute[72129]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)
Aug 01 13:51:20 user nova-compute[72129]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)
Aug 01 13:51:20 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)
Aug 01 13:51:20 user nova-compute[72129]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)
Aug 01 13:51:20 user nova-compute[72129]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)
Aug 01 13:51:20 user nova-compute[72129]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)
Aug 01 13:51:20 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 -p 172.16.0.220:3260 --login {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG nova.compute.manager [req-00c0bffd-21b7-4959-8362-67be8a7131fa req-6ef096cb-6d41-40d2-b6f6-09ce760f3868 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Received event network-vif-plugged-9d03baea-c746-4c97-9661-07d0e2e03291 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-00c0bffd-21b7-4959-8362-67be8a7131fa req-6ef096cb-6d41-40d2-b6f6-09ce760f3868 service nova] Acquiring lock "1490f922-a4b0-43be-8826-ab527f66a350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-00c0bffd-21b7-4959-8362-67be8a7131fa req-6ef096cb-6d41-40d2-b6f6-09ce760f3868 service nova] Lock "1490f922-a4b0-43be-8826-ab527f66a350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-00c0bffd-21b7-4959-8362-67be8a7131fa req-6ef096cb-6d41-40d2-b6f6-09ce760f3868 service nova] Lock "1490f922-a4b0-43be-8826-ab527f66a350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG nova.compute.manager [req-00c0bffd-21b7-4959-8362-67be8a7131fa req-6ef096cb-6d41-40d2-b6f6-09ce760f3868 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] No waiting events found dispatching network-vif-plugged-9d03baea-c746-4c97-9661-07d0e2e03291 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:51:20 user nova-compute[72129]: WARNING nova.compute.manager [req-00c0bffd-21b7-4959-8362-67be8a7131fa req-6ef096cb-6d41-40d2-b6f6-09ce760f3868 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Received unexpected event network-vif-plugged-9d03baea-c746-4c97-9661-07d0e2e03291 for instance with vm_state building and task_state spawning.
Aug 01 13:51:20 user nova-compute[72129]: DEBUG nova.compute.manager [req-00c0bffd-21b7-4959-8362-67be8a7131fa req-6ef096cb-6d41-40d2-b6f6-09ce760f3868 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Received event network-vif-plugged-13cf26e5-e302-48ae-abeb-d63bbf4c0572 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-00c0bffd-21b7-4959-8362-67be8a7131fa req-6ef096cb-6d41-40d2-b6f6-09ce760f3868 service nova] Acquiring lock "1490f922-a4b0-43be-8826-ab527f66a350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-00c0bffd-21b7-4959-8362-67be8a7131fa req-6ef096cb-6d41-40d2-b6f6-09ce760f3868 service nova] Lock "1490f922-a4b0-43be-8826-ab527f66a350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-00c0bffd-21b7-4959-8362-67be8a7131fa req-6ef096cb-6d41-40d2-b6f6-09ce760f3868 service nova] Lock "1490f922-a4b0-43be-8826-ab527f66a350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG nova.compute.manager [req-00c0bffd-21b7-4959-8362-67be8a7131fa req-6ef096cb-6d41-40d2-b6f6-09ce760f3868 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] No waiting events found dispatching network-vif-plugged-13cf26e5-e302-48ae-abeb-d63bbf4c0572 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:51:20 user nova-compute[72129]: WARNING nova.compute.manager [req-00c0bffd-21b7-4959-8362-67be8a7131fa req-6ef096cb-6d41-40d2-b6f6-09ce760f3868 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Received unexpected event network-vif-plugged-13cf26e5-e302-48ae-abeb-d63bbf4c0572 for instance with vm_state building and task_state spawning.
Aug 01 13:51:20 user nova-compute[72129]: DEBUG nova.compute.manager [req-00c0bffd-21b7-4959-8362-67be8a7131fa req-6ef096cb-6d41-40d2-b6f6-09ce760f3868 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Received event network-vif-plugged-13cf26e5-e302-48ae-abeb-d63bbf4c0572 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-00c0bffd-21b7-4959-8362-67be8a7131fa req-6ef096cb-6d41-40d2-b6f6-09ce760f3868 service nova] Acquiring lock "1490f922-a4b0-43be-8826-ab527f66a350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-00c0bffd-21b7-4959-8362-67be8a7131fa req-6ef096cb-6d41-40d2-b6f6-09ce760f3868 service nova] Lock "1490f922-a4b0-43be-8826-ab527f66a350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-00c0bffd-21b7-4959-8362-67be8a7131fa req-6ef096cb-6d41-40d2-b6f6-09ce760f3868 service nova] Lock "1490f922-a4b0-43be-8826-ab527f66a350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG nova.compute.manager [req-00c0bffd-21b7-4959-8362-67be8a7131fa req-6ef096cb-6d41-40d2-b6f6-09ce760f3868 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] No waiting events found dispatching network-vif-plugged-13cf26e5-e302-48ae-abeb-d63bbf4c0572 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:51:20 user nova-compute[72129]: WARNING nova.compute.manager [req-00c0bffd-21b7-4959-8362-67be8a7131fa req-6ef096cb-6d41-40d2-b6f6-09ce760f3868 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Received unexpected event network-vif-plugged-13cf26e5-e302-48ae-abeb-d63bbf4c0572 for instance with vm_state building and task_state spawning.
Aug 01 13:51:20 user nova-compute[72129]: DEBUG nova.compute.manager [req-00c0bffd-21b7-4959-8362-67be8a7131fa req-6ef096cb-6d41-40d2-b6f6-09ce760f3868 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Received event network-vif-plugged-17974af1-27e5-41f4-9c13-31fb31cd6cc2 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-00c0bffd-21b7-4959-8362-67be8a7131fa req-6ef096cb-6d41-40d2-b6f6-09ce760f3868 service nova] Acquiring lock "1490f922-a4b0-43be-8826-ab527f66a350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-00c0bffd-21b7-4959-8362-67be8a7131fa req-6ef096cb-6d41-40d2-b6f6-09ce760f3868 service nova] Lock "1490f922-a4b0-43be-8826-ab527f66a350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-00c0bffd-21b7-4959-8362-67be8a7131fa req-6ef096cb-6d41-40d2-b6f6-09ce760f3868 service nova] Lock "1490f922-a4b0-43be-8826-ab527f66a350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG nova.compute.manager [req-00c0bffd-21b7-4959-8362-67be8a7131fa req-6ef096cb-6d41-40d2-b6f6-09ce760f3868 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] No waiting events found dispatching network-vif-plugged-17974af1-27e5-41f4-9c13-31fb31cd6cc2 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:51:20 user nova-compute[72129]: WARNING nova.compute.manager [req-00c0bffd-21b7-4959-8362-67be8a7131fa req-6ef096cb-6d41-40d2-b6f6-09ce760f3868 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Received unexpected event network-vif-plugged-17974af1-27e5-41f4-9c13-31fb31cd6cc2 for instance with vm_state building and task_state spawning.
Aug 01 13:51:20 user nova-compute[72129]: DEBUG nova.compute.manager [req-00c0bffd-21b7-4959-8362-67be8a7131fa req-6ef096cb-6d41-40d2-b6f6-09ce760f3868 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Received event network-vif-plugged-17974af1-27e5-41f4-9c13-31fb31cd6cc2 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-00c0bffd-21b7-4959-8362-67be8a7131fa req-6ef096cb-6d41-40d2-b6f6-09ce760f3868 service nova] Acquiring lock "1490f922-a4b0-43be-8826-ab527f66a350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-00c0bffd-21b7-4959-8362-67be8a7131fa req-6ef096cb-6d41-40d2-b6f6-09ce760f3868 service nova] Lock "1490f922-a4b0-43be-8826-ab527f66a350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-00c0bffd-21b7-4959-8362-67be8a7131fa req-6ef096cb-6d41-40d2-b6f6-09ce760f3868 service nova] Lock "1490f922-a4b0-43be-8826-ab527f66a350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG nova.compute.manager [req-00c0bffd-21b7-4959-8362-67be8a7131fa req-6ef096cb-6d41-40d2-b6f6-09ce760f3868 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] No waiting events found dispatching network-vif-plugged-17974af1-27e5-41f4-9c13-31fb31cd6cc2 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:51:20 user nova-compute[72129]: WARNING nova.compute.manager [req-00c0bffd-21b7-4959-8362-67be8a7131fa req-6ef096cb-6d41-40d2-b6f6-09ce760f3868 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Received unexpected event network-vif-plugged-17974af1-27e5-41f4-9c13-31fb31cd6cc2 for instance with vm_state building and task_state spawning.
Aug 01 13:51:20 user nova-compute[72129]: DEBUG nova.compute.manager [req-00c0bffd-21b7-4959-8362-67be8a7131fa req-6ef096cb-6d41-40d2-b6f6-09ce760f3868 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Received event network-vif-plugged-a3697523-c958-4f9f-92a2-ec52e2ee249b {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-00c0bffd-21b7-4959-8362-67be8a7131fa req-6ef096cb-6d41-40d2-b6f6-09ce760f3868 service nova] Acquiring lock "1490f922-a4b0-43be-8826-ab527f66a350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-00c0bffd-21b7-4959-8362-67be8a7131fa req-6ef096cb-6d41-40d2-b6f6-09ce760f3868 service nova] Lock "1490f922-a4b0-43be-8826-ab527f66a350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-00c0bffd-21b7-4959-8362-67be8a7131fa req-6ef096cb-6d41-40d2-b6f6-09ce760f3868 service nova] Lock "1490f922-a4b0-43be-8826-ab527f66a350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG nova.compute.manager [req-00c0bffd-21b7-4959-8362-67be8a7131fa req-6ef096cb-6d41-40d2-b6f6-09ce760f3868 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] No waiting events found dispatching network-vif-plugged-a3697523-c958-4f9f-92a2-ec52e2ee249b {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:51:20 user nova-compute[72129]: WARNING nova.compute.manager [req-00c0bffd-21b7-4959-8362-67be8a7131fa req-6ef096cb-6d41-40d2-b6f6-09ce760f3868 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Received unexpected event network-vif-plugged-a3697523-c958-4f9f-92a2-ec52e2ee249b for instance with vm_state building and task_state spawning.
Aug 01 13:51:20 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b9a113-1897-499b-9eff-95d2f72a88e5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61, portal: 172.16.0.220,3260]
Aug 01 13:51:20 user nova-compute[72129]: Login to [iface: default, target: iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61, portal: 172.16.0.220,3260] successful.
Aug 01 13:51:20 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcbb1736-0cc3-4fa3-a10d-d039189c111a]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b91f92-7b6c-48d3-a203-184c4e5970cf]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)
Aug 01 13:51:20 user nova-compute[72129]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)
Aug 01 13:51:20 user nova-compute[72129]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)
Aug 01 13:51:20 user nova-compute[72129]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)
Aug 01 13:51:20 user nova-compute[72129]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 (non-flash)
Aug 01 13:51:20 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)
Aug 01 13:51:20 user nova-compute[72129]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)
Aug 01 13:51:20 user nova-compute[72129]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)
Aug 01 13:51:20 user nova-compute[72129]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)
Aug 01 13:51:20 user nova-compute[72129]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 (non-flash)
Aug 01 13:51:20 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.358s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Connected to 172.16.0.220:3260 {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=72129) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72129) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c69633-f91e-4caf-897c-3e1f7436bec5]: (4, ('- - 0', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ONpRYLvh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG nova.compute.manager [req-06e6da77-04d9-40d9-8ebd-6df060b06039 req-fb93199f-7b31-4ffb-838f-c3071b91baff service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Received event network-vif-plugged-7ee53caa-f8d2-4ff3-b29f-131d386cbc14 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-06e6da77-04d9-40d9-8ebd-6df060b06039 req-fb93199f-7b31-4ffb-838f-c3071b91baff service nova] Acquiring lock "1490f922-a4b0-43be-8826-ab527f66a350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-06e6da77-04d9-40d9-8ebd-6df060b06039 req-fb93199f-7b31-4ffb-838f-c3071b91baff service nova] Lock "1490f922-a4b0-43be-8826-ab527f66a350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-06e6da77-04d9-40d9-8ebd-6df060b06039 req-fb93199f-7b31-4ffb-838f-c3071b91baff service nova] Lock "1490f922-a4b0-43be-8826-ab527f66a350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG nova.compute.manager [req-06e6da77-04d9-40d9-8ebd-6df060b06039 req-fb93199f-7b31-4ffb-838f-c3071b91baff service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] No waiting events found dispatching network-vif-plugged-7ee53caa-f8d2-4ff3-b29f-131d386cbc14 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:51:20 user nova-compute[72129]: WARNING nova.compute.manager [req-06e6da77-04d9-40d9-8ebd-6df060b06039 req-fb93199f-7b31-4ffb-838f-c3071b91baff service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Received unexpected event network-vif-plugged-7ee53caa-f8d2-4ff3-b29f-131d386cbc14 for instance with vm_state building and task_state spawning.
Aug 01 13:51:20 user nova-compute[72129]: DEBUG nova.compute.manager [req-06e6da77-04d9-40d9-8ebd-6df060b06039 req-fb93199f-7b31-4ffb-838f-c3071b91baff service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Received event network-vif-plugged-71c06aee-1c23-4a9b-9d91-73cc48cb7c23 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-06e6da77-04d9-40d9-8ebd-6df060b06039 req-fb93199f-7b31-4ffb-838f-c3071b91baff service nova] Acquiring lock "1490f922-a4b0-43be-8826-ab527f66a350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-06e6da77-04d9-40d9-8ebd-6df060b06039 req-fb93199f-7b31-4ffb-838f-c3071b91baff service nova] Lock "1490f922-a4b0-43be-8826-ab527f66a350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-06e6da77-04d9-40d9-8ebd-6df060b06039 req-fb93199f-7b31-4ffb-838f-c3071b91baff service nova] Lock "1490f922-a4b0-43be-8826-ab527f66a350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG nova.compute.manager [req-06e6da77-04d9-40d9-8ebd-6df060b06039 req-fb93199f-7b31-4ffb-838f-c3071b91baff service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] No waiting events found dispatching network-vif-plugged-71c06aee-1c23-4a9b-9d91-73cc48cb7c23 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:51:20 user nova-compute[72129]: WARNING nova.compute.manager [req-06e6da77-04d9-40d9-8ebd-6df060b06039 req-fb93199f-7b31-4ffb-838f-c3071b91baff service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Received unexpected event network-vif-plugged-71c06aee-1c23-4a9b-9d91-73cc48cb7c23 for instance with vm_state building and task_state spawning.
Aug 01 13:51:20 user nova-compute[72129]: DEBUG nova.compute.manager [req-06e6da77-04d9-40d9-8ebd-6df060b06039 req-fb93199f-7b31-4ffb-838f-c3071b91baff service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Received event network-vif-plugged-71c06aee-1c23-4a9b-9d91-73cc48cb7c23 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-06e6da77-04d9-40d9-8ebd-6df060b06039 req-fb93199f-7b31-4ffb-838f-c3071b91baff service nova] Acquiring lock "1490f922-a4b0-43be-8826-ab527f66a350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-06e6da77-04d9-40d9-8ebd-6df060b06039 req-fb93199f-7b31-4ffb-838f-c3071b91baff service nova] Lock "1490f922-a4b0-43be-8826-ab527f66a350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-06e6da77-04d9-40d9-8ebd-6df060b06039 req-fb93199f-7b31-4ffb-838f-c3071b91baff service nova] Lock "1490f922-a4b0-43be-8826-ab527f66a350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG nova.compute.manager [req-06e6da77-04d9-40d9-8ebd-6df060b06039 req-fb93199f-7b31-4ffb-838f-c3071b91baff service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] No waiting events found dispatching network-vif-plugged-71c06aee-1c23-4a9b-9d91-73cc48cb7c23 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:51:20 user nova-compute[72129]: WARNING nova.compute.manager [req-06e6da77-04d9-40d9-8ebd-6df060b06039 req-fb93199f-7b31-4ffb-838f-c3071b91baff service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Received unexpected event network-vif-plugged-71c06aee-1c23-4a9b-9d91-73cc48cb7c23 for instance with vm_state building and task_state spawning.
Aug 01 13:51:20 user nova-compute[72129]: DEBUG nova.compute.manager [req-06e6da77-04d9-40d9-8ebd-6df060b06039 req-fb93199f-7b31-4ffb-838f-c3071b91baff service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Received event network-vif-plugged-b23e74f7-64a8-466e-840b-0365e486355f {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-06e6da77-04d9-40d9-8ebd-6df060b06039 req-fb93199f-7b31-4ffb-838f-c3071b91baff service nova] Acquiring lock "1490f922-a4b0-43be-8826-ab527f66a350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-06e6da77-04d9-40d9-8ebd-6df060b06039 req-fb93199f-7b31-4ffb-838f-c3071b91baff service nova] Lock "1490f922-a4b0-43be-8826-ab527f66a350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-06e6da77-04d9-40d9-8ebd-6df060b06039 req-fb93199f-7b31-4ffb-838f-c3071b91baff service nova] Lock "1490f922-a4b0-43be-8826-ab527f66a350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG nova.compute.manager [req-06e6da77-04d9-40d9-8ebd-6df060b06039 req-fb93199f-7b31-4ffb-838f-c3071b91baff service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] No waiting events found dispatching network-vif-plugged-b23e74f7-64a8-466e-840b-0365e486355f {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:51:20 user nova-compute[72129]: WARNING nova.compute.manager [req-06e6da77-04d9-40d9-8ebd-6df060b06039 req-fb93199f-7b31-4ffb-838f-c3071b91baff service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Received unexpected event network-vif-plugged-b23e74f7-64a8-466e-840b-0365e486355f for instance with vm_state building and task_state spawning.
Aug 01 13:51:20 user nova-compute[72129]: DEBUG nova.compute.manager [req-06e6da77-04d9-40d9-8ebd-6df060b06039 req-fb93199f-7b31-4ffb-838f-c3071b91baff service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Received event network-vif-plugged-b23e74f7-64a8-466e-840b-0365e486355f {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-06e6da77-04d9-40d9-8ebd-6df060b06039 req-fb93199f-7b31-4ffb-838f-c3071b91baff service nova] Acquiring lock "1490f922-a4b0-43be-8826-ab527f66a350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-06e6da77-04d9-40d9-8ebd-6df060b06039 req-fb93199f-7b31-4ffb-838f-c3071b91baff service nova] Lock "1490f922-a4b0-43be-8826-ab527f66a350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-06e6da77-04d9-40d9-8ebd-6df060b06039 req-fb93199f-7b31-4ffb-838f-c3071b91baff service nova] Lock "1490f922-a4b0-43be-8826-ab527f66a350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:51:20 user nova-compute[72129]: DEBUG nova.compute.manager [req-06e6da77-04d9-40d9-8ebd-6df060b06039 req-fb93199f-7b31-4ffb-838f-c3071b91baff service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] No waiting events found dispatching network-vif-plugged-b23e74f7-64a8-466e-840b-0365e486355f {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:51:20 user nova-compute[72129]: WARNING nova.compute.manager [req-06e6da77-04d9-40d9-8ebd-6df060b06039 req-fb93199f-7b31-4ffb-838f-c3071b91baff service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Received unexpected event network-vif-plugged-b23e74f7-64a8-466e-840b-0365e486355f for instance with vm_state building and task_state spawning.
Aug 01 13:51:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:21 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.404s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:51:21 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] <== connect_volume: return (1408ms) {'type': 'block', 'scsi_wwn': '23963633764303961', 'path': '/dev/sdf'} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:51:21 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963633764303961', 'path': '/dev/sdf'} {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 13:51:21 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Calling os-brick to attach iSCSI Volume {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 13:51:21 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SQziXWIc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:51:21 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 13:51:21 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:51:21 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:51:21 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 13:51:21 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:51:21 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:51:21 user nova-compute[72129]: INFO os_brick.initiator.connectors.iscsi [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 13:51:21 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 -p 172.16.0.220:3260 {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:21 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:21 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd13bc19-b1a8-49d6-9942-5ad7e0057abc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:21 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 13:51:21 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:51:21 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 -p 172.16.0.220:3260 --interface default --op new {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:21 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:21 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[6925c4ac-1a29-4378-b572-4b45532b08d5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23] added\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:21 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23] added
Aug 01 13:51:21 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:51:21 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:21 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:21 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d788f53-4b2f-4f81-9719-c6b3e7de8588]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:21 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:51:21 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:22 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:22 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d763c412-aee5-4c01-899a-490fda18592e]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:22 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:51:22 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SQziXWIc {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:22 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SQziXWIc" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:22 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec7ea7a9-93ba-4d86-899e-b491973b9585]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:22 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SQziXWIc'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:51:22 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:22 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:22 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ec4efb-03b0-4491-a066-8aa5d72eecb2]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:22 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:51:22 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:22 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:22 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[131ba616-5df8-4293-aff8-213b1a903c73]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:22 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)
Aug 01 13:51:22 user nova-compute[72129]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)
Aug 01 13:51:22 user nova-compute[72129]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)
Aug 01 13:51:22 user nova-compute[72129]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)
Aug 01 13:51:22 user nova-compute[72129]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 (non-flash)
Aug 01 13:51:22 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:51:22 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)
Aug 01 13:51:22 user nova-compute[72129]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)
Aug 01 13:51:22 user nova-compute[72129]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)
Aug 01 13:51:22 user nova-compute[72129]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)
Aug 01 13:51:22 user nova-compute[72129]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 (non-flash)
Aug 01 13:51:22 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:51:22 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 -p 172.16.0.220:3260 --login {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:22 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:22 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[926f2103-f479-4b48-b97e-d204f185ef1d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:22 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23, portal: 172.16.0.220,3260]
Aug 01 13:51:22 user nova-compute[72129]: Login to [iface: default, target: iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23, portal: 172.16.0.220,3260] successful.
Aug 01 13:51:22 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:51:22 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:22 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:22 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed212ff-52c3-4745-b890-a6d3f473be8c]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:22 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:51:22 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:22 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:22 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ccf970-9d90-417a-b760-9739f00e0317]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:22 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)
Aug 01 13:51:22 user nova-compute[72129]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)
Aug 01 13:51:22 user nova-compute[72129]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)
Aug 01 13:51:22 user nova-compute[72129]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)
Aug 01 13:51:22 user nova-compute[72129]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 (non-flash)
Aug 01 13:51:22 user nova-compute[72129]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 (non-flash)
Aug 01 13:51:22 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:51:22 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)
Aug 01 13:51:22 user nova-compute[72129]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)
Aug 01 13:51:22 user nova-compute[72129]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)
Aug 01 13:51:22 user nova-compute[72129]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)
Aug 01 13:51:22 user nova-compute[72129]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 (non-flash)
Aug 01 13:51:22 user nova-compute[72129]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 (non-flash)
Aug 01 13:51:22 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:51:22 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:51:22 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Connected to 172.16.0.220:3260 {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 13:51:22 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=72129) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 13:51:22 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72129) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 13:51:22 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:22 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:22 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[9477c329-ee35-409b-ab23-ad233fa4fab3]: (4, ('- - 0', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:22 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 13:51:22 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SQziXWIc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 13:51:22 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690897882.3860097, 1490f922-a4b0-43be-8826-ab527f66a350 => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:51:22 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] VM Resumed (Lifecycle Event)
Aug 01 13:51:22 user nova-compute[72129]: DEBUG nova.compute.manager [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Instance event wait completed in 0 seconds for  {{(pid=72129) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 13:51:22 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Guest created on hypervisor {{(pid=72129) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 13:51:22 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Instance spawned successfully.
Aug 01 13:51:22 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 13:51:22 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:51:22 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 13:51:22 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Found default for hw_cdrom_bus of ide {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:51:22 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Found default for hw_disk_bus of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:51:22 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Found default for hw_input_bus of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:51:22 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Found default for hw_pointer_model of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:51:22 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Found default for hw_video_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:51:22 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Found default for hw_vif_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:51:22 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 13:51:22 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690897882.3913178, 1490f922-a4b0-43be-8826-ab527f66a350 => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:51:22 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] VM Started (Lifecycle Event)
Aug 01 13:51:22 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:51:22 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 13:51:22 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 13:51:22 user nova-compute[72129]: INFO nova.compute.manager [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Took 10.51 seconds to spawn the instance on the hypervisor.
Aug 01 13:51:22 user nova-compute[72129]: DEBUG nova.compute.manager [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:51:22 user nova-compute[72129]: INFO nova.compute.manager [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Took 39.14 seconds to build instance.
Aug 01 13:51:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-bc70c8e6-9c4a-40b8-8f3a-26fc4ea07aa8 tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Lock "1490f922-a4b0-43be-8826-ab527f66a350" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 39.297s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:51:22 user nova-compute[72129]: DEBUG nova.compute.manager [req-77c6de76-55bd-49d1-80b1-8ea82a8aceaa req-aad8caa3-3e5e-48cb-9d1a-b126afcc0b88 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Received event network-vif-plugged-a3697523-c958-4f9f-92a2-ec52e2ee249b {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:51:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-77c6de76-55bd-49d1-80b1-8ea82a8aceaa req-aad8caa3-3e5e-48cb-9d1a-b126afcc0b88 service nova] Acquiring lock "1490f922-a4b0-43be-8826-ab527f66a350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:51:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-77c6de76-55bd-49d1-80b1-8ea82a8aceaa req-aad8caa3-3e5e-48cb-9d1a-b126afcc0b88 service nova] Lock "1490f922-a4b0-43be-8826-ab527f66a350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:51:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-77c6de76-55bd-49d1-80b1-8ea82a8aceaa req-aad8caa3-3e5e-48cb-9d1a-b126afcc0b88 service nova] Lock "1490f922-a4b0-43be-8826-ab527f66a350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:51:22 user nova-compute[72129]: DEBUG nova.compute.manager [req-77c6de76-55bd-49d1-80b1-8ea82a8aceaa req-aad8caa3-3e5e-48cb-9d1a-b126afcc0b88 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] No waiting events found dispatching network-vif-plugged-a3697523-c958-4f9f-92a2-ec52e2ee249b {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:51:22 user nova-compute[72129]: WARNING nova.compute.manager [req-77c6de76-55bd-49d1-80b1-8ea82a8aceaa req-aad8caa3-3e5e-48cb-9d1a-b126afcc0b88 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Received unexpected event network-vif-plugged-a3697523-c958-4f9f-92a2-ec52e2ee249b for instance with vm_state active and task_state None.
Aug 01 13:51:23 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '23362383438653535', 'path': '/dev/sdg'} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23362383438653535', 'path': '/dev/sdg'} {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T13:50:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1241803801',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1241803801',id=11,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+QtfmHSYayd423+Jyi4G3aVMwHbijAAkXCDfLEQf4gBJATuD2dk3LYaj/9StA19vP6tOnx01tyID845MCigJxBrCNqDQZakylTkXzkcsXu0p0VQpMF87v9qpWxh97hvQ==',key_name='tempest-keypair-38580498',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b3a8ce92ea64365b59ae1e4cd450941',ramdisk_id='',reservation_id='r-n7fx3bly',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1602482701',owner_user_name='tempest-TaggedBootDevicesTest-1602482701-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:50:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1283f74fc4f74184a36fddf17c319ae1',uuid=e1ee9e5e-0bd8-4986-8641-d44680f97724,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4856f394-91dc-4fd0-9fff-8a45f53f0e01", "address": "fa:16:3e:39:15:ba", "network": {"id": "2dfa2891-a873-4a7a-8460-b78ee7a967e1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1716980837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4856f394-91", "ovs_interfaceid": "4856f394-91dc-4fd0-9fff-8a45f53f0e01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Converting VIF {"id": "4856f394-91dc-4fd0-9fff-8a45f53f0e01", "address": "fa:16:3e:39:15:ba", "network": {"id": "2dfa2891-a873-4a7a-8460-b78ee7a967e1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1716980837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4856f394-91", "ovs_interfaceid": "4856f394-91dc-4fd0-9fff-8a45f53f0e01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:15:ba,bridge_name='br-int',has_traffic_filtering=True,id=4856f394-91dc-4fd0-9fff-8a45f53f0e01,network=Network(2dfa2891-a873-4a7a-8460-b78ee7a967e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4856f394-91') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T13:50:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1241803801',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1241803801',id=11,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+QtfmHSYayd423+Jyi4G3aVMwHbijAAkXCDfLEQf4gBJATuD2dk3LYaj/9StA19vP6tOnx01tyID845MCigJxBrCNqDQZakylTkXzkcsXu0p0VQpMF87v9qpWxh97hvQ==',key_name='tempest-keypair-38580498',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b3a8ce92ea64365b59ae1e4cd450941',ramdisk_id='',reservation_id='r-n7fx3bly',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1602482701',owner_user_name='tempest-TaggedBootDevicesTest-1602482701-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:50:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1283f74fc4f74184a36fddf17c319ae1',uuid=e1ee9e5e-0bd8-4986-8641-d44680f97724,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3da4a68a-4d20-4f36-bf85-e74a93a6c9f2", "address": "fa:16:3e:3a:cf:74", "network": {"id": "0238d661-fbc1-4955-8933-92891b6a621e", "bridge": "br-int", "label": "tempest-device-tagging-net1-78670494", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3da4a68a-4d", "ovs_interfaceid": "3da4a68a-4d20-4f36-bf85-e74a93a6c9f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Converting VIF {"id": "3da4a68a-4d20-4f36-bf85-e74a93a6c9f2", "address": "fa:16:3e:3a:cf:74", "network": {"id": "0238d661-fbc1-4955-8933-92891b6a621e", "bridge": "br-int", "label": "tempest-device-tagging-net1-78670494", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3da4a68a-4d", "ovs_interfaceid": "3da4a68a-4d20-4f36-bf85-e74a93a6c9f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:cf:74,bridge_name='br-int',has_traffic_filtering=True,id=3da4a68a-4d20-4f36-bf85-e74a93a6c9f2,network=Network(0238d661-fbc1-4955-8933-92891b6a621e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3da4a68a-4d') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T13:50:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1241803801',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1241803801',id=11,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+QtfmHSYayd423+Jyi4G3aVMwHbijAAkXCDfLEQf4gBJATuD2dk3LYaj/9StA19vP6tOnx01tyID845MCigJxBrCNqDQZakylTkXzkcsXu0p0VQpMF87v9qpWxh97hvQ==',key_name='tempest-keypair-38580498',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b3a8ce92ea64365b59ae1e4cd450941',ramdisk_id='',reservation_id='r-n7fx3bly',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1602482701',owner_user_name='tempest-TaggedBootDevicesTest-1602482701-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:50:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1283f74fc4f74184a36fddf17c319ae1',uuid=e1ee9e5e-0bd8-4986-8641-d44680f97724,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3fc041a-b39f-448a-a5d6-3e2b67368d50", "address": "fa:16:3e:31:e8:5e", "network": {"id": "0238d661-fbc1-4955-8933-92891b6a621e", "bridge": "br-int", "label": "tempest-device-tagging-net1-78670494", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3fc041a-b3", "ovs_interfaceid": "c3fc041a-b39f-448a-a5d6-3e2b67368d50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Converting VIF {"id": "c3fc041a-b39f-448a-a5d6-3e2b67368d50", "address": "fa:16:3e:31:e8:5e", "network": {"id": "0238d661-fbc1-4955-8933-92891b6a621e", "bridge": "br-int", "label": "tempest-device-tagging-net1-78670494", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3fc041a-b3", "ovs_interfaceid": "c3fc041a-b39f-448a-a5d6-3e2b67368d50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:e8:5e,bridge_name='br-int',has_traffic_filtering=True,id=c3fc041a-b39f-448a-a5d6-3e2b67368d50,network=Network(0238d661-fbc1-4955-8933-92891b6a621e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc3fc041a-b3') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T13:50:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1241803801',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1241803801',id=11,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+QtfmHSYayd423+Jyi4G3aVMwHbijAAkXCDfLEQf4gBJATuD2dk3LYaj/9StA19vP6tOnx01tyID845MCigJxBrCNqDQZakylTkXzkcsXu0p0VQpMF87v9qpWxh97hvQ==',key_name='tempest-keypair-38580498',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b3a8ce92ea64365b59ae1e4cd450941',ramdisk_id='',reservation_id='r-n7fx3bly',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1602482701',owner_user_name='tempest-TaggedBootDevicesTest-1602482701-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:50:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1283f74fc4f74184a36fddf17c319ae1',uuid=e1ee9e5e-0bd8-4986-8641-d44680f97724,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a10af43-8f79-43a4-b847-2c4471576097", "address": "fa:16:3e:d9:f3:84", "network": {"id": "0238d661-fbc1-4955-8933-92891b6a621e", "bridge": "br-int", "label": "tempest-device-tagging-net1-78670494", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a10af43-8f", "ovs_interfaceid": "1a10af43-8f79-43a4-b847-2c4471576097", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Converting VIF {"id": "1a10af43-8f79-43a4-b847-2c4471576097", "address": "fa:16:3e:d9:f3:84", "network": {"id": "0238d661-fbc1-4955-8933-92891b6a621e", "bridge": "br-int", "label": "tempest-device-tagging-net1-78670494", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a10af43-8f", "ovs_interfaceid": "1a10af43-8f79-43a4-b847-2c4471576097", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:f3:84,bridge_name='br-int',has_traffic_filtering=True,id=1a10af43-8f79-43a4-b847-2c4471576097,network=Network(0238d661-fbc1-4955-8933-92891b6a621e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a10af43-8f') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T13:50:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1241803801',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1241803801',id=11,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+QtfmHSYayd423+Jyi4G3aVMwHbijAAkXCDfLEQf4gBJATuD2dk3LYaj/9StA19vP6tOnx01tyID845MCigJxBrCNqDQZakylTkXzkcsXu0p0VQpMF87v9qpWxh97hvQ==',key_name='tempest-keypair-38580498',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b3a8ce92ea64365b59ae1e4cd450941',ramdisk_id='',reservation_id='r-n7fx3bly',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1602482701',owner_user_name='tempest-TaggedBootDevicesTest-1602482701-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:50:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1283f74fc4f74184a36fddf17c319ae1',uuid=e1ee9e5e-0bd8-4986-8641-d44680f97724,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4a333bd-6565-4da1-ae2c-4953c3a14f53", "address": "fa:16:3e:06:c9:e4", "network": {"id": "0238d661-fbc1-4955-8933-92891b6a621e", "bridge": "br-int", "label": "tempest-device-tagging-net1-78670494", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4a333bd-65", "ovs_interfaceid": "e4a333bd-6565-4da1-ae2c-4953c3a14f53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Converting VIF {"id": "e4a333bd-6565-4da1-ae2c-4953c3a14f53", "address": "fa:16:3e:06:c9:e4", "network": {"id": "0238d661-fbc1-4955-8933-92891b6a621e", "bridge": "br-int", "label": "tempest-device-tagging-net1-78670494", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4a333bd-65", "ovs_interfaceid": "e4a333bd-6565-4da1-ae2c-4953c3a14f53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:c9:e4,bridge_name='br-int',has_traffic_filtering=True,id=e4a333bd-6565-4da1-ae2c-4953c3a14f53,network=Network(0238d661-fbc1-4955-8933-92891b6a621e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4a333bd-65') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T13:50:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1241803801',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1241803801',id=11,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+QtfmHSYayd423+Jyi4G3aVMwHbijAAkXCDfLEQf4gBJATuD2dk3LYaj/9StA19vP6tOnx01tyID845MCigJxBrCNqDQZakylTkXzkcsXu0p0VQpMF87v9qpWxh97hvQ==',key_name='tempest-keypair-38580498',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b3a8ce92ea64365b59ae1e4cd450941',ramdisk_id='',reservation_id='r-n7fx3bly',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1602482701',owner_user_name='tempest-TaggedBootDevicesTest-1602482701-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:50:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1283f74fc4f74184a36fddf17c319ae1',uuid=e1ee9e5e-0bd8-4986-8641-d44680f97724,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1d5b511-b4c8-4d81-8b78-e58ffdfb3015", "address": "fa:16:3e:e1:69:b3", "network": {"id": "a7073672-c19c-45cb-8549-4c0e25c52255", "bridge": "br-int", "label": "tempest-device-tagging-net2-1432218036", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d5b511-b4", "ovs_interfaceid": "e1d5b511-b4c8-4d81-8b78-e58ffdfb3015", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Converting VIF {"id": "e1d5b511-b4c8-4d81-8b78-e58ffdfb3015", "address": "fa:16:3e:e1:69:b3", "network": {"id": "a7073672-c19c-45cb-8549-4c0e25c52255", "bridge": "br-int", "label": "tempest-device-tagging-net2-1432218036", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d5b511-b4", "ovs_interfaceid": "e1d5b511-b4c8-4d81-8b78-e58ffdfb3015", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:69:b3,bridge_name='br-int',has_traffic_filtering=True,id=e1d5b511-b4c8-4d81-8b78-e58ffdfb3015,network=Network(a7073672-c19c-45cb-8549-4c0e25c52255),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1d5b511-b4') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T13:50:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1241803801',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1241803801',id=11,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+QtfmHSYayd423+Jyi4G3aVMwHbijAAkXCDfLEQf4gBJATuD2dk3LYaj/9StA19vP6tOnx01tyID845MCigJxBrCNqDQZakylTkXzkcsXu0p0VQpMF87v9qpWxh97hvQ==',key_name='tempest-keypair-38580498',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b3a8ce92ea64365b59ae1e4cd450941',ramdisk_id='',reservation_id='r-n7fx3bly',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1602482701',owner_user_name='tempest-TaggedBootDevicesTest-1602482701-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:50:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1283f74fc4f74184a36fddf17c319ae1',uuid=e1ee9e5e-0bd8-4986-8641-d44680f97724,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4bb0a232-3a92-4b85-9a12-29f8d822362e", "address": "fa:16:3e:a2:99:fb", "network": {"id": "a7073672-c19c-45cb-8549-4c0e25c52255", "bridge": "br-int", "label": "tempest-device-tagging-net2-1432218036", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bb0a232-3a", "ovs_interfaceid": "4bb0a232-3a92-4b85-9a12-29f8d822362e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Converting VIF {"id": "4bb0a232-3a92-4b85-9a12-29f8d822362e", "address": "fa:16:3e:a2:99:fb", "network": {"id": "a7073672-c19c-45cb-8549-4c0e25c52255", "bridge": "br-int", "label": "tempest-device-tagging-net2-1432218036", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bb0a232-3a", "ovs_interfaceid": "4bb0a232-3a92-4b85-9a12-29f8d822362e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:99:fb,bridge_name='br-int',has_traffic_filtering=True,id=4bb0a232-3a92-4b85-9a12-29f8d822362e,network=Network(a7073672-c19c-45cb-8549-4c0e25c52255),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bb0a232-3a') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG nova.objects.instance [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Lazy-loading 'pci_devices' on Instance uuid e1ee9e5e-0bd8-4986-8641-d44680f97724 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] End _get_guest_xml xml=<domain type="kvm">
Aug 01 13:51:23 user nova-compute[72129]:   <uuid>e1ee9e5e-0bd8-4986-8641-d44680f97724</uuid>
Aug 01 13:51:23 user nova-compute[72129]:   <name>instance-0000000b</name>
Aug 01 13:51:23 user nova-compute[72129]:   <memory>524288</memory>
Aug 01 13:51:23 user nova-compute[72129]:   <vcpu>1</vcpu>
Aug 01 13:51:23 user nova-compute[72129]:   <metadata>
Aug 01 13:51:23 user nova-compute[72129]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 13:51:23 user nova-compute[72129]:       <nova:package version="0.0.0"/>
Aug 01 13:51:23 user nova-compute[72129]:       <nova:name>tempest-device-tagging-server-1241803801</nova:name>
Aug 01 13:51:23 user nova-compute[72129]:       <nova:creationTime>2023-08-01 13:51:18</nova:creationTime>
Aug 01 13:51:23 user nova-compute[72129]:       <nova:flavor name="m1.tiny">
Aug 01 13:51:23 user nova-compute[72129]:         <nova:memory>512</nova:memory>
Aug 01 13:51:23 user nova-compute[72129]:         <nova:disk>1</nova:disk>
Aug 01 13:51:23 user nova-compute[72129]:         <nova:swap>0</nova:swap>
Aug 01 13:51:23 user nova-compute[72129]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 13:51:23 user nova-compute[72129]:         <nova:vcpus>1</nova:vcpus>
Aug 01 13:51:23 user nova-compute[72129]:       </nova:flavor>
Aug 01 13:51:23 user nova-compute[72129]:       <nova:owner>
Aug 01 13:51:23 user nova-compute[72129]:         <nova:user uuid="1283f74fc4f74184a36fddf17c319ae1">tempest-TaggedBootDevicesTest-1602482701-project-member</nova:user>
Aug 01 13:51:23 user nova-compute[72129]:         <nova:project uuid="2b3a8ce92ea64365b59ae1e4cd450941">tempest-TaggedBootDevicesTest-1602482701</nova:project>
Aug 01 13:51:23 user nova-compute[72129]:       </nova:owner>
Aug 01 13:51:23 user nova-compute[72129]:       <nova:root type="image" uuid="b6472c34-1b0f-4034-ba3a-7e8eb5103715"/>
Aug 01 13:51:23 user nova-compute[72129]:       <nova:ports>
Aug 01 13:51:23 user nova-compute[72129]:         <nova:port uuid="4856f394-91dc-4fd0-9fff-8a45f53f0e01">
Aug 01 13:51:23 user nova-compute[72129]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 01 13:51:23 user nova-compute[72129]:         </nova:port>
Aug 01 13:51:23 user nova-compute[72129]:         <nova:port uuid="3da4a68a-4d20-4f36-bf85-e74a93a6c9f2">
Aug 01 13:51:23 user nova-compute[72129]:           <nova:ip type="fixed" address="10.1.1.223" ipVersion="4"/>
Aug 01 13:51:23 user nova-compute[72129]:         </nova:port>
Aug 01 13:51:23 user nova-compute[72129]:         <nova:port uuid="c3fc041a-b39f-448a-a5d6-3e2b67368d50">
Aug 01 13:51:23 user nova-compute[72129]:           <nova:ip type="fixed" address="10.1.1.243" ipVersion="4"/>
Aug 01 13:51:23 user nova-compute[72129]:         </nova:port>
Aug 01 13:51:23 user nova-compute[72129]:         <nova:port uuid="1a10af43-8f79-43a4-b847-2c4471576097">
Aug 01 13:51:23 user nova-compute[72129]:           <nova:ip type="fixed" address="10.1.1.13" ipVersion="4"/>
Aug 01 13:51:23 user nova-compute[72129]:         </nova:port>
Aug 01 13:51:23 user nova-compute[72129]:         <nova:port uuid="e4a333bd-6565-4da1-ae2c-4953c3a14f53">
Aug 01 13:51:23 user nova-compute[72129]:           <nova:ip type="fixed" address="10.1.1.99" ipVersion="4"/>
Aug 01 13:51:23 user nova-compute[72129]:         </nova:port>
Aug 01 13:51:23 user nova-compute[72129]:         <nova:port uuid="e1d5b511-b4c8-4d81-8b78-e58ffdfb3015">
Aug 01 13:51:23 user nova-compute[72129]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 01 13:51:23 user nova-compute[72129]:         </nova:port>
Aug 01 13:51:23 user nova-compute[72129]:         <nova:port uuid="4bb0a232-3a92-4b85-9a12-29f8d822362e">
Aug 01 13:51:23 user nova-compute[72129]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 01 13:51:23 user nova-compute[72129]:         </nova:port>
Aug 01 13:51:23 user nova-compute[72129]:       </nova:ports>
Aug 01 13:51:23 user nova-compute[72129]:     </nova:instance>
Aug 01 13:51:23 user nova-compute[72129]:   </metadata>
Aug 01 13:51:23 user nova-compute[72129]:   <sysinfo type="smbios">
Aug 01 13:51:23 user nova-compute[72129]:     <system>
Aug 01 13:51:23 user nova-compute[72129]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 13:51:23 user nova-compute[72129]:       <entry name="product">OpenStack Nova</entry>
Aug 01 13:51:23 user nova-compute[72129]:       <entry name="version">0.0.0</entry>
Aug 01 13:51:23 user nova-compute[72129]:       <entry name="serial">e1ee9e5e-0bd8-4986-8641-d44680f97724</entry>
Aug 01 13:51:23 user nova-compute[72129]:       <entry name="uuid">e1ee9e5e-0bd8-4986-8641-d44680f97724</entry>
Aug 01 13:51:23 user nova-compute[72129]:       <entry name="family">Virtual Machine</entry>
Aug 01 13:51:23 user nova-compute[72129]:     </system>
Aug 01 13:51:23 user nova-compute[72129]:   </sysinfo>
Aug 01 13:51:23 user nova-compute[72129]:   <os>
Aug 01 13:51:23 user nova-compute[72129]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 13:51:23 user nova-compute[72129]:     <boot dev="hd"/>
Aug 01 13:51:23 user nova-compute[72129]:     <smbios mode="sysinfo"/>
Aug 01 13:51:23 user nova-compute[72129]:   </os>
Aug 01 13:51:23 user nova-compute[72129]:   <features>
Aug 01 13:51:23 user nova-compute[72129]:     <acpi/>
Aug 01 13:51:23 user nova-compute[72129]:     <apic/>
Aug 01 13:51:23 user nova-compute[72129]:     <vmcoreinfo/>
Aug 01 13:51:23 user nova-compute[72129]:   </features>
Aug 01 13:51:23 user nova-compute[72129]:   <clock offset="utc">
Aug 01 13:51:23 user nova-compute[72129]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 13:51:23 user nova-compute[72129]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 13:51:23 user nova-compute[72129]:     <timer name="hpet" present="no"/>
Aug 01 13:51:23 user nova-compute[72129]:   </clock>
Aug 01 13:51:23 user nova-compute[72129]:   <cpu mode="custom" match="exact">
Aug 01 13:51:23 user nova-compute[72129]:     <model>Nehalem</model>
Aug 01 13:51:23 user nova-compute[72129]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 13:51:23 user nova-compute[72129]:   </cpu>
Aug 01 13:51:23 user nova-compute[72129]:   <devices>
Aug 01 13:51:23 user nova-compute[72129]:     <disk type="file" device="cdrom">
Aug 01 13:51:23 user nova-compute[72129]:       <driver name="qemu" type="raw" cache="none"/>
Aug 01 13:51:23 user nova-compute[72129]:       <source file="/opt/stack/data/nova/instances/e1ee9e5e-0bd8-4986-8641-d44680f97724/disk.config"/>
Aug 01 13:51:23 user nova-compute[72129]:       <target dev="hda" bus="ide"/>
Aug 01 13:51:23 user nova-compute[72129]:     </disk>
Aug 01 13:51:23 user nova-compute[72129]:     <disk type="block" device="disk">
Aug 01 13:51:23 user nova-compute[72129]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 13:51:23 user nova-compute[72129]:       <source dev="/dev/sde"/>
Aug 01 13:51:23 user nova-compute[72129]:       <target dev="vda" bus="virtio"/>
Aug 01 13:51:23 user nova-compute[72129]:       <serial>b931025d-0e61-46c7-8838-619aeff58f08</serial>
Aug 01 13:51:23 user nova-compute[72129]:     </disk>
Aug 01 13:51:23 user nova-compute[72129]:     <disk type="block" device="disk">
Aug 01 13:51:23 user nova-compute[72129]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 13:51:23 user nova-compute[72129]:       <source dev="/dev/sdf"/>
Aug 01 13:51:23 user nova-compute[72129]:       <target dev="vdb" bus="virtio"/>
Aug 01 13:51:23 user nova-compute[72129]:       <serial>f0565343-ef40-41a1-bb6a-d7d01d463a61</serial>
Aug 01 13:51:23 user nova-compute[72129]:     </disk>
Aug 01 13:51:23 user nova-compute[72129]:     <disk type="block" device="disk">
Aug 01 13:51:23 user nova-compute[72129]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 13:51:23 user nova-compute[72129]:       <source dev="/dev/sdg"/>
Aug 01 13:51:23 user nova-compute[72129]:       <target dev="vdc" bus="virtio"/>
Aug 01 13:51:23 user nova-compute[72129]:       <serial>04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23</serial>
Aug 01 13:51:23 user nova-compute[72129]:     </disk>
Aug 01 13:51:23 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 13:51:23 user nova-compute[72129]:       <mac address="fa:16:3e:39:15:ba"/>
Aug 01 13:51:23 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 13:51:23 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 13:51:23 user nova-compute[72129]:       <target dev="tap4856f394-91"/>
Aug 01 13:51:23 user nova-compute[72129]:     </interface>
Aug 01 13:51:23 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 13:51:23 user nova-compute[72129]:       <mac address="fa:16:3e:3a:cf:74"/>
Aug 01 13:51:23 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 13:51:23 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 13:51:23 user nova-compute[72129]:       <target dev="tap3da4a68a-4d"/>
Aug 01 13:51:23 user nova-compute[72129]:     </interface>
Aug 01 13:51:23 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 13:51:23 user nova-compute[72129]:       <mac address="fa:16:3e:31:e8:5e"/>
Aug 01 13:51:23 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 13:51:23 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 13:51:23 user nova-compute[72129]:       <target dev="tapc3fc041a-b3"/>
Aug 01 13:51:23 user nova-compute[72129]:     </interface>
Aug 01 13:51:23 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 13:51:23 user nova-compute[72129]:       <mac address="fa:16:3e:d9:f3:84"/>
Aug 01 13:51:23 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 13:51:23 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 13:51:23 user nova-compute[72129]:       <target dev="tap1a10af43-8f"/>
Aug 01 13:51:23 user nova-compute[72129]:     </interface>
Aug 01 13:51:23 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 13:51:23 user nova-compute[72129]:       <mac address="fa:16:3e:06:c9:e4"/>
Aug 01 13:51:23 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 13:51:23 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 13:51:23 user nova-compute[72129]:       <target dev="tape4a333bd-65"/>
Aug 01 13:51:23 user nova-compute[72129]:     </interface>
Aug 01 13:51:23 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 13:51:23 user nova-compute[72129]:       <mac address="fa:16:3e:e1:69:b3"/>
Aug 01 13:51:23 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 13:51:23 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 13:51:23 user nova-compute[72129]:       <target dev="tape1d5b511-b4"/>
Aug 01 13:51:23 user nova-compute[72129]:     </interface>
Aug 01 13:51:23 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 13:51:23 user nova-compute[72129]:       <mac address="fa:16:3e:a2:99:fb"/>
Aug 01 13:51:23 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 13:51:23 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 13:51:23 user nova-compute[72129]:       <target dev="tap4bb0a232-3a"/>
Aug 01 13:51:23 user nova-compute[72129]:     </interface>
Aug 01 13:51:23 user nova-compute[72129]:     <serial type="pty">
Aug 01 13:51:23 user nova-compute[72129]:       <log file="/opt/stack/data/nova/instances/e1ee9e5e-0bd8-4986-8641-d44680f97724/console.log" append="off"/>
Aug 01 13:51:23 user nova-compute[72129]:     </serial>
Aug 01 13:51:23 user nova-compute[72129]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 13:51:23 user nova-compute[72129]:     <video>
Aug 01 13:51:23 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 13:51:23 user nova-compute[72129]:     </video>
Aug 01 13:51:23 user nova-compute[72129]:     <rng model="virtio">
Aug 01 13:51:23 user nova-compute[72129]:       <backend model="random">/dev/urandom</backend>
Aug 01 13:51:23 user nova-compute[72129]:     </rng>
Aug 01 13:51:23 user nova-compute[72129]:     <controller type="usb" index="0" model="none"/>
Aug 01 13:51:23 user nova-compute[72129]:     <memballoon model="virtio">
Aug 01 13:51:23 user nova-compute[72129]:       <stats period="10"/>
Aug 01 13:51:23 user nova-compute[72129]:     </memballoon>
Aug 01 13:51:23 user nova-compute[72129]:   </devices>
Aug 01 13:51:23 user nova-compute[72129]: </domain>
Aug 01 13:51:23 user nova-compute[72129]:  {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T13:50:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1241803801',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1241803801',id=11,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+QtfmHSYayd423+Jyi4G3aVMwHbijAAkXCDfLEQf4gBJATuD2dk3LYaj/9StA19vP6tOnx01tyID845MCigJxBrCNqDQZakylTkXzkcsXu0p0VQpMF87v9qpWxh97hvQ==',key_name='tempest-keypair-38580498',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b3a8ce92ea64365b59ae1e4cd450941',ramdisk_id='',reservation_id='r-n7fx3bly',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1602482701',owner_user_name='tempest-TaggedBootDevicesTest-1602482701-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:50:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1283f74fc4f74184a36fddf17c319ae1',uuid=e1ee9e5e-0bd8-4986-8641-d44680f97724,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4856f394-91dc-4fd0-9fff-8a45f53f0e01", "address": "fa:16:3e:39:15:ba", "network": {"id": "2dfa2891-a873-4a7a-8460-b78ee7a967e1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1716980837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4856f394-91", "ovs_interfaceid": "4856f394-91dc-4fd0-9fff-8a45f53f0e01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Converting VIF {"id": "4856f394-91dc-4fd0-9fff-8a45f53f0e01", "address": "fa:16:3e:39:15:ba", "network": {"id": "2dfa2891-a873-4a7a-8460-b78ee7a967e1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1716980837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4856f394-91", "ovs_interfaceid": "4856f394-91dc-4fd0-9fff-8a45f53f0e01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:15:ba,bridge_name='br-int',has_traffic_filtering=True,id=4856f394-91dc-4fd0-9fff-8a45f53f0e01,network=Network(2dfa2891-a873-4a7a-8460-b78ee7a967e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4856f394-91') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG os_vif [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:15:ba,bridge_name='br-int',has_traffic_filtering=True,id=4856f394-91dc-4fd0-9fff-8a45f53f0e01,network=Network(2dfa2891-a873-4a7a-8460-b78ee7a967e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4856f394-91') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4856f394-91, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4856f394-91, col_values=(('external_ids', {'iface-id': '4856f394-91dc-4fd0-9fff-8a45f53f0e01', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:15:ba', 'vm-uuid': 'e1ee9e5e-0bd8-4986-8641-d44680f97724'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:23 user nova-compute[72129]: INFO os_vif [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:15:ba,bridge_name='br-int',has_traffic_filtering=True,id=4856f394-91dc-4fd0-9fff-8a45f53f0e01,network=Network(2dfa2891-a873-4a7a-8460-b78ee7a967e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4856f394-91')
Aug 01 13:51:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T13:50:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1241803801',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1241803801',id=11,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+QtfmHSYayd423+Jyi4G3aVMwHbijAAkXCDfLEQf4gBJATuD2dk3LYaj/9StA19vP6tOnx01tyID845MCigJxBrCNqDQZakylTkXzkcsXu0p0VQpMF87v9qpWxh97hvQ==',key_name='tempest-keypair-38580498',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b3a8ce92ea64365b59ae1e4cd450941',ramdisk_id='',reservation_id='r-n7fx3bly',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1602482701',owner_user_name='tempest-TaggedBootDevicesTest-1602482701-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:50:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1283f74fc4f74184a36fddf17c319ae1',uuid=e1ee9e5e-0bd8-4986-8641-d44680f97724,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3da4a68a-4d20-4f36-bf85-e74a93a6c9f2", "address": "fa:16:3e:3a:cf:74", "network": {"id": "0238d661-fbc1-4955-8933-92891b6a621e", "bridge": "br-int", "label": "tempest-device-tagging-net1-78670494", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3da4a68a-4d", "ovs_interfaceid": "3da4a68a-4d20-4f36-bf85-e74a93a6c9f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Converting VIF {"id": "3da4a68a-4d20-4f36-bf85-e74a93a6c9f2", "address": "fa:16:3e:3a:cf:74", "network": {"id": "0238d661-fbc1-4955-8933-92891b6a621e", "bridge": "br-int", "label": "tempest-device-tagging-net1-78670494", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3da4a68a-4d", "ovs_interfaceid": "3da4a68a-4d20-4f36-bf85-e74a93a6c9f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:cf:74,bridge_name='br-int',has_traffic_filtering=True,id=3da4a68a-4d20-4f36-bf85-e74a93a6c9f2,network=Network(0238d661-fbc1-4955-8933-92891b6a621e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3da4a68a-4d') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG os_vif [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:cf:74,bridge_name='br-int',has_traffic_filtering=True,id=3da4a68a-4d20-4f36-bf85-e74a93a6c9f2,network=Network(0238d661-fbc1-4955-8933-92891b6a621e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3da4a68a-4d') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3da4a68a-4d, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3da4a68a-4d, col_values=(('external_ids', {'iface-id': '3da4a68a-4d20-4f36-bf85-e74a93a6c9f2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:cf:74', 'vm-uuid': 'e1ee9e5e-0bd8-4986-8641-d44680f97724'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:23 user nova-compute[72129]: INFO os_vif [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:cf:74,bridge_name='br-int',has_traffic_filtering=True,id=3da4a68a-4d20-4f36-bf85-e74a93a6c9f2,network=Network(0238d661-fbc1-4955-8933-92891b6a621e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3da4a68a-4d')
Aug 01 13:51:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T13:50:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1241803801',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1241803801',id=11,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+QtfmHSYayd423+Jyi4G3aVMwHbijAAkXCDfLEQf4gBJATuD2dk3LYaj/9StA19vP6tOnx01tyID845MCigJxBrCNqDQZakylTkXzkcsXu0p0VQpMF87v9qpWxh97hvQ==',key_name='tempest-keypair-38580498',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b3a8ce92ea64365b59ae1e4cd450941',ramdisk_id='',reservation_id='r-n7fx3bly',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1602482701',owner_user_name='tempest-TaggedBootDevicesTest-1602482701-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:50:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1283f74fc4f74184a36fddf17c319ae1',uuid=e1ee9e5e-0bd8-4986-8641-d44680f97724,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3fc041a-b39f-448a-a5d6-3e2b67368d50", "address": "fa:16:3e:31:e8:5e", "network": {"id": "0238d661-fbc1-4955-8933-92891b6a621e", "bridge": "br-int", "label": "tempest-device-tagging-net1-78670494", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3fc041a-b3", "ovs_interfaceid": "c3fc041a-b39f-448a-a5d6-3e2b67368d50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Converting VIF {"id": "c3fc041a-b39f-448a-a5d6-3e2b67368d50", "address": "fa:16:3e:31:e8:5e", "network": {"id": "0238d661-fbc1-4955-8933-92891b6a621e", "bridge": "br-int", "label": "tempest-device-tagging-net1-78670494", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3fc041a-b3", "ovs_interfaceid": "c3fc041a-b39f-448a-a5d6-3e2b67368d50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:e8:5e,bridge_name='br-int',has_traffic_filtering=True,id=c3fc041a-b39f-448a-a5d6-3e2b67368d50,network=Network(0238d661-fbc1-4955-8933-92891b6a621e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc3fc041a-b3') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG os_vif [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:e8:5e,bridge_name='br-int',has_traffic_filtering=True,id=c3fc041a-b39f-448a-a5d6-3e2b67368d50,network=Network(0238d661-fbc1-4955-8933-92891b6a621e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc3fc041a-b3') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc3fc041a-b3, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc3fc041a-b3, col_values=(('external_ids', {'iface-id': 'c3fc041a-b39f-448a-a5d6-3e2b67368d50', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:e8:5e', 'vm-uuid': 'e1ee9e5e-0bd8-4986-8641-d44680f97724'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:23 user nova-compute[72129]: INFO os_vif [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:e8:5e,bridge_name='br-int',has_traffic_filtering=True,id=c3fc041a-b39f-448a-a5d6-3e2b67368d50,network=Network(0238d661-fbc1-4955-8933-92891b6a621e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc3fc041a-b3')
Aug 01 13:51:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T13:50:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1241803801',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1241803801',id=11,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+QtfmHSYayd423+Jyi4G3aVMwHbijAAkXCDfLEQf4gBJATuD2dk3LYaj/9StA19vP6tOnx01tyID845MCigJxBrCNqDQZakylTkXzkcsXu0p0VQpMF87v9qpWxh97hvQ==',key_name='tempest-keypair-38580498',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b3a8ce92ea64365b59ae1e4cd450941',ramdisk_id='',reservation_id='r-n7fx3bly',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1602482701',owner_user_name='tempest-TaggedBootDevicesTest-1602482701-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:50:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1283f74fc4f74184a36fddf17c319ae1',uuid=e1ee9e5e-0bd8-4986-8641-d44680f97724,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a10af43-8f79-43a4-b847-2c4471576097", "address": "fa:16:3e:d9:f3:84", "network": {"id": "0238d661-fbc1-4955-8933-92891b6a621e", "bridge": "br-int", "label": "tempest-device-tagging-net1-78670494", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a10af43-8f", "ovs_interfaceid": "1a10af43-8f79-43a4-b847-2c4471576097", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Converting VIF {"id": "1a10af43-8f79-43a4-b847-2c4471576097", "address": "fa:16:3e:d9:f3:84", "network": {"id": "0238d661-fbc1-4955-8933-92891b6a621e", "bridge": "br-int", "label": "tempest-device-tagging-net1-78670494", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a10af43-8f", "ovs_interfaceid": "1a10af43-8f79-43a4-b847-2c4471576097", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:f3:84,bridge_name='br-int',has_traffic_filtering=True,id=1a10af43-8f79-43a4-b847-2c4471576097,network=Network(0238d661-fbc1-4955-8933-92891b6a621e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a10af43-8f') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG os_vif [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:f3:84,bridge_name='br-int',has_traffic_filtering=True,id=1a10af43-8f79-43a4-b847-2c4471576097,network=Network(0238d661-fbc1-4955-8933-92891b6a621e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a10af43-8f') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1a10af43-8f, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1a10af43-8f, col_values=(('external_ids', {'iface-id': '1a10af43-8f79-43a4-b847-2c4471576097', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:f3:84', 'vm-uuid': 'e1ee9e5e-0bd8-4986-8641-d44680f97724'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:23 user nova-compute[72129]: INFO os_vif [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:f3:84,bridge_name='br-int',has_traffic_filtering=True,id=1a10af43-8f79-43a4-b847-2c4471576097,network=Network(0238d661-fbc1-4955-8933-92891b6a621e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a10af43-8f')
Aug 01 13:51:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T13:50:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1241803801',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1241803801',id=11,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+QtfmHSYayd423+Jyi4G3aVMwHbijAAkXCDfLEQf4gBJATuD2dk3LYaj/9StA19vP6tOnx01tyID845MCigJxBrCNqDQZakylTkXzkcsXu0p0VQpMF87v9qpWxh97hvQ==',key_name='tempest-keypair-38580498',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b3a8ce92ea64365b59ae1e4cd450941',ramdisk_id='',reservation_id='r-n7fx3bly',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1602482701',owner_user_name='tempest-TaggedBootDevicesTest-1602482701-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:50:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1283f74fc4f74184a36fddf17c319ae1',uuid=e1ee9e5e-0bd8-4986-8641-d44680f97724,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4a333bd-6565-4da1-ae2c-4953c3a14f53", "address": "fa:16:3e:06:c9:e4", "network": {"id": "0238d661-fbc1-4955-8933-92891b6a621e", "bridge": "br-int", "label": "tempest-device-tagging-net1-78670494", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4a333bd-65", "ovs_interfaceid": "e4a333bd-6565-4da1-ae2c-4953c3a14f53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Converting VIF {"id": "e4a333bd-6565-4da1-ae2c-4953c3a14f53", "address": "fa:16:3e:06:c9:e4", "network": {"id": "0238d661-fbc1-4955-8933-92891b6a621e", "bridge": "br-int", "label": "tempest-device-tagging-net1-78670494", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4a333bd-65", "ovs_interfaceid": "e4a333bd-6565-4da1-ae2c-4953c3a14f53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:c9:e4,bridge_name='br-int',has_traffic_filtering=True,id=e4a333bd-6565-4da1-ae2c-4953c3a14f53,network=Network(0238d661-fbc1-4955-8933-92891b6a621e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4a333bd-65') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG os_vif [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:c9:e4,bridge_name='br-int',has_traffic_filtering=True,id=e4a333bd-6565-4da1-ae2c-4953c3a14f53,network=Network(0238d661-fbc1-4955-8933-92891b6a621e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4a333bd-65') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape4a333bd-65, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape4a333bd-65, col_values=(('external_ids', {'iface-id': 'e4a333bd-6565-4da1-ae2c-4953c3a14f53', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:c9:e4', 'vm-uuid': 'e1ee9e5e-0bd8-4986-8641-d44680f97724'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:23 user nova-compute[72129]: INFO os_vif [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:c9:e4,bridge_name='br-int',has_traffic_filtering=True,id=e4a333bd-6565-4da1-ae2c-4953c3a14f53,network=Network(0238d661-fbc1-4955-8933-92891b6a621e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4a333bd-65')
Aug 01 13:51:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T13:50:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1241803801',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1241803801',id=11,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+QtfmHSYayd423+Jyi4G3aVMwHbijAAkXCDfLEQf4gBJATuD2dk3LYaj/9StA19vP6tOnx01tyID845MCigJxBrCNqDQZakylTkXzkcsXu0p0VQpMF87v9qpWxh97hvQ==',key_name='tempest-keypair-38580498',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b3a8ce92ea64365b59ae1e4cd450941',ramdisk_id='',reservation_id='r-n7fx3bly',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1602482701',owner_user_name='tempest-TaggedBootDevicesTest-1602482701-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:50:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1283f74fc4f74184a36fddf17c319ae1',uuid=e1ee9e5e-0bd8-4986-8641-d44680f97724,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1d5b511-b4c8-4d81-8b78-e58ffdfb3015", "address": "fa:16:3e:e1:69:b3", "network": {"id": "a7073672-c19c-45cb-8549-4c0e25c52255", "bridge": "br-int", "label": "tempest-device-tagging-net2-1432218036", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d5b511-b4", "ovs_interfaceid": "e1d5b511-b4c8-4d81-8b78-e58ffdfb3015", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Converting VIF {"id": "e1d5b511-b4c8-4d81-8b78-e58ffdfb3015", "address": "fa:16:3e:e1:69:b3", "network": {"id": "a7073672-c19c-45cb-8549-4c0e25c52255", "bridge": "br-int", "label": "tempest-device-tagging-net2-1432218036", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d5b511-b4", "ovs_interfaceid": "e1d5b511-b4c8-4d81-8b78-e58ffdfb3015", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:69:b3,bridge_name='br-int',has_traffic_filtering=True,id=e1d5b511-b4c8-4d81-8b78-e58ffdfb3015,network=Network(a7073672-c19c-45cb-8549-4c0e25c52255),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1d5b511-b4') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG os_vif [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:69:b3,bridge_name='br-int',has_traffic_filtering=True,id=e1d5b511-b4c8-4d81-8b78-e58ffdfb3015,network=Network(a7073672-c19c-45cb-8549-4c0e25c52255),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1d5b511-b4') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape1d5b511-b4, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape1d5b511-b4, col_values=(('external_ids', {'iface-id': 'e1d5b511-b4c8-4d81-8b78-e58ffdfb3015', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:69:b3', 'vm-uuid': 'e1ee9e5e-0bd8-4986-8641-d44680f97724'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:23 user nova-compute[72129]: INFO os_vif [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:69:b3,bridge_name='br-int',has_traffic_filtering=True,id=e1d5b511-b4c8-4d81-8b78-e58ffdfb3015,network=Network(a7073672-c19c-45cb-8549-4c0e25c52255),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1d5b511-b4')
Aug 01 13:51:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T13:50:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1241803801',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1241803801',id=11,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+QtfmHSYayd423+Jyi4G3aVMwHbijAAkXCDfLEQf4gBJATuD2dk3LYaj/9StA19vP6tOnx01tyID845MCigJxBrCNqDQZakylTkXzkcsXu0p0VQpMF87v9qpWxh97hvQ==',key_name='tempest-keypair-38580498',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b3a8ce92ea64365b59ae1e4cd450941',ramdisk_id='',reservation_id='r-n7fx3bly',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1602482701',owner_user_name='tempest-TaggedBootDevicesTest-1602482701-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:50:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1283f74fc4f74184a36fddf17c319ae1',uuid=e1ee9e5e-0bd8-4986-8641-d44680f97724,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4bb0a232-3a92-4b85-9a12-29f8d822362e", "address": "fa:16:3e:a2:99:fb", "network": {"id": "a7073672-c19c-45cb-8549-4c0e25c52255", "bridge": "br-int", "label": "tempest-device-tagging-net2-1432218036", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bb0a232-3a", "ovs_interfaceid": "4bb0a232-3a92-4b85-9a12-29f8d822362e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Converting VIF {"id": "4bb0a232-3a92-4b85-9a12-29f8d822362e", "address": "fa:16:3e:a2:99:fb", "network": {"id": "a7073672-c19c-45cb-8549-4c0e25c52255", "bridge": "br-int", "label": "tempest-device-tagging-net2-1432218036", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bb0a232-3a", "ovs_interfaceid": "4bb0a232-3a92-4b85-9a12-29f8d822362e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:99:fb,bridge_name='br-int',has_traffic_filtering=True,id=4bb0a232-3a92-4b85-9a12-29f8d822362e,network=Network(a7073672-c19c-45cb-8549-4c0e25c52255),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bb0a232-3a') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG os_vif [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:99:fb,bridge_name='br-int',has_traffic_filtering=True,id=4bb0a232-3a92-4b85-9a12-29f8d822362e,network=Network(a7073672-c19c-45cb-8549-4c0e25c52255),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bb0a232-3a') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4bb0a232-3a, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4bb0a232-3a, col_values=(('external_ids', {'iface-id': '4bb0a232-3a92-4b85-9a12-29f8d822362e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:99:fb', 'vm-uuid': 'e1ee9e5e-0bd8-4986-8641-d44680f97724'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:23 user nova-compute[72129]: INFO os_vif [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:99:fb,bridge_name='br-int',has_traffic_filtering=True,id=4bb0a232-3a92-4b85-9a12-29f8d822362e,network=Network(a7073672-c19c-45cb-8549-4c0e25c52255),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bb0a232-3a')
Aug 01 13:51:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] No BDM found with device name hda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] No VIF found with MAC fa:16:3e:39:15:ba, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] No VIF found with MAC fa:16:3e:06:c9:e4, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 13:51:23 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Using config drive
Aug 01 13:51:23 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Creating config drive at /opt/stack/data/nova/instances/e1ee9e5e-0bd8-4986-8641-d44680f97724/disk.config
Aug 01 13:51:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e1ee9e5e-0bd8-4986-8641-d44680f97724/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpdr26zgdj {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e1ee9e5e-0bd8-4986-8641-d44680f97724/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpdr26zgdj" returned: 0 in 0.055s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:25 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:25 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:25 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:25 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:25 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:25 user nova-compute[72129]: DEBUG nova.compute.manager [req-008aa45d-df59-43a7-ac2f-c0a241be4ec3 req-95357425-ac17-4042-98f6-9195601e71c6 service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Received event network-vif-plugged-4856f394-91dc-4fd0-9fff-8a45f53f0e01 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:51:25 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-008aa45d-df59-43a7-ac2f-c0a241be4ec3 req-95357425-ac17-4042-98f6-9195601e71c6 service nova] Acquiring lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:51:25 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-008aa45d-df59-43a7-ac2f-c0a241be4ec3 req-95357425-ac17-4042-98f6-9195601e71c6 service nova] Lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:51:25 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-008aa45d-df59-43a7-ac2f-c0a241be4ec3 req-95357425-ac17-4042-98f6-9195601e71c6 service nova] Lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:51:25 user nova-compute[72129]: DEBUG nova.compute.manager [req-008aa45d-df59-43a7-ac2f-c0a241be4ec3 req-95357425-ac17-4042-98f6-9195601e71c6 service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] No waiting events found dispatching network-vif-plugged-4856f394-91dc-4fd0-9fff-8a45f53f0e01 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:51:25 user nova-compute[72129]: WARNING nova.compute.manager [req-008aa45d-df59-43a7-ac2f-c0a241be4ec3 req-95357425-ac17-4042-98f6-9195601e71c6 service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Received unexpected event network-vif-plugged-4856f394-91dc-4fd0-9fff-8a45f53f0e01 for instance with vm_state building and task_state spawning.
Aug 01 13:51:25 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:25 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:25 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:25 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:25 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:26 user nova-compute[72129]: DEBUG nova.compute.manager [req-f9f95a08-4f90-4b71-bfeb-4935682a8d1a req-7bc07661-7bbb-4055-b91f-1e29fffbd615 service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Received event network-vif-plugged-c3fc041a-b39f-448a-a5d6-3e2b67368d50 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:51:26 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f9f95a08-4f90-4b71-bfeb-4935682a8d1a req-7bc07661-7bbb-4055-b91f-1e29fffbd615 service nova] Acquiring lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:51:26 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f9f95a08-4f90-4b71-bfeb-4935682a8d1a req-7bc07661-7bbb-4055-b91f-1e29fffbd615 service nova] Lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:51:26 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f9f95a08-4f90-4b71-bfeb-4935682a8d1a req-7bc07661-7bbb-4055-b91f-1e29fffbd615 service nova] Lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:51:26 user nova-compute[72129]: DEBUG nova.compute.manager [req-f9f95a08-4f90-4b71-bfeb-4935682a8d1a req-7bc07661-7bbb-4055-b91f-1e29fffbd615 service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] No waiting events found dispatching network-vif-plugged-c3fc041a-b39f-448a-a5d6-3e2b67368d50 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:51:26 user nova-compute[72129]: WARNING nova.compute.manager [req-f9f95a08-4f90-4b71-bfeb-4935682a8d1a req-7bc07661-7bbb-4055-b91f-1e29fffbd615 service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Received unexpected event network-vif-plugged-c3fc041a-b39f-448a-a5d6-3e2b67368d50 for instance with vm_state building and task_state spawning.
Aug 01 13:51:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:26 user nova-compute[72129]: DEBUG nova.compute.manager [req-40868096-3a82-4b01-bf58-8ce67cf5b1de req-6724f4ff-6b5b-40be-88ba-31c01662784a service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Received event network-vif-plugged-1a10af43-8f79-43a4-b847-2c4471576097 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:51:26 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-40868096-3a82-4b01-bf58-8ce67cf5b1de req-6724f4ff-6b5b-40be-88ba-31c01662784a service nova] Acquiring lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:51:26 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-40868096-3a82-4b01-bf58-8ce67cf5b1de req-6724f4ff-6b5b-40be-88ba-31c01662784a service nova] Lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:51:26 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-40868096-3a82-4b01-bf58-8ce67cf5b1de req-6724f4ff-6b5b-40be-88ba-31c01662784a service nova] Lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:51:26 user nova-compute[72129]: DEBUG nova.compute.manager [req-40868096-3a82-4b01-bf58-8ce67cf5b1de req-6724f4ff-6b5b-40be-88ba-31c01662784a service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] No waiting events found dispatching network-vif-plugged-1a10af43-8f79-43a4-b847-2c4471576097 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:51:26 user nova-compute[72129]: WARNING nova.compute.manager [req-40868096-3a82-4b01-bf58-8ce67cf5b1de req-6724f4ff-6b5b-40be-88ba-31c01662784a service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Received unexpected event network-vif-plugged-1a10af43-8f79-43a4-b847-2c4471576097 for instance with vm_state building and task_state spawning.
Aug 01 13:51:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:27 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:27 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:27 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:27 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:27 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:27 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:27 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:27 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:27 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:27 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:27 user nova-compute[72129]: DEBUG nova.compute.manager [req-f13eb49f-a216-4273-939b-0f06774ad37a req-1d154525-6ad0-4626-a2fb-81c364d14b89 service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Received event network-vif-plugged-4856f394-91dc-4fd0-9fff-8a45f53f0e01 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:51:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f13eb49f-a216-4273-939b-0f06774ad37a req-1d154525-6ad0-4626-a2fb-81c364d14b89 service nova] Acquiring lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:51:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f13eb49f-a216-4273-939b-0f06774ad37a req-1d154525-6ad0-4626-a2fb-81c364d14b89 service nova] Lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:51:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f13eb49f-a216-4273-939b-0f06774ad37a req-1d154525-6ad0-4626-a2fb-81c364d14b89 service nova] Lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:51:27 user nova-compute[72129]: DEBUG nova.compute.manager [req-f13eb49f-a216-4273-939b-0f06774ad37a req-1d154525-6ad0-4626-a2fb-81c364d14b89 service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] No waiting events found dispatching network-vif-plugged-4856f394-91dc-4fd0-9fff-8a45f53f0e01 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:51:27 user nova-compute[72129]: WARNING nova.compute.manager [req-f13eb49f-a216-4273-939b-0f06774ad37a req-1d154525-6ad0-4626-a2fb-81c364d14b89 service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Received unexpected event network-vif-plugged-4856f394-91dc-4fd0-9fff-8a45f53f0e01 for instance with vm_state building and task_state spawning.
Aug 01 13:51:27 user nova-compute[72129]: DEBUG nova.compute.manager [req-f13eb49f-a216-4273-939b-0f06774ad37a req-1d154525-6ad0-4626-a2fb-81c364d14b89 service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Received event network-vif-plugged-3da4a68a-4d20-4f36-bf85-e74a93a6c9f2 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:51:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f13eb49f-a216-4273-939b-0f06774ad37a req-1d154525-6ad0-4626-a2fb-81c364d14b89 service nova] Acquiring lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:51:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f13eb49f-a216-4273-939b-0f06774ad37a req-1d154525-6ad0-4626-a2fb-81c364d14b89 service nova] Lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:51:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f13eb49f-a216-4273-939b-0f06774ad37a req-1d154525-6ad0-4626-a2fb-81c364d14b89 service nova] Lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:51:27 user nova-compute[72129]: DEBUG nova.compute.manager [req-f13eb49f-a216-4273-939b-0f06774ad37a req-1d154525-6ad0-4626-a2fb-81c364d14b89 service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] No waiting events found dispatching network-vif-plugged-3da4a68a-4d20-4f36-bf85-e74a93a6c9f2 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:51:27 user nova-compute[72129]: WARNING nova.compute.manager [req-f13eb49f-a216-4273-939b-0f06774ad37a req-1d154525-6ad0-4626-a2fb-81c364d14b89 service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Received unexpected event network-vif-plugged-3da4a68a-4d20-4f36-bf85-e74a93a6c9f2 for instance with vm_state building and task_state spawning.
Aug 01 13:51:27 user nova-compute[72129]: DEBUG nova.compute.manager [req-f13eb49f-a216-4273-939b-0f06774ad37a req-1d154525-6ad0-4626-a2fb-81c364d14b89 service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Received event network-vif-plugged-3da4a68a-4d20-4f36-bf85-e74a93a6c9f2 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:51:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f13eb49f-a216-4273-939b-0f06774ad37a req-1d154525-6ad0-4626-a2fb-81c364d14b89 service nova] Acquiring lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:51:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f13eb49f-a216-4273-939b-0f06774ad37a req-1d154525-6ad0-4626-a2fb-81c364d14b89 service nova] Lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:51:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f13eb49f-a216-4273-939b-0f06774ad37a req-1d154525-6ad0-4626-a2fb-81c364d14b89 service nova] Lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:51:27 user nova-compute[72129]: DEBUG nova.compute.manager [req-f13eb49f-a216-4273-939b-0f06774ad37a req-1d154525-6ad0-4626-a2fb-81c364d14b89 service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] No waiting events found dispatching network-vif-plugged-3da4a68a-4d20-4f36-bf85-e74a93a6c9f2 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:51:27 user nova-compute[72129]: WARNING nova.compute.manager [req-f13eb49f-a216-4273-939b-0f06774ad37a req-1d154525-6ad0-4626-a2fb-81c364d14b89 service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Received unexpected event network-vif-plugged-3da4a68a-4d20-4f36-bf85-e74a93a6c9f2 for instance with vm_state building and task_state spawning.
Aug 01 13:51:27 user nova-compute[72129]: DEBUG nova.compute.manager [req-f13eb49f-a216-4273-939b-0f06774ad37a req-1d154525-6ad0-4626-a2fb-81c364d14b89 service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Received event network-vif-plugged-e4a333bd-6565-4da1-ae2c-4953c3a14f53 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:51:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f13eb49f-a216-4273-939b-0f06774ad37a req-1d154525-6ad0-4626-a2fb-81c364d14b89 service nova] Acquiring lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:51:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f13eb49f-a216-4273-939b-0f06774ad37a req-1d154525-6ad0-4626-a2fb-81c364d14b89 service nova] Lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:51:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f13eb49f-a216-4273-939b-0f06774ad37a req-1d154525-6ad0-4626-a2fb-81c364d14b89 service nova] Lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:51:27 user nova-compute[72129]: DEBUG nova.compute.manager [req-f13eb49f-a216-4273-939b-0f06774ad37a req-1d154525-6ad0-4626-a2fb-81c364d14b89 service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] No waiting events found dispatching network-vif-plugged-e4a333bd-6565-4da1-ae2c-4953c3a14f53 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:51:27 user nova-compute[72129]: WARNING nova.compute.manager [req-f13eb49f-a216-4273-939b-0f06774ad37a req-1d154525-6ad0-4626-a2fb-81c364d14b89 service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Received unexpected event network-vif-plugged-e4a333bd-6565-4da1-ae2c-4953c3a14f53 for instance with vm_state building and task_state spawning.
Aug 01 13:51:27 user nova-compute[72129]: DEBUG nova.compute.manager [req-f13eb49f-a216-4273-939b-0f06774ad37a req-1d154525-6ad0-4626-a2fb-81c364d14b89 service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Received event network-vif-plugged-e4a333bd-6565-4da1-ae2c-4953c3a14f53 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:51:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f13eb49f-a216-4273-939b-0f06774ad37a req-1d154525-6ad0-4626-a2fb-81c364d14b89 service nova] Acquiring lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:51:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f13eb49f-a216-4273-939b-0f06774ad37a req-1d154525-6ad0-4626-a2fb-81c364d14b89 service nova] Lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:51:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f13eb49f-a216-4273-939b-0f06774ad37a req-1d154525-6ad0-4626-a2fb-81c364d14b89 service nova] Lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:51:27 user nova-compute[72129]: DEBUG nova.compute.manager [req-f13eb49f-a216-4273-939b-0f06774ad37a req-1d154525-6ad0-4626-a2fb-81c364d14b89 service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] No waiting events found dispatching network-vif-plugged-e4a333bd-6565-4da1-ae2c-4953c3a14f53 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:51:27 user nova-compute[72129]: WARNING nova.compute.manager [req-f13eb49f-a216-4273-939b-0f06774ad37a req-1d154525-6ad0-4626-a2fb-81c364d14b89 service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Received unexpected event network-vif-plugged-e4a333bd-6565-4da1-ae2c-4953c3a14f53 for instance with vm_state building and task_state spawning.
Aug 01 13:51:27 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:27 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:28 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:28 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:28 user nova-compute[72129]: DEBUG nova.compute.manager [req-d827b9d0-2c3c-475c-a6f6-f2b8e1ff8798 req-2a1f99be-9592-4b41-b149-f6fa2ffc3810 service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Received event network-vif-plugged-c3fc041a-b39f-448a-a5d6-3e2b67368d50 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:51:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-d827b9d0-2c3c-475c-a6f6-f2b8e1ff8798 req-2a1f99be-9592-4b41-b149-f6fa2ffc3810 service nova] Acquiring lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:51:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-d827b9d0-2c3c-475c-a6f6-f2b8e1ff8798 req-2a1f99be-9592-4b41-b149-f6fa2ffc3810 service nova] Lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:51:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-d827b9d0-2c3c-475c-a6f6-f2b8e1ff8798 req-2a1f99be-9592-4b41-b149-f6fa2ffc3810 service nova] Lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:51:28 user nova-compute[72129]: DEBUG nova.compute.manager [req-d827b9d0-2c3c-475c-a6f6-f2b8e1ff8798 req-2a1f99be-9592-4b41-b149-f6fa2ffc3810 service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] No waiting events found dispatching network-vif-plugged-c3fc041a-b39f-448a-a5d6-3e2b67368d50 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:51:28 user nova-compute[72129]: WARNING nova.compute.manager [req-d827b9d0-2c3c-475c-a6f6-f2b8e1ff8798 req-2a1f99be-9592-4b41-b149-f6fa2ffc3810 service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Received unexpected event network-vif-plugged-c3fc041a-b39f-448a-a5d6-3e2b67368d50 for instance with vm_state building and task_state spawning.
Aug 01 13:51:28 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:28 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:28 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:28 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:28 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:28 user nova-compute[72129]: DEBUG nova.compute.manager [req-be64d9fe-e05e-4bec-b572-1703e1c5fa60 req-24ebe2ff-0f8b-49e8-98b2-97864c8b9d6c service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Received event network-vif-plugged-1a10af43-8f79-43a4-b847-2c4471576097 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:51:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-be64d9fe-e05e-4bec-b572-1703e1c5fa60 req-24ebe2ff-0f8b-49e8-98b2-97864c8b9d6c service nova] Acquiring lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:51:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-be64d9fe-e05e-4bec-b572-1703e1c5fa60 req-24ebe2ff-0f8b-49e8-98b2-97864c8b9d6c service nova] Lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:51:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-be64d9fe-e05e-4bec-b572-1703e1c5fa60 req-24ebe2ff-0f8b-49e8-98b2-97864c8b9d6c service nova] Lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:51:28 user nova-compute[72129]: DEBUG nova.compute.manager [req-be64d9fe-e05e-4bec-b572-1703e1c5fa60 req-24ebe2ff-0f8b-49e8-98b2-97864c8b9d6c service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] No waiting events found dispatching network-vif-plugged-1a10af43-8f79-43a4-b847-2c4471576097 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:51:28 user nova-compute[72129]: WARNING nova.compute.manager [req-be64d9fe-e05e-4bec-b572-1703e1c5fa60 req-24ebe2ff-0f8b-49e8-98b2-97864c8b9d6c service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Received unexpected event network-vif-plugged-1a10af43-8f79-43a4-b847-2c4471576097 for instance with vm_state building and task_state spawning.
Aug 01 13:51:28 user nova-compute[72129]: DEBUG nova.compute.manager [req-be64d9fe-e05e-4bec-b572-1703e1c5fa60 req-24ebe2ff-0f8b-49e8-98b2-97864c8b9d6c service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Received event network-vif-plugged-e1d5b511-b4c8-4d81-8b78-e58ffdfb3015 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:51:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-be64d9fe-e05e-4bec-b572-1703e1c5fa60 req-24ebe2ff-0f8b-49e8-98b2-97864c8b9d6c service nova] Acquiring lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:51:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-be64d9fe-e05e-4bec-b572-1703e1c5fa60 req-24ebe2ff-0f8b-49e8-98b2-97864c8b9d6c service nova] Lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:51:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-be64d9fe-e05e-4bec-b572-1703e1c5fa60 req-24ebe2ff-0f8b-49e8-98b2-97864c8b9d6c service nova] Lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:51:28 user nova-compute[72129]: DEBUG nova.compute.manager [req-be64d9fe-e05e-4bec-b572-1703e1c5fa60 req-24ebe2ff-0f8b-49e8-98b2-97864c8b9d6c service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] No waiting events found dispatching network-vif-plugged-e1d5b511-b4c8-4d81-8b78-e58ffdfb3015 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:51:28 user nova-compute[72129]: WARNING nova.compute.manager [req-be64d9fe-e05e-4bec-b572-1703e1c5fa60 req-24ebe2ff-0f8b-49e8-98b2-97864c8b9d6c service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Received unexpected event network-vif-plugged-e1d5b511-b4c8-4d81-8b78-e58ffdfb3015 for instance with vm_state building and task_state spawning.
Aug 01 13:51:28 user nova-compute[72129]: DEBUG nova.compute.manager [req-be64d9fe-e05e-4bec-b572-1703e1c5fa60 req-24ebe2ff-0f8b-49e8-98b2-97864c8b9d6c service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Received event network-vif-plugged-e1d5b511-b4c8-4d81-8b78-e58ffdfb3015 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:51:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-be64d9fe-e05e-4bec-b572-1703e1c5fa60 req-24ebe2ff-0f8b-49e8-98b2-97864c8b9d6c service nova] Acquiring lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:51:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-be64d9fe-e05e-4bec-b572-1703e1c5fa60 req-24ebe2ff-0f8b-49e8-98b2-97864c8b9d6c service nova] Lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.008s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:51:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-be64d9fe-e05e-4bec-b572-1703e1c5fa60 req-24ebe2ff-0f8b-49e8-98b2-97864c8b9d6c service nova] Lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:51:28 user nova-compute[72129]: DEBUG nova.compute.manager [req-be64d9fe-e05e-4bec-b572-1703e1c5fa60 req-24ebe2ff-0f8b-49e8-98b2-97864c8b9d6c service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] No waiting events found dispatching network-vif-plugged-e1d5b511-b4c8-4d81-8b78-e58ffdfb3015 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:51:28 user nova-compute[72129]: WARNING nova.compute.manager [req-be64d9fe-e05e-4bec-b572-1703e1c5fa60 req-24ebe2ff-0f8b-49e8-98b2-97864c8b9d6c service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Received unexpected event network-vif-plugged-e1d5b511-b4c8-4d81-8b78-e58ffdfb3015 for instance with vm_state building and task_state spawning.
Aug 01 13:51:29 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:29 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:29 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690897889.777575, e1ee9e5e-0bd8-4986-8641-d44680f97724 => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:51:29 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] VM Resumed (Lifecycle Event)
Aug 01 13:51:29 user nova-compute[72129]: DEBUG nova.compute.manager [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Instance event wait completed in 0 seconds for  {{(pid=72129) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 13:51:29 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Guest created on hypervisor {{(pid=72129) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 13:51:29 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Instance spawned successfully.
Aug 01 13:51:29 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 13:51:29 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:51:29 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 13:51:29 user nova-compute[72129]: DEBUG nova.compute.manager [req-741da606-98d6-4cf0-bdd6-2fa00da179f9 req-83cfcdca-ecf8-4e31-a4fd-db037f6aa4fd service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Received event network-vif-plugged-4bb0a232-3a92-4b85-9a12-29f8d822362e {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:51:29 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-741da606-98d6-4cf0-bdd6-2fa00da179f9 req-83cfcdca-ecf8-4e31-a4fd-db037f6aa4fd service nova] Acquiring lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:51:29 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-741da606-98d6-4cf0-bdd6-2fa00da179f9 req-83cfcdca-ecf8-4e31-a4fd-db037f6aa4fd service nova] Lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:51:29 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-741da606-98d6-4cf0-bdd6-2fa00da179f9 req-83cfcdca-ecf8-4e31-a4fd-db037f6aa4fd service nova] Lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:51:29 user nova-compute[72129]: DEBUG nova.compute.manager [req-741da606-98d6-4cf0-bdd6-2fa00da179f9 req-83cfcdca-ecf8-4e31-a4fd-db037f6aa4fd service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] No waiting events found dispatching network-vif-plugged-4bb0a232-3a92-4b85-9a12-29f8d822362e {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:51:29 user nova-compute[72129]: WARNING nova.compute.manager [req-741da606-98d6-4cf0-bdd6-2fa00da179f9 req-83cfcdca-ecf8-4e31-a4fd-db037f6aa4fd service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Received unexpected event network-vif-plugged-4bb0a232-3a92-4b85-9a12-29f8d822362e for instance with vm_state building and task_state spawning.
Aug 01 13:51:29 user nova-compute[72129]: DEBUG nova.compute.manager [req-741da606-98d6-4cf0-bdd6-2fa00da179f9 req-83cfcdca-ecf8-4e31-a4fd-db037f6aa4fd service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Received event network-vif-plugged-4bb0a232-3a92-4b85-9a12-29f8d822362e {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:51:29 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-741da606-98d6-4cf0-bdd6-2fa00da179f9 req-83cfcdca-ecf8-4e31-a4fd-db037f6aa4fd service nova] Acquiring lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:51:29 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-741da606-98d6-4cf0-bdd6-2fa00da179f9 req-83cfcdca-ecf8-4e31-a4fd-db037f6aa4fd service nova] Lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:51:29 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-741da606-98d6-4cf0-bdd6-2fa00da179f9 req-83cfcdca-ecf8-4e31-a4fd-db037f6aa4fd service nova] Lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:51:29 user nova-compute[72129]: DEBUG nova.compute.manager [req-741da606-98d6-4cf0-bdd6-2fa00da179f9 req-83cfcdca-ecf8-4e31-a4fd-db037f6aa4fd service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] No waiting events found dispatching network-vif-plugged-4bb0a232-3a92-4b85-9a12-29f8d822362e {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:51:29 user nova-compute[72129]: WARNING nova.compute.manager [req-741da606-98d6-4cf0-bdd6-2fa00da179f9 req-83cfcdca-ecf8-4e31-a4fd-db037f6aa4fd service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Received unexpected event network-vif-plugged-4bb0a232-3a92-4b85-9a12-29f8d822362e for instance with vm_state building and task_state spawning.
Aug 01 13:51:29 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Found default for hw_cdrom_bus of ide {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:51:29 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Found default for hw_disk_bus of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:51:29 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Found default for hw_input_bus of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:51:29 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Found default for hw_pointer_model of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:51:29 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Found default for hw_video_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:51:29 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Found default for hw_vif_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:51:29 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 13:51:29 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690897889.778491, e1ee9e5e-0bd8-4986-8641-d44680f97724 => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:51:29 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] VM Started (Lifecycle Event)
Aug 01 13:51:29 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:51:29 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 13:51:29 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 13:51:29 user nova-compute[72129]: INFO nova.compute.manager [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Took 11.14 seconds to spawn the instance on the hypervisor.
Aug 01 13:51:29 user nova-compute[72129]: DEBUG nova.compute.manager [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:51:30 user nova-compute[72129]: INFO nova.compute.manager [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Took 44.38 seconds to build instance.
Aug 01 13:51:30 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-399954d3-4731-4b7c-a8ce-a6fc1cea2a1a tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Lock "e1ee9e5e-0bd8-4986-8641-d44680f97724" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 44.512s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:51:30 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:33 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:34 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:51:34 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:51:35 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:51:35 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:51:35 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:51:35 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:51:35 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72129) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 13:51:35 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:36 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:51:36 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:51:36 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:51:36 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:51:36 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:51:36 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Auditing locally available compute resources for user (node: user) {{(pid=72129) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 13:51:36 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:36 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:36 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:36 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:36 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c1f751a-e2aa-4447-b72f-9dc88c4c1a84/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:36 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c1f751a-e2aa-4447-b72f-9dc88c4c1a84/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:36 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c1f751a-e2aa-4447-b72f-9dc88c4c1a84/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:36 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c1f751a-e2aa-4447-b72f-9dc88c4c1a84/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:36 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28115c7d-544a-4504-98da-2398e0e354d8/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:36 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28115c7d-544a-4504-98da-2398e0e354d8/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:36 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28115c7d-544a-4504-98da-2398e0e354d8/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:37 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28115c7d-544a-4504-98da-2398e0e354d8/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:37 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 13:51:37 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 13:51:37 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 13:51:37 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b77b93-6f25-447f-80a7-d64374fee14d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:37 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b77b93-6f25-447f-80a7-d64374fee14d/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:37 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b77b93-6f25-447f-80a7-d64374fee14d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:37 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b77b93-6f25-447f-80a7-d64374fee14d/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:37 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 13:51:37 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 13:51:37 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 13:51:37 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b336c3-c7d4-4353-8e51-416726833407/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:37 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b336c3-c7d4-4353-8e51-416726833407/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:37 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b336c3-c7d4-4353-8e51-416726833407/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:37 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b336c3-c7d4-4353-8e51-416726833407/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:37 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31105963-52fa-4aff-9270-075cd98f08a5/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:37 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31105963-52fa-4aff-9270-075cd98f08a5/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:37 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31105963-52fa-4aff-9270-075cd98f08a5/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:38 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31105963-52fa-4aff-9270-075cd98f08a5/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:38 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ce22ea1-b01c-47c6-b9e4-bf28aebc125c/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:38 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ce22ea1-b01c-47c6-b9e4-bf28aebc125c/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:38 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ce22ea1-b01c-47c6-b9e4-bf28aebc125c/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:38 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ce22ea1-b01c-47c6-b9e4-bf28aebc125c/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:38 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63c0c1fe-7e4d-4763-8ede-a7662747a4c0/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:38 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63c0c1fe-7e4d-4763-8ede-a7662747a4c0/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:38 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63c0c1fe-7e4d-4763-8ede-a7662747a4c0/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:38 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:38 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63c0c1fe-7e4d-4763-8ede-a7662747a4c0/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:38 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efa87a6-1dd6-4441-a55e-8e86be7f0a35/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:38 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efa87a6-1dd6-4441-a55e-8e86be7f0a35/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:38 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efa87a6-1dd6-4441-a55e-8e86be7f0a35/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:39 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efa87a6-1dd6-4441-a55e-8e86be7f0a35/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:39 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:51:39 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:51:39 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Hypervisor/Node resource view: name=user free_ram=6778MB free_disk=25.57529067993164GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72129) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 13:51:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:51:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:51:39 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance d6b336c3-c7d4-4353-8e51-416726833407 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:51:39 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 63c0c1fe-7e4d-4763-8ede-a7662747a4c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:51:39 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 2efa87a6-1dd6-4441-a55e-8e86be7f0a35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:51:39 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 28115c7d-544a-4504-98da-2398e0e354d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:51:39 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 31105963-52fa-4aff-9270-075cd98f08a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:51:39 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 78b77b93-6f25-447f-80a7-d64374fee14d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:51:39 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:51:39 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:51:39 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:51:39 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 1490f922-a4b0-43be-8826-ab527f66a350 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:51:39 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance e1ee9e5e-0bd8-4986-8641-d44680f97724 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:51:39 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 13:51:39 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 13:51:40 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 13:51:40 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 13:51:40 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:40 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Compute_service record updated for user:user {{(pid=72129) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 13:51:40 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.640s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:51:41 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:51:41 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:51:41 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Starting heal instance info cache {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 13:51:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "refresh_cache-63c0c1fe-7e4d-4763-8ede-a7662747a4c0" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:51:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquired lock "refresh_cache-63c0c1fe-7e4d-4763-8ede-a7662747a4c0" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:51:41 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] Forcefully refreshing network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 13:51:42 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] Updating instance_info_cache with network_info: [{"id": "33a9acea-27a3-4a66-a5f9-4be39dc61ae7", "address": "fa:16:3e:65:63:71", "network": {"id": "90839969-290c-4555-ab2f-2215c33e89e9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1983064867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f34719c31d18460fa308e1f40130ed24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33a9acea-27", "ovs_interfaceid": "33a9acea-27a3-4a66-a5f9-4be39dc61ae7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:51:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Releasing lock "refresh_cache-63c0c1fe-7e4d-4763-8ede-a7662747a4c0" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:51:42 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] Updated the network info_cache for instance {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 13:51:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-63c71cd7-7f43-4ab7-8fd8-e5b4b307677a tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Acquiring lock "d6b336c3-c7d4-4353-8e51-416726833407" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:51:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-63c71cd7-7f43-4ab7-8fd8-e5b4b307677a tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Lock "d6b336c3-c7d4-4353-8e51-416726833407" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:51:42 user nova-compute[72129]: DEBUG nova.objects.instance [None req-63c71cd7-7f43-4ab7-8fd8-e5b4b307677a tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Lazy-loading 'flavor' on Instance uuid d6b336c3-c7d4-4353-8e51-416726833407 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:51:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-63c71cd7-7f43-4ab7-8fd8-e5b4b307677a tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Lock "d6b336c3-c7d4-4353-8e51-416726833407" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.096s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:51:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-63c71cd7-7f43-4ab7-8fd8-e5b4b307677a tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Acquiring lock "d6b336c3-c7d4-4353-8e51-416726833407" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:51:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-63c71cd7-7f43-4ab7-8fd8-e5b4b307677a tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Lock "d6b336c3-c7d4-4353-8e51-416726833407" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:51:42 user nova-compute[72129]: INFO nova.compute.manager [None req-63c71cd7-7f43-4ab7-8fd8-e5b4b307677a tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] [instance: d6b336c3-c7d4-4353-8e51-416726833407] Attaching volume 61472460-c919-4222-88c4-bc0a50db5d5f to /dev/vdb
Aug 01 13:51:42 user nova-compute[72129]: DEBUG os_brick.utils [None req-63c71cd7-7f43-4ab7-8fd8-e5b4b307677a tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:51:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:42 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc92089d-cb9d-4b72-9e24-9298e19ab6f3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f9b449c2cd3d\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:42 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ae0d2c-349b-4643-9735-e38f357c468f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:42 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[838e71ec-7418-4946-8b63-dc7e4125d8a1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:42 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e52fa7-daea-4117-a23e-71a80c68edbe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-63c71cd7-7f43-4ab7-8fd8-e5b4b307677a tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Running cmd (subprocess): nvme version {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-63c71cd7-7f43-4ab7-8fd8-e5b4b307677a tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] 'nvme version' failed. Not Retrying. {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 13:51:42 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.nvmeof [None req-63c71cd7-7f43-4ab7-8fd8-e5b4b307677a tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] nvme not present on system {{(pid=72129) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 13:51:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 13:51:42 user nova-compute[72129]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 13:51:42 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b82315-fb9a-4ac7-8327-86078ea23ba8]: (4, '') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:42 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-63c71cd7-7f43-4ab7-8fd8-e5b4b307677a tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72129) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 13:51:42 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-63c71cd7-7f43-4ab7-8fd8-e5b4b307677a tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 13:51:42 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-63c71cd7-7f43-4ab7-8fd8-e5b4b307677a tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] LIGHTOS: no hostnqn found. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 13:51:42 user nova-compute[72129]: DEBUG os_brick.utils [None req-63c71cd7-7f43-4ab7-8fd8-e5b4b307677a tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f9b449c2cd3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:51:42 user nova-compute[72129]: DEBUG nova.virt.block_device [None req-63c71cd7-7f43-4ab7-8fd8-e5b4b307677a tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] [instance: d6b336c3-c7d4-4353-8e51-416726833407] Updating existing volume attachment record: c55eb8fe-270b-43a5-b0d8-237a679e5db7 {{(pid=72129) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 13:51:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Acquiring lock "31781ddf-6764-4c41-8047-21adfc25d610" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:51:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Lock "31781ddf-6764-4c41-8047-21adfc25d610" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:51:42 user nova-compute[72129]: DEBUG nova.compute.manager [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] Starting instance... {{(pid=72129) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 13:51:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:51:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:51:43 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72129) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 13:51:43 user nova-compute[72129]: INFO nova.compute.claims [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] Claim successful on node user
Aug 01 13:51:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:43 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 13:51:43 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 13:51:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.887s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:51:43 user nova-compute[72129]: DEBUG nova.compute.manager [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] Start building networks asynchronously for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 13:51:43 user nova-compute[72129]: DEBUG nova.compute.manager [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] Allocating IP information in the background. {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 13:51:43 user nova-compute[72129]: DEBUG nova.network.neutron [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] allocate_for_instance() {{(pid=72129) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 13:51:44 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 13:51:44 user nova-compute[72129]: DEBUG nova.compute.manager [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] Start building block device mappings for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 13:51:44 user nova-compute[72129]: DEBUG nova.policy [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '14a1a4faeffb41a8bcebc292a7d73cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34719c31d18460fa308e1f40130ed24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72129) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 13:51:44 user nova-compute[72129]: DEBUG nova.compute.manager [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] Start spawning the instance on the hypervisor. {{(pid=72129) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 13:51:44 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] Creating instance directory {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 13:51:44 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] Creating image(s)
Aug 01 13:51:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Acquiring lock "/opt/stack/data/nova/instances/31781ddf-6764-4c41-8047-21adfc25d610/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:51:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Lock "/opt/stack/data/nova/instances/31781ddf-6764-4c41-8047-21adfc25d610/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:51:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Lock "/opt/stack/data/nova/instances/31781ddf-6764-4c41-8047-21adfc25d610/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:51:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.152s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Acquiring lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:51:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:51:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.154s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/31781ddf-6764-4c41-8047-21adfc25d610/disk 1073741824 {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/31781ddf-6764-4c41-8047-21adfc25d610/disk 1073741824" returned: 0 in 0.048s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.210s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:51:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.140s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:44 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Checking if we can resize image /opt/stack/data/nova/instances/31781ddf-6764-4c41-8047-21adfc25d610/disk. size=1073741824 {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 13:51:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31781ddf-6764-4c41-8047-21adfc25d610/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31781ddf-6764-4c41-8047-21adfc25d610/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:44 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Cannot resize image /opt/stack/data/nova/instances/31781ddf-6764-4c41-8047-21adfc25d610/disk to a smaller size. {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 13:51:44 user nova-compute[72129]: DEBUG nova.objects.instance [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Lazy-loading 'migration_context' on Instance uuid 31781ddf-6764-4c41-8047-21adfc25d610 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:51:44 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] Created local disks {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 13:51:44 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] Ensure instance console log exists: /opt/stack/data/nova/instances/31781ddf-6764-4c41-8047-21adfc25d610/console.log {{(pid=72129) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 13:51:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:51:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:51:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:51:44 user nova-compute[72129]: DEBUG nova.network.neutron [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] Successfully created port: bd36aadb-c36c-4c08-80c9-75f12b422c3d {{(pid=72129) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 13:51:45 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:45 user nova-compute[72129]: DEBUG nova.compute.manager [req-782d7052-12fb-4c1b-8892-21cbd637356c req-87c9852d-8c86-4fed-8a52-9047b7791efb service nova] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] Received event network-changed-85708040-d7bf-4951-a29c-68cd6d3c4c42 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:51:45 user nova-compute[72129]: DEBUG nova.compute.manager [req-782d7052-12fb-4c1b-8892-21cbd637356c req-87c9852d-8c86-4fed-8a52-9047b7791efb service nova] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] Refreshing instance network info cache due to event network-changed-85708040-d7bf-4951-a29c-68cd6d3c4c42. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 13:51:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-782d7052-12fb-4c1b-8892-21cbd637356c req-87c9852d-8c86-4fed-8a52-9047b7791efb service nova] Acquiring lock "refresh_cache-28115c7d-544a-4504-98da-2398e0e354d8" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:51:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-782d7052-12fb-4c1b-8892-21cbd637356c req-87c9852d-8c86-4fed-8a52-9047b7791efb service nova] Acquired lock "refresh_cache-28115c7d-544a-4504-98da-2398e0e354d8" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:51:45 user nova-compute[72129]: DEBUG nova.network.neutron [req-782d7052-12fb-4c1b-8892-21cbd637356c req-87c9852d-8c86-4fed-8a52-9047b7791efb service nova] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] Refreshing network info cache for port 85708040-d7bf-4951-a29c-68cd6d3c4c42 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 13:51:46 user nova-compute[72129]: DEBUG nova.compute.manager [req-45c0b0d3-60df-42c1-acac-eaa041ac7f9e req-28997a99-799c-4348-a400-3084744ca59e service nova] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Received event network-changed-d59c6949-2748-4a57-b089-6219f9102815 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:51:46 user nova-compute[72129]: DEBUG nova.compute.manager [req-45c0b0d3-60df-42c1-acac-eaa041ac7f9e req-28997a99-799c-4348-a400-3084744ca59e service nova] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Refreshing instance network info cache due to event network-changed-d59c6949-2748-4a57-b089-6219f9102815. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 13:51:46 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-45c0b0d3-60df-42c1-acac-eaa041ac7f9e req-28997a99-799c-4348-a400-3084744ca59e service nova] Acquiring lock "refresh_cache-2efa87a6-1dd6-4441-a55e-8e86be7f0a35" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:51:46 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-45c0b0d3-60df-42c1-acac-eaa041ac7f9e req-28997a99-799c-4348-a400-3084744ca59e service nova] Acquired lock "refresh_cache-2efa87a6-1dd6-4441-a55e-8e86be7f0a35" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:51:46 user nova-compute[72129]: DEBUG nova.network.neutron [req-45c0b0d3-60df-42c1-acac-eaa041ac7f9e req-28997a99-799c-4348-a400-3084744ca59e service nova] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Refreshing network info cache for port d59c6949-2748-4a57-b089-6219f9102815 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 13:51:46 user nova-compute[72129]: DEBUG nova.network.neutron [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] Successfully updated port: bd36aadb-c36c-4c08-80c9-75f12b422c3d {{(pid=72129) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 13:51:46 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Acquiring lock "refresh_cache-31781ddf-6764-4c41-8047-21adfc25d610" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:51:46 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Acquired lock "refresh_cache-31781ddf-6764-4c41-8047-21adfc25d610" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:51:46 user nova-compute[72129]: DEBUG nova.network.neutron [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 13:51:46 user nova-compute[72129]: DEBUG nova.compute.manager [req-dfd82b24-390a-4125-abb2-7d0f8996b7fc req-89e20648-a9f3-4b15-9eee-bcc0952f16c2 service nova] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] Received event network-changed-bd36aadb-c36c-4c08-80c9-75f12b422c3d {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:51:46 user nova-compute[72129]: DEBUG nova.compute.manager [req-dfd82b24-390a-4125-abb2-7d0f8996b7fc req-89e20648-a9f3-4b15-9eee-bcc0952f16c2 service nova] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] Refreshing instance network info cache due to event network-changed-bd36aadb-c36c-4c08-80c9-75f12b422c3d. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 13:51:46 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-dfd82b24-390a-4125-abb2-7d0f8996b7fc req-89e20648-a9f3-4b15-9eee-bcc0952f16c2 service nova] Acquiring lock "refresh_cache-31781ddf-6764-4c41-8047-21adfc25d610" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:51:46 user nova-compute[72129]: DEBUG nova.network.neutron [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] Instance cache missing network info. {{(pid=72129) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 13:51:46 user nova-compute[72129]: DEBUG nova.network.neutron [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] Updating instance_info_cache with network_info: [{"id": "bd36aadb-c36c-4c08-80c9-75f12b422c3d", "address": "fa:16:3e:1e:1e:07", "network": {"id": "90839969-290c-4555-ab2f-2215c33e89e9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1983064867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f34719c31d18460fa308e1f40130ed24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd36aadb-c3", "ovs_interfaceid": "bd36aadb-c36c-4c08-80c9-75f12b422c3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:51:46 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Releasing lock "refresh_cache-31781ddf-6764-4c41-8047-21adfc25d610" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:51:46 user nova-compute[72129]: DEBUG nova.compute.manager [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] Instance network_info: |[{"id": "bd36aadb-c36c-4c08-80c9-75f12b422c3d", "address": "fa:16:3e:1e:1e:07", "network": {"id": "90839969-290c-4555-ab2f-2215c33e89e9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1983064867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f34719c31d18460fa308e1f40130ed24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd36aadb-c3", "ovs_interfaceid": "bd36aadb-c36c-4c08-80c9-75f12b422c3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 13:51:46 user nova-compute[72129]: DEBUG nova.network.neutron [req-782d7052-12fb-4c1b-8892-21cbd637356c req-87c9852d-8c86-4fed-8a52-9047b7791efb service nova] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] Updated VIF entry in instance network info cache for port 85708040-d7bf-4951-a29c-68cd6d3c4c42. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 13:51:46 user nova-compute[72129]: DEBUG nova.network.neutron [req-782d7052-12fb-4c1b-8892-21cbd637356c req-87c9852d-8c86-4fed-8a52-9047b7791efb service nova] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] Updating instance_info_cache with network_info: [{"id": "85708040-d7bf-4951-a29c-68cd6d3c4c42", "address": "fa:16:3e:ed:f5:6f", "network": {"id": "2338fb81-87b6-4976-a6ab-b4ea0218fa9b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-606840206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebef26e9d3654bf99ecf391ccb263330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85708040-d7", "ovs_interfaceid": "85708040-d7bf-4951-a29c-68cd6d3c4c42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:51:46 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-dfd82b24-390a-4125-abb2-7d0f8996b7fc req-89e20648-a9f3-4b15-9eee-bcc0952f16c2 service nova] Acquired lock "refresh_cache-31781ddf-6764-4c41-8047-21adfc25d610" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:51:46 user nova-compute[72129]: DEBUG nova.network.neutron [req-dfd82b24-390a-4125-abb2-7d0f8996b7fc req-89e20648-a9f3-4b15-9eee-bcc0952f16c2 service nova] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] Refreshing network info cache for port bd36aadb-c36c-4c08-80c9-75f12b422c3d {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 13:51:46 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] Start _get_guest_xml network_info=[{"id": "bd36aadb-c36c-4c08-80c9-75f12b422c3d", "address": "fa:16:3e:1e:1e:07", "network": {"id": "90839969-290c-4555-ab2f-2215c33e89e9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1983064867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f34719c31d18460fa308e1f40130ed24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd36aadb-c3", "ovs_interfaceid": "bd36aadb-c36c-4c08-80c9-75f12b422c3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'image_id': 'b6472c34-1b0f-4034-ba3a-7e8eb5103715'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 13:51:46 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-782d7052-12fb-4c1b-8892-21cbd637356c req-87c9852d-8c86-4fed-8a52-9047b7791efb service nova] Releasing lock "refresh_cache-28115c7d-544a-4504-98da-2398e0e354d8" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:51:46 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:51:46 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:51:46 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 13:51:46 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] CPU controller missing on host. {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 13:51:46 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 13:51:46 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] CPU controller found on host. {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 13:51:46 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72129) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 13:51:46 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T13:45:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 13:51:46 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Flavor limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 13:51:46 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Image limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 13:51:46 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Flavor pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 13:51:46 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Image pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 13:51:46 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 13:51:46 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 13:51:46 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 13:51:46 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Got 1 possible topologies {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 13:51:46 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 13:51:46 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 13:51:46 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:51:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-859811517',display_name='tempest-ServersNegativeTestJSON-server-859811517',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-859811517',id=12,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f34719c31d18460fa308e1f40130ed24',ramdisk_id='',reservation_id='r-5xh56j0i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-281733508',owner_user_name='tempest-ServersNegativeTestJSON-281733508-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:51:44Z,user_data=None,user_id='14a1a4faeffb41a8bcebc292a7d73cb2',uuid=31781ddf-6764-4c41-8047-21adfc25d610,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd36aadb-c36c-4c08-80c9-75f12b422c3d", "address": "fa:16:3e:1e:1e:07", "network": {"id": "90839969-290c-4555-ab2f-2215c33e89e9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1983064867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f34719c31d18460fa308e1f40130ed24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd36aadb-c3", "ovs_interfaceid": "bd36aadb-c36c-4c08-80c9-75f12b422c3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 13:51:46 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Converting VIF {"id": "bd36aadb-c36c-4c08-80c9-75f12b422c3d", "address": "fa:16:3e:1e:1e:07", "network": {"id": "90839969-290c-4555-ab2f-2215c33e89e9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1983064867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f34719c31d18460fa308e1f40130ed24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd36aadb-c3", "ovs_interfaceid": "bd36aadb-c36c-4c08-80c9-75f12b422c3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:51:46 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:1e:07,bridge_name='br-int',has_traffic_filtering=True,id=bd36aadb-c36c-4c08-80c9-75f12b422c3d,network=Network(90839969-290c-4555-ab2f-2215c33e89e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd36aadb-c3') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:51:46 user nova-compute[72129]: DEBUG nova.objects.instance [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Lazy-loading 'pci_devices' on Instance uuid 31781ddf-6764-4c41-8047-21adfc25d610 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:51:46 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] End _get_guest_xml xml=<domain type="kvm">
Aug 01 13:51:46 user nova-compute[72129]:   <uuid>31781ddf-6764-4c41-8047-21adfc25d610</uuid>
Aug 01 13:51:46 user nova-compute[72129]:   <name>instance-0000000c</name>
Aug 01 13:51:46 user nova-compute[72129]:   <memory>524288</memory>
Aug 01 13:51:46 user nova-compute[72129]:   <vcpu>1</vcpu>
Aug 01 13:51:46 user nova-compute[72129]:   <metadata>
Aug 01 13:51:46 user nova-compute[72129]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 13:51:46 user nova-compute[72129]:       <nova:package version="0.0.0"/>
Aug 01 13:51:46 user nova-compute[72129]:       <nova:name>tempest-ServersNegativeTestJSON-server-859811517</nova:name>
Aug 01 13:51:46 user nova-compute[72129]:       <nova:creationTime>2023-08-01 13:51:46</nova:creationTime>
Aug 01 13:51:46 user nova-compute[72129]:       <nova:flavor name="m1.tiny">
Aug 01 13:51:46 user nova-compute[72129]:         <nova:memory>512</nova:memory>
Aug 01 13:51:46 user nova-compute[72129]:         <nova:disk>1</nova:disk>
Aug 01 13:51:46 user nova-compute[72129]:         <nova:swap>0</nova:swap>
Aug 01 13:51:46 user nova-compute[72129]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 13:51:46 user nova-compute[72129]:         <nova:vcpus>1</nova:vcpus>
Aug 01 13:51:46 user nova-compute[72129]:       </nova:flavor>
Aug 01 13:51:46 user nova-compute[72129]:       <nova:owner>
Aug 01 13:51:46 user nova-compute[72129]:         <nova:user uuid="14a1a4faeffb41a8bcebc292a7d73cb2">tempest-ServersNegativeTestJSON-281733508-project-member</nova:user>
Aug 01 13:51:46 user nova-compute[72129]:         <nova:project uuid="f34719c31d18460fa308e1f40130ed24">tempest-ServersNegativeTestJSON-281733508</nova:project>
Aug 01 13:51:46 user nova-compute[72129]:       </nova:owner>
Aug 01 13:51:46 user nova-compute[72129]:       <nova:root type="image" uuid="b6472c34-1b0f-4034-ba3a-7e8eb5103715"/>
Aug 01 13:51:46 user nova-compute[72129]:       <nova:ports>
Aug 01 13:51:46 user nova-compute[72129]:         <nova:port uuid="bd36aadb-c36c-4c08-80c9-75f12b422c3d">
Aug 01 13:51:46 user nova-compute[72129]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 01 13:51:46 user nova-compute[72129]:         </nova:port>
Aug 01 13:51:46 user nova-compute[72129]:       </nova:ports>
Aug 01 13:51:46 user nova-compute[72129]:     </nova:instance>
Aug 01 13:51:46 user nova-compute[72129]:   </metadata>
Aug 01 13:51:46 user nova-compute[72129]:   <sysinfo type="smbios">
Aug 01 13:51:46 user nova-compute[72129]:     <system>
Aug 01 13:51:46 user nova-compute[72129]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 13:51:46 user nova-compute[72129]:       <entry name="product">OpenStack Nova</entry>
Aug 01 13:51:46 user nova-compute[72129]:       <entry name="version">0.0.0</entry>
Aug 01 13:51:46 user nova-compute[72129]:       <entry name="serial">31781ddf-6764-4c41-8047-21adfc25d610</entry>
Aug 01 13:51:46 user nova-compute[72129]:       <entry name="uuid">31781ddf-6764-4c41-8047-21adfc25d610</entry>
Aug 01 13:51:46 user nova-compute[72129]:       <entry name="family">Virtual Machine</entry>
Aug 01 13:51:46 user nova-compute[72129]:     </system>
Aug 01 13:51:46 user nova-compute[72129]:   </sysinfo>
Aug 01 13:51:46 user nova-compute[72129]:   <os>
Aug 01 13:51:46 user nova-compute[72129]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 13:51:46 user nova-compute[72129]:     <boot dev="hd"/>
Aug 01 13:51:46 user nova-compute[72129]:     <smbios mode="sysinfo"/>
Aug 01 13:51:46 user nova-compute[72129]:   </os>
Aug 01 13:51:46 user nova-compute[72129]:   <features>
Aug 01 13:51:46 user nova-compute[72129]:     <acpi/>
Aug 01 13:51:46 user nova-compute[72129]:     <apic/>
Aug 01 13:51:46 user nova-compute[72129]:     <vmcoreinfo/>
Aug 01 13:51:46 user nova-compute[72129]:   </features>
Aug 01 13:51:46 user nova-compute[72129]:   <clock offset="utc">
Aug 01 13:51:46 user nova-compute[72129]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 13:51:46 user nova-compute[72129]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 13:51:46 user nova-compute[72129]:     <timer name="hpet" present="no"/>
Aug 01 13:51:46 user nova-compute[72129]:   </clock>
Aug 01 13:51:46 user nova-compute[72129]:   <cpu mode="custom" match="exact">
Aug 01 13:51:46 user nova-compute[72129]:     <model>Nehalem</model>
Aug 01 13:51:46 user nova-compute[72129]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 13:51:46 user nova-compute[72129]:   </cpu>
Aug 01 13:51:46 user nova-compute[72129]:   <devices>
Aug 01 13:51:46 user nova-compute[72129]:     <disk type="file" device="disk">
Aug 01 13:51:46 user nova-compute[72129]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 13:51:46 user nova-compute[72129]:       <source file="/opt/stack/data/nova/instances/31781ddf-6764-4c41-8047-21adfc25d610/disk"/>
Aug 01 13:51:46 user nova-compute[72129]:       <target dev="vda" bus="virtio"/>
Aug 01 13:51:46 user nova-compute[72129]:     </disk>
Aug 01 13:51:46 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 13:51:46 user nova-compute[72129]:       <mac address="fa:16:3e:1e:1e:07"/>
Aug 01 13:51:46 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 13:51:46 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 13:51:46 user nova-compute[72129]:       <target dev="tapbd36aadb-c3"/>
Aug 01 13:51:46 user nova-compute[72129]:     </interface>
Aug 01 13:51:46 user nova-compute[72129]:     <serial type="pty">
Aug 01 13:51:46 user nova-compute[72129]:       <log file="/opt/stack/data/nova/instances/31781ddf-6764-4c41-8047-21adfc25d610/console.log" append="off"/>
Aug 01 13:51:46 user nova-compute[72129]:     </serial>
Aug 01 13:51:46 user nova-compute[72129]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 13:51:46 user nova-compute[72129]:     <video>
Aug 01 13:51:46 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 13:51:46 user nova-compute[72129]:     </video>
Aug 01 13:51:46 user nova-compute[72129]:     <rng model="virtio">
Aug 01 13:51:46 user nova-compute[72129]:       <backend model="random">/dev/urandom</backend>
Aug 01 13:51:46 user nova-compute[72129]:     </rng>
Aug 01 13:51:46 user nova-compute[72129]:     <controller type="usb" index="0" model="none"/>
Aug 01 13:51:46 user nova-compute[72129]:     <memballoon model="virtio">
Aug 01 13:51:46 user nova-compute[72129]:       <stats period="10"/>
Aug 01 13:51:46 user nova-compute[72129]:     </memballoon>
Aug 01 13:51:46 user nova-compute[72129]:   </devices>
Aug 01 13:51:46 user nova-compute[72129]: </domain>
Aug 01 13:51:46 user nova-compute[72129]:  {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 13:51:46 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:51:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-859811517',display_name='tempest-ServersNegativeTestJSON-server-859811517',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-859811517',id=12,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f34719c31d18460fa308e1f40130ed24',ramdisk_id='',reservation_id='r-5xh56j0i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-281733508',owner_user_name='tempest-ServersNegativeTestJSON-281733508-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:51:44Z,user_data=None,user_id='14a1a4faeffb41a8bcebc292a7d73cb2',uuid=31781ddf-6764-4c41-8047-21adfc25d610,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd36aadb-c36c-4c08-80c9-75f12b422c3d", "address": "fa:16:3e:1e:1e:07", "network": {"id": "90839969-290c-4555-ab2f-2215c33e89e9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1983064867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f34719c31d18460fa308e1f40130ed24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd36aadb-c3", "ovs_interfaceid": "bd36aadb-c36c-4c08-80c9-75f12b422c3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 13:51:46 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Converting VIF {"id": "bd36aadb-c36c-4c08-80c9-75f12b422c3d", "address": "fa:16:3e:1e:1e:07", "network": {"id": "90839969-290c-4555-ab2f-2215c33e89e9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1983064867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f34719c31d18460fa308e1f40130ed24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd36aadb-c3", "ovs_interfaceid": "bd36aadb-c36c-4c08-80c9-75f12b422c3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:51:46 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:1e:07,bridge_name='br-int',has_traffic_filtering=True,id=bd36aadb-c36c-4c08-80c9-75f12b422c3d,network=Network(90839969-290c-4555-ab2f-2215c33e89e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd36aadb-c3') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:51:46 user nova-compute[72129]: DEBUG os_vif [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:1e:07,bridge_name='br-int',has_traffic_filtering=True,id=bd36aadb-c36c-4c08-80c9-75f12b422c3d,network=Network(90839969-290c-4555-ab2f-2215c33e89e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd36aadb-c3') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 13:51:46 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:46 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:51:46 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 13:51:46 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:46 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbd36aadb-c3, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:51:46 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbd36aadb-c3, col_values=(('external_ids', {'iface-id': 'bd36aadb-c36c-4c08-80c9-75f12b422c3d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:1e:07', 'vm-uuid': '31781ddf-6764-4c41-8047-21adfc25d610'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:51:46 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:46 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 13:51:46 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:46 user nova-compute[72129]: INFO os_vif [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:1e:07,bridge_name='br-int',has_traffic_filtering=True,id=bd36aadb-c36c-4c08-80c9-75f12b422c3d,network=Network(90839969-290c-4555-ab2f-2215c33e89e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd36aadb-c3')
Aug 01 13:51:47 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 13:51:47 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] No VIF found with MAC fa:16:3e:1e:1e:07, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 13:51:47 user nova-compute[72129]: DEBUG nova.network.neutron [req-45c0b0d3-60df-42c1-acac-eaa041ac7f9e req-28997a99-799c-4348-a400-3084744ca59e service nova] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Updated VIF entry in instance network info cache for port d59c6949-2748-4a57-b089-6219f9102815. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 13:51:47 user nova-compute[72129]: DEBUG nova.network.neutron [req-45c0b0d3-60df-42c1-acac-eaa041ac7f9e req-28997a99-799c-4348-a400-3084744ca59e service nova] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Updating instance_info_cache with network_info: [{"id": "d59c6949-2748-4a57-b089-6219f9102815", "address": "fa:16:3e:20:eb:cf", "network": {"id": "4de0d3ee-7981-427b-9013-99cf0bc22cf8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-289359635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d693a983e4a44434b64c7983239371a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd59c6949-27", "ovs_interfaceid": "d59c6949-2748-4a57-b089-6219f9102815", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:51:47 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-45c0b0d3-60df-42c1-acac-eaa041ac7f9e req-28997a99-799c-4348-a400-3084744ca59e service nova] Releasing lock "refresh_cache-2efa87a6-1dd6-4441-a55e-8e86be7f0a35" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:51:47 user nova-compute[72129]: DEBUG nova.network.neutron [req-dfd82b24-390a-4125-abb2-7d0f8996b7fc req-89e20648-a9f3-4b15-9eee-bcc0952f16c2 service nova] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] Updated VIF entry in instance network info cache for port bd36aadb-c36c-4c08-80c9-75f12b422c3d. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 13:51:47 user nova-compute[72129]: DEBUG nova.network.neutron [req-dfd82b24-390a-4125-abb2-7d0f8996b7fc req-89e20648-a9f3-4b15-9eee-bcc0952f16c2 service nova] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] Updating instance_info_cache with network_info: [{"id": "bd36aadb-c36c-4c08-80c9-75f12b422c3d", "address": "fa:16:3e:1e:1e:07", "network": {"id": "90839969-290c-4555-ab2f-2215c33e89e9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1983064867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f34719c31d18460fa308e1f40130ed24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd36aadb-c3", "ovs_interfaceid": "bd36aadb-c36c-4c08-80c9-75f12b422c3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:51:47 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-dfd82b24-390a-4125-abb2-7d0f8996b7fc req-89e20648-a9f3-4b15-9eee-bcc0952f16c2 service nova] Releasing lock "refresh_cache-31781ddf-6764-4c41-8047-21adfc25d610" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:51:48 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:48 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:48 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:48 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:48 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:48 user nova-compute[72129]: DEBUG nova.compute.manager [req-7a4c7782-7381-4c26-a495-148979d0ae75 req-1bc6695e-a8e3-4b9c-b904-3c2665ceec85 service nova] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] Received event network-vif-plugged-bd36aadb-c36c-4c08-80c9-75f12b422c3d {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:51:48 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-7a4c7782-7381-4c26-a495-148979d0ae75 req-1bc6695e-a8e3-4b9c-b904-3c2665ceec85 service nova] Acquiring lock "31781ddf-6764-4c41-8047-21adfc25d610-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:51:48 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-7a4c7782-7381-4c26-a495-148979d0ae75 req-1bc6695e-a8e3-4b9c-b904-3c2665ceec85 service nova] Lock "31781ddf-6764-4c41-8047-21adfc25d610-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:51:48 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-7a4c7782-7381-4c26-a495-148979d0ae75 req-1bc6695e-a8e3-4b9c-b904-3c2665ceec85 service nova] Lock "31781ddf-6764-4c41-8047-21adfc25d610-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:51:48 user nova-compute[72129]: DEBUG nova.compute.manager [req-7a4c7782-7381-4c26-a495-148979d0ae75 req-1bc6695e-a8e3-4b9c-b904-3c2665ceec85 service nova] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] No waiting events found dispatching network-vif-plugged-bd36aadb-c36c-4c08-80c9-75f12b422c3d {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:51:48 user nova-compute[72129]: WARNING nova.compute.manager [req-7a4c7782-7381-4c26-a495-148979d0ae75 req-1bc6695e-a8e3-4b9c-b904-3c2665ceec85 service nova] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] Received unexpected event network-vif-plugged-bd36aadb-c36c-4c08-80c9-75f12b422c3d for instance with vm_state building and task_state spawning.
Aug 01 13:51:50 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:50 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690897910.7332892, 31781ddf-6764-4c41-8047-21adfc25d610 => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:51:50 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] VM Resumed (Lifecycle Event)
Aug 01 13:51:50 user nova-compute[72129]: DEBUG nova.compute.manager [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] Instance event wait completed in 0 seconds for  {{(pid=72129) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 13:51:50 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] Guest created on hypervisor {{(pid=72129) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 13:51:50 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] Instance spawned successfully.
Aug 01 13:51:50 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 13:51:50 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:51:50 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 13:51:50 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] Found default for hw_cdrom_bus of ide {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:51:50 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] Found default for hw_disk_bus of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:51:50 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] Found default for hw_input_bus of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:51:50 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] Found default for hw_pointer_model of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:51:50 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] Found default for hw_video_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:51:50 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] Found default for hw_vif_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:51:50 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 13:51:50 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690897910.7343297, 31781ddf-6764-4c41-8047-21adfc25d610 => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:51:50 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] VM Started (Lifecycle Event)
Aug 01 13:51:50 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:51:50 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 13:51:50 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 13:51:50 user nova-compute[72129]: INFO nova.compute.manager [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] Took 6.68 seconds to spawn the instance on the hypervisor.
Aug 01 13:51:50 user nova-compute[72129]: DEBUG nova.compute.manager [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:51:50 user nova-compute[72129]: INFO nova.compute.manager [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] Took 7.95 seconds to build instance.
Aug 01 13:51:50 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-033f312d-fc99-406a-a6dd-69db5f39fb02 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Lock "31781ddf-6764-4c41-8047-21adfc25d610" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.055s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:51:51 user nova-compute[72129]: DEBUG nova.compute.manager [req-abfb7d0a-c0aa-4e28-b49b-b3c7f2577801 req-95d7b36b-8524-4243-a057-675e51f3cf3c service nova] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] Received event network-vif-plugged-bd36aadb-c36c-4c08-80c9-75f12b422c3d {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:51:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-abfb7d0a-c0aa-4e28-b49b-b3c7f2577801 req-95d7b36b-8524-4243-a057-675e51f3cf3c service nova] Acquiring lock "31781ddf-6764-4c41-8047-21adfc25d610-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:51:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-abfb7d0a-c0aa-4e28-b49b-b3c7f2577801 req-95d7b36b-8524-4243-a057-675e51f3cf3c service nova] Lock "31781ddf-6764-4c41-8047-21adfc25d610-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:51:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-abfb7d0a-c0aa-4e28-b49b-b3c7f2577801 req-95d7b36b-8524-4243-a057-675e51f3cf3c service nova] Lock "31781ddf-6764-4c41-8047-21adfc25d610-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:51:51 user nova-compute[72129]: DEBUG nova.compute.manager [req-abfb7d0a-c0aa-4e28-b49b-b3c7f2577801 req-95d7b36b-8524-4243-a057-675e51f3cf3c service nova] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] No waiting events found dispatching network-vif-plugged-bd36aadb-c36c-4c08-80c9-75f12b422c3d {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:51:51 user nova-compute[72129]: WARNING nova.compute.manager [req-abfb7d0a-c0aa-4e28-b49b-b3c7f2577801 req-95d7b36b-8524-4243-a057-675e51f3cf3c service nova] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] Received unexpected event network-vif-plugged-bd36aadb-c36c-4c08-80c9-75f12b422c3d for instance with vm_state building and task_state spawning.
Aug 01 13:51:51 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63c71cd7-7f43-4ab7-8fd8-e5b4b307677a tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] [instance: d6b336c3-c7d4-4353-8e51-416726833407] Calling os-brick to attach iSCSI Volume {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 13:51:51 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c71cd7-7f43-4ab7-8fd8-e5b4b307677a tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:61472460-c919-4222-88c4-bc0a50db5d5f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ATEnhpck', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:51:51 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-63c71cd7-7f43-4ab7-8fd8-e5b4b307677a tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 13:51:51 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-63c71cd7-7f43-4ab7-8fd8-e5b4b307677a tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:51:51 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-63c71cd7-7f43-4ab7-8fd8-e5b4b307677a tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:51:51 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-63c71cd7-7f43-4ab7-8fd8-e5b4b307677a tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 13:51:51 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-63c71cd7-7f43-4ab7-8fd8-e5b4b307677a tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61472460-c919-4222-88c4-bc0a50db5d5f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:51:51 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-63c71cd7-7f43-4ab7-8fd8-e5b4b307677a tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61472460-c919-4222-88c4-bc0a50db5d5f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:51:51 user nova-compute[72129]: INFO os_brick.initiator.connectors.iscsi [None req-63c71cd7-7f43-4ab7-8fd8-e5b4b307677a tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 13:51:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61472460-c919-4222-88c4-bc0a50db5d5f -p 172.16.0.220:3260 {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61472460-c919-4222-88c4-bc0a50db5d5f -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:51 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b78e50e-48ef-4ba2-9e4d-0616e2ba0868]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:51 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c71cd7-7f43-4ab7-8fd8-e5b4b307677a tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 13:51:51 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:51:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61472460-c919-4222-88c4-bc0a50db5d5f -p 172.16.0.220:3260 --interface default --op new {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61472460-c919-4222-88c4-bc0a50db5d5f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:51 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b670756-2973-4f31-bce7-081776880235]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61472460-c919-4222-88c4-bc0a50db5d5f] added\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:51 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c71cd7-7f43-4ab7-8fd8-e5b4b307677a tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61472460-c919-4222-88c4-bc0a50db5d5f] added
Aug 01 13:51:51 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:51:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61472460-c919-4222-88c4-bc0a50db5d5f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61472460-c919-4222-88c4-bc0a50db5d5f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:51 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7bf0519-dd51-4389-ab16-991463ea646d]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:51 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c71cd7-7f43-4ab7-8fd8-e5b4b307677a tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:51:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61472460-c919-4222-88c4-bc0a50db5d5f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61472460-c919-4222-88c4-bc0a50db5d5f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:51 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e49ad5-a6c6-4af5-a2f6-e8344c860f71]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:51 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c71cd7-7f43-4ab7-8fd8-e5b4b307677a tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:51:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61472460-c919-4222-88c4-bc0a50db5d5f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ATEnhpck {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61472460-c919-4222-88c4-bc0a50db5d5f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ATEnhpck" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:51 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc449b31-0481-4425-ac09-f5ec59cd3f7c]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:51 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c71cd7-7f43-4ab7-8fd8-e5b4b307677a tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ATEnhpck'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:51:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61472460-c919-4222-88c4-bc0a50db5d5f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61472460-c919-4222-88c4-bc0a50db5d5f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:51 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[55af8ce8-f9f8-47dd-b604-e72a0879ffd7]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:51 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c71cd7-7f43-4ab7-8fd8-e5b4b307677a tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:51:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:51 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe9f9528-f54e-4aba-9015-e00848ba88c5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:51 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c71cd7-7f43-4ab7-8fd8-e5b4b307677a tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)
Aug 01 13:51:51 user nova-compute[72129]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)
Aug 01 13:51:51 user nova-compute[72129]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)
Aug 01 13:51:51 user nova-compute[72129]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)
Aug 01 13:51:51 user nova-compute[72129]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 (non-flash)
Aug 01 13:51:51 user nova-compute[72129]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 (non-flash)
Aug 01 13:51:51 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:51:51 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c71cd7-7f43-4ab7-8fd8-e5b4b307677a tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)
Aug 01 13:51:51 user nova-compute[72129]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)
Aug 01 13:51:51 user nova-compute[72129]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)
Aug 01 13:51:51 user nova-compute[72129]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)
Aug 01 13:51:51 user nova-compute[72129]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 (non-flash)
Aug 01 13:51:51 user nova-compute[72129]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 (non-flash)
Aug 01 13:51:51 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:51:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61472460-c919-4222-88c4-bc0a50db5d5f -p 172.16.0.220:3260 --login {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61472460-c919-4222-88c4-bc0a50db5d5f -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:51 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[67591ce6-8f97-4670-a642-915330057fca]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:61472460-c919-4222-88c4-bc0a50db5d5f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:61472460-c919-4222-88c4-bc0a50db5d5f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:51 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c71cd7-7f43-4ab7-8fd8-e5b4b307677a tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:61472460-c919-4222-88c4-bc0a50db5d5f, portal: 172.16.0.220,3260]
Aug 01 13:51:51 user nova-compute[72129]: Login to [iface: default, target: iqn.2010-10.org.openstack:61472460-c919-4222-88c4-bc0a50db5d5f, portal: 172.16.0.220,3260] successful.
Aug 01 13:51:51 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:51:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61472460-c919-4222-88c4-bc0a50db5d5f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61472460-c919-4222-88c4-bc0a50db5d5f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:51 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[558b3b63-0504-4a55-ad43-6e52a03065b3]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:51 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c71cd7-7f43-4ab7-8fd8-e5b4b307677a tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:51:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:51 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[be0264bc-85f3-4d50-ba8b-3db845472f65]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61472460-c919-4222-88c4-bc0a50db5d5f (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:51 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c71cd7-7f43-4ab7-8fd8-e5b4b307677a tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)
Aug 01 13:51:51 user nova-compute[72129]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)
Aug 01 13:51:51 user nova-compute[72129]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)
Aug 01 13:51:51 user nova-compute[72129]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)
Aug 01 13:51:51 user nova-compute[72129]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 (non-flash)
Aug 01 13:51:51 user nova-compute[72129]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 (non-flash)
Aug 01 13:51:51 user nova-compute[72129]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61472460-c919-4222-88c4-bc0a50db5d5f (non-flash)
Aug 01 13:51:51 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:51:51 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c71cd7-7f43-4ab7-8fd8-e5b4b307677a tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)
Aug 01 13:51:51 user nova-compute[72129]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)
Aug 01 13:51:51 user nova-compute[72129]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)
Aug 01 13:51:51 user nova-compute[72129]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)
Aug 01 13:51:51 user nova-compute[72129]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 (non-flash)
Aug 01 13:51:51 user nova-compute[72129]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 (non-flash)
Aug 01 13:51:51 user nova-compute[72129]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61472460-c919-4222-88c4-bc0a50db5d5f (non-flash)
Aug 01 13:51:51 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:51:51 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-63c71cd7-7f43-4ab7-8fd8-e5b4b307677a tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61472460-c919-4222-88c4-bc0a50db5d5f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.348s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:51:51 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c71cd7-7f43-4ab7-8fd8-e5b4b307677a tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Connected to 172.16.0.220:3260 {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 13:51:51 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-63c71cd7-7f43-4ab7-8fd8-e5b4b307677a tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=72129) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 13:51:51 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-63c71cd7-7f43-4ab7-8fd8-e5b4b307677a tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72129) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 13:51:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:51 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d372b81-b081-4939-861e-0dfe1cec611d]: (4, ('- - 0', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:51 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-63c71cd7-7f43-4ab7-8fd8-e5b4b307677a tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 13:51:51 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c71cd7-7f43-4ab7-8fd8-e5b4b307677a tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ATEnhpck', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 13:51:51 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:52 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-63c71cd7-7f43-4ab7-8fd8-e5b4b307677a tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.389s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:51:52 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-63c71cd7-7f43-4ab7-8fd8-e5b4b307677a tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] <== connect_volume: return (1391ms) {'type': 'block', 'scsi_wwn': '23532353461326463', 'path': '/dev/sdh'} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:51:52 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63c71cd7-7f43-4ab7-8fd8-e5b4b307677a tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] [instance: d6b336c3-c7d4-4353-8e51-416726833407] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532353461326463', 'path': '/dev/sdh'} {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 13:51:52 user nova-compute[72129]: DEBUG nova.objects.instance [None req-63c71cd7-7f43-4ab7-8fd8-e5b4b307677a tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Lazy-loading 'flavor' on Instance uuid d6b336c3-c7d4-4353-8e51-416726833407 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:51:52 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-63c71cd7-7f43-4ab7-8fd8-e5b4b307677a tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 13:51:52 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 13:51:52 user nova-compute[72129]:   <source dev="/dev/sdh"/>
Aug 01 13:51:52 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 13:51:52 user nova-compute[72129]:   <serial>61472460-c919-4222-88c4-bc0a50db5d5f</serial>
Aug 01 13:51:52 user nova-compute[72129]: </disk>
Aug 01 13:51:52 user nova-compute[72129]:  {{(pid=72129) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 13:51:53 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-63c71cd7-7f43-4ab7-8fd8-e5b4b307677a tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 13:51:53 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-63c71cd7-7f43-4ab7-8fd8-e5b4b307677a tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 13:51:53 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-63c71cd7-7f43-4ab7-8fd8-e5b4b307677a tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] No VIF found with MAC fa:16:3e:a7:96:5a, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 13:51:53 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-63c71cd7-7f43-4ab7-8fd8-e5b4b307677a tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Lock "d6b336c3-c7d4-4353-8e51-416726833407" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.924s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:51:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e169ba7b-bb8d-4e9c-b250-d6008a30e1fa tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Acquiring lock "d6b336c3-c7d4-4353-8e51-416726833407" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:51:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e169ba7b-bb8d-4e9c-b250-d6008a30e1fa tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Lock "d6b336c3-c7d4-4353-8e51-416726833407" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:51:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e169ba7b-bb8d-4e9c-b250-d6008a30e1fa tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Acquiring lock "d6b336c3-c7d4-4353-8e51-416726833407-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:51:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e169ba7b-bb8d-4e9c-b250-d6008a30e1fa tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Lock "d6b336c3-c7d4-4353-8e51-416726833407-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:51:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e169ba7b-bb8d-4e9c-b250-d6008a30e1fa tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Lock "d6b336c3-c7d4-4353-8e51-416726833407-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:51:54 user nova-compute[72129]: INFO nova.compute.manager [None req-e169ba7b-bb8d-4e9c-b250-d6008a30e1fa tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] [instance: d6b336c3-c7d4-4353-8e51-416726833407] Terminating instance
Aug 01 13:51:54 user nova-compute[72129]: DEBUG nova.compute.manager [None req-e169ba7b-bb8d-4e9c-b250-d6008a30e1fa tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] [instance: d6b336c3-c7d4-4353-8e51-416726833407] Start destroying the instance on the hypervisor. {{(pid=72129) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 13:51:54 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:54 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:54 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:54 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:54 user nova-compute[72129]: DEBUG nova.compute.manager [req-4ec9f16e-0d95-4eef-8119-21f5ff6e9593 req-f12c6a7b-d779-462b-9386-d5822a4dd18f service nova] [instance: d6b336c3-c7d4-4353-8e51-416726833407] Received event network-vif-unplugged-129db8e9-6741-408c-b62c-ae48485fa290 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:51:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-4ec9f16e-0d95-4eef-8119-21f5ff6e9593 req-f12c6a7b-d779-462b-9386-d5822a4dd18f service nova] Acquiring lock "d6b336c3-c7d4-4353-8e51-416726833407-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:51:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-4ec9f16e-0d95-4eef-8119-21f5ff6e9593 req-f12c6a7b-d779-462b-9386-d5822a4dd18f service nova] Lock "d6b336c3-c7d4-4353-8e51-416726833407-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:51:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-4ec9f16e-0d95-4eef-8119-21f5ff6e9593 req-f12c6a7b-d779-462b-9386-d5822a4dd18f service nova] Lock "d6b336c3-c7d4-4353-8e51-416726833407-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:51:54 user nova-compute[72129]: DEBUG nova.compute.manager [req-4ec9f16e-0d95-4eef-8119-21f5ff6e9593 req-f12c6a7b-d779-462b-9386-d5822a4dd18f service nova] [instance: d6b336c3-c7d4-4353-8e51-416726833407] No waiting events found dispatching network-vif-unplugged-129db8e9-6741-408c-b62c-ae48485fa290 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:51:54 user nova-compute[72129]: DEBUG nova.compute.manager [req-4ec9f16e-0d95-4eef-8119-21f5ff6e9593 req-f12c6a7b-d779-462b-9386-d5822a4dd18f service nova] [instance: d6b336c3-c7d4-4353-8e51-416726833407] Received event network-vif-unplugged-129db8e9-6741-408c-b62c-ae48485fa290 for instance with task_state deleting. {{(pid=72129) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 13:51:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:55 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: d6b336c3-c7d4-4353-8e51-416726833407] Instance destroyed successfully.
Aug 01 13:51:55 user nova-compute[72129]: DEBUG nova.objects.instance [None req-e169ba7b-bb8d-4e9c-b250-d6008a30e1fa tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Lazy-loading 'resources' on Instance uuid d6b336c3-c7d4-4353-8e51-416726833407 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:51:55 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-e169ba7b-bb8d-4e9c-b250-d6008a30e1fa tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:49:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-2057841141',display_name='tempest-DeleteServersTestJSON-server-2057841141',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-2057841141',id=1,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T13:50:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='48c5a30b0df04cfba39fb66d63ff8f85',ramdisk_id='',reservation_id='r-arueo1z2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-668770508',owner_user_name='tempest-DeleteServersTestJSON-668770508-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T13:50:03Z,user_data=None,user_id='4d084de1d7a046a889105f56d6222025',uuid=d6b336c3-c7d4-4353-8e51-416726833407,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "129db8e9-6741-408c-b62c-ae48485fa290", "address": "fa:16:3e:a7:96:5a", "network": {"id": "3d94af2c-7df4-4d95-ba9e-8273497eff49", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-50216644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48c5a30b0df04cfba39fb66d63ff8f85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap129db8e9-67", "ovs_interfaceid": "129db8e9-6741-408c-b62c-ae48485fa290", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 13:51:55 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-e169ba7b-bb8d-4e9c-b250-d6008a30e1fa tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Converting VIF {"id": "129db8e9-6741-408c-b62c-ae48485fa290", "address": "fa:16:3e:a7:96:5a", "network": {"id": "3d94af2c-7df4-4d95-ba9e-8273497eff49", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-50216644-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48c5a30b0df04cfba39fb66d63ff8f85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap129db8e9-67", "ovs_interfaceid": "129db8e9-6741-408c-b62c-ae48485fa290", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:51:55 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-e169ba7b-bb8d-4e9c-b250-d6008a30e1fa tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:96:5a,bridge_name='br-int',has_traffic_filtering=True,id=129db8e9-6741-408c-b62c-ae48485fa290,network=Network(3d94af2c-7df4-4d95-ba9e-8273497eff49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap129db8e9-67') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:51:55 user nova-compute[72129]: DEBUG os_vif [None req-e169ba7b-bb8d-4e9c-b250-d6008a30e1fa tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:96:5a,bridge_name='br-int',has_traffic_filtering=True,id=129db8e9-6741-408c-b62c-ae48485fa290,network=Network(3d94af2c-7df4-4d95-ba9e-8273497eff49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap129db8e9-67') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 13:51:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap129db8e9-67, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:51:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:51:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 13:51:55 user nova-compute[72129]: INFO os_vif [None req-e169ba7b-bb8d-4e9c-b250-d6008a30e1fa tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:96:5a,bridge_name='br-int',has_traffic_filtering=True,id=129db8e9-6741-408c-b62c-ae48485fa290,network=Network(3d94af2c-7df4-4d95-ba9e-8273497eff49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap129db8e9-67')
Aug 01 13:51:55 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e169ba7b-bb8d-4e9c-b250-d6008a30e1fa tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] [instance: d6b336c3-c7d4-4353-8e51-416726833407] calling os-brick to detach iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 13:51:55 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-e169ba7b-bb8d-4e9c-b250-d6008a30e1fa tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, {'target_iqns': ['iqn.2010-10.org.openstack:61472460-c919-4222-88c4-bc0a50db5d5f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ATEnhpck', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:51:55 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-e169ba7b-bb8d-4e9c-b250-d6008a30e1fa tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 13:51:55 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-e169ba7b-bb8d-4e9c-b250-d6008a30e1fa tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:51:55 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-e169ba7b-bb8d-4e9c-b250-d6008a30e1fa tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:51:55 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-e169ba7b-bb8d-4e9c-b250-d6008a30e1fa tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61472460-c919-4222-88c4-bc0a50db5d5f', 0)] {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 13:51:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:55 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d24323b-109f-4c4a-9bb3-d033ae4e3670]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61472460-c919-4222-88c4-bc0a50db5d5f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:55 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5778175-50b8-4165-8fdc-a1f7f9091657]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61472460-c919-4222-88c4-bc0a50db5d5f (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:55 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-e169ba7b-bb8d-4e9c-b250-d6008a30e1fa tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)
Aug 01 13:51:55 user nova-compute[72129]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)
Aug 01 13:51:55 user nova-compute[72129]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)
Aug 01 13:51:55 user nova-compute[72129]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)
Aug 01 13:51:55 user nova-compute[72129]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 (non-flash)
Aug 01 13:51:55 user nova-compute[72129]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 (non-flash)
Aug 01 13:51:55 user nova-compute[72129]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61472460-c919-4222-88c4-bc0a50db5d5f (non-flash)
Aug 01 13:51:55 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:51:55 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-e169ba7b-bb8d-4e9c-b250-d6008a30e1fa tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)
Aug 01 13:51:55 user nova-compute[72129]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)
Aug 01 13:51:55 user nova-compute[72129]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)
Aug 01 13:51:55 user nova-compute[72129]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)
Aug 01 13:51:55 user nova-compute[72129]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 (non-flash)
Aug 01 13:51:55 user nova-compute[72129]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 (non-flash)
Aug 01 13:51:55 user nova-compute[72129]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61472460-c919-4222-88c4-bc0a50db5d5f (non-flash)
Aug 01 13:51:55 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:51:55 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-e169ba7b-bb8d-4e9c-b250-d6008a30e1fa tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2828118af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61472460-c919-4222-88c4-bc0a50db5d5f'): ({'sdh'}, set())}) {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 13:51:55 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-e169ba7b-bb8d-4e9c-b250-d6008a30e1fa tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Removing single pathed devices sdh {{(pid=72129) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 13:51:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:55 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b65019-6fb1-497d-8173-4600c06e103b]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.025s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:55 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6649582-6efe-4b2e-b5e8-157c25b838f2]: (4, ('ok\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:55 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-e169ba7b-bb8d-4e9c-b250-d6008a30e1fa tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Flushing IO for device /dev/sdh {{(pid=72129) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 13:51:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:55 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed96cca-c371-4769-b640-6926df499c18]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:55 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-e169ba7b-bb8d-4e9c-b250-d6008a30e1fa tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72129) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 13:51:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.052s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:55 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2fc4c70-7e40-475b-9fb0-401e06458d9a]: (4, ('1', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:55 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-e169ba7b-bb8d-4e9c-b250-d6008a30e1fa tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 13:51:55 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-e169ba7b-bb8d-4e9c-b250-d6008a30e1fa tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] SCSI volumes sdh have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 13:51:55 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-e169ba7b-bb8d-4e9c-b250-d6008a30e1fa tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61472460-c919-4222-88c4-bc0a50db5d5f')] {{(pid=72129) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 13:51:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61472460-c919-4222-88c4-bc0a50db5d5f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61472460-c919-4222-88c4-bc0a50db5d5f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:55 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[e12f4693-3b35-4115-a5d0-2ef4853adfad]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:55 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-e169ba7b-bb8d-4e9c-b250-d6008a30e1fa tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:51:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61472460-c919-4222-88c4-bc0a50db5d5f -p 172.16.0.220:3260 --logout {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61472460-c919-4222-88c4-bc0a50db5d5f -p 172.16.0.220:3260 --logout" returned: 0 in 0.092s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:55 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce23f2c1-b4a1-4dd0-b6db-36e7d8b88fc8]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:61472460-c919-4222-88c4-bc0a50db5d5f, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:61472460-c919-4222-88c4-bc0a50db5d5f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:55 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-e169ba7b-bb8d-4e9c-b250-d6008a30e1fa tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:61472460-c919-4222-88c4-bc0a50db5d5f, portal: 172.16.0.220,3260]
Aug 01 13:51:55 user nova-compute[72129]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:61472460-c919-4222-88c4-bc0a50db5d5f, portal: 172.16.0.220,3260] successful.
Aug 01 13:51:55 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:51:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61472460-c919-4222-88c4-bc0a50db5d5f -p 172.16.0.220:3260 --op delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61472460-c919-4222-88c4-bc0a50db5d5f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:55 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f14ac4a-5c81-4e4c-864e-846eeec80d50]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:55 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-e169ba7b-bb8d-4e9c-b250-d6008a30e1fa tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:51:55 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-e169ba7b-bb8d-4e9c-b250-d6008a30e1fa tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:51:55 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-e169ba7b-bb8d-4e9c-b250-d6008a30e1fa tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] <== disconnect_volume: return (356ms) None {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:51:55 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e169ba7b-bb8d-4e9c-b250-d6008a30e1fa tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] [instance: d6b336c3-c7d4-4353-8e51-416726833407] Disconnected iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 13:51:55 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-e169ba7b-bb8d-4e9c-b250-d6008a30e1fa tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] [instance: d6b336c3-c7d4-4353-8e51-416726833407] Deleting instance files /opt/stack/data/nova/instances/d6b336c3-c7d4-4353-8e51-416726833407_del
Aug 01 13:51:55 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-e169ba7b-bb8d-4e9c-b250-d6008a30e1fa tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] [instance: d6b336c3-c7d4-4353-8e51-416726833407] Deletion of /opt/stack/data/nova/instances/d6b336c3-c7d4-4353-8e51-416726833407_del complete
Aug 01 13:51:55 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-e169ba7b-bb8d-4e9c-b250-d6008a30e1fa tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Checking UEFI support for host arch (x86_64) {{(pid=72129) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Aug 01 13:51:55 user nova-compute[72129]: INFO nova.virt.libvirt.host [None req-e169ba7b-bb8d-4e9c-b250-d6008a30e1fa tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] UEFI support detected
Aug 01 13:51:55 user nova-compute[72129]: INFO nova.compute.manager [None req-e169ba7b-bb8d-4e9c-b250-d6008a30e1fa tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] [instance: d6b336c3-c7d4-4353-8e51-416726833407] Took 1.35 seconds to destroy the instance on the hypervisor.
Aug 01 13:51:55 user nova-compute[72129]: DEBUG oslo.service.loopingcall [None req-e169ba7b-bb8d-4e9c-b250-d6008a30e1fa tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72129) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 13:51:55 user nova-compute[72129]: DEBUG nova.compute.manager [-] [instance: d6b336c3-c7d4-4353-8e51-416726833407] Deallocating network for instance {{(pid=72129) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 13:51:55 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: d6b336c3-c7d4-4353-8e51-416726833407] deallocate_for_instance() {{(pid=72129) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 13:51:56 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Acquiring lock "a07aaeaa-322d-419e-86f5-65cd448c39e7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:51:56 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Lock "a07aaeaa-322d-419e-86f5-65cd448c39e7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:51:56 user nova-compute[72129]: DEBUG nova.compute.manager [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Starting instance... {{(pid=72129) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 13:51:56 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:51:56 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:51:56 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72129) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 13:51:56 user nova-compute[72129]: INFO nova.compute.claims [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Claim successful on node user
Aug 01 13:51:56 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: d6b336c3-c7d4-4353-8e51-416726833407] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:51:56 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: d6b336c3-c7d4-4353-8e51-416726833407] Took 0.73 seconds to deallocate network for instance.
Aug 01 13:51:56 user nova-compute[72129]: DEBUG nova.compute.manager [req-3dc8d27a-34e9-489b-8136-8131d1ace915 req-e0d8c0cb-dd48-47d9-bac9-badf723d133f service nova] [instance: d6b336c3-c7d4-4353-8e51-416726833407] Received event network-vif-deleted-129db8e9-6741-408c-b62c-ae48485fa290 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:51:56 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 13:51:56 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 13:51:56 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.492s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:51:56 user nova-compute[72129]: DEBUG nova.compute.manager [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Start building networks asynchronously for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 13:51:56 user nova-compute[72129]: DEBUG nova.compute.manager [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Allocating IP information in the background. {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 13:51:56 user nova-compute[72129]: DEBUG nova.network.neutron [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] allocate_for_instance() {{(pid=72129) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 13:51:56 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 13:51:56 user nova-compute[72129]: DEBUG nova.compute.manager [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Start building block device mappings for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 13:51:57 user nova-compute[72129]: INFO nova.virt.block_device [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Booting with volume 5b0dd53d-1f22-4c51-adec-a83e1193589b at /dev/vda
Aug 01 13:51:57 user nova-compute[72129]: DEBUG nova.compute.manager [req-78055793-34e6-4ba7-9409-46845d57a0c1 req-2256b644-25de-4a02-90f2-1b99f20c0663 service nova] [instance: d6b336c3-c7d4-4353-8e51-416726833407] Received event network-vif-plugged-129db8e9-6741-408c-b62c-ae48485fa290 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:51:57 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-78055793-34e6-4ba7-9409-46845d57a0c1 req-2256b644-25de-4a02-90f2-1b99f20c0663 service nova] Acquiring lock "d6b336c3-c7d4-4353-8e51-416726833407-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:51:57 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-78055793-34e6-4ba7-9409-46845d57a0c1 req-2256b644-25de-4a02-90f2-1b99f20c0663 service nova] Lock "d6b336c3-c7d4-4353-8e51-416726833407-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:51:57 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-78055793-34e6-4ba7-9409-46845d57a0c1 req-2256b644-25de-4a02-90f2-1b99f20c0663 service nova] Lock "d6b336c3-c7d4-4353-8e51-416726833407-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:51:57 user nova-compute[72129]: DEBUG nova.compute.manager [req-78055793-34e6-4ba7-9409-46845d57a0c1 req-2256b644-25de-4a02-90f2-1b99f20c0663 service nova] [instance: d6b336c3-c7d4-4353-8e51-416726833407] No waiting events found dispatching network-vif-plugged-129db8e9-6741-408c-b62c-ae48485fa290 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:51:57 user nova-compute[72129]: WARNING nova.compute.manager [req-78055793-34e6-4ba7-9409-46845d57a0c1 req-2256b644-25de-4a02-90f2-1b99f20c0663 service nova] [instance: d6b336c3-c7d4-4353-8e51-416726833407] Received unexpected event network-vif-plugged-129db8e9-6741-408c-b62c-ae48485fa290 for instance with vm_state active and task_state deleting.
Aug 01 13:51:57 user nova-compute[72129]: DEBUG nova.policy [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '37e6bf606d3041d9928c5e5d6f4a9063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebef26e9d3654bf99ecf391ccb263330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72129) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 13:51:57 user nova-compute[72129]: DEBUG os_brick.utils [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:51:57 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:57 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:57 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a217261-13ef-43d8-9979-6c9c4a078343]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f9b449c2cd3d\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:57 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:57 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:57 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c3aba17-b508-4e34-a6c9-024253528033]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:57 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:57 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:51:57 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df42869-33a8-42e4-93f7-e1eac5e96852]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:57 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0f1670-6d30-43c8-827e-b54a530daa2b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:57 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Running cmd (subprocess): nvme version {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:57 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] 'nvme version' failed. Not Retrying. {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 13:51:57 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] nvme not present on system {{(pid=72129) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 13:51:57 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:51:57 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 13:51:57 user nova-compute[72129]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 13:51:57 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf861bd5-ed01-4ae1-81ce-20a5b4273bf1]: (4, '') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:51:57 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72129) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 13:51:57 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 13:51:57 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] LIGHTOS: no hostnqn found. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 13:51:57 user nova-compute[72129]: DEBUG os_brick.utils [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f9b449c2cd3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:51:57 user nova-compute[72129]: DEBUG nova.virt.block_device [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Updating existing volume attachment record: 0523be42-4410-49ec-a321-3b3ddbe6e807 {{(pid=72129) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 13:51:57 user nova-compute[72129]: INFO nova.compute.manager [None req-e169ba7b-bb8d-4e9c-b250-d6008a30e1fa tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] [instance: d6b336c3-c7d4-4353-8e51-416726833407] Took 0.85 seconds to detach 1 volumes for instance.
Aug 01 13:51:57 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e169ba7b-bb8d-4e9c-b250-d6008a30e1fa tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:51:57 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e169ba7b-bb8d-4e9c-b250-d6008a30e1fa tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:51:57 user nova-compute[72129]: DEBUG nova.network.neutron [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Successfully created port: f3403639-00ba-4c7c-983a-7995f60f2519 {{(pid=72129) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 13:51:57 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-e169ba7b-bb8d-4e9c-b250-d6008a30e1fa tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 13:51:57 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-e169ba7b-bb8d-4e9c-b250-d6008a30e1fa tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 13:51:58 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e169ba7b-bb8d-4e9c-b250-d6008a30e1fa tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.429s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:51:58 user nova-compute[72129]: INFO nova.scheduler.client.report [None req-e169ba7b-bb8d-4e9c-b250-d6008a30e1fa tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Deleted allocations for instance d6b336c3-c7d4-4353-8e51-416726833407
Aug 01 13:51:58 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e169ba7b-bb8d-4e9c-b250-d6008a30e1fa tempest-DeleteServersTestJSON-668770508 tempest-DeleteServersTestJSON-668770508-project-member] Lock "d6b336c3-c7d4-4353-8e51-416726833407" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.663s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:51:58 user nova-compute[72129]: DEBUG nova.network.neutron [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Successfully updated port: f3403639-00ba-4c7c-983a-7995f60f2519 {{(pid=72129) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 13:51:58 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Acquiring lock "refresh_cache-a07aaeaa-322d-419e-86f5-65cd448c39e7" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:51:58 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Acquired lock "refresh_cache-a07aaeaa-322d-419e-86f5-65cd448c39e7" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:51:58 user nova-compute[72129]: DEBUG nova.network.neutron [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 13:51:58 user nova-compute[72129]: DEBUG nova.network.neutron [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Instance cache missing network info. {{(pid=72129) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 13:51:58 user nova-compute[72129]: DEBUG nova.compute.manager [req-9d6a8ab6-43e2-455a-a541-ea08aab9ca2f req-9aea5915-f0f1-4790-848b-646075cfefa4 service nova] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Received event network-changed-f3403639-00ba-4c7c-983a-7995f60f2519 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:51:58 user nova-compute[72129]: DEBUG nova.compute.manager [req-9d6a8ab6-43e2-455a-a541-ea08aab9ca2f req-9aea5915-f0f1-4790-848b-646075cfefa4 service nova] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Refreshing instance network info cache due to event network-changed-f3403639-00ba-4c7c-983a-7995f60f2519. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 13:51:58 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-9d6a8ab6-43e2-455a-a541-ea08aab9ca2f req-9aea5915-f0f1-4790-848b-646075cfefa4 service nova] Acquiring lock "refresh_cache-a07aaeaa-322d-419e-86f5-65cd448c39e7" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:51:58 user nova-compute[72129]: DEBUG nova.network.neutron [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Updating instance_info_cache with network_info: [{"id": "f3403639-00ba-4c7c-983a-7995f60f2519", "address": "fa:16:3e:4b:01:bd", "network": {"id": "2338fb81-87b6-4976-a6ab-b4ea0218fa9b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-606840206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebef26e9d3654bf99ecf391ccb263330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3403639-00", "ovs_interfaceid": "f3403639-00ba-4c7c-983a-7995f60f2519", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:51:58 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Releasing lock "refresh_cache-a07aaeaa-322d-419e-86f5-65cd448c39e7" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:51:58 user nova-compute[72129]: DEBUG nova.compute.manager [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Instance network_info: |[{"id": "f3403639-00ba-4c7c-983a-7995f60f2519", "address": "fa:16:3e:4b:01:bd", "network": {"id": "2338fb81-87b6-4976-a6ab-b4ea0218fa9b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-606840206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebef26e9d3654bf99ecf391ccb263330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3403639-00", "ovs_interfaceid": "f3403639-00ba-4c7c-983a-7995f60f2519", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 13:51:58 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-9d6a8ab6-43e2-455a-a541-ea08aab9ca2f req-9aea5915-f0f1-4790-848b-646075cfefa4 service nova] Acquired lock "refresh_cache-a07aaeaa-322d-419e-86f5-65cd448c39e7" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:51:58 user nova-compute[72129]: DEBUG nova.network.neutron [req-9d6a8ab6-43e2-455a-a541-ea08aab9ca2f req-9aea5915-f0f1-4790-848b-646075cfefa4 service nova] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Refreshing network info cache for port f3403639-00ba-4c7c-983a-7995f60f2519 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 13:51:59 user nova-compute[72129]: DEBUG nova.network.neutron [req-9d6a8ab6-43e2-455a-a541-ea08aab9ca2f req-9aea5915-f0f1-4790-848b-646075cfefa4 service nova] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Updated VIF entry in instance network info cache for port f3403639-00ba-4c7c-983a-7995f60f2519. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 13:51:59 user nova-compute[72129]: DEBUG nova.network.neutron [req-9d6a8ab6-43e2-455a-a541-ea08aab9ca2f req-9aea5915-f0f1-4790-848b-646075cfefa4 service nova] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Updating instance_info_cache with network_info: [{"id": "f3403639-00ba-4c7c-983a-7995f60f2519", "address": "fa:16:3e:4b:01:bd", "network": {"id": "2338fb81-87b6-4976-a6ab-b4ea0218fa9b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-606840206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebef26e9d3654bf99ecf391ccb263330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3403639-00", "ovs_interfaceid": "f3403639-00ba-4c7c-983a-7995f60f2519", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:51:59 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-9d6a8ab6-43e2-455a-a541-ea08aab9ca2f req-9aea5915-f0f1-4790-848b-646075cfefa4 service nova] Releasing lock "refresh_cache-a07aaeaa-322d-419e-86f5-65cd448c39e7" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:52:00 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:00 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:05 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:05 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG nova.compute.manager [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Start spawning the instance on the hypervisor. {{(pid=72129) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Creating instance directory {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 13:52:06 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Creating image(s)
Aug 01 13:52:06 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Did not create local disks {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Ensure instance console log exists: /opt/stack/data/nova/instances/a07aaeaa-322d-419e-86f5-65cd448c39e7/console.log {{(pid=72129) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Start _get_guest_xml network_info=[{"id": "f3403639-00ba-4c7c-983a-7995f60f2519", "address": "fa:16:3e:4b:01:bd", "network": {"id": "2338fb81-87b6-4976-a6ab-b4ea0218fa9b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-606840206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebef26e9d3654bf99ecf391ccb263330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3403639-00", "ovs_interfaceid": "f3403639-00ba-4c7c-983a-7995f60f2519", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '0523be42-4410-49ec-a321-3b3ddbe6e807', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gilTSBJb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a07aaeaa-322d-419e-86f5-65cd448c39e7', 'attached_at': '', 'detached_at': '', 'volume_id': '5b0dd53d-1f22-4c51-adec-a83e1193589b', 'serial': '5b0dd53d-1f22-4c51-adec-a83e1193589b'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 13:52:06 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:52:06 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:52:06 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] CPU controller missing on host. {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] CPU controller found on host. {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72129) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T13:45:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Flavor limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Image limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Flavor pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Image pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Got 1 possible topologies {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Calling os-brick to attach iSCSI Volume {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gilTSBJb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:52:06 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 13:52:06 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:52:06 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 13:52:06 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:52:06 user nova-compute[72129]: INFO os_brick.initiator.connectors.iscsi [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 13:52:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b -p 172.16.0.220:3260 {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[0116ecc5-33d5-4c5d-b521-5855344289fa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 13:52:06 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b -p 172.16.0.220:3260 --interface default --op new {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[8024ed84-46b6-4af3-99be-a8fa4d9c3cd4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b] added\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b] added
Aug 01 13:52:06 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[27defe0c-8d58-47dd-a9a5-fb3323d3fbac]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[35697910-f8f9-4696-a18d-f599a432db16]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gilTSBJb {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gilTSBJb" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[000a8187-2d4a-4c6a-ad7a-de61b93efcd6]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gilTSBJb'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[656c1ab3-651b-4fea-b57e-8fe724c3e925]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[09851ca2-7b8f-4473-aa98-338cf2977721]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)
Aug 01 13:52:06 user nova-compute[72129]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)
Aug 01 13:52:06 user nova-compute[72129]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)
Aug 01 13:52:06 user nova-compute[72129]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)
Aug 01 13:52:06 user nova-compute[72129]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 (non-flash)
Aug 01 13:52:06 user nova-compute[72129]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 (non-flash)
Aug 01 13:52:06 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)
Aug 01 13:52:06 user nova-compute[72129]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)
Aug 01 13:52:06 user nova-compute[72129]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)
Aug 01 13:52:06 user nova-compute[72129]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)
Aug 01 13:52:06 user nova-compute[72129]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 (non-flash)
Aug 01 13:52:06 user nova-compute[72129]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 (non-flash)
Aug 01 13:52:06 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b -p 172.16.0.220:3260 --login {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[50780b40-089a-4392-aa83-dfd345292679]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b, portal: 172.16.0.220,3260]
Aug 01 13:52:06 user nova-compute[72129]: Login to [iface: default, target: iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b, portal: 172.16.0.220,3260] successful.
Aug 01 13:52:06 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eda2e36-6c48-48ad-a2eb-61ce5fb35ff2]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53a509d-5720-4ba2-af78-e2681ef8447c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)
Aug 01 13:52:06 user nova-compute[72129]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)
Aug 01 13:52:06 user nova-compute[72129]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)
Aug 01 13:52:06 user nova-compute[72129]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)
Aug 01 13:52:06 user nova-compute[72129]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 (non-flash)
Aug 01 13:52:06 user nova-compute[72129]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 (non-flash)
Aug 01 13:52:06 user nova-compute[72129]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)
Aug 01 13:52:06 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)
Aug 01 13:52:06 user nova-compute[72129]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)
Aug 01 13:52:06 user nova-compute[72129]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)
Aug 01 13:52:06 user nova-compute[72129]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)
Aug 01 13:52:06 user nova-compute[72129]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 (non-flash)
Aug 01 13:52:06 user nova-compute[72129]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 (non-flash)
Aug 01 13:52:06 user nova-compute[72129]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)
Aug 01 13:52:06 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Connected to 172.16.0.220:3260 {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=72129) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72129) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f566fbe-9787-4817-aa2f-c5b65f303f05]: (4, ('- - 0', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gilTSBJb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG nova.compute.manager [req-e26fcdb2-53f1-4227-be8a-ddf5e9ddd37b req-1716aeff-869d-4cc2-bfa8-83972c310d5a service nova] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] Received event network-changed-a56b8b52-26f1-4e64-b02e-0e46462dfb13 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG nova.compute.manager [req-e26fcdb2-53f1-4227-be8a-ddf5e9ddd37b req-1716aeff-869d-4cc2-bfa8-83972c310d5a service nova] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] Refreshing instance network info cache due to event network-changed-a56b8b52-26f1-4e64-b02e-0e46462dfb13. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-e26fcdb2-53f1-4227-be8a-ddf5e9ddd37b req-1716aeff-869d-4cc2-bfa8-83972c310d5a service nova] Acquiring lock "refresh_cache-31105963-52fa-4aff-9270-075cd98f08a5" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-e26fcdb2-53f1-4227-be8a-ddf5e9ddd37b req-1716aeff-869d-4cc2-bfa8-83972c310d5a service nova] Acquired lock "refresh_cache-31105963-52fa-4aff-9270-075cd98f08a5" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:52:06 user nova-compute[72129]: DEBUG nova.network.neutron [req-e26fcdb2-53f1-4227-be8a-ddf5e9ddd37b req-1716aeff-869d-4cc2-bfa8-83972c310d5a service nova] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] Refreshing network info cache for port a56b8b52-26f1-4e64-b02e-0e46462dfb13 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 13:52:07 user nova-compute[72129]: DEBUG nova.network.neutron [req-e26fcdb2-53f1-4227-be8a-ddf5e9ddd37b req-1716aeff-869d-4cc2-bfa8-83972c310d5a service nova] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] Updated VIF entry in instance network info cache for port a56b8b52-26f1-4e64-b02e-0e46462dfb13. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 13:52:07 user nova-compute[72129]: DEBUG nova.network.neutron [req-e26fcdb2-53f1-4227-be8a-ddf5e9ddd37b req-1716aeff-869d-4cc2-bfa8-83972c310d5a service nova] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] Updating instance_info_cache with network_info: [{"id": "a56b8b52-26f1-4e64-b02e-0e46462dfb13", "address": "fa:16:3e:a8:fe:6c", "network": {"id": "8c424a77-2cdc-4519-bad7-e5c4498aa600", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1161619305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8fd0bc919dc4f39a702173f8be6a847", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa56b8b52-26", "ovs_interfaceid": "a56b8b52-26f1-4e64-b02e-0e46462dfb13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:52:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-e26fcdb2-53f1-4227-be8a-ddf5e9ddd37b req-1716aeff-869d-4cc2-bfa8-83972c310d5a service nova] Releasing lock "refresh_cache-31105963-52fa-4aff-9270-075cd98f08a5" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:52:07 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:52:07 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '26164333761333862', 'path': '/dev/sdh'} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:52:07 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26164333761333862', 'path': '/dev/sdh'} {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 13:52:07 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:51:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-582848887',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-582848887',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHP4lq6QUMPS3pezcVQZPAh44QK9Cjc2FafAnYqVVnXmR/G2I0IR/iHbmL/nrBBWAYHzkIVIbYY+6AfkD3E0LtsteDcaYMG5TC80GmI1zAMDyri/eMn3gWGPdMZtuTTfcw==',key_name='tempest-keypair-1869868466',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ebef26e9d3654bf99ecf391ccb263330',ramdisk_id='',reservation_id='r-mcwbm2vy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1852542004',owner_user_name='tempest-ServerActionsV293TestJSON-1852542004-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:51:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37e6bf606d3041d9928c5e5d6f4a9063',uuid=a07aaeaa-322d-419e-86f5-65cd448c39e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3403639-00ba-4c7c-983a-7995f60f2519", "address": "fa:16:3e:4b:01:bd", "network": {"id": "2338fb81-87b6-4976-a6ab-b4ea0218fa9b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-606840206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebef26e9d3654bf99ecf391ccb263330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3403639-00", "ovs_interfaceid": "f3403639-00ba-4c7c-983a-7995f60f2519", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 13:52:07 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Converting VIF {"id": "f3403639-00ba-4c7c-983a-7995f60f2519", "address": "fa:16:3e:4b:01:bd", "network": {"id": "2338fb81-87b6-4976-a6ab-b4ea0218fa9b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-606840206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebef26e9d3654bf99ecf391ccb263330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3403639-00", "ovs_interfaceid": "f3403639-00ba-4c7c-983a-7995f60f2519", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:52:07 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:01:bd,bridge_name='br-int',has_traffic_filtering=True,id=f3403639-00ba-4c7c-983a-7995f60f2519,network=Network(2338fb81-87b6-4976-a6ab-b4ea0218fa9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3403639-00') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:52:07 user nova-compute[72129]: DEBUG nova.objects.instance [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Lazy-loading 'pci_devices' on Instance uuid a07aaeaa-322d-419e-86f5-65cd448c39e7 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:52:07 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] End _get_guest_xml xml=<domain type="kvm">
Aug 01 13:52:07 user nova-compute[72129]:   <uuid>a07aaeaa-322d-419e-86f5-65cd448c39e7</uuid>
Aug 01 13:52:07 user nova-compute[72129]:   <name>instance-0000000d</name>
Aug 01 13:52:07 user nova-compute[72129]:   <memory>524288</memory>
Aug 01 13:52:07 user nova-compute[72129]:   <vcpu>1</vcpu>
Aug 01 13:52:07 user nova-compute[72129]:   <metadata>
Aug 01 13:52:07 user nova-compute[72129]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 13:52:07 user nova-compute[72129]:       <nova:package version="0.0.0"/>
Aug 01 13:52:07 user nova-compute[72129]:       <nova:name>tempest-ServerActionsV293TestJSON-server-582848887</nova:name>
Aug 01 13:52:07 user nova-compute[72129]:       <nova:creationTime>2023-08-01 13:52:06</nova:creationTime>
Aug 01 13:52:07 user nova-compute[72129]:       <nova:flavor name="m1.tiny">
Aug 01 13:52:07 user nova-compute[72129]:         <nova:memory>512</nova:memory>
Aug 01 13:52:07 user nova-compute[72129]:         <nova:disk>1</nova:disk>
Aug 01 13:52:07 user nova-compute[72129]:         <nova:swap>0</nova:swap>
Aug 01 13:52:07 user nova-compute[72129]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 13:52:07 user nova-compute[72129]:         <nova:vcpus>1</nova:vcpus>
Aug 01 13:52:07 user nova-compute[72129]:       </nova:flavor>
Aug 01 13:52:07 user nova-compute[72129]:       <nova:owner>
Aug 01 13:52:07 user nova-compute[72129]:         <nova:user uuid="37e6bf606d3041d9928c5e5d6f4a9063">tempest-ServerActionsV293TestJSON-1852542004-project-member</nova:user>
Aug 01 13:52:07 user nova-compute[72129]:         <nova:project uuid="ebef26e9d3654bf99ecf391ccb263330">tempest-ServerActionsV293TestJSON-1852542004</nova:project>
Aug 01 13:52:07 user nova-compute[72129]:       </nova:owner>
Aug 01 13:52:07 user nova-compute[72129]:       <nova:ports>
Aug 01 13:52:07 user nova-compute[72129]:         <nova:port uuid="f3403639-00ba-4c7c-983a-7995f60f2519">
Aug 01 13:52:07 user nova-compute[72129]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 01 13:52:07 user nova-compute[72129]:         </nova:port>
Aug 01 13:52:07 user nova-compute[72129]:       </nova:ports>
Aug 01 13:52:07 user nova-compute[72129]:     </nova:instance>
Aug 01 13:52:07 user nova-compute[72129]:   </metadata>
Aug 01 13:52:07 user nova-compute[72129]:   <sysinfo type="smbios">
Aug 01 13:52:07 user nova-compute[72129]:     <system>
Aug 01 13:52:07 user nova-compute[72129]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 13:52:07 user nova-compute[72129]:       <entry name="product">OpenStack Nova</entry>
Aug 01 13:52:07 user nova-compute[72129]:       <entry name="version">0.0.0</entry>
Aug 01 13:52:07 user nova-compute[72129]:       <entry name="serial">a07aaeaa-322d-419e-86f5-65cd448c39e7</entry>
Aug 01 13:52:07 user nova-compute[72129]:       <entry name="uuid">a07aaeaa-322d-419e-86f5-65cd448c39e7</entry>
Aug 01 13:52:07 user nova-compute[72129]:       <entry name="family">Virtual Machine</entry>
Aug 01 13:52:07 user nova-compute[72129]:     </system>
Aug 01 13:52:07 user nova-compute[72129]:   </sysinfo>
Aug 01 13:52:07 user nova-compute[72129]:   <os>
Aug 01 13:52:07 user nova-compute[72129]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 13:52:07 user nova-compute[72129]:     <boot dev="hd"/>
Aug 01 13:52:07 user nova-compute[72129]:     <smbios mode="sysinfo"/>
Aug 01 13:52:07 user nova-compute[72129]:   </os>
Aug 01 13:52:07 user nova-compute[72129]:   <features>
Aug 01 13:52:07 user nova-compute[72129]:     <acpi/>
Aug 01 13:52:07 user nova-compute[72129]:     <apic/>
Aug 01 13:52:07 user nova-compute[72129]:     <vmcoreinfo/>
Aug 01 13:52:07 user nova-compute[72129]:   </features>
Aug 01 13:52:07 user nova-compute[72129]:   <clock offset="utc">
Aug 01 13:52:07 user nova-compute[72129]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 13:52:07 user nova-compute[72129]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 13:52:07 user nova-compute[72129]:     <timer name="hpet" present="no"/>
Aug 01 13:52:07 user nova-compute[72129]:   </clock>
Aug 01 13:52:07 user nova-compute[72129]:   <cpu mode="custom" match="exact">
Aug 01 13:52:07 user nova-compute[72129]:     <model>Nehalem</model>
Aug 01 13:52:07 user nova-compute[72129]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 13:52:07 user nova-compute[72129]:   </cpu>
Aug 01 13:52:07 user nova-compute[72129]:   <devices>
Aug 01 13:52:07 user nova-compute[72129]:     <disk type="block" device="disk">
Aug 01 13:52:07 user nova-compute[72129]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 13:52:07 user nova-compute[72129]:       <source dev="/dev/sdh"/>
Aug 01 13:52:07 user nova-compute[72129]:       <target dev="vda" bus="virtio"/>
Aug 01 13:52:07 user nova-compute[72129]:       <serial>5b0dd53d-1f22-4c51-adec-a83e1193589b</serial>
Aug 01 13:52:07 user nova-compute[72129]:     </disk>
Aug 01 13:52:07 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 13:52:07 user nova-compute[72129]:       <mac address="fa:16:3e:4b:01:bd"/>
Aug 01 13:52:07 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 13:52:07 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 13:52:07 user nova-compute[72129]:       <target dev="tapf3403639-00"/>
Aug 01 13:52:07 user nova-compute[72129]:     </interface>
Aug 01 13:52:07 user nova-compute[72129]:     <serial type="pty">
Aug 01 13:52:07 user nova-compute[72129]:       <log file="/opt/stack/data/nova/instances/a07aaeaa-322d-419e-86f5-65cd448c39e7/console.log" append="off"/>
Aug 01 13:52:07 user nova-compute[72129]:     </serial>
Aug 01 13:52:07 user nova-compute[72129]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 13:52:07 user nova-compute[72129]:     <video>
Aug 01 13:52:07 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 13:52:07 user nova-compute[72129]:     </video>
Aug 01 13:52:07 user nova-compute[72129]:     <rng model="virtio">
Aug 01 13:52:07 user nova-compute[72129]:       <backend model="random">/dev/urandom</backend>
Aug 01 13:52:07 user nova-compute[72129]:     </rng>
Aug 01 13:52:07 user nova-compute[72129]:     <controller type="usb" index="0" model="none"/>
Aug 01 13:52:07 user nova-compute[72129]:     <memballoon model="virtio">
Aug 01 13:52:07 user nova-compute[72129]:       <stats period="10"/>
Aug 01 13:52:07 user nova-compute[72129]:     </memballoon>
Aug 01 13:52:07 user nova-compute[72129]:   </devices>
Aug 01 13:52:07 user nova-compute[72129]: </domain>
Aug 01 13:52:07 user nova-compute[72129]:  {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 13:52:07 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:51:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-582848887',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-582848887',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHP4lq6QUMPS3pezcVQZPAh44QK9Cjc2FafAnYqVVnXmR/G2I0IR/iHbmL/nrBBWAYHzkIVIbYY+6AfkD3E0LtsteDcaYMG5TC80GmI1zAMDyri/eMn3gWGPdMZtuTTfcw==',key_name='tempest-keypair-1869868466',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ebef26e9d3654bf99ecf391ccb263330',ramdisk_id='',reservation_id='r-mcwbm2vy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1852542004',owner_user_name='tempest-ServerActionsV293TestJSON-1852542004-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:51:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37e6bf606d3041d9928c5e5d6f4a9063',uuid=a07aaeaa-322d-419e-86f5-65cd448c39e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3403639-00ba-4c7c-983a-7995f60f2519", "address": "fa:16:3e:4b:01:bd", "network": {"id": "2338fb81-87b6-4976-a6ab-b4ea0218fa9b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-606840206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebef26e9d3654bf99ecf391ccb263330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3403639-00", "ovs_interfaceid": "f3403639-00ba-4c7c-983a-7995f60f2519", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 13:52:07 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Converting VIF {"id": "f3403639-00ba-4c7c-983a-7995f60f2519", "address": "fa:16:3e:4b:01:bd", "network": {"id": "2338fb81-87b6-4976-a6ab-b4ea0218fa9b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-606840206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebef26e9d3654bf99ecf391ccb263330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3403639-00", "ovs_interfaceid": "f3403639-00ba-4c7c-983a-7995f60f2519", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:52:07 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:01:bd,bridge_name='br-int',has_traffic_filtering=True,id=f3403639-00ba-4c7c-983a-7995f60f2519,network=Network(2338fb81-87b6-4976-a6ab-b4ea0218fa9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3403639-00') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:52:07 user nova-compute[72129]: DEBUG os_vif [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:01:bd,bridge_name='br-int',has_traffic_filtering=True,id=f3403639-00ba-4c7c-983a-7995f60f2519,network=Network(2338fb81-87b6-4976-a6ab-b4ea0218fa9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3403639-00') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 13:52:07 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:07 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:52:07 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 13:52:07 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:07 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf3403639-00, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:52:07 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf3403639-00, col_values=(('external_ids', {'iface-id': 'f3403639-00ba-4c7c-983a-7995f60f2519', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:01:bd', 'vm-uuid': 'a07aaeaa-322d-419e-86f5-65cd448c39e7'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:52:07 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:07 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 13:52:07 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:07 user nova-compute[72129]: INFO os_vif [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:01:bd,bridge_name='br-int',has_traffic_filtering=True,id=f3403639-00ba-4c7c-983a-7995f60f2519,network=Network(2338fb81-87b6-4976-a6ab-b4ea0218fa9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3403639-00')
Aug 01 13:52:07 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 13:52:07 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] No VIF found with MAC fa:16:3e:4b:01:bd, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 13:52:08 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:09 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:09 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:09 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:09 user nova-compute[72129]: DEBUG nova.compute.manager [req-12858c26-6b8a-45cc-85ba-054806e7c37c req-2d4279c3-0477-4d8b-8df4-fb1cb32e97da service nova] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Received event network-vif-plugged-f3403639-00ba-4c7c-983a-7995f60f2519 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:52:09 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-12858c26-6b8a-45cc-85ba-054806e7c37c req-2d4279c3-0477-4d8b-8df4-fb1cb32e97da service nova] Acquiring lock "a07aaeaa-322d-419e-86f5-65cd448c39e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:52:09 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-12858c26-6b8a-45cc-85ba-054806e7c37c req-2d4279c3-0477-4d8b-8df4-fb1cb32e97da service nova] Lock "a07aaeaa-322d-419e-86f5-65cd448c39e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:52:09 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-12858c26-6b8a-45cc-85ba-054806e7c37c req-2d4279c3-0477-4d8b-8df4-fb1cb32e97da service nova] Lock "a07aaeaa-322d-419e-86f5-65cd448c39e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:52:09 user nova-compute[72129]: DEBUG nova.compute.manager [req-12858c26-6b8a-45cc-85ba-054806e7c37c req-2d4279c3-0477-4d8b-8df4-fb1cb32e97da service nova] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] No waiting events found dispatching network-vif-plugged-f3403639-00ba-4c7c-983a-7995f60f2519 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:52:09 user nova-compute[72129]: WARNING nova.compute.manager [req-12858c26-6b8a-45cc-85ba-054806e7c37c req-2d4279c3-0477-4d8b-8df4-fb1cb32e97da service nova] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Received unexpected event network-vif-plugged-f3403639-00ba-4c7c-983a-7995f60f2519 for instance with vm_state building and task_state spawning.
Aug 01 13:52:09 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:10 user nova-compute[72129]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690897915.3360832, d6b336c3-c7d4-4353-8e51-416726833407 => Stopped> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:52:10 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: d6b336c3-c7d4-4353-8e51-416726833407] VM Stopped (Lifecycle Event)
Aug 01 13:52:10 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:10 user nova-compute[72129]: DEBUG nova.compute.manager [None req-de8230b9-c13f-40e9-85dd-cfdbac0bdf9b None None] [instance: d6b336c3-c7d4-4353-8e51-416726833407] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:52:10 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-1fd9f7a0-cf26-4524-9dc9-96bec63e68ab tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Acquiring lock "31105963-52fa-4aff-9270-075cd98f08a5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:52:10 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-1fd9f7a0-cf26-4524-9dc9-96bec63e68ab tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Lock "31105963-52fa-4aff-9270-075cd98f08a5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:52:10 user nova-compute[72129]: DEBUG nova.objects.instance [None req-1fd9f7a0-cf26-4524-9dc9-96bec63e68ab tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Lazy-loading 'flavor' on Instance uuid 31105963-52fa-4aff-9270-075cd98f08a5 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:52:10 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-1fd9f7a0-cf26-4524-9dc9-96bec63e68ab tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Lock "31105963-52fa-4aff-9270-075cd98f08a5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.086s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:52:10 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-1fd9f7a0-cf26-4524-9dc9-96bec63e68ab tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Acquiring lock "31105963-52fa-4aff-9270-075cd98f08a5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:52:10 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-1fd9f7a0-cf26-4524-9dc9-96bec63e68ab tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Lock "31105963-52fa-4aff-9270-075cd98f08a5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:52:10 user nova-compute[72129]: INFO nova.compute.manager [None req-1fd9f7a0-cf26-4524-9dc9-96bec63e68ab tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] Attaching volume f678f2b1-ba48-4e62-ad0a-0dd0139bbe53 to /dev/vdb
Aug 01 13:52:10 user nova-compute[72129]: DEBUG os_brick.utils [None req-1fd9f7a0-cf26-4524-9dc9-96bec63e68ab tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:52:10 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:10 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:10 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[f575e0e9-5a5a-45c6-9875-ed1aa305ccc0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f9b449c2cd3d\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:10 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:10 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:10 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[27da94c5-ad42-4c89-8310-1066c61fe4c0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:10 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:10 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:10 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c1fc43-c7bb-4e19-a909-f0493ea778ad]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:10 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c85feb4d-5c35-4215-a9b6-b321834cc84f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:10 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-1fd9f7a0-cf26-4524-9dc9-96bec63e68ab tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Running cmd (subprocess): nvme version {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:10 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-1fd9f7a0-cf26-4524-9dc9-96bec63e68ab tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] 'nvme version' failed. Not Retrying. {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 13:52:10 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1fd9f7a0-cf26-4524-9dc9-96bec63e68ab tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] nvme not present on system {{(pid=72129) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 13:52:10 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:10 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 13:52:10 user nova-compute[72129]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 13:52:10 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ffaf48f-320c-45e7-8074-dfbfeae05e9c]: (4, '') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:10 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-1fd9f7a0-cf26-4524-9dc9-96bec63e68ab tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72129) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 13:52:10 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-1fd9f7a0-cf26-4524-9dc9-96bec63e68ab tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 13:52:10 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-1fd9f7a0-cf26-4524-9dc9-96bec63e68ab tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] LIGHTOS: no hostnqn found. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 13:52:10 user nova-compute[72129]: DEBUG os_brick.utils [None req-1fd9f7a0-cf26-4524-9dc9-96bec63e68ab tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f9b449c2cd3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:52:10 user nova-compute[72129]: DEBUG nova.virt.block_device [None req-1fd9f7a0-cf26-4524-9dc9-96bec63e68ab tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] Updating existing volume attachment record: 105f9677-244b-497d-91e1-df00fbee4485 {{(pid=72129) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 13:52:11 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690897931.1588697, a07aaeaa-322d-419e-86f5-65cd448c39e7 => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:52:11 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] VM Resumed (Lifecycle Event)
Aug 01 13:52:11 user nova-compute[72129]: DEBUG nova.compute.manager [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Instance event wait completed in 0 seconds for  {{(pid=72129) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 13:52:11 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Guest created on hypervisor {{(pid=72129) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 13:52:11 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Instance spawned successfully.
Aug 01 13:52:11 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 13:52:11 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:52:11 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 13:52:11 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Found default for hw_cdrom_bus of ide {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:52:11 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Found default for hw_disk_bus of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:52:11 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Found default for hw_input_bus of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:52:11 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Found default for hw_pointer_model of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:52:11 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Found default for hw_video_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:52:11 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Found default for hw_vif_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:52:11 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 13:52:11 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690897931.159315, a07aaeaa-322d-419e-86f5-65cd448c39e7 => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:52:11 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] VM Started (Lifecycle Event)
Aug 01 13:52:11 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:52:11 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 13:52:11 user nova-compute[72129]: DEBUG nova.compute.manager [req-76f9b4ea-798a-4d9b-9c9a-2be43370ca20 req-b2b39554-d5ed-4299-8bab-68188aa113d0 service nova] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Received event network-vif-plugged-f3403639-00ba-4c7c-983a-7995f60f2519 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:52:11 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-76f9b4ea-798a-4d9b-9c9a-2be43370ca20 req-b2b39554-d5ed-4299-8bab-68188aa113d0 service nova] Acquiring lock "a07aaeaa-322d-419e-86f5-65cd448c39e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:52:11 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-76f9b4ea-798a-4d9b-9c9a-2be43370ca20 req-b2b39554-d5ed-4299-8bab-68188aa113d0 service nova] Lock "a07aaeaa-322d-419e-86f5-65cd448c39e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:52:11 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-76f9b4ea-798a-4d9b-9c9a-2be43370ca20 req-b2b39554-d5ed-4299-8bab-68188aa113d0 service nova] Lock "a07aaeaa-322d-419e-86f5-65cd448c39e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:52:11 user nova-compute[72129]: DEBUG nova.compute.manager [req-76f9b4ea-798a-4d9b-9c9a-2be43370ca20 req-b2b39554-d5ed-4299-8bab-68188aa113d0 service nova] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] No waiting events found dispatching network-vif-plugged-f3403639-00ba-4c7c-983a-7995f60f2519 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:52:11 user nova-compute[72129]: WARNING nova.compute.manager [req-76f9b4ea-798a-4d9b-9c9a-2be43370ca20 req-b2b39554-d5ed-4299-8bab-68188aa113d0 service nova] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Received unexpected event network-vif-plugged-f3403639-00ba-4c7c-983a-7995f60f2519 for instance with vm_state building and task_state spawning.
Aug 01 13:52:11 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 13:52:11 user nova-compute[72129]: INFO nova.compute.manager [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Took 5.12 seconds to spawn the instance on the hypervisor.
Aug 01 13:52:11 user nova-compute[72129]: DEBUG nova.compute.manager [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:52:11 user nova-compute[72129]: INFO nova.compute.manager [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Took 15.07 seconds to build instance.
Aug 01 13:52:11 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5f0b5e4b-829a-4825-acaf-32bd2d4454af tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Lock "a07aaeaa-322d-419e-86f5-65cd448c39e7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.189s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:52:12 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:13 user nova-compute[72129]: DEBUG nova.compute.manager [req-ed988a9c-498a-4d0a-84b0-9d96a3ba925b req-9446fec4-ea7e-4201-8bf8-ff7031679c3c service nova] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] Received event network-changed-31519672-974b-48c8-a361-e36ef1177d4e {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:52:13 user nova-compute[72129]: DEBUG nova.compute.manager [req-ed988a9c-498a-4d0a-84b0-9d96a3ba925b req-9446fec4-ea7e-4201-8bf8-ff7031679c3c service nova] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] Refreshing instance network info cache due to event network-changed-31519672-974b-48c8-a361-e36ef1177d4e. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 13:52:13 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ed988a9c-498a-4d0a-84b0-9d96a3ba925b req-9446fec4-ea7e-4201-8bf8-ff7031679c3c service nova] Acquiring lock "refresh_cache-78b77b93-6f25-447f-80a7-d64374fee14d" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:52:13 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ed988a9c-498a-4d0a-84b0-9d96a3ba925b req-9446fec4-ea7e-4201-8bf8-ff7031679c3c service nova] Acquired lock "refresh_cache-78b77b93-6f25-447f-80a7-d64374fee14d" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:52:13 user nova-compute[72129]: DEBUG nova.network.neutron [req-ed988a9c-498a-4d0a-84b0-9d96a3ba925b req-9446fec4-ea7e-4201-8bf8-ff7031679c3c service nova] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] Refreshing network info cache for port 31519672-974b-48c8-a361-e36ef1177d4e {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 13:52:14 user nova-compute[72129]: DEBUG nova.network.neutron [req-ed988a9c-498a-4d0a-84b0-9d96a3ba925b req-9446fec4-ea7e-4201-8bf8-ff7031679c3c service nova] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] Updated VIF entry in instance network info cache for port 31519672-974b-48c8-a361-e36ef1177d4e. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 13:52:14 user nova-compute[72129]: DEBUG nova.network.neutron [req-ed988a9c-498a-4d0a-84b0-9d96a3ba925b req-9446fec4-ea7e-4201-8bf8-ff7031679c3c service nova] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] Updating instance_info_cache with network_info: [{"id": "31519672-974b-48c8-a361-e36ef1177d4e", "address": "fa:16:3e:4c:0e:3b", "network": {"id": "2bfb447a-e137-4844-8659-2d8d008da293", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-168024472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70b05bc50bbd461296d701a4b3a58edc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31519672-97", "ovs_interfaceid": "31519672-974b-48c8-a361-e36ef1177d4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:52:14 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ed988a9c-498a-4d0a-84b0-9d96a3ba925b req-9446fec4-ea7e-4201-8bf8-ff7031679c3c service nova] Releasing lock "refresh_cache-78b77b93-6f25-447f-80a7-d64374fee14d" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:52:15 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-46e6e2d7-529b-4a84-9717-9b123f8b46fe tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Acquiring lock "78b77b93-6f25-447f-80a7-d64374fee14d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:52:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-46e6e2d7-529b-4a84-9717-9b123f8b46fe tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Lock "78b77b93-6f25-447f-80a7-d64374fee14d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:52:17 user nova-compute[72129]: DEBUG nova.objects.instance [None req-46e6e2d7-529b-4a84-9717-9b123f8b46fe tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Lazy-loading 'flavor' on Instance uuid 78b77b93-6f25-447f-80a7-d64374fee14d {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:52:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-46e6e2d7-529b-4a84-9717-9b123f8b46fe tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Lock "78b77b93-6f25-447f-80a7-d64374fee14d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:52:17 user nova-compute[72129]: DEBUG nova.compute.manager [req-2f3cae33-463d-4c37-8708-96d6ba3ca1fd req-b7732fb5-c129-42e4-88a2-b5fbdff8b188 service nova] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Received event network-changed-7b1167ce-d40a-4355-8411-6a1dd005465f {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:52:17 user nova-compute[72129]: DEBUG nova.compute.manager [req-2f3cae33-463d-4c37-8708-96d6ba3ca1fd req-b7732fb5-c129-42e4-88a2-b5fbdff8b188 service nova] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Refreshing instance network info cache due to event network-changed-7b1167ce-d40a-4355-8411-6a1dd005465f. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 13:52:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-2f3cae33-463d-4c37-8708-96d6ba3ca1fd req-b7732fb5-c129-42e4-88a2-b5fbdff8b188 service nova] Acquiring lock "refresh_cache-3c1f751a-e2aa-4447-b72f-9dc88c4c1a84" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:52:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-2f3cae33-463d-4c37-8708-96d6ba3ca1fd req-b7732fb5-c129-42e4-88a2-b5fbdff8b188 service nova] Acquired lock "refresh_cache-3c1f751a-e2aa-4447-b72f-9dc88c4c1a84" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:52:17 user nova-compute[72129]: DEBUG nova.network.neutron [req-2f3cae33-463d-4c37-8708-96d6ba3ca1fd req-b7732fb5-c129-42e4-88a2-b5fbdff8b188 service nova] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Refreshing network info cache for port 7b1167ce-d40a-4355-8411-6a1dd005465f {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 13:52:17 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-46e6e2d7-529b-4a84-9717-9b123f8b46fe tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Acquiring lock "78b77b93-6f25-447f-80a7-d64374fee14d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:52:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-46e6e2d7-529b-4a84-9717-9b123f8b46fe tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Lock "78b77b93-6f25-447f-80a7-d64374fee14d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:52:17 user nova-compute[72129]: INFO nova.compute.manager [None req-46e6e2d7-529b-4a84-9717-9b123f8b46fe tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] Attaching volume b246557a-2729-42fe-9d5c-2cf7e1e4cc5a to /dev/sdc
Aug 01 13:52:17 user nova-compute[72129]: DEBUG os_brick.utils [None req-46e6e2d7-529b-4a84-9717-9b123f8b46fe tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:52:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:17 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f71d26a-5571-48f6-a783-944bfde6d919]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f9b449c2cd3d\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.025s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:17 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77522df-ab5f-4f65-ba0b-ca8e32cd1985]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:17 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[80578bb4-06d3-4eaa-84ca-6c74369691d9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:17 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecacad62-d2a8-4752-83aa-3c7baf485991]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-46e6e2d7-529b-4a84-9717-9b123f8b46fe tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Running cmd (subprocess): nvme version {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-46e6e2d7-529b-4a84-9717-9b123f8b46fe tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] 'nvme version' failed. Not Retrying. {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 13:52:17 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.nvmeof [None req-46e6e2d7-529b-4a84-9717-9b123f8b46fe tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] nvme not present on system {{(pid=72129) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 13:52:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 13:52:17 user nova-compute[72129]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 13:52:17 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[2690c89f-a321-4886-b586-95344d8d4cf1]: (4, '') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:17 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-46e6e2d7-529b-4a84-9717-9b123f8b46fe tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72129) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 13:52:17 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-46e6e2d7-529b-4a84-9717-9b123f8b46fe tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 13:52:17 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-46e6e2d7-529b-4a84-9717-9b123f8b46fe tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] LIGHTOS: no hostnqn found. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 13:52:17 user nova-compute[72129]: DEBUG os_brick.utils [None req-46e6e2d7-529b-4a84-9717-9b123f8b46fe tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f9b449c2cd3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:52:17 user nova-compute[72129]: DEBUG nova.virt.block_device [None req-46e6e2d7-529b-4a84-9717-9b123f8b46fe tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] Updating existing volume attachment record: ced30642-e3b2-40a5-8bfe-b889e7bd7b29 {{(pid=72129) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 13:52:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9eef02f5-13bf-4b0c-ae1f-b521129b2402 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Acquiring lock "interface-3c1f751a-e2aa-4447-b72f-9dc88c4c1a84-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:52:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9eef02f5-13bf-4b0c-ae1f-b521129b2402 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Lock "interface-3c1f751a-e2aa-4447-b72f-9dc88c4c1a84-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:52:17 user nova-compute[72129]: DEBUG nova.objects.instance [None req-9eef02f5-13bf-4b0c-ae1f-b521129b2402 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Lazy-loading 'flavor' on Instance uuid 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:52:18 user nova-compute[72129]: DEBUG nova.network.neutron [req-2f3cae33-463d-4c37-8708-96d6ba3ca1fd req-b7732fb5-c129-42e4-88a2-b5fbdff8b188 service nova] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Updated VIF entry in instance network info cache for port 7b1167ce-d40a-4355-8411-6a1dd005465f. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 13:52:18 user nova-compute[72129]: DEBUG nova.network.neutron [req-2f3cae33-463d-4c37-8708-96d6ba3ca1fd req-b7732fb5-c129-42e4-88a2-b5fbdff8b188 service nova] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Updating instance_info_cache with network_info: [{"id": "7b1167ce-d40a-4355-8411-6a1dd005465f", "address": "fa:16:3e:58:10:73", "network": {"id": "5ae4ed86-1215-49ba-97b9-b9ca5b7d90ba", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-461203891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2184fb8ab16d482ea3ca397fbb5515ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b1167ce-d4", "ovs_interfaceid": "7b1167ce-d40a-4355-8411-6a1dd005465f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:52:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-2f3cae33-463d-4c37-8708-96d6ba3ca1fd req-b7732fb5-c129-42e4-88a2-b5fbdff8b188 service nova] Releasing lock "refresh_cache-3c1f751a-e2aa-4447-b72f-9dc88c4c1a84" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:52:18 user nova-compute[72129]: DEBUG nova.objects.instance [None req-9eef02f5-13bf-4b0c-ae1f-b521129b2402 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Lazy-loading 'pci_requests' on Instance uuid 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:52:18 user nova-compute[72129]: DEBUG nova.network.neutron [None req-9eef02f5-13bf-4b0c-ae1f-b521129b2402 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] allocate_for_instance() {{(pid=72129) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 13:52:18 user nova-compute[72129]: DEBUG nova.policy [None req-9eef02f5-13bf-4b0c-ae1f-b521129b2402 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ded159a3c395418d9e4d699ed249eabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2184fb8ab16d482ea3ca397fbb5515ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72129) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 13:52:19 user nova-compute[72129]: DEBUG nova.network.neutron [None req-9eef02f5-13bf-4b0c-ae1f-b521129b2402 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Successfully created port: f5389e5c-c039-4fbf-a851-8a8b1c8c5a4c {{(pid=72129) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 13:52:19 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fd9f7a0-cf26-4524-9dc9-96bec63e68ab tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] Calling os-brick to attach iSCSI Volume {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 13:52:19 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd9f7a0-cf26-4524-9dc9-96bec63e68ab tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f678f2b1-ba48-4e62-ad0a-0dd0139bbe53'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xbuSPiyW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:52:19 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-1fd9f7a0-cf26-4524-9dc9-96bec63e68ab tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 13:52:19 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-1fd9f7a0-cf26-4524-9dc9-96bec63e68ab tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:52:19 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-1fd9f7a0-cf26-4524-9dc9-96bec63e68ab tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:52:19 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-1fd9f7a0-cf26-4524-9dc9-96bec63e68ab tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 13:52:19 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-1fd9f7a0-cf26-4524-9dc9-96bec63e68ab tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f678f2b1-ba48-4e62-ad0a-0dd0139bbe53" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:52:19 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-1fd9f7a0-cf26-4524-9dc9-96bec63e68ab tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f678f2b1-ba48-4e62-ad0a-0dd0139bbe53" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:52:19 user nova-compute[72129]: INFO os_brick.initiator.connectors.iscsi [None req-1fd9f7a0-cf26-4524-9dc9-96bec63e68ab tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 13:52:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f678f2b1-ba48-4e62-ad0a-0dd0139bbe53 -p 172.16.0.220:3260 {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f678f2b1-ba48-4e62-ad0a-0dd0139bbe53 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:19 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[199838b8-9ccf-4993-88f8-a162ea59a75c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:19 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd9f7a0-cf26-4524-9dc9-96bec63e68ab tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 13:52:19 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f678f2b1-ba48-4e62-ad0a-0dd0139bbe53 -p 172.16.0.220:3260 --interface default --op new {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f678f2b1-ba48-4e62-ad0a-0dd0139bbe53 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:19 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8680c1e-e2d7-4b0d-b857-4366c0fc3d9e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f678f2b1-ba48-4e62-ad0a-0dd0139bbe53] added\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:19 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd9f7a0-cf26-4524-9dc9-96bec63e68ab tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f678f2b1-ba48-4e62-ad0a-0dd0139bbe53] added
Aug 01 13:52:19 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f678f2b1-ba48-4e62-ad0a-0dd0139bbe53 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f678f2b1-ba48-4e62-ad0a-0dd0139bbe53 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:19 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[632630af-b341-4714-bede-6ac309061e91]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:19 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd9f7a0-cf26-4524-9dc9-96bec63e68ab tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f678f2b1-ba48-4e62-ad0a-0dd0139bbe53 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f678f2b1-ba48-4e62-ad0a-0dd0139bbe53 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:19 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[be18a89d-8588-4f64-a653-4f7e8d938150]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:19 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd9f7a0-cf26-4524-9dc9-96bec63e68ab tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f678f2b1-ba48-4e62-ad0a-0dd0139bbe53 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xbuSPiyW {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f678f2b1-ba48-4e62-ad0a-0dd0139bbe53 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xbuSPiyW" returned: 0 in 0.023s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:19 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[9761cd7b-da99-46fe-a374-8bae0085a32a]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:19 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd9f7a0-cf26-4524-9dc9-96bec63e68ab tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xbuSPiyW'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f678f2b1-ba48-4e62-ad0a-0dd0139bbe53 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f678f2b1-ba48-4e62-ad0a-0dd0139bbe53 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:19 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1e6a91-5f7b-4635-985e-1440882253b7]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:19 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd9f7a0-cf26-4524-9dc9-96bec63e68ab tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:19 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b268f8f7-d824-47a3-8dc0-6c9bc24a13f6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:19 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd9f7a0-cf26-4524-9dc9-96bec63e68ab tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)
Aug 01 13:52:19 user nova-compute[72129]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)
Aug 01 13:52:19 user nova-compute[72129]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)
Aug 01 13:52:19 user nova-compute[72129]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)
Aug 01 13:52:19 user nova-compute[72129]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 (non-flash)
Aug 01 13:52:19 user nova-compute[72129]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 (non-flash)
Aug 01 13:52:19 user nova-compute[72129]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)
Aug 01 13:52:19 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:52:19 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd9f7a0-cf26-4524-9dc9-96bec63e68ab tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)
Aug 01 13:52:19 user nova-compute[72129]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)
Aug 01 13:52:19 user nova-compute[72129]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)
Aug 01 13:52:19 user nova-compute[72129]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)
Aug 01 13:52:19 user nova-compute[72129]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 (non-flash)
Aug 01 13:52:19 user nova-compute[72129]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 (non-flash)
Aug 01 13:52:19 user nova-compute[72129]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)
Aug 01 13:52:19 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:52:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f678f2b1-ba48-4e62-ad0a-0dd0139bbe53 -p 172.16.0.220:3260 --login {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f678f2b1-ba48-4e62-ad0a-0dd0139bbe53 -p 172.16.0.220:3260 --login" returned: 0 in 0.107s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:19 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[72680d93-a231-44d5-bc40-b090339f8f61]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f678f2b1-ba48-4e62-ad0a-0dd0139bbe53, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f678f2b1-ba48-4e62-ad0a-0dd0139bbe53, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:19 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd9f7a0-cf26-4524-9dc9-96bec63e68ab tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f678f2b1-ba48-4e62-ad0a-0dd0139bbe53, portal: 172.16.0.220,3260]
Aug 01 13:52:19 user nova-compute[72129]: Login to [iface: default, target: iqn.2010-10.org.openstack:f678f2b1-ba48-4e62-ad0a-0dd0139bbe53, portal: 172.16.0.220,3260] successful.
Aug 01 13:52:19 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f678f2b1-ba48-4e62-ad0a-0dd0139bbe53 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:19 user nova-compute[72129]: DEBUG nova.network.neutron [None req-9eef02f5-13bf-4b0c-ae1f-b521129b2402 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Successfully updated port: f5389e5c-c039-4fbf-a851-8a8b1c8c5a4c {{(pid=72129) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 13:52:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f678f2b1-ba48-4e62-ad0a-0dd0139bbe53 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:19 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0f918d-9f21-44df-b671-be5cd61881c1]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:19 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd9f7a0-cf26-4524-9dc9-96bec63e68ab tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:19 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9eef02f5-13bf-4b0c-ae1f-b521129b2402 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Acquiring lock "refresh_cache-3c1f751a-e2aa-4447-b72f-9dc88c4c1a84" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:52:19 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9eef02f5-13bf-4b0c-ae1f-b521129b2402 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Acquired lock "refresh_cache-3c1f751a-e2aa-4447-b72f-9dc88c4c1a84" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:52:19 user nova-compute[72129]: DEBUG nova.network.neutron [None req-9eef02f5-13bf-4b0c-ae1f-b521129b2402 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 13:52:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:19 user nova-compute[72129]: DEBUG nova.compute.manager [req-a4c1a608-156f-4ed2-b39d-0e8c611bf7fd req-d2ffd640-ae4f-4c85-bd4c-0d33253f0a6a service nova] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Received event network-changed-f5389e5c-c039-4fbf-a851-8a8b1c8c5a4c {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:52:19 user nova-compute[72129]: DEBUG nova.compute.manager [req-a4c1a608-156f-4ed2-b39d-0e8c611bf7fd req-d2ffd640-ae4f-4c85-bd4c-0d33253f0a6a service nova] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Refreshing instance network info cache due to event network-changed-f5389e5c-c039-4fbf-a851-8a8b1c8c5a4c. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 13:52:19 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-a4c1a608-156f-4ed2-b39d-0e8c611bf7fd req-d2ffd640-ae4f-4c85-bd4c-0d33253f0a6a service nova] Acquiring lock "refresh_cache-3c1f751a-e2aa-4447-b72f-9dc88c4c1a84" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:52:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:19 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a231b68-ce1c-44f7-aff2-b8603448d5ef]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f678f2b1-ba48-4e62-ad0a-0dd0139bbe53 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:19 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd9f7a0-cf26-4524-9dc9-96bec63e68ab tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f678f2b1-ba48-4e62-ad0a-0dd0139bbe53 (non-flash)
Aug 01 13:52:19 user nova-compute[72129]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)
Aug 01 13:52:19 user nova-compute[72129]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)
Aug 01 13:52:19 user nova-compute[72129]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)
Aug 01 13:52:19 user nova-compute[72129]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)
Aug 01 13:52:19 user nova-compute[72129]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 (non-flash)
Aug 01 13:52:19 user nova-compute[72129]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 (non-flash)
Aug 01 13:52:19 user nova-compute[72129]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)
Aug 01 13:52:19 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:52:19 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd9f7a0-cf26-4524-9dc9-96bec63e68ab tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f678f2b1-ba48-4e62-ad0a-0dd0139bbe53 (non-flash)
Aug 01 13:52:19 user nova-compute[72129]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)
Aug 01 13:52:19 user nova-compute[72129]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)
Aug 01 13:52:19 user nova-compute[72129]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)
Aug 01 13:52:19 user nova-compute[72129]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)
Aug 01 13:52:19 user nova-compute[72129]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 (non-flash)
Aug 01 13:52:19 user nova-compute[72129]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 (non-flash)
Aug 01 13:52:19 user nova-compute[72129]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)
Aug 01 13:52:19 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:52:19 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-1fd9f7a0-cf26-4524-9dc9-96bec63e68ab tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f678f2b1-ba48-4e62-ad0a-0dd0139bbe53" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.391s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:52:19 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd9f7a0-cf26-4524-9dc9-96bec63e68ab tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Connected to 172.16.0.220:3260 {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 13:52:19 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-1fd9f7a0-cf26-4524-9dc9-96bec63e68ab tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=72129) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 13:52:19 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-1fd9f7a0-cf26-4524-9dc9-96bec63e68ab tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=72129) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 13:52:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:20 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:20 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2fbea4-021f-4f7a-8986-2e08f2fcf659]: (4, ('- - 0', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:20 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-1fd9f7a0-cf26-4524-9dc9-96bec63e68ab tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 13:52:20 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd9f7a0-cf26-4524-9dc9-96bec63e68ab tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xbuSPiyW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 13:52:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:21 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-1fd9f7a0-cf26-4524-9dc9-96bec63e68ab tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.446s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:52:21 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fd9f7a0-cf26-4524-9dc9-96bec63e68ab tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] <== connect_volume: return (1449ms) {'type': 'block', 'scsi_wwn': '23366336462356339', 'path': '/dev/sdi'} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:52:21 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fd9f7a0-cf26-4524-9dc9-96bec63e68ab tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366336462356339', 'path': '/dev/sdi'} {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 13:52:21 user nova-compute[72129]: DEBUG nova.objects.instance [None req-1fd9f7a0-cf26-4524-9dc9-96bec63e68ab tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Lazy-loading 'flavor' on Instance uuid 31105963-52fa-4aff-9270-075cd98f08a5 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:52:21 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-1fd9f7a0-cf26-4524-9dc9-96bec63e68ab tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 13:52:21 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 13:52:21 user nova-compute[72129]:   <source dev="/dev/sdi"/>
Aug 01 13:52:21 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 13:52:21 user nova-compute[72129]:   <serial>f678f2b1-ba48-4e62-ad0a-0dd0139bbe53</serial>
Aug 01 13:52:21 user nova-compute[72129]: </disk>
Aug 01 13:52:21 user nova-compute[72129]:  {{(pid=72129) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 13:52:21 user nova-compute[72129]: DEBUG nova.network.neutron [None req-9eef02f5-13bf-4b0c-ae1f-b521129b2402 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Updating instance_info_cache with network_info: [{"id": "7b1167ce-d40a-4355-8411-6a1dd005465f", "address": "fa:16:3e:58:10:73", "network": {"id": "5ae4ed86-1215-49ba-97b9-b9ca5b7d90ba", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-461203891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2184fb8ab16d482ea3ca397fbb5515ff", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b1167ce-d4", "ovs_interfaceid": "7b1167ce-d40a-4355-8411-6a1dd005465f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f5389e5c-c039-4fbf-a851-8a8b1c8c5a4c", "address": "fa:16:3e:08:82:8a", "network": {"id": "18cced8e-a715-4226-89e6-39ea504b5746", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-521965974", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2184fb8ab16d482ea3ca397fbb5515ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5389e5c-c0", "ovs_interfaceid": "f5389e5c-c039-4fbf-a851-8a8b1c8c5a4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:52:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9eef02f5-13bf-4b0c-ae1f-b521129b2402 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Releasing lock "refresh_cache-3c1f751a-e2aa-4447-b72f-9dc88c4c1a84" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:52:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-a4c1a608-156f-4ed2-b39d-0e8c611bf7fd req-d2ffd640-ae4f-4c85-bd4c-0d33253f0a6a service nova] Acquired lock "refresh_cache-3c1f751a-e2aa-4447-b72f-9dc88c4c1a84" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:52:21 user nova-compute[72129]: DEBUG nova.network.neutron [req-a4c1a608-156f-4ed2-b39d-0e8c611bf7fd req-d2ffd640-ae4f-4c85-bd4c-0d33253f0a6a service nova] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Refreshing network info cache for port f5389e5c-c039-4fbf-a851-8a8b1c8c5a4c {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 13:52:21 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-9eef02f5-13bf-4b0c-ae1f-b521129b2402 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T13:50:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1732967996',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1732967996',id=8,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLV9A0exWrqx9JsfbE2qI31l+qAJAoY1ILqBBhJy25PwbbuJ9xEqV3MLcWWfDrGgYOcUOAwPrjT+u/vasbyQv8o1AhTEdbBmNL+fkWaNh0TGgFByD46Z+LnLlJ94XdbvJQ==',key_name='tempest-keypair-1026124919',keypairs=<?>,launch_index=0,launched_at=2023-08-01T13:50:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2184fb8ab16d482ea3ca397fbb5515ff',ramdisk_id='',reservation_id='r-qogqtpk0',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1582776521',owner_user_name='tempest-TaggedAttachmentsTest-1582776521-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T13:50:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ded159a3c395418d9e4d699ed249eabb',uuid=3c1f751a-e2aa-4447-b72f-9dc88c4c1a84,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5389e5c-c039-4fbf-a851-8a8b1c8c5a4c", "address": "fa:16:3e:08:82:8a", "network": {"id": "18cced8e-a715-4226-89e6-39ea504b5746", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-521965974", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2184fb8ab16d482ea3ca397fbb5515ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5389e5c-c0", "ovs_interfaceid": "f5389e5c-c039-4fbf-a851-8a8b1c8c5a4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 13:52:21 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-9eef02f5-13bf-4b0c-ae1f-b521129b2402 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Converting VIF {"id": "f5389e5c-c039-4fbf-a851-8a8b1c8c5a4c", "address": "fa:16:3e:08:82:8a", "network": {"id": "18cced8e-a715-4226-89e6-39ea504b5746", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-521965974", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2184fb8ab16d482ea3ca397fbb5515ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5389e5c-c0", "ovs_interfaceid": "f5389e5c-c039-4fbf-a851-8a8b1c8c5a4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:52:21 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-9eef02f5-13bf-4b0c-ae1f-b521129b2402 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:82:8a,bridge_name='br-int',has_traffic_filtering=True,id=f5389e5c-c039-4fbf-a851-8a8b1c8c5a4c,network=Network(18cced8e-a715-4226-89e6-39ea504b5746),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5389e5c-c0') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:52:21 user nova-compute[72129]: DEBUG os_vif [None req-9eef02f5-13bf-4b0c-ae1f-b521129b2402 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:82:8a,bridge_name='br-int',has_traffic_filtering=True,id=f5389e5c-c039-4fbf-a851-8a8b1c8c5a4c,network=Network(18cced8e-a715-4226-89e6-39ea504b5746),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5389e5c-c0') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 13:52:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:52:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 13:52:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf5389e5c-c0, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:52:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf5389e5c-c0, col_values=(('external_ids', {'iface-id': 'f5389e5c-c039-4fbf-a851-8a8b1c8c5a4c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:82:8a', 'vm-uuid': '3c1f751a-e2aa-4447-b72f-9dc88c4c1a84'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:52:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 13:52:21 user nova-compute[72129]: INFO os_vif [None req-9eef02f5-13bf-4b0c-ae1f-b521129b2402 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:82:8a,bridge_name='br-int',has_traffic_filtering=True,id=f5389e5c-c039-4fbf-a851-8a8b1c8c5a4c,network=Network(18cced8e-a715-4226-89e6-39ea504b5746),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5389e5c-c0')
Aug 01 13:52:21 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-9eef02f5-13bf-4b0c-ae1f-b521129b2402 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T13:50:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1732967996',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1732967996',id=8,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLV9A0exWrqx9JsfbE2qI31l+qAJAoY1ILqBBhJy25PwbbuJ9xEqV3MLcWWfDrGgYOcUOAwPrjT+u/vasbyQv8o1AhTEdbBmNL+fkWaNh0TGgFByD46Z+LnLlJ94XdbvJQ==',key_name='tempest-keypair-1026124919',keypairs=<?>,launch_index=0,launched_at=2023-08-01T13:50:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2184fb8ab16d482ea3ca397fbb5515ff',ramdisk_id='',reservation_id='r-qogqtpk0',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1582776521',owner_user_name='tempest-TaggedAttachmentsTest-1582776521-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T13:50:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ded159a3c395418d9e4d699ed249eabb',uuid=3c1f751a-e2aa-4447-b72f-9dc88c4c1a84,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5389e5c-c039-4fbf-a851-8a8b1c8c5a4c", "address": "fa:16:3e:08:82:8a", "network": {"id": "18cced8e-a715-4226-89e6-39ea504b5746", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-521965974", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2184fb8ab16d482ea3ca397fbb5515ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5389e5c-c0", "ovs_interfaceid": "f5389e5c-c039-4fbf-a851-8a8b1c8c5a4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 13:52:21 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-9eef02f5-13bf-4b0c-ae1f-b521129b2402 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Converting VIF {"id": "f5389e5c-c039-4fbf-a851-8a8b1c8c5a4c", "address": "fa:16:3e:08:82:8a", "network": {"id": "18cced8e-a715-4226-89e6-39ea504b5746", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-521965974", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2184fb8ab16d482ea3ca397fbb5515ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5389e5c-c0", "ovs_interfaceid": "f5389e5c-c039-4fbf-a851-8a8b1c8c5a4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:52:21 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-9eef02f5-13bf-4b0c-ae1f-b521129b2402 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:82:8a,bridge_name='br-int',has_traffic_filtering=True,id=f5389e5c-c039-4fbf-a851-8a8b1c8c5a4c,network=Network(18cced8e-a715-4226-89e6-39ea504b5746),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5389e5c-c0') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:52:21 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-9eef02f5-13bf-4b0c-ae1f-b521129b2402 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] attach device xml: <interface type="ethernet">
Aug 01 13:52:21 user nova-compute[72129]:   <mac address="fa:16:3e:08:82:8a"/>
Aug 01 13:52:21 user nova-compute[72129]:   <model type="virtio"/>
Aug 01 13:52:21 user nova-compute[72129]:   <mtu size="1442"/>
Aug 01 13:52:21 user nova-compute[72129]:   <target dev="tapf5389e5c-c0"/>
Aug 01 13:52:21 user nova-compute[72129]: </interface>
Aug 01 13:52:21 user nova-compute[72129]:  {{(pid=72129) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 13:52:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:21 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-1fd9f7a0-cf26-4524-9dc9-96bec63e68ab tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 13:52:21 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-1fd9f7a0-cf26-4524-9dc9-96bec63e68ab tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 13:52:21 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-1fd9f7a0-cf26-4524-9dc9-96bec63e68ab tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] No VIF found with MAC fa:16:3e:a8:fe:6c, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 13:52:21 user nova-compute[72129]: DEBUG nova.compute.manager [req-ce72d25e-5adf-4c41-8b91-568c8a1d31f1 req-3e319a64-2306-4519-b57c-239ea546755d service nova] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Received event network-vif-plugged-f5389e5c-c039-4fbf-a851-8a8b1c8c5a4c {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:52:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ce72d25e-5adf-4c41-8b91-568c8a1d31f1 req-3e319a64-2306-4519-b57c-239ea546755d service nova] Acquiring lock "3c1f751a-e2aa-4447-b72f-9dc88c4c1a84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:52:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ce72d25e-5adf-4c41-8b91-568c8a1d31f1 req-3e319a64-2306-4519-b57c-239ea546755d service nova] Lock "3c1f751a-e2aa-4447-b72f-9dc88c4c1a84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:52:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ce72d25e-5adf-4c41-8b91-568c8a1d31f1 req-3e319a64-2306-4519-b57c-239ea546755d service nova] Lock "3c1f751a-e2aa-4447-b72f-9dc88c4c1a84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:52:21 user nova-compute[72129]: DEBUG nova.compute.manager [req-ce72d25e-5adf-4c41-8b91-568c8a1d31f1 req-3e319a64-2306-4519-b57c-239ea546755d service nova] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] No waiting events found dispatching network-vif-plugged-f5389e5c-c039-4fbf-a851-8a8b1c8c5a4c {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:52:21 user nova-compute[72129]: WARNING nova.compute.manager [req-ce72d25e-5adf-4c41-8b91-568c8a1d31f1 req-3e319a64-2306-4519-b57c-239ea546755d service nova] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Received unexpected event network-vif-plugged-f5389e5c-c039-4fbf-a851-8a8b1c8c5a4c for instance with vm_state active and task_state None.
Aug 01 13:52:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-1fd9f7a0-cf26-4524-9dc9-96bec63e68ab tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Lock "31105963-52fa-4aff-9270-075cd98f08a5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.386s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:52:22 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9eef02f5-13bf-4b0c-ae1f-b521129b2402 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 13:52:22 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9eef02f5-13bf-4b0c-ae1f-b521129b2402 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] No BDM found with device name hda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 13:52:22 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9eef02f5-13bf-4b0c-ae1f-b521129b2402 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] No VIF found with MAC fa:16:3e:58:10:73, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 13:52:22 user nova-compute[72129]: DEBUG nova.network.neutron [req-a4c1a608-156f-4ed2-b39d-0e8c611bf7fd req-d2ffd640-ae4f-4c85-bd4c-0d33253f0a6a service nova] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Updated VIF entry in instance network info cache for port f5389e5c-c039-4fbf-a851-8a8b1c8c5a4c. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 13:52:22 user nova-compute[72129]: DEBUG nova.network.neutron [req-a4c1a608-156f-4ed2-b39d-0e8c611bf7fd req-d2ffd640-ae4f-4c85-bd4c-0d33253f0a6a service nova] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Updating instance_info_cache with network_info: [{"id": "7b1167ce-d40a-4355-8411-6a1dd005465f", "address": "fa:16:3e:58:10:73", "network": {"id": "5ae4ed86-1215-49ba-97b9-b9ca5b7d90ba", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-461203891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2184fb8ab16d482ea3ca397fbb5515ff", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b1167ce-d4", "ovs_interfaceid": "7b1167ce-d40a-4355-8411-6a1dd005465f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f5389e5c-c039-4fbf-a851-8a8b1c8c5a4c", "address": "fa:16:3e:08:82:8a", "network": {"id": "18cced8e-a715-4226-89e6-39ea504b5746", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-521965974", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2184fb8ab16d482ea3ca397fbb5515ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5389e5c-c0", "ovs_interfaceid": "f5389e5c-c039-4fbf-a851-8a8b1c8c5a4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:52:22 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-9eef02f5-13bf-4b0c-ae1f-b521129b2402 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 13:52:22 user nova-compute[72129]:   <nova:package version="0.0.0"/>
Aug 01 13:52:22 user nova-compute[72129]:   <nova:name>tempest-device-tagging-server-1732967996</nova:name>
Aug 01 13:52:22 user nova-compute[72129]:   <nova:creationTime>2023-08-01 13:52:22</nova:creationTime>
Aug 01 13:52:22 user nova-compute[72129]:   <nova:flavor name="m1.tiny">
Aug 01 13:52:22 user nova-compute[72129]:     <nova:memory>512</nova:memory>
Aug 01 13:52:22 user nova-compute[72129]:     <nova:disk>1</nova:disk>
Aug 01 13:52:22 user nova-compute[72129]:     <nova:swap>0</nova:swap>
Aug 01 13:52:22 user nova-compute[72129]:     <nova:ephemeral>0</nova:ephemeral>
Aug 01 13:52:22 user nova-compute[72129]:     <nova:vcpus>1</nova:vcpus>
Aug 01 13:52:22 user nova-compute[72129]:   </nova:flavor>
Aug 01 13:52:22 user nova-compute[72129]:   <nova:owner>
Aug 01 13:52:22 user nova-compute[72129]:     <nova:user uuid="ded159a3c395418d9e4d699ed249eabb">tempest-TaggedAttachmentsTest-1582776521-project-member</nova:user>
Aug 01 13:52:22 user nova-compute[72129]:     <nova:project uuid="2184fb8ab16d482ea3ca397fbb5515ff">tempest-TaggedAttachmentsTest-1582776521</nova:project>
Aug 01 13:52:22 user nova-compute[72129]:   </nova:owner>
Aug 01 13:52:22 user nova-compute[72129]:   <nova:root type="image" uuid="b6472c34-1b0f-4034-ba3a-7e8eb5103715"/>
Aug 01 13:52:22 user nova-compute[72129]:   <nova:ports>
Aug 01 13:52:22 user nova-compute[72129]:     <nova:port uuid="7b1167ce-d40a-4355-8411-6a1dd005465f">
Aug 01 13:52:22 user nova-compute[72129]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 01 13:52:22 user nova-compute[72129]:     </nova:port>
Aug 01 13:52:22 user nova-compute[72129]:     <nova:port uuid="f5389e5c-c039-4fbf-a851-8a8b1c8c5a4c">
Aug 01 13:52:22 user nova-compute[72129]:       <nova:ip type="fixed" address="10.10.10.129" ipVersion="4"/>
Aug 01 13:52:22 user nova-compute[72129]:     </nova:port>
Aug 01 13:52:22 user nova-compute[72129]:   </nova:ports>
Aug 01 13:52:22 user nova-compute[72129]: </nova:instance>
Aug 01 13:52:22 user nova-compute[72129]:  {{(pid=72129) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 01 13:52:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-a4c1a608-156f-4ed2-b39d-0e8c611bf7fd req-d2ffd640-ae4f-4c85-bd4c-0d33253f0a6a service nova] Releasing lock "refresh_cache-3c1f751a-e2aa-4447-b72f-9dc88c4c1a84" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:52:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9eef02f5-13bf-4b0c-ae1f-b521129b2402 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Lock "interface-3c1f751a-e2aa-4447-b72f-9dc88c4c1a84-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 4.288s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:52:22 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:22 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5f497522-80a2-4bb6-9e55-aeea9c4c0108 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Acquiring lock "3c1f751a-e2aa-4447-b72f-9dc88c4c1a84" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:52:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5f497522-80a2-4bb6-9e55-aeea9c4c0108 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Lock "3c1f751a-e2aa-4447-b72f-9dc88c4c1a84" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:52:22 user nova-compute[72129]: DEBUG nova.objects.instance [None req-5f497522-80a2-4bb6-9e55-aeea9c4c0108 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Lazy-loading 'flavor' on Instance uuid 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:52:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5f497522-80a2-4bb6-9e55-aeea9c4c0108 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Lock "3c1f751a-e2aa-4447-b72f-9dc88c4c1a84" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:52:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5f497522-80a2-4bb6-9e55-aeea9c4c0108 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Acquiring lock "3c1f751a-e2aa-4447-b72f-9dc88c4c1a84" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:52:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5f497522-80a2-4bb6-9e55-aeea9c4c0108 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Lock "3c1f751a-e2aa-4447-b72f-9dc88c4c1a84" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:52:22 user nova-compute[72129]: INFO nova.compute.manager [None req-5f497522-80a2-4bb6-9e55-aeea9c4c0108 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Attaching volume b1ab9c7e-7cec-4b1c-b1fb-1fbfa40c9f32 to /dev/vdb
Aug 01 13:52:23 user nova-compute[72129]: DEBUG os_brick.utils [None req-5f497522-80a2-4bb6-9e55-aeea9c4c0108 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:52:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:23 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[065ebf4e-41d2-495e-8ec6-4040f69dec3b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f9b449c2cd3d\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:23 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a5b17b-5825-450d-9605-038bb79ab5d2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:23 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bfd7e0b-5dd4-45be-990b-c2f66567c11f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:23 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c5515e9-8773-4b98-9063-6fdac0ea23ce]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-5f497522-80a2-4bb6-9e55-aeea9c4c0108 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Running cmd (subprocess): nvme version {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-5f497522-80a2-4bb6-9e55-aeea9c4c0108 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] 'nvme version' failed. Not Retrying. {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 13:52:23 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5f497522-80a2-4bb6-9e55-aeea9c4c0108 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] nvme not present on system {{(pid=72129) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 13:52:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 13:52:23 user nova-compute[72129]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 13:52:23 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d45eb7c-bb22-4bc2-95f3-16b33aa3c253]: (4, '') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:23 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-5f497522-80a2-4bb6-9e55-aeea9c4c0108 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72129) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 13:52:23 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-5f497522-80a2-4bb6-9e55-aeea9c4c0108 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 13:52:23 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-5f497522-80a2-4bb6-9e55-aeea9c4c0108 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] LIGHTOS: no hostnqn found. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 13:52:23 user nova-compute[72129]: DEBUG os_brick.utils [None req-5f497522-80a2-4bb6-9e55-aeea9c4c0108 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f9b449c2cd3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:52:23 user nova-compute[72129]: DEBUG nova.virt.block_device [None req-5f497522-80a2-4bb6-9e55-aeea9c4c0108 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Updating existing volume attachment record: beb49cf6-bfab-4f0c-9157-8d4f9675cd67 {{(pid=72129) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 13:52:23 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-10e14ea0-e49c-4110-a859-537da1e08740 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Acquiring lock "31105963-52fa-4aff-9270-075cd98f08a5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:52:23 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-10e14ea0-e49c-4110-a859-537da1e08740 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Lock "31105963-52fa-4aff-9270-075cd98f08a5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:52:23 user nova-compute[72129]: INFO nova.compute.manager [None req-10e14ea0-e49c-4110-a859-537da1e08740 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] Detaching volume f678f2b1-ba48-4e62-ad0a-0dd0139bbe53
Aug 01 13:52:23 user nova-compute[72129]: INFO nova.virt.block_device [None req-10e14ea0-e49c-4110-a859-537da1e08740 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] Attempting to driver detach volume f678f2b1-ba48-4e62-ad0a-0dd0139bbe53 from mountpoint /dev/vdb
Aug 01 13:52:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-10e14ea0-e49c-4110-a859-537da1e08740 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Attempting to detach device vdb from instance 31105963-52fa-4aff-9270-075cd98f08a5 from the persistent domain config. {{(pid=72129) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 13:52:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-10e14ea0-e49c-4110-a859-537da1e08740 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 13:52:23 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 13:52:23 user nova-compute[72129]:   <source dev="/dev/sdi"/>
Aug 01 13:52:23 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 13:52:23 user nova-compute[72129]:   <serial>f678f2b1-ba48-4e62-ad0a-0dd0139bbe53</serial>
Aug 01 13:52:23 user nova-compute[72129]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 13:52:23 user nova-compute[72129]: </disk>
Aug 01 13:52:23 user nova-compute[72129]:  {{(pid=72129) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 13:52:23 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-10e14ea0-e49c-4110-a859-537da1e08740 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Successfully detached device vdb from instance 31105963-52fa-4aff-9270-075cd98f08a5 from the persistent domain config.
Aug 01 13:52:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-10e14ea0-e49c-4110-a859-537da1e08740 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 31105963-52fa-4aff-9270-075cd98f08a5 from the live domain config. {{(pid=72129) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 13:52:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-10e14ea0-e49c-4110-a859-537da1e08740 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 13:52:23 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 13:52:23 user nova-compute[72129]:   <source dev="/dev/sdi"/>
Aug 01 13:52:23 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 13:52:23 user nova-compute[72129]:   <serial>f678f2b1-ba48-4e62-ad0a-0dd0139bbe53</serial>
Aug 01 13:52:23 user nova-compute[72129]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 13:52:23 user nova-compute[72129]: </disk>
Aug 01 13:52:23 user nova-compute[72129]:  {{(pid=72129) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 13:52:23 user nova-compute[72129]: DEBUG nova.compute.manager [req-9055db7e-4753-49f3-96e4-1fd50b92efd1 req-86176a9f-dd0f-4e10-9baa-630959ffcc7f service nova] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Received event network-vif-plugged-f5389e5c-c039-4fbf-a851-8a8b1c8c5a4c {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:52:23 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-9055db7e-4753-49f3-96e4-1fd50b92efd1 req-86176a9f-dd0f-4e10-9baa-630959ffcc7f service nova] Acquiring lock "3c1f751a-e2aa-4447-b72f-9dc88c4c1a84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:52:23 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-9055db7e-4753-49f3-96e4-1fd50b92efd1 req-86176a9f-dd0f-4e10-9baa-630959ffcc7f service nova] Lock "3c1f751a-e2aa-4447-b72f-9dc88c4c1a84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:52:23 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-9055db7e-4753-49f3-96e4-1fd50b92efd1 req-86176a9f-dd0f-4e10-9baa-630959ffcc7f service nova] Lock "3c1f751a-e2aa-4447-b72f-9dc88c4c1a84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:52:23 user nova-compute[72129]: DEBUG nova.compute.manager [req-9055db7e-4753-49f3-96e4-1fd50b92efd1 req-86176a9f-dd0f-4e10-9baa-630959ffcc7f service nova] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] No waiting events found dispatching network-vif-plugged-f5389e5c-c039-4fbf-a851-8a8b1c8c5a4c {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:52:23 user nova-compute[72129]: WARNING nova.compute.manager [req-9055db7e-4753-49f3-96e4-1fd50b92efd1 req-86176a9f-dd0f-4e10-9baa-630959ffcc7f service nova] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Received unexpected event network-vif-plugged-f5389e5c-c039-4fbf-a851-8a8b1c8c5a4c for instance with vm_state active and task_state None.
Aug 01 13:52:24 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Received event <DeviceRemovedEvent: 1690897944.31712, 31105963-52fa-4aff-9270-075cd98f08a5 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72129) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 13:52:24 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-10e14ea0-e49c-4110-a859-537da1e08740 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 31105963-52fa-4aff-9270-075cd98f08a5 {{(pid=72129) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 13:52:24 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-10e14ea0-e49c-4110-a859-537da1e08740 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Successfully detached device vdb from instance 31105963-52fa-4aff-9270-075cd98f08a5 from the live domain config.
Aug 01 13:52:24 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10e14ea0-e49c-4110-a859-537da1e08740 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] calling os-brick to detach iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 13:52:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e14ea0-e49c-4110-a859-537da1e08740 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, {'target_iqns': ['iqn.2010-10.org.openstack:f678f2b1-ba48-4e62-ad0a-0dd0139bbe53'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xbuSPiyW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:52:24 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-10e14ea0-e49c-4110-a859-537da1e08740 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 13:52:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-10e14ea0-e49c-4110-a859-537da1e08740 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:52:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-10e14ea0-e49c-4110-a859-537da1e08740 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:52:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e14ea0-e49c-4110-a859-537da1e08740 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f678f2b1-ba48-4e62-ad0a-0dd0139bbe53', 0)] {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 13:52:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:24 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6250ed-23d8-4ad8-b7cf-a6acebf47b31]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f678f2b1-ba48-4e62-ad0a-0dd0139bbe53\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:24 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[658961c4-fa26-4be1-88bb-55b80282bb68]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f678f2b1-ba48-4e62-ad0a-0dd0139bbe53 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e14ea0-e49c-4110-a859-537da1e08740 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f678f2b1-ba48-4e62-ad0a-0dd0139bbe53 (non-flash)
Aug 01 13:52:24 user nova-compute[72129]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)
Aug 01 13:52:24 user nova-compute[72129]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)
Aug 01 13:52:24 user nova-compute[72129]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)
Aug 01 13:52:24 user nova-compute[72129]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)
Aug 01 13:52:24 user nova-compute[72129]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 (non-flash)
Aug 01 13:52:24 user nova-compute[72129]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 (non-flash)
Aug 01 13:52:24 user nova-compute[72129]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)
Aug 01 13:52:24 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:52:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e14ea0-e49c-4110-a859-537da1e08740 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f678f2b1-ba48-4e62-ad0a-0dd0139bbe53 (non-flash)
Aug 01 13:52:24 user nova-compute[72129]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)
Aug 01 13:52:24 user nova-compute[72129]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)
Aug 01 13:52:24 user nova-compute[72129]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)
Aug 01 13:52:24 user nova-compute[72129]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)
Aug 01 13:52:24 user nova-compute[72129]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 (non-flash)
Aug 01 13:52:24 user nova-compute[72129]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 (non-flash)
Aug 01 13:52:24 user nova-compute[72129]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)
Aug 01 13:52:24 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:52:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e14ea0-e49c-4110-a859-537da1e08740 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2828338160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f678f2b1-ba48-4e62-ad0a-0dd0139bbe53'): ({'sdi'}, set())}) {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 13:52:24 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-10e14ea0-e49c-4110-a859-537da1e08740 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Removing single pathed devices sdi {{(pid=72129) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 13:52:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:24 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff1f23e-d57e-49b0-bf8b-9a203b8b5fd8]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:24 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[501f6e3c-8481-48bd-8b9e-17c07f7d5374]: (4, ('ok\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:24 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-10e14ea0-e49c-4110-a859-537da1e08740 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Flushing IO for device /dev/sdi {{(pid=72129) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 13:52:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:24 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0fcccf1-430f-4cd4-8411-dc087f426306]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:24 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-10e14ea0-e49c-4110-a859-537da1e08740 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=72129) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 13:52:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.049s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:24 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b02838d-9947-42c7-a456-a8f007abb28f]: (4, ('1', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:24 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-10e14ea0-e49c-4110-a859-537da1e08740 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 13:52:24 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-10e14ea0-e49c-4110-a859-537da1e08740 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] SCSI volumes sdi have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 13:52:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e14ea0-e49c-4110-a859-537da1e08740 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f678f2b1-ba48-4e62-ad0a-0dd0139bbe53')] {{(pid=72129) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 13:52:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f678f2b1-ba48-4e62-ad0a-0dd0139bbe53 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f678f2b1-ba48-4e62-ad0a-0dd0139bbe53 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:24 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a409fe-6112-4035-b4db-d24eee70a47d]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e14ea0-e49c-4110-a859-537da1e08740 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f678f2b1-ba48-4e62-ad0a-0dd0139bbe53 -p 172.16.0.220:3260 --logout {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f678f2b1-ba48-4e62-ad0a-0dd0139bbe53 -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:24 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d58d951-334f-42e6-b5b6-90e212674b08]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:f678f2b1-ba48-4e62-ad0a-0dd0139bbe53, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:f678f2b1-ba48-4e62-ad0a-0dd0139bbe53, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e14ea0-e49c-4110-a859-537da1e08740 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:f678f2b1-ba48-4e62-ad0a-0dd0139bbe53, portal: 172.16.0.220,3260]
Aug 01 13:52:24 user nova-compute[72129]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:f678f2b1-ba48-4e62-ad0a-0dd0139bbe53, portal: 172.16.0.220,3260] successful.
Aug 01 13:52:24 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f678f2b1-ba48-4e62-ad0a-0dd0139bbe53 -p 172.16.0.220:3260 --op delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f678f2b1-ba48-4e62-ad0a-0dd0139bbe53 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:24 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0bb9ebe-7896-4eba-9493-eebc0356107b]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e14ea0-e49c-4110-a859-537da1e08740 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-10e14ea0-e49c-4110-a859-537da1e08740 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:52:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-10e14ea0-e49c-4110-a859-537da1e08740 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] <== disconnect_volume: return (356ms) None {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:52:24 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10e14ea0-e49c-4110-a859-537da1e08740 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] Disconnected iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 13:52:25 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:25 user nova-compute[72129]: DEBUG nova.compute.manager [req-f7bfd7b6-6a9e-43a2-8155-fd44cdd7a775 req-aec28acf-718e-4197-a41b-a177a8b90141 service nova] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Received event network-changed-027152b9-a97b-4756-8618-25d27e5c6e2f {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:52:25 user nova-compute[72129]: DEBUG nova.compute.manager [req-f7bfd7b6-6a9e-43a2-8155-fd44cdd7a775 req-aec28acf-718e-4197-a41b-a177a8b90141 service nova] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Refreshing instance network info cache due to event network-changed-027152b9-a97b-4756-8618-25d27e5c6e2f. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 13:52:25 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f7bfd7b6-6a9e-43a2-8155-fd44cdd7a775 req-aec28acf-718e-4197-a41b-a177a8b90141 service nova] Acquiring lock "refresh_cache-33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:52:25 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f7bfd7b6-6a9e-43a2-8155-fd44cdd7a775 req-aec28acf-718e-4197-a41b-a177a8b90141 service nova] Acquired lock "refresh_cache-33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:52:25 user nova-compute[72129]: DEBUG nova.network.neutron [req-f7bfd7b6-6a9e-43a2-8155-fd44cdd7a775 req-aec28acf-718e-4197-a41b-a177a8b90141 service nova] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Refreshing network info cache for port 027152b9-a97b-4756-8618-25d27e5c6e2f {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 13:52:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:26 user nova-compute[72129]: DEBUG nova.network.neutron [req-f7bfd7b6-6a9e-43a2-8155-fd44cdd7a775 req-aec28acf-718e-4197-a41b-a177a8b90141 service nova] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Updated VIF entry in instance network info cache for port 027152b9-a97b-4756-8618-25d27e5c6e2f. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 13:52:26 user nova-compute[72129]: DEBUG nova.network.neutron [req-f7bfd7b6-6a9e-43a2-8155-fd44cdd7a775 req-aec28acf-718e-4197-a41b-a177a8b90141 service nova] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Updating instance_info_cache with network_info: [{"id": "027152b9-a97b-4756-8618-25d27e5c6e2f", "address": "fa:16:3e:a2:d0:6d", "network": {"id": "934b1a56-2f37-418b-bce9-a6cdc8a2083b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1371342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0177e373be24a209f050b7fd6cd646a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap027152b9-a9", "ovs_interfaceid": "027152b9-a97b-4756-8618-25d27e5c6e2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:52:26 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f7bfd7b6-6a9e-43a2-8155-fd44cdd7a775 req-aec28acf-718e-4197-a41b-a177a8b90141 service nova] Releasing lock "refresh_cache-33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:52:27 user nova-compute[72129]: DEBUG nova.objects.instance [None req-10e14ea0-e49c-4110-a859-537da1e08740 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Lazy-loading 'flavor' on Instance uuid 31105963-52fa-4aff-9270-075cd98f08a5 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:52:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-10e14ea0-e49c-4110-a859-537da1e08740 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Lock "31105963-52fa-4aff-9270-075cd98f08a5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.770s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:52:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-99d2ebaf-8bf3-49a8-beaa-cb55a52ed991 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Acquiring lock "33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:52:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-99d2ebaf-8bf3-49a8-beaa-cb55a52ed991 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Lock "33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:52:27 user nova-compute[72129]: DEBUG nova.objects.instance [None req-99d2ebaf-8bf3-49a8-beaa-cb55a52ed991 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Lazy-loading 'flavor' on Instance uuid 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:52:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-99d2ebaf-8bf3-49a8-beaa-cb55a52ed991 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Lock "33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:52:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-80951f06-3e66-4553-96fb-8b91a1a7d6ee tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] Acquiring lock "0ce22ea1-b01c-47c6-b9e4-bf28aebc125c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:52:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-80951f06-3e66-4553-96fb-8b91a1a7d6ee tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] Lock "0ce22ea1-b01c-47c6-b9e4-bf28aebc125c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:52:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-80951f06-3e66-4553-96fb-8b91a1a7d6ee tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] Acquiring lock "0ce22ea1-b01c-47c6-b9e4-bf28aebc125c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:52:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-80951f06-3e66-4553-96fb-8b91a1a7d6ee tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] Lock "0ce22ea1-b01c-47c6-b9e4-bf28aebc125c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:52:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-80951f06-3e66-4553-96fb-8b91a1a7d6ee tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] Lock "0ce22ea1-b01c-47c6-b9e4-bf28aebc125c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:52:27 user nova-compute[72129]: INFO nova.compute.manager [None req-80951f06-3e66-4553-96fb-8b91a1a7d6ee tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] [instance: 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c] Terminating instance
Aug 01 13:52:27 user nova-compute[72129]: DEBUG nova.compute.manager [None req-80951f06-3e66-4553-96fb-8b91a1a7d6ee tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] [instance: 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c] Start destroying the instance on the hypervisor. {{(pid=72129) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 13:52:27 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:27 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:27 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:27 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-99d2ebaf-8bf3-49a8-beaa-cb55a52ed991 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Acquiring lock "33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-99d2ebaf-8bf3-49a8-beaa-cb55a52ed991 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Lock "33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:52:28 user nova-compute[72129]: INFO nova.compute.manager [None req-99d2ebaf-8bf3-49a8-beaa-cb55a52ed991 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Attaching volume 43c1b008-ef2f-494c-8ba1-6c55ed0085a5 to /dev/vdb
Aug 01 13:52:28 user nova-compute[72129]: DEBUG os_brick.utils [None req-99d2ebaf-8bf3-49a8-beaa-cb55a52ed991 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8db05d-8b62-493d-baeb-de71e422f1b9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f9b449c2cd3d\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c740c069-d10a-4391-817a-66d01b8a26ac]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c3ae05-37ef-463a-9e1b-2e6ff66020a7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a803a2-9074-461a-a430-ef78362f8efa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-99d2ebaf-8bf3-49a8-beaa-cb55a52ed991 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Running cmd (subprocess): nvme version {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-99d2ebaf-8bf3-49a8-beaa-cb55a52ed991 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] 'nvme version' failed. Not Retrying. {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.nvmeof [None req-99d2ebaf-8bf3-49a8-beaa-cb55a52ed991 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] nvme not present on system {{(pid=72129) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 13:52:28 user nova-compute[72129]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 13:52:28 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[386ba221-67fa-4f97-b0e8-f85468f337bb]: (4, '') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-99d2ebaf-8bf3-49a8-beaa-cb55a52ed991 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72129) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-99d2ebaf-8bf3-49a8-beaa-cb55a52ed991 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-99d2ebaf-8bf3-49a8-beaa-cb55a52ed991 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] LIGHTOS: no hostnqn found. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG os_brick.utils [None req-99d2ebaf-8bf3-49a8-beaa-cb55a52ed991 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f9b449c2cd3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG nova.virt.block_device [None req-99d2ebaf-8bf3-49a8-beaa-cb55a52ed991 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Updating existing volume attachment record: da204189-a94f-41c3-af02-9f520ed53992 {{(pid=72129) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG nova.compute.manager [req-d7240a34-56a7-45e4-bab8-41684bc878c3 req-a6f4efd7-e1c6-4c39-8990-871b50989d1b service nova] [instance: 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c] Received event network-vif-unplugged-9d5e1d9d-528d-460c-9bd0-c35925eba4d5 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-d7240a34-56a7-45e4-bab8-41684bc878c3 req-a6f4efd7-e1c6-4c39-8990-871b50989d1b service nova] Acquiring lock "0ce22ea1-b01c-47c6-b9e4-bf28aebc125c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-d7240a34-56a7-45e4-bab8-41684bc878c3 req-a6f4efd7-e1c6-4c39-8990-871b50989d1b service nova] Lock "0ce22ea1-b01c-47c6-b9e4-bf28aebc125c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-d7240a34-56a7-45e4-bab8-41684bc878c3 req-a6f4efd7-e1c6-4c39-8990-871b50989d1b service nova] Lock "0ce22ea1-b01c-47c6-b9e4-bf28aebc125c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG nova.compute.manager [req-d7240a34-56a7-45e4-bab8-41684bc878c3 req-a6f4efd7-e1c6-4c39-8990-871b50989d1b service nova] [instance: 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c] No waiting events found dispatching network-vif-unplugged-9d5e1d9d-528d-460c-9bd0-c35925eba4d5 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG nova.compute.manager [req-d7240a34-56a7-45e4-bab8-41684bc878c3 req-a6f4efd7-e1c6-4c39-8990-871b50989d1b service nova] [instance: 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c] Received event network-vif-unplugged-9d5e1d9d-528d-460c-9bd0-c35925eba4d5 for instance with task_state deleting. {{(pid=72129) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 13:52:28 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c] Instance destroyed successfully.
Aug 01 13:52:28 user nova-compute[72129]: DEBUG nova.objects.instance [None req-80951f06-3e66-4553-96fb-8b91a1a7d6ee tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] Lazy-loading 'resources' on Instance uuid 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-80951f06-3e66-4553-96fb-8b91a1a7d6ee tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:50:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-687052976',display_name='tempest-VolumesActionsTest-instance-687052976',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-687052976',id=7,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T13:50:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4c98827f5c4643448756c4f155066c4f',ramdisk_id='',reservation_id='r-pnxdvoix',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1598482940',owner_user_name='tempest-VolumesActionsTest-1598482940-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T13:50:34Z,user_data=None,user_id='6a2f94718731466aa9d2b7fad712cee4',uuid=0ce22ea1-b01c-47c6-b9e4-bf28aebc125c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9d5e1d9d-528d-460c-9bd0-c35925eba4d5", "address": "fa:16:3e:95:b4:31", "network": {"id": "645f47df-6143-48ce-880f-38bacfbfd6a8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1771698777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c98827f5c4643448756c4f155066c4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d5e1d9d-52", "ovs_interfaceid": "9d5e1d9d-528d-460c-9bd0-c35925eba4d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-80951f06-3e66-4553-96fb-8b91a1a7d6ee tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] Converting VIF {"id": "9d5e1d9d-528d-460c-9bd0-c35925eba4d5", "address": "fa:16:3e:95:b4:31", "network": {"id": "645f47df-6143-48ce-880f-38bacfbfd6a8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1771698777-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c98827f5c4643448756c4f155066c4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d5e1d9d-52", "ovs_interfaceid": "9d5e1d9d-528d-460c-9bd0-c35925eba4d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-80951f06-3e66-4553-96fb-8b91a1a7d6ee tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:b4:31,bridge_name='br-int',has_traffic_filtering=True,id=9d5e1d9d-528d-460c-9bd0-c35925eba4d5,network=Network(645f47df-6143-48ce-880f-38bacfbfd6a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d5e1d9d-52') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG os_vif [None req-80951f06-3e66-4553-96fb-8b91a1a7d6ee tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:b4:31,bridge_name='br-int',has_traffic_filtering=True,id=9d5e1d9d-528d-460c-9bd0-c35925eba4d5,network=Network(645f47df-6143-48ce-880f-38bacfbfd6a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d5e1d9d-52') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9d5e1d9d-52, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:28 user nova-compute[72129]: INFO os_vif [None req-80951f06-3e66-4553-96fb-8b91a1a7d6ee tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:b4:31,bridge_name='br-int',has_traffic_filtering=True,id=9d5e1d9d-528d-460c-9bd0-c35925eba4d5,network=Network(645f47df-6143-48ce-880f-38bacfbfd6a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d5e1d9d-52')
Aug 01 13:52:28 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-80951f06-3e66-4553-96fb-8b91a1a7d6ee tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] [instance: 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c] Deleting instance files /opt/stack/data/nova/instances/0ce22ea1-b01c-47c6-b9e4-bf28aebc125c_del
Aug 01 13:52:28 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-80951f06-3e66-4553-96fb-8b91a1a7d6ee tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] [instance: 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c] Deletion of /opt/stack/data/nova/instances/0ce22ea1-b01c-47c6-b9e4-bf28aebc125c_del complete
Aug 01 13:52:28 user nova-compute[72129]: INFO nova.compute.manager [None req-80951f06-3e66-4553-96fb-8b91a1a7d6ee tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] [instance: 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c] Took 0.71 seconds to destroy the instance on the hypervisor.
Aug 01 13:52:28 user nova-compute[72129]: DEBUG oslo.service.loopingcall [None req-80951f06-3e66-4553-96fb-8b91a1a7d6ee tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72129) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG nova.compute.manager [-] [instance: 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c] Deallocating network for instance {{(pid=72129) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c] deallocate_for_instance() {{(pid=72129) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46e6e2d7-529b-4a84-9717-9b123f8b46fe tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] Calling os-brick to attach iSCSI Volume {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e6e2d7-529b-4a84-9717-9b123f8b46fe tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b246557a-2729-42fe-9d5c-2cf7e1e4cc5a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RAecvWaV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:52:28 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-46e6e2d7-529b-4a84-9717-9b123f8b46fe tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 13:52:28 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-46e6e2d7-529b-4a84-9717-9b123f8b46fe tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-46e6e2d7-529b-4a84-9717-9b123f8b46fe tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:52:28 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-46e6e2d7-529b-4a84-9717-9b123f8b46fe tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 13:52:28 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-46e6e2d7-529b-4a84-9717-9b123f8b46fe tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b246557a-2729-42fe-9d5c-2cf7e1e4cc5a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-46e6e2d7-529b-4a84-9717-9b123f8b46fe tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b246557a-2729-42fe-9d5c-2cf7e1e4cc5a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:52:28 user nova-compute[72129]: INFO os_brick.initiator.connectors.iscsi [None req-46e6e2d7-529b-4a84-9717-9b123f8b46fe tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 13:52:28 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b246557a-2729-42fe-9d5c-2cf7e1e4cc5a -p 172.16.0.220:3260 {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b246557a-2729-42fe-9d5c-2cf7e1e4cc5a -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ab1b16-cec3-4a41-854b-fbf112d01dc0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e6e2d7-529b-4a84-9717-9b123f8b46fe tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 13:52:28 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b246557a-2729-42fe-9d5c-2cf7e1e4cc5a -p 172.16.0.220:3260 --interface default --op new {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b246557a-2729-42fe-9d5c-2cf7e1e4cc5a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b6ba92-e7ea-4ba2-a311-306374766df1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b246557a-2729-42fe-9d5c-2cf7e1e4cc5a] added\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e6e2d7-529b-4a84-9717-9b123f8b46fe tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b246557a-2729-42fe-9d5c-2cf7e1e4cc5a] added
Aug 01 13:52:28 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b246557a-2729-42fe-9d5c-2cf7e1e4cc5a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b246557a-2729-42fe-9d5c-2cf7e1e4cc5a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[5286e6e7-82d0-4d20-ad66-b90bbe2aece8]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e6e2d7-529b-4a84-9717-9b123f8b46fe tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b246557a-2729-42fe-9d5c-2cf7e1e4cc5a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b246557a-2729-42fe-9d5c-2cf7e1e4cc5a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[abdd58f8-654b-4e6d-bfec-b916a31dc8ba]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e6e2d7-529b-4a84-9717-9b123f8b46fe tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b246557a-2729-42fe-9d5c-2cf7e1e4cc5a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RAecvWaV {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b246557a-2729-42fe-9d5c-2cf7e1e4cc5a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RAecvWaV" returned: 0 in 0.024s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ba57e8-b071-4531-b91c-0df590789187]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e6e2d7-529b-4a84-9717-9b123f8b46fe tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RAecvWaV'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b246557a-2729-42fe-9d5c-2cf7e1e4cc5a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b246557a-2729-42fe-9d5c-2cf7e1e4cc5a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d5e6db-b13a-4a27-bb62-c42c2e831fe0]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e6e2d7-529b-4a84-9717-9b123f8b46fe tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[739d02cb-4ec3-497d-853f-3cb324aa7bee]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e6e2d7-529b-4a84-9717-9b123f8b46fe tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)
Aug 01 13:52:28 user nova-compute[72129]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)
Aug 01 13:52:28 user nova-compute[72129]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)
Aug 01 13:52:28 user nova-compute[72129]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)
Aug 01 13:52:28 user nova-compute[72129]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 (non-flash)
Aug 01 13:52:28 user nova-compute[72129]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 (non-flash)
Aug 01 13:52:28 user nova-compute[72129]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)
Aug 01 13:52:28 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e6e2d7-529b-4a84-9717-9b123f8b46fe tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)
Aug 01 13:52:28 user nova-compute[72129]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)
Aug 01 13:52:28 user nova-compute[72129]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)
Aug 01 13:52:28 user nova-compute[72129]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)
Aug 01 13:52:28 user nova-compute[72129]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 (non-flash)
Aug 01 13:52:28 user nova-compute[72129]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 (non-flash)
Aug 01 13:52:28 user nova-compute[72129]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)
Aug 01 13:52:28 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b246557a-2729-42fe-9d5c-2cf7e1e4cc5a -p 172.16.0.220:3260 --login {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b246557a-2729-42fe-9d5c-2cf7e1e4cc5a -p 172.16.0.220:3260 --login" returned: 0 in 0.100s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[342eba3d-8dce-4cc2-be4b-4507fb72d864]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b246557a-2729-42fe-9d5c-2cf7e1e4cc5a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b246557a-2729-42fe-9d5c-2cf7e1e4cc5a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e6e2d7-529b-4a84-9717-9b123f8b46fe tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b246557a-2729-42fe-9d5c-2cf7e1e4cc5a, portal: 172.16.0.220,3260]
Aug 01 13:52:28 user nova-compute[72129]: Login to [iface: default, target: iqn.2010-10.org.openstack:b246557a-2729-42fe-9d5c-2cf7e1e4cc5a, portal: 172.16.0.220,3260] successful.
Aug 01 13:52:28 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b246557a-2729-42fe-9d5c-2cf7e1e4cc5a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b246557a-2729-42fe-9d5c-2cf7e1e4cc5a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[1928ef9c-91ab-462a-b687-069dab55a52f]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e6e2d7-529b-4a84-9717-9b123f8b46fe tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7431aee-2e61-4999-80a4-3b64d9e1bc1e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b246557a-2729-42fe-9d5c-2cf7e1e4cc5a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e6e2d7-529b-4a84-9717-9b123f8b46fe tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b246557a-2729-42fe-9d5c-2cf7e1e4cc5a (non-flash)
Aug 01 13:52:28 user nova-compute[72129]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)
Aug 01 13:52:28 user nova-compute[72129]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)
Aug 01 13:52:28 user nova-compute[72129]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)
Aug 01 13:52:28 user nova-compute[72129]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)
Aug 01 13:52:28 user nova-compute[72129]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 (non-flash)
Aug 01 13:52:28 user nova-compute[72129]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 (non-flash)
Aug 01 13:52:28 user nova-compute[72129]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)
Aug 01 13:52:28 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e6e2d7-529b-4a84-9717-9b123f8b46fe tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b246557a-2729-42fe-9d5c-2cf7e1e4cc5a (non-flash)
Aug 01 13:52:28 user nova-compute[72129]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)
Aug 01 13:52:28 user nova-compute[72129]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)
Aug 01 13:52:28 user nova-compute[72129]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)
Aug 01 13:52:28 user nova-compute[72129]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)
Aug 01 13:52:28 user nova-compute[72129]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 (non-flash)
Aug 01 13:52:28 user nova-compute[72129]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 (non-flash)
Aug 01 13:52:28 user nova-compute[72129]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)
Aug 01 13:52:28 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-46e6e2d7-529b-4a84-9717-9b123f8b46fe tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b246557a-2729-42fe-9d5c-2cf7e1e4cc5a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.373s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e6e2d7-529b-4a84-9717-9b123f8b46fe tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Connected to 172.16.0.220:3260 {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-46e6e2d7-529b-4a84-9717-9b123f8b46fe tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] HCTL ('40', '-', '-', 0) found on session 11 with lun 0 {{(pid=72129) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-46e6e2d7-529b-4a84-9717-9b123f8b46fe tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=72129) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[84253742-4b0c-42f5-a7c7-c8f8bafaf957]: (4, ('- - 0', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:28 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-46e6e2d7-529b-4a84-9717-9b123f8b46fe tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Searching for a device in session 11 and hctl ['40', '*', '*', 0] yield: None {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 13:52:29 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:52:29 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c] Took 0.69 seconds to deallocate network for instance.
Aug 01 13:52:29 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-80951f06-3e66-4553-96fb-8b91a1a7d6ee tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:52:29 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-80951f06-3e66-4553-96fb-8b91a1a7d6ee tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:52:29 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-80951f06-3e66-4553-96fb-8b91a1a7d6ee tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 13:52:29 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-80951f06-3e66-4553-96fb-8b91a1a7d6ee tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 13:52:29 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-80951f06-3e66-4553-96fb-8b91a1a7d6ee tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.443s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:52:29 user nova-compute[72129]: INFO nova.scheduler.client.report [None req-80951f06-3e66-4553-96fb-8b91a1a7d6ee tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] Deleted allocations for instance 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c
Aug 01 13:52:29 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-80951f06-3e66-4553-96fb-8b91a1a7d6ee tempest-VolumesActionsTest-1598482940 tempest-VolumesActionsTest-1598482940-project-member] Lock "0ce22ea1-b01c-47c6-b9e4-bf28aebc125c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.093s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:52:29 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-46e6e2d7-529b-4a84-9717-9b123f8b46fe tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Searching for a device in session 11 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 13:52:29 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e6e2d7-529b-4a84-9717-9b123f8b46fe tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RAecvWaV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 13:52:29 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-46e6e2d7-529b-4a84-9717-9b123f8b46fe tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.411s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:52:29 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-46e6e2d7-529b-4a84-9717-9b123f8b46fe tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] <== connect_volume: return (1414ms) {'type': 'block', 'scsi_wwn': '23363313265366565', 'path': '/dev/sdi'} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:52:29 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46e6e2d7-529b-4a84-9717-9b123f8b46fe tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363313265366565', 'path': '/dev/sdi'} {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 13:52:29 user nova-compute[72129]: DEBUG nova.objects.instance [None req-46e6e2d7-529b-4a84-9717-9b123f8b46fe tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Lazy-loading 'flavor' on Instance uuid 78b77b93-6f25-447f-80a7-d64374fee14d {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:52:29 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-46e6e2d7-529b-4a84-9717-9b123f8b46fe tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 13:52:29 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 13:52:29 user nova-compute[72129]:   <source dev="/dev/sdi"/>
Aug 01 13:52:29 user nova-compute[72129]:   <target dev="sdc" bus="scsi"/>
Aug 01 13:52:29 user nova-compute[72129]:   <serial>b246557a-2729-42fe-9d5c-2cf7e1e4cc5a</serial>
Aug 01 13:52:29 user nova-compute[72129]:   <address type="drive" controller="0" unit="2"/>
Aug 01 13:52:29 user nova-compute[72129]: </disk>
Aug 01 13:52:29 user nova-compute[72129]:  {{(pid=72129) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 13:52:30 user nova-compute[72129]: DEBUG nova.compute.manager [req-a9c2b43d-d189-4d60-b7b7-3068c16f0f2c req-4986c316-fed7-473b-9f9d-c3c2e060e5f4 service nova] [instance: 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c] Received event network-vif-plugged-9d5e1d9d-528d-460c-9bd0-c35925eba4d5 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:52:30 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-a9c2b43d-d189-4d60-b7b7-3068c16f0f2c req-4986c316-fed7-473b-9f9d-c3c2e060e5f4 service nova] Acquiring lock "0ce22ea1-b01c-47c6-b9e4-bf28aebc125c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:52:30 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-a9c2b43d-d189-4d60-b7b7-3068c16f0f2c req-4986c316-fed7-473b-9f9d-c3c2e060e5f4 service nova] Lock "0ce22ea1-b01c-47c6-b9e4-bf28aebc125c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:52:30 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-a9c2b43d-d189-4d60-b7b7-3068c16f0f2c req-4986c316-fed7-473b-9f9d-c3c2e060e5f4 service nova] Lock "0ce22ea1-b01c-47c6-b9e4-bf28aebc125c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:52:30 user nova-compute[72129]: DEBUG nova.compute.manager [req-a9c2b43d-d189-4d60-b7b7-3068c16f0f2c req-4986c316-fed7-473b-9f9d-c3c2e060e5f4 service nova] [instance: 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c] No waiting events found dispatching network-vif-plugged-9d5e1d9d-528d-460c-9bd0-c35925eba4d5 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:52:30 user nova-compute[72129]: WARNING nova.compute.manager [req-a9c2b43d-d189-4d60-b7b7-3068c16f0f2c req-4986c316-fed7-473b-9f9d-c3c2e060e5f4 service nova] [instance: 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c] Received unexpected event network-vif-plugged-9d5e1d9d-528d-460c-9bd0-c35925eba4d5 for instance with vm_state deleted and task_state None.
Aug 01 13:52:30 user nova-compute[72129]: DEBUG nova.compute.manager [req-a9c2b43d-d189-4d60-b7b7-3068c16f0f2c req-4986c316-fed7-473b-9f9d-c3c2e060e5f4 service nova] [instance: 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c] Received event network-vif-deleted-9d5e1d9d-528d-460c-9bd0-c35925eba4d5 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:52:30 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:30 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-46e6e2d7-529b-4a84-9717-9b123f8b46fe tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] No BDM found with device name sda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 13:52:30 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-46e6e2d7-529b-4a84-9717-9b123f8b46fe tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 13:52:30 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-46e6e2d7-529b-4a84-9717-9b123f8b46fe tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] No BDM found with device name sdc, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 13:52:30 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-46e6e2d7-529b-4a84-9717-9b123f8b46fe tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] No VIF found with MAC fa:16:3e:4c:0e:3b, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 13:52:30 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-46e6e2d7-529b-4a84-9717-9b123f8b46fe tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Lock "78b77b93-6f25-447f-80a7-d64374fee14d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.873s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:52:31 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-df5bd65e-6191-4e17-80af-47181cbcbe29 tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Acquiring lock "78b77b93-6f25-447f-80a7-d64374fee14d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:52:31 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-df5bd65e-6191-4e17-80af-47181cbcbe29 tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Lock "78b77b93-6f25-447f-80a7-d64374fee14d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:52:31 user nova-compute[72129]: INFO nova.compute.manager [None req-df5bd65e-6191-4e17-80af-47181cbcbe29 tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] Detaching volume b246557a-2729-42fe-9d5c-2cf7e1e4cc5a
Aug 01 13:52:31 user nova-compute[72129]: INFO nova.virt.block_device [None req-df5bd65e-6191-4e17-80af-47181cbcbe29 tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] Attempting to driver detach volume b246557a-2729-42fe-9d5c-2cf7e1e4cc5a from mountpoint /dev/sdc
Aug 01 13:52:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-df5bd65e-6191-4e17-80af-47181cbcbe29 tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Attempting to detach device sdc from instance 78b77b93-6f25-447f-80a7-d64374fee14d from the persistent domain config. {{(pid=72129) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 13:52:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-df5bd65e-6191-4e17-80af-47181cbcbe29 tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 13:52:31 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 13:52:31 user nova-compute[72129]:   <source dev="/dev/sdi"/>
Aug 01 13:52:31 user nova-compute[72129]:   <target dev="sdc" bus="scsi"/>
Aug 01 13:52:31 user nova-compute[72129]:   <serial>b246557a-2729-42fe-9d5c-2cf7e1e4cc5a</serial>
Aug 01 13:52:31 user nova-compute[72129]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 01 13:52:31 user nova-compute[72129]: </disk>
Aug 01 13:52:31 user nova-compute[72129]:  {{(pid=72129) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 13:52:31 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-df5bd65e-6191-4e17-80af-47181cbcbe29 tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Successfully detached device sdc from instance 78b77b93-6f25-447f-80a7-d64374fee14d from the persistent domain config.
Aug 01 13:52:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-df5bd65e-6191-4e17-80af-47181cbcbe29 tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 78b77b93-6f25-447f-80a7-d64374fee14d from the live domain config. {{(pid=72129) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 13:52:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-df5bd65e-6191-4e17-80af-47181cbcbe29 tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 13:52:31 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 13:52:31 user nova-compute[72129]:   <source dev="/dev/sdi"/>
Aug 01 13:52:31 user nova-compute[72129]:   <target dev="sdc" bus="scsi"/>
Aug 01 13:52:31 user nova-compute[72129]:   <serial>b246557a-2729-42fe-9d5c-2cf7e1e4cc5a</serial>
Aug 01 13:52:31 user nova-compute[72129]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 01 13:52:31 user nova-compute[72129]: </disk>
Aug 01 13:52:31 user nova-compute[72129]:  {{(pid=72129) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 13:52:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Received event <DeviceRemovedEvent: 1690897951.9899757, 78b77b93-6f25-447f-80a7-d64374fee14d => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72129) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 13:52:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-df5bd65e-6191-4e17-80af-47181cbcbe29 tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 78b77b93-6f25-447f-80a7-d64374fee14d {{(pid=72129) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 13:52:31 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-df5bd65e-6191-4e17-80af-47181cbcbe29 tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Successfully detached device sdc from instance 78b77b93-6f25-447f-80a7-d64374fee14d from the live domain config.
Aug 01 13:52:32 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df5bd65e-6191-4e17-80af-47181cbcbe29 tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] calling os-brick to detach iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 13:52:32 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-df5bd65e-6191-4e17-80af-47181cbcbe29 tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, {'target_iqns': ['iqn.2010-10.org.openstack:b246557a-2729-42fe-9d5c-2cf7e1e4cc5a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RAecvWaV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:52:32 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-df5bd65e-6191-4e17-80af-47181cbcbe29 tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 13:52:32 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-df5bd65e-6191-4e17-80af-47181cbcbe29 tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:52:32 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-df5bd65e-6191-4e17-80af-47181cbcbe29 tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:52:32 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-df5bd65e-6191-4e17-80af-47181cbcbe29 tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b246557a-2729-42fe-9d5c-2cf7e1e4cc5a', 0)] {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 13:52:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:32 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[df117dbe-c7eb-4e12-93df-265cc1f1f873]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b246557a-2729-42fe-9d5c-2cf7e1e4cc5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:32 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fdf3109-6332-4a66-90ec-1bb4c5be0a11]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b246557a-2729-42fe-9d5c-2cf7e1e4cc5a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:32 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-df5bd65e-6191-4e17-80af-47181cbcbe29 tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b246557a-2729-42fe-9d5c-2cf7e1e4cc5a (non-flash)
Aug 01 13:52:32 user nova-compute[72129]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)
Aug 01 13:52:32 user nova-compute[72129]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)
Aug 01 13:52:32 user nova-compute[72129]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)
Aug 01 13:52:32 user nova-compute[72129]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)
Aug 01 13:52:32 user nova-compute[72129]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 (non-flash)
Aug 01 13:52:32 user nova-compute[72129]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 (non-flash)
Aug 01 13:52:32 user nova-compute[72129]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)
Aug 01 13:52:32 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:52:32 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-df5bd65e-6191-4e17-80af-47181cbcbe29 tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b246557a-2729-42fe-9d5c-2cf7e1e4cc5a (non-flash)
Aug 01 13:52:32 user nova-compute[72129]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)
Aug 01 13:52:32 user nova-compute[72129]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)
Aug 01 13:52:32 user nova-compute[72129]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)
Aug 01 13:52:32 user nova-compute[72129]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)
Aug 01 13:52:32 user nova-compute[72129]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 (non-flash)
Aug 01 13:52:32 user nova-compute[72129]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 (non-flash)
Aug 01 13:52:32 user nova-compute[72129]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)
Aug 01 13:52:32 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:52:32 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-df5bd65e-6191-4e17-80af-47181cbcbe29 tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f282811b640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b246557a-2729-42fe-9d5c-2cf7e1e4cc5a'): ({'sdi'}, set())}) {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 13:52:32 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-df5bd65e-6191-4e17-80af-47181cbcbe29 tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Removing single pathed devices sdi {{(pid=72129) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 13:52:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:32 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb42f82-89ff-4ee6-843d-abf5d05aeff8]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.024s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:32 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e54408f-d3ef-461d-b360-e42a923f544c]: (4, ('ok\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:32 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-df5bd65e-6191-4e17-80af-47181cbcbe29 tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Flushing IO for device /dev/sdi {{(pid=72129) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 13:52:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.015s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:32 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf1699e-1f3c-47b1-a117-8b7d8a608110]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:32 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-df5bd65e-6191-4e17-80af-47181cbcbe29 tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=72129) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 13:52:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.048s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:32 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[82692db1-0d4b-4bac-b692-808a480aa5cc]: (4, ('1', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:32 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-df5bd65e-6191-4e17-80af-47181cbcbe29 tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 13:52:32 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-df5bd65e-6191-4e17-80af-47181cbcbe29 tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] SCSI volumes sdi have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 13:52:32 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-df5bd65e-6191-4e17-80af-47181cbcbe29 tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b246557a-2729-42fe-9d5c-2cf7e1e4cc5a')] {{(pid=72129) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 13:52:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b246557a-2729-42fe-9d5c-2cf7e1e4cc5a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b246557a-2729-42fe-9d5c-2cf7e1e4cc5a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:32 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a52e8524-867d-4fce-9a5a-d12709ce3664]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:32 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-df5bd65e-6191-4e17-80af-47181cbcbe29 tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b246557a-2729-42fe-9d5c-2cf7e1e4cc5a -p 172.16.0.220:3260 --logout {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b246557a-2729-42fe-9d5c-2cf7e1e4cc5a -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:32 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb471d86-2603-4146-a3bc-8dba427e2321]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:b246557a-2729-42fe-9d5c-2cf7e1e4cc5a, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:b246557a-2729-42fe-9d5c-2cf7e1e4cc5a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:32 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-df5bd65e-6191-4e17-80af-47181cbcbe29 tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:b246557a-2729-42fe-9d5c-2cf7e1e4cc5a, portal: 172.16.0.220,3260]
Aug 01 13:52:32 user nova-compute[72129]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:b246557a-2729-42fe-9d5c-2cf7e1e4cc5a, portal: 172.16.0.220,3260] successful.
Aug 01 13:52:32 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b246557a-2729-42fe-9d5c-2cf7e1e4cc5a -p 172.16.0.220:3260 --op delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b246557a-2729-42fe-9d5c-2cf7e1e4cc5a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:32 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbde3659-ab17-4042-9532-5cd94f4345ca]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:32 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-df5bd65e-6191-4e17-80af-47181cbcbe29 tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:32 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-df5bd65e-6191-4e17-80af-47181cbcbe29 tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:52:32 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-df5bd65e-6191-4e17-80af-47181cbcbe29 tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] <== disconnect_volume: return (346ms) None {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:52:32 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df5bd65e-6191-4e17-80af-47181cbcbe29 tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] Disconnected iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 13:52:33 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:34 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:52:34 user nova-compute[72129]: DEBUG nova.compute.manager [req-51661f69-f5df-4e3a-86dd-b5afc0592e49 req-502b9ada-2b92-4deb-b5ed-81f90d8235ef service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Received event network-changed-9d03baea-c746-4c97-9661-07d0e2e03291 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:52:34 user nova-compute[72129]: DEBUG nova.compute.manager [req-51661f69-f5df-4e3a-86dd-b5afc0592e49 req-502b9ada-2b92-4deb-b5ed-81f90d8235ef service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Refreshing instance network info cache due to event network-changed-9d03baea-c746-4c97-9661-07d0e2e03291. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 13:52:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-51661f69-f5df-4e3a-86dd-b5afc0592e49 req-502b9ada-2b92-4deb-b5ed-81f90d8235ef service nova] Acquiring lock "refresh_cache-1490f922-a4b0-43be-8826-ab527f66a350" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:52:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-51661f69-f5df-4e3a-86dd-b5afc0592e49 req-502b9ada-2b92-4deb-b5ed-81f90d8235ef service nova] Acquired lock "refresh_cache-1490f922-a4b0-43be-8826-ab527f66a350" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:52:34 user nova-compute[72129]: DEBUG nova.network.neutron [req-51661f69-f5df-4e3a-86dd-b5afc0592e49 req-502b9ada-2b92-4deb-b5ed-81f90d8235ef service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Refreshing network info cache for port 9d03baea-c746-4c97-9661-07d0e2e03291 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 13:52:34 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f497522-80a2-4bb6-9e55-aeea9c4c0108 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Calling os-brick to attach iSCSI Volume {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 13:52:34 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f497522-80a2-4bb6-9e55-aeea9c4c0108 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b1ab9c7e-7cec-4b1c-b1fb-1fbfa40c9f32'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MvAWaoBE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:52:34 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-5f497522-80a2-4bb6-9e55-aeea9c4c0108 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 13:52:34 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-5f497522-80a2-4bb6-9e55-aeea9c4c0108 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:52:34 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-5f497522-80a2-4bb6-9e55-aeea9c4c0108 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:52:34 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-5f497522-80a2-4bb6-9e55-aeea9c4c0108 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 13:52:34 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-5f497522-80a2-4bb6-9e55-aeea9c4c0108 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1ab9c7e-7cec-4b1c-b1fb-1fbfa40c9f32" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:52:34 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-5f497522-80a2-4bb6-9e55-aeea9c4c0108 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1ab9c7e-7cec-4b1c-b1fb-1fbfa40c9f32" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:52:34 user nova-compute[72129]: INFO os_brick.initiator.connectors.iscsi [None req-5f497522-80a2-4bb6-9e55-aeea9c4c0108 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 13:52:34 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ab9c7e-7cec-4b1c-b1fb-1fbfa40c9f32 -p 172.16.0.220:3260 {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:34 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ab9c7e-7cec-4b1c-b1fb-1fbfa40c9f32 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:34 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc0e14b1-e6b9-4022-baf2-ea4a9d7aacff]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:34 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f497522-80a2-4bb6-9e55-aeea9c4c0108 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 13:52:34 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:34 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ab9c7e-7cec-4b1c-b1fb-1fbfa40c9f32 -p 172.16.0.220:3260 --interface default --op new {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:34 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ab9c7e-7cec-4b1c-b1fb-1fbfa40c9f32 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:34 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd505864-bf4c-425b-a8fa-d97daf4da6e0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1ab9c7e-7cec-4b1c-b1fb-1fbfa40c9f32] added\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:34 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f497522-80a2-4bb6-9e55-aeea9c4c0108 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1ab9c7e-7cec-4b1c-b1fb-1fbfa40c9f32] added
Aug 01 13:52:34 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:34 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ab9c7e-7cec-4b1c-b1fb-1fbfa40c9f32 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:34 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ab9c7e-7cec-4b1c-b1fb-1fbfa40c9f32 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:34 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de30bc6-1ae2-4433-aeaf-cfaf6c86ff5a]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:34 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f497522-80a2-4bb6-9e55-aeea9c4c0108 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:34 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ab9c7e-7cec-4b1c-b1fb-1fbfa40c9f32 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:34 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ab9c7e-7cec-4b1c-b1fb-1fbfa40c9f32 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:34 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc57ad42-c32e-446a-8b66-b419c27bdb45]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:34 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f497522-80a2-4bb6-9e55-aeea9c4c0108 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:34 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ab9c7e-7cec-4b1c-b1fb-1fbfa40c9f32 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MvAWaoBE {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:34 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ab9c7e-7cec-4b1c-b1fb-1fbfa40c9f32 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MvAWaoBE" returned: 0 in 0.026s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:34 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c191774f-4c32-4d30-8c5f-4b64a9313956]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:34 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f497522-80a2-4bb6-9e55-aeea9c4c0108 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MvAWaoBE'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:34 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ab9c7e-7cec-4b1c-b1fb-1fbfa40c9f32 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:34 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ab9c7e-7cec-4b1c-b1fb-1fbfa40c9f32 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:34 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad04455c-8a58-44f3-9c70-cb892904bf9e]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:34 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f497522-80a2-4bb6-9e55-aeea9c4c0108 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:34 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:34 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:34 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[572b9706-9cf8-457c-852b-43b382454f37]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:34 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f497522-80a2-4bb6-9e55-aeea9c4c0108 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)
Aug 01 13:52:34 user nova-compute[72129]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)
Aug 01 13:52:34 user nova-compute[72129]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)
Aug 01 13:52:34 user nova-compute[72129]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)
Aug 01 13:52:34 user nova-compute[72129]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 (non-flash)
Aug 01 13:52:34 user nova-compute[72129]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 (non-flash)
Aug 01 13:52:34 user nova-compute[72129]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)
Aug 01 13:52:34 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:52:34 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f497522-80a2-4bb6-9e55-aeea9c4c0108 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)
Aug 01 13:52:34 user nova-compute[72129]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)
Aug 01 13:52:34 user nova-compute[72129]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)
Aug 01 13:52:34 user nova-compute[72129]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)
Aug 01 13:52:34 user nova-compute[72129]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 (non-flash)
Aug 01 13:52:34 user nova-compute[72129]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 (non-flash)
Aug 01 13:52:34 user nova-compute[72129]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)
Aug 01 13:52:34 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:52:34 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ab9c7e-7cec-4b1c-b1fb-1fbfa40c9f32 -p 172.16.0.220:3260 --login {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:34 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ab9c7e-7cec-4b1c-b1fb-1fbfa40c9f32 -p 172.16.0.220:3260 --login" returned: 0 in 0.098s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:34 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d0f2d3-cda4-46ac-82da-27f429e69911]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1ab9c7e-7cec-4b1c-b1fb-1fbfa40c9f32, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b1ab9c7e-7cec-4b1c-b1fb-1fbfa40c9f32, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:34 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f497522-80a2-4bb6-9e55-aeea9c4c0108 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1ab9c7e-7cec-4b1c-b1fb-1fbfa40c9f32, portal: 172.16.0.220,3260]
Aug 01 13:52:34 user nova-compute[72129]: Login to [iface: default, target: iqn.2010-10.org.openstack:b1ab9c7e-7cec-4b1c-b1fb-1fbfa40c9f32, portal: 172.16.0.220,3260] successful.
Aug 01 13:52:34 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:34 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ab9c7e-7cec-4b1c-b1fb-1fbfa40c9f32 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:34 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ab9c7e-7cec-4b1c-b1fb-1fbfa40c9f32 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:34 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[662899a9-fd4c-467d-ab84-8bc058d7b4e1]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:34 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f497522-80a2-4bb6-9e55-aeea9c4c0108 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:34 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:34 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:34 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe3bebf-4b85-40a6-a231-8e47444b52f6]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ab9c7e-7cec-4b1c-b1fb-1fbfa40c9f32 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:34 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f497522-80a2-4bb6-9e55-aeea9c4c0108 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ab9c7e-7cec-4b1c-b1fb-1fbfa40c9f32 (non-flash)
Aug 01 13:52:34 user nova-compute[72129]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)
Aug 01 13:52:34 user nova-compute[72129]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)
Aug 01 13:52:34 user nova-compute[72129]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)
Aug 01 13:52:34 user nova-compute[72129]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)
Aug 01 13:52:34 user nova-compute[72129]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 (non-flash)
Aug 01 13:52:34 user nova-compute[72129]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 (non-flash)
Aug 01 13:52:34 user nova-compute[72129]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)
Aug 01 13:52:34 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:52:34 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f497522-80a2-4bb6-9e55-aeea9c4c0108 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ab9c7e-7cec-4b1c-b1fb-1fbfa40c9f32 (non-flash)
Aug 01 13:52:34 user nova-compute[72129]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)
Aug 01 13:52:34 user nova-compute[72129]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)
Aug 01 13:52:34 user nova-compute[72129]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)
Aug 01 13:52:34 user nova-compute[72129]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)
Aug 01 13:52:34 user nova-compute[72129]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 (non-flash)
Aug 01 13:52:34 user nova-compute[72129]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 (non-flash)
Aug 01 13:52:34 user nova-compute[72129]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)
Aug 01 13:52:34 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:52:34 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-5f497522-80a2-4bb6-9e55-aeea9c4c0108 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1ab9c7e-7cec-4b1c-b1fb-1fbfa40c9f32" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.370s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:52:34 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f497522-80a2-4bb6-9e55-aeea9c4c0108 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Connected to 172.16.0.220:3260 {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 13:52:34 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-5f497522-80a2-4bb6-9e55-aeea9c4c0108 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] HCTL ('40', '-', '-', 0) found on session 12 with lun 0 {{(pid=72129) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 13:52:34 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-5f497522-80a2-4bb6-9e55-aeea9c4c0108 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=72129) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 13:52:34 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:34 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:34 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[49050315-7c55-42a2-bec0-16423ca992b5]: (4, ('- - 0', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:34 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-5f497522-80a2-4bb6-9e55-aeea9c4c0108 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Searching for a device in session 12 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 13:52:34 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f497522-80a2-4bb6-9e55-aeea9c4c0108 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MvAWaoBE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 13:52:35 user nova-compute[72129]: DEBUG nova.network.neutron [req-51661f69-f5df-4e3a-86dd-b5afc0592e49 req-502b9ada-2b92-4deb-b5ed-81f90d8235ef service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Updated VIF entry in instance network info cache for port 9d03baea-c746-4c97-9661-07d0e2e03291. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 13:52:35 user nova-compute[72129]: DEBUG nova.network.neutron [req-51661f69-f5df-4e3a-86dd-b5afc0592e49 req-502b9ada-2b92-4deb-b5ed-81f90d8235ef service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Updating instance_info_cache with network_info: [{"id": "9d03baea-c746-4c97-9661-07d0e2e03291", "address": "fa:16:3e:92:fb:0d", "network": {"id": "9c8a1041-95f3-463f-a449-858dfa63c555", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-88919181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d03baea-c7", "ovs_interfaceid": "9d03baea-c746-4c97-9661-07d0e2e03291", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7ee53caa-f8d2-4ff3-b29f-131d386cbc14", "address": "fa:16:3e:f6:0d:dc", "network": {"id": "5a66b974-bfc2-4121-92e0-4c22ae1e3290", "bridge": "br-int", "label": "tempest-device-tagging-net1-1666088374", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee53caa-f8", "ovs_interfaceid": "7ee53caa-f8d2-4ff3-b29f-131d386cbc14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "13cf26e5-e302-48ae-abeb-d63bbf4c0572", "address": "fa:16:3e:97:83:19", "network": {"id": "5a66b974-bfc2-4121-92e0-4c22ae1e3290", "bridge": "br-int", "label": "tempest-device-tagging-net1-1666088374", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13cf26e5-e3", "ovs_interfaceid": "13cf26e5-e302-48ae-abeb-d63bbf4c0572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "71c06aee-1c23-4a9b-9d91-73cc48cb7c23", "address": "fa:16:3e:98:bf:66", "network": {"id": "5a66b974-bfc2-4121-92e0-4c22ae1e3290", "bridge": "br-int", "label": "tempest-device-tagging-net1-1666088374", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71c06aee-1c", "ovs_interfaceid": "71c06aee-1c23-4a9b-9d91-73cc48cb7c23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "17974af1-27e5-41f4-9c13-31fb31cd6cc2", "address": "fa:16:3e:a1:d7:1f", "network": {"id": "5a66b974-bfc2-4121-92e0-4c22ae1e3290", "bridge": "br-int", "label": "tempest-device-tagging-net1-1666088374", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17974af1-27", "ovs_interfaceid": "17974af1-27e5-41f4-9c13-31fb31cd6cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a3697523-c958-4f9f-92a2-ec52e2ee249b", "address": "fa:16:3e:9f:03:16", "network": {"id": "ce8bea02-998e-4055-9ac6-e226a89f103c", "bridge": "br-int", "label": "tempest-device-tagging-net2-808946084", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3697523-c9", "ovs_interfaceid": "a3697523-c958-4f9f-92a2-ec52e2ee249b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b23e74f7-64a8-466e-840b-0365e486355f", "address": "fa:16:3e:4f:8b:2c", "network": {"id": "ce8bea02-998e-4055-9ac6-e226a89f103c", "bridge": "br-int", "label": "tempest-device-tagging-net2-808946084", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb23e74f7-64", "ovs_interfaceid": "b23e74f7-64a8-466e-840b-0365e486355f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:52:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-51661f69-f5df-4e3a-86dd-b5afc0592e49 req-502b9ada-2b92-4deb-b5ed-81f90d8235ef service nova] Releasing lock "refresh_cache-1490f922-a4b0-43be-8826-ab527f66a350" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:52:35 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:35 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-5f497522-80a2-4bb6-9e55-aeea9c4c0108 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.408s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:52:35 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f497522-80a2-4bb6-9e55-aeea9c4c0108 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] <== connect_volume: return (1410ms) {'type': 'block', 'scsi_wwn': '23833633532396430', 'path': '/dev/sdi'} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:52:35 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f497522-80a2-4bb6-9e55-aeea9c4c0108 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833633532396430', 'path': '/dev/sdi'} {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 13:52:35 user nova-compute[72129]: DEBUG nova.objects.instance [None req-5f497522-80a2-4bb6-9e55-aeea9c4c0108 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Lazy-loading 'flavor' on Instance uuid 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:52:35 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-5f497522-80a2-4bb6-9e55-aeea9c4c0108 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 13:52:35 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 13:52:35 user nova-compute[72129]:   <source dev="/dev/sdi"/>
Aug 01 13:52:35 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 13:52:35 user nova-compute[72129]:   <serial>b1ab9c7e-7cec-4b1c-b1fb-1fbfa40c9f32</serial>
Aug 01 13:52:35 user nova-compute[72129]: </disk>
Aug 01 13:52:35 user nova-compute[72129]:  {{(pid=72129) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 13:52:36 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:52:36 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:52:36 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-5f497522-80a2-4bb6-9e55-aeea9c4c0108 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 13:52:36 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-5f497522-80a2-4bb6-9e55-aeea9c4c0108 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] No BDM found with device name hda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 13:52:36 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-5f497522-80a2-4bb6-9e55-aeea9c4c0108 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] No VIF found with MAC fa:16:3e:58:10:73, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 13:52:36 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5f497522-80a2-4bb6-9e55-aeea9c4c0108 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Lock "3c1f751a-e2aa-4447-b72f-9dc88c4c1a84" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.417s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:52:36 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Acquiring lock "1490f922-a4b0-43be-8826-ab527f66a350" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:52:36 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Lock "1490f922-a4b0-43be-8826-ab527f66a350" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:52:36 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Acquiring lock "1490f922-a4b0-43be-8826-ab527f66a350-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:52:36 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Lock "1490f922-a4b0-43be-8826-ab527f66a350-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:52:36 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Lock "1490f922-a4b0-43be-8826-ab527f66a350-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:52:36 user nova-compute[72129]: INFO nova.compute.manager [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Terminating instance
Aug 01 13:52:36 user nova-compute[72129]: DEBUG nova.compute.manager [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Start destroying the instance on the hypervisor. {{(pid=72129) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 13:52:37 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:52:37 user nova-compute[72129]: DEBUG nova.compute.manager [req-74a175f1-ce00-43a4-b48d-c30b45175828 req-443a4892-0179-48ce-9bac-297668f9c26e service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Received event network-changed-4856f394-91dc-4fd0-9fff-8a45f53f0e01 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:52:37 user nova-compute[72129]: DEBUG nova.compute.manager [req-74a175f1-ce00-43a4-b48d-c30b45175828 req-443a4892-0179-48ce-9bac-297668f9c26e service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Refreshing instance network info cache due to event network-changed-4856f394-91dc-4fd0-9fff-8a45f53f0e01. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 13:52:37 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-74a175f1-ce00-43a4-b48d-c30b45175828 req-443a4892-0179-48ce-9bac-297668f9c26e service nova] Acquiring lock "refresh_cache-e1ee9e5e-0bd8-4986-8641-d44680f97724" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:52:37 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-74a175f1-ce00-43a4-b48d-c30b45175828 req-443a4892-0179-48ce-9bac-297668f9c26e service nova] Acquired lock "refresh_cache-e1ee9e5e-0bd8-4986-8641-d44680f97724" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:52:37 user nova-compute[72129]: DEBUG nova.network.neutron [req-74a175f1-ce00-43a4-b48d-c30b45175828 req-443a4892-0179-48ce-9bac-297668f9c26e service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Refreshing network info cache for port 4856f394-91dc-4fd0-9fff-8a45f53f0e01 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 13:52:37 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:52:37 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:52:37 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72129) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 13:52:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:37 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-bd6ecdf1-bc13-433a-bcc6-9a735726df18 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Acquiring lock "3c1f751a-e2aa-4447-b72f-9dc88c4c1a84" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:52:37 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-bd6ecdf1-bc13-433a-bcc6-9a735726df18 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Lock "3c1f751a-e2aa-4447-b72f-9dc88c4c1a84" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:52:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:37 user nova-compute[72129]: DEBUG nova.compute.manager [req-330f3385-726b-48d2-960f-39aa08ff0c09 req-94e47e34-4f5e-4a83-b324-451bb8182bf0 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Received event network-vif-unplugged-7ee53caa-f8d2-4ff3-b29f-131d386cbc14 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:52:37 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-330f3385-726b-48d2-960f-39aa08ff0c09 req-94e47e34-4f5e-4a83-b324-451bb8182bf0 service nova] Acquiring lock "1490f922-a4b0-43be-8826-ab527f66a350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:52:37 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-330f3385-726b-48d2-960f-39aa08ff0c09 req-94e47e34-4f5e-4a83-b324-451bb8182bf0 service nova] Lock "1490f922-a4b0-43be-8826-ab527f66a350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:52:37 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-330f3385-726b-48d2-960f-39aa08ff0c09 req-94e47e34-4f5e-4a83-b324-451bb8182bf0 service nova] Lock "1490f922-a4b0-43be-8826-ab527f66a350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:52:37 user nova-compute[72129]: DEBUG nova.compute.manager [req-330f3385-726b-48d2-960f-39aa08ff0c09 req-94e47e34-4f5e-4a83-b324-451bb8182bf0 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] No waiting events found dispatching network-vif-unplugged-7ee53caa-f8d2-4ff3-b29f-131d386cbc14 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:52:37 user nova-compute[72129]: DEBUG nova.compute.manager [req-330f3385-726b-48d2-960f-39aa08ff0c09 req-94e47e34-4f5e-4a83-b324-451bb8182bf0 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Received event network-vif-unplugged-7ee53caa-f8d2-4ff3-b29f-131d386cbc14 for instance with task_state deleting. {{(pid=72129) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 13:52:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:37 user nova-compute[72129]: INFO nova.compute.manager [None req-bd6ecdf1-bc13-433a-bcc6-9a735726df18 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Detaching volume b1ab9c7e-7cec-4b1c-b1fb-1fbfa40c9f32
Aug 01 13:52:37 user nova-compute[72129]: INFO nova.virt.block_device [None req-bd6ecdf1-bc13-433a-bcc6-9a735726df18 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Attempting to driver detach volume b1ab9c7e-7cec-4b1c-b1fb-1fbfa40c9f32 from mountpoint /dev/vdb
Aug 01 13:52:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:37 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-bd6ecdf1-bc13-433a-bcc6-9a735726df18 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Attempting to detach device vdb from instance 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84 from the persistent domain config. {{(pid=72129) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 13:52:37 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-bd6ecdf1-bc13-433a-bcc6-9a735726df18 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 13:52:37 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 13:52:37 user nova-compute[72129]:   <source dev="/dev/sdi"/>
Aug 01 13:52:37 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 13:52:37 user nova-compute[72129]:   <serial>b1ab9c7e-7cec-4b1c-b1fb-1fbfa40c9f32</serial>
Aug 01 13:52:37 user nova-compute[72129]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 01 13:52:37 user nova-compute[72129]: </disk>
Aug 01 13:52:37 user nova-compute[72129]:  {{(pid=72129) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 13:52:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:38 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-bd6ecdf1-bc13-433a-bcc6-9a735726df18 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Successfully detached device vdb from instance 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84 from the persistent domain config.
Aug 01 13:52:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-bd6ecdf1-bc13-433a-bcc6-9a735726df18 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84 from the live domain config. {{(pid=72129) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 13:52:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-bd6ecdf1-bc13-433a-bcc6-9a735726df18 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 13:52:38 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 13:52:38 user nova-compute[72129]:   <source dev="/dev/sdi"/>
Aug 01 13:52:38 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 13:52:38 user nova-compute[72129]:   <serial>b1ab9c7e-7cec-4b1c-b1fb-1fbfa40c9f32</serial>
Aug 01 13:52:38 user nova-compute[72129]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 01 13:52:38 user nova-compute[72129]: </disk>
Aug 01 13:52:38 user nova-compute[72129]:  {{(pid=72129) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 13:52:38 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:52:38 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Starting heal instance info cache {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 13:52:38 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:38 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:38 user nova-compute[72129]: DEBUG nova.network.neutron [req-74a175f1-ce00-43a4-b48d-c30b45175828 req-443a4892-0179-48ce-9bac-297668f9c26e service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Updated VIF entry in instance network info cache for port 4856f394-91dc-4fd0-9fff-8a45f53f0e01. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 13:52:38 user nova-compute[72129]: DEBUG nova.network.neutron [req-74a175f1-ce00-43a4-b48d-c30b45175828 req-443a4892-0179-48ce-9bac-297668f9c26e service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Updating instance_info_cache with network_info: [{"id": "4856f394-91dc-4fd0-9fff-8a45f53f0e01", "address": "fa:16:3e:39:15:ba", "network": {"id": "2dfa2891-a873-4a7a-8460-b78ee7a967e1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1716980837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4856f394-91", "ovs_interfaceid": "4856f394-91dc-4fd0-9fff-8a45f53f0e01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3da4a68a-4d20-4f36-bf85-e74a93a6c9f2", "address": "fa:16:3e:3a:cf:74", "network": {"id": "0238d661-fbc1-4955-8933-92891b6a621e", "bridge": "br-int", "label": "tempest-device-tagging-net1-78670494", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3da4a68a-4d", "ovs_interfaceid": "3da4a68a-4d20-4f36-bf85-e74a93a6c9f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c3fc041a-b39f-448a-a5d6-3e2b67368d50", "address": "fa:16:3e:31:e8:5e", "network": {"id": "0238d661-fbc1-4955-8933-92891b6a621e", "bridge": "br-int", "label": "tempest-device-tagging-net1-78670494", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3fc041a-b3", "ovs_interfaceid": "c3fc041a-b39f-448a-a5d6-3e2b67368d50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1a10af43-8f79-43a4-b847-2c4471576097", "address": "fa:16:3e:d9:f3:84", "network": {"id": "0238d661-fbc1-4955-8933-92891b6a621e", "bridge": "br-int", "label": "tempest-device-tagging-net1-78670494", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a10af43-8f", "ovs_interfaceid": "1a10af43-8f79-43a4-b847-2c4471576097", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e4a333bd-6565-4da1-ae2c-4953c3a14f53", "address": "fa:16:3e:06:c9:e4", "network": {"id": "0238d661-fbc1-4955-8933-92891b6a621e", "bridge": "br-int", "label": "tempest-device-tagging-net1-78670494", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4a333bd-65", "ovs_interfaceid": "e4a333bd-6565-4da1-ae2c-4953c3a14f53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e1d5b511-b4c8-4d81-8b78-e58ffdfb3015", "address": "fa:16:3e:e1:69:b3", "network": {"id": "a7073672-c19c-45cb-8549-4c0e25c52255", "bridge": "br-int", "label": "tempest-device-tagging-net2-1432218036", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d5b511-b4", "ovs_interfaceid": "e1d5b511-b4c8-4d81-8b78-e58ffdfb3015", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4bb0a232-3a92-4b85-9a12-29f8d822362e", "address": "fa:16:3e:a2:99:fb", "network": {"id": "a7073672-c19c-45cb-8549-4c0e25c52255", "bridge": "br-int", "label": "tempest-device-tagging-net2-1432218036", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bb0a232-3a", "ovs_interfaceid": "4bb0a232-3a92-4b85-9a12-29f8d822362e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:52:38 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:38 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:38 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "refresh_cache-2efa87a6-1dd6-4441-a55e-8e86be7f0a35" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:52:38 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquired lock "refresh_cache-2efa87a6-1dd6-4441-a55e-8e86be7f0a35" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:52:38 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Forcefully refreshing network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 13:52:38 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-74a175f1-ce00-43a4-b48d-c30b45175828 req-443a4892-0179-48ce-9bac-297668f9c26e service nova] Releasing lock "refresh_cache-e1ee9e5e-0bd8-4986-8641-d44680f97724" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:52:38 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99d2ebaf-8bf3-49a8-beaa-cb55a52ed991 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Calling os-brick to attach iSCSI Volume {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 13:52:38 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d2ebaf-8bf3-49a8-beaa-cb55a52ed991 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wpUkcKQv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:52:38 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-99d2ebaf-8bf3-49a8-beaa-cb55a52ed991 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 13:52:38 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-99d2ebaf-8bf3-49a8-beaa-cb55a52ed991 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:52:38 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-99d2ebaf-8bf3-49a8-beaa-cb55a52ed991 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:52:38 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-99d2ebaf-8bf3-49a8-beaa-cb55a52ed991 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 13:52:38 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-99d2ebaf-8bf3-49a8-beaa-cb55a52ed991 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:52:38 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-99d2ebaf-8bf3-49a8-beaa-cb55a52ed991 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:52:38 user nova-compute[72129]: INFO os_brick.initiator.connectors.iscsi [None req-99d2ebaf-8bf3-49a8-beaa-cb55a52ed991 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 13:52:38 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:38 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 -p 172.16.0.220:3260 {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:38 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:38 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08c3923-4815-4406-8fd3-8071ddb216be]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:38 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d2ebaf-8bf3-49a8-beaa-cb55a52ed991 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 13:52:38 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:38 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 -p 172.16.0.220:3260 --interface default --op new {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:38 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:38 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa449b91-7605-4b2b-9821-6c7951dbb008]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5] added\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:38 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d2ebaf-8bf3-49a8-beaa-cb55a52ed991 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5] added
Aug 01 13:52:38 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:38 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:38 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:38 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:38 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ff4cbd-b284-427e-918c-c9f6342087f9]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:38 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d2ebaf-8bf3-49a8-beaa-cb55a52ed991 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:38 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:38 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:38 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec790e7-2319-458d-838b-0aa178ca11c5]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:38 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d2ebaf-8bf3-49a8-beaa-cb55a52ed991 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:38 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wpUkcKQv {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:38 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wpUkcKQv" returned: 0 in 0.040s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:38 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b42360-013f-4698-94a2-9b570fb21db1]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:38 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d2ebaf-8bf3-49a8-beaa-cb55a52ed991 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wpUkcKQv'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:38 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:38 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:38 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.046s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:38 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[1061e1fc-5e33-48fe-886b-3af1457ed82d]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:38 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d2ebaf-8bf3-49a8-beaa-cb55a52ed991 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:38 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:38 user nova-compute[72129]: DEBUG nova.objects.instance [None req-df5bd65e-6191-4e17-80af-47181cbcbe29 tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Lazy-loading 'flavor' on Instance uuid 78b77b93-6f25-447f-80a7-d64374fee14d {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:52:38 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.114s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:38 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e93ea3b-d131-4d6d-af3c-6fc05c45ecbb]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ab9c7e-7cec-4b1c-b1fb-1fbfa40c9f32 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:38 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d2ebaf-8bf3-49a8-beaa-cb55a52ed991 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ab9c7e-7cec-4b1c-b1fb-1fbfa40c9f32 (non-flash)
Aug 01 13:52:38 user nova-compute[72129]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)
Aug 01 13:52:38 user nova-compute[72129]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)
Aug 01 13:52:38 user nova-compute[72129]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)
Aug 01 13:52:38 user nova-compute[72129]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)
Aug 01 13:52:38 user nova-compute[72129]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 (non-flash)
Aug 01 13:52:38 user nova-compute[72129]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 (non-flash)
Aug 01 13:52:38 user nova-compute[72129]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)
Aug 01 13:52:38 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:52:38 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d2ebaf-8bf3-49a8-beaa-cb55a52ed991 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ab9c7e-7cec-4b1c-b1fb-1fbfa40c9f32 (non-flash)
Aug 01 13:52:38 user nova-compute[72129]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)
Aug 01 13:52:38 user nova-compute[72129]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)
Aug 01 13:52:38 user nova-compute[72129]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)
Aug 01 13:52:38 user nova-compute[72129]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)
Aug 01 13:52:38 user nova-compute[72129]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 (non-flash)
Aug 01 13:52:38 user nova-compute[72129]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 (non-flash)
Aug 01 13:52:38 user nova-compute[72129]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)
Aug 01 13:52:38 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:52:38 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 -p 172.16.0.220:3260 --login {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Received event <DeviceRemovedEvent: 1690897958.892809, 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72129) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 13:52:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-bd6ecdf1-bc13-433a-bcc6-9a735726df18 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84 {{(pid=72129) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 13:52:38 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-df5bd65e-6191-4e17-80af-47181cbcbe29 tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Lock "78b77b93-6f25-447f-80a7-d64374fee14d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 7.435s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:52:38 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-bd6ecdf1-bc13-433a-bcc6-9a735726df18 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Successfully detached device vdb from instance 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84 from the live domain config.
Aug 01 13:52:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd6ecdf1-bc13-433a-bcc6-9a735726df18 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] calling os-brick to detach iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 13:52:38 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd6ecdf1-bc13-433a-bcc6-9a735726df18 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, {'target_iqns': ['iqn.2010-10.org.openstack:b1ab9c7e-7cec-4b1c-b1fb-1fbfa40c9f32'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MvAWaoBE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:52:38 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-bd6ecdf1-bc13-433a-bcc6-9a735726df18 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 13:52:38 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-bd6ecdf1-bc13-433a-bcc6-9a735726df18 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:52:38 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 -p 172.16.0.220:3260 --login" returned: 0 in 0.123s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce67a7e-ae2c-434c-94d8-f4a02951b62a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d2ebaf-8bf3-49a8-beaa-cb55a52ed991 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5, portal: 172.16.0.220,3260]
Aug 01 13:52:39 user nova-compute[72129]: Login to [iface: default, target: iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5, portal: 172.16.0.220,3260] successful.
Aug 01 13:52:39 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[57287015-48ce-4056-907c-ef26fff2319a]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d2ebaf-8bf3-49a8-beaa-cb55a52ed991 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:39 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Instance destroyed successfully.
Aug 01 13:52:39 user nova-compute[72129]: DEBUG nova.objects.instance [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Lazy-loading 'resources' on Instance uuid 1490f922-a4b0-43be-8826-ab527f66a350 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T13:50:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1928450351',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1928450351',id=10,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtHDuqy+Nzk7emhGVzyG8Atlb399fl8z1ienNkLDirkAyqlRTHVGlJWt3v5Ylsze6Lfcjp3h4DkXA64Z4aXGVM7KBd/eKPTCqWIQv8vR8ce9fDSbLU6nYkdK54CW21tJw==',key_name='tempest-keypair-1892312772',keypairs=<?>,launch_index=0,launched_at=2023-08-01T13:51:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='12210d07b1b040b192bdbf59bf952a8b',ramdisk_id='',reservation_id='r-go2wk8ji',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1903474152',owner_user_name='tempest-TaggedBootDevicesTest_v242-1903474152-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T13:51:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4057f22dc0c4e3dbdc55a6a0decebd8',uuid=1490f922-a4b0-43be-8826-ab527f66a350,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9d03baea-c746-4c97-9661-07d0e2e03291", "address": "fa:16:3e:92:fb:0d", "network": {"id": "9c8a1041-95f3-463f-a449-858dfa63c555", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-88919181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d03baea-c7", "ovs_interfaceid": "9d03baea-c746-4c97-9661-07d0e2e03291", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Converting VIF {"id": "9d03baea-c746-4c97-9661-07d0e2e03291", "address": "fa:16:3e:92:fb:0d", "network": {"id": "9c8a1041-95f3-463f-a449-858dfa63c555", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-88919181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d03baea-c7", "ovs_interfaceid": "9d03baea-c746-4c97-9661-07d0e2e03291", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:fb:0d,bridge_name='br-int',has_traffic_filtering=True,id=9d03baea-c746-4c97-9661-07d0e2e03291,network=Network(9c8a1041-95f3-463f-a449-858dfa63c555),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d03baea-c7') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG os_vif [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:fb:0d,bridge_name='br-int',has_traffic_filtering=True,id=9d03baea-c746-4c97-9661-07d0e2e03291,network=Network(9c8a1041-95f3-463f-a449-858dfa63c555),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d03baea-c7') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a20d78-e948-40dc-8e1a-32a235daca48]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ab9c7e-7cec-4b1c-b1fb-1fbfa40c9f32 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d2ebaf-8bf3-49a8-beaa-cb55a52ed991 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ab9c7e-7cec-4b1c-b1fb-1fbfa40c9f32 (non-flash)
Aug 01 13:52:39 user nova-compute[72129]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 (non-flash)
Aug 01 13:52:39 user nova-compute[72129]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)
Aug 01 13:52:39 user nova-compute[72129]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)
Aug 01 13:52:39 user nova-compute[72129]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)
Aug 01 13:52:39 user nova-compute[72129]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)
Aug 01 13:52:39 user nova-compute[72129]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 (non-flash)
Aug 01 13:52:39 user nova-compute[72129]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 (non-flash)
Aug 01 13:52:39 user nova-compute[72129]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)
Aug 01 13:52:39 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d2ebaf-8bf3-49a8-beaa-cb55a52ed991 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ab9c7e-7cec-4b1c-b1fb-1fbfa40c9f32 (non-flash)
Aug 01 13:52:39 user nova-compute[72129]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 (non-flash)
Aug 01 13:52:39 user nova-compute[72129]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)
Aug 01 13:52:39 user nova-compute[72129]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)
Aug 01 13:52:39 user nova-compute[72129]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)
Aug 01 13:52:39 user nova-compute[72129]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)
Aug 01 13:52:39 user nova-compute[72129]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 (non-flash)
Aug 01 13:52:39 user nova-compute[72129]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 (non-flash)
Aug 01 13:52:39 user nova-compute[72129]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)
Aug 01 13:52:39 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-99d2ebaf-8bf3-49a8-beaa-cb55a52ed991 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.586s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d2ebaf-8bf3-49a8-beaa-cb55a52ed991 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Connected to 172.16.0.220:3260 {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-99d2ebaf-8bf3-49a8-beaa-cb55a52ed991 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] HCTL ('41', '-', '-', 0) found on session 13 with lun 0 {{(pid=72129) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-99d2ebaf-8bf3-49a8-beaa-cb55a52ed991 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=72129) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9d03baea-c7, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG nova.compute.manager [req-f3aa4700-0445-4047-9384-5380fe3f209e req-3710afb4-aba4-4bb4-a827-b88442f32521 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Received event network-vif-unplugged-9d03baea-c746-4c97-9661-07d0e2e03291 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f3aa4700-0445-4047-9384-5380fe3f209e req-3710afb4-aba4-4bb4-a827-b88442f32521 service nova] Acquiring lock "1490f922-a4b0-43be-8826-ab527f66a350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f3aa4700-0445-4047-9384-5380fe3f209e req-3710afb4-aba4-4bb4-a827-b88442f32521 service nova] Lock "1490f922-a4b0-43be-8826-ab527f66a350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f3aa4700-0445-4047-9384-5380fe3f209e req-3710afb4-aba4-4bb4-a827-b88442f32521 service nova] Lock "1490f922-a4b0-43be-8826-ab527f66a350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG nova.compute.manager [req-f3aa4700-0445-4047-9384-5380fe3f209e req-3710afb4-aba4-4bb4-a827-b88442f32521 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] No waiting events found dispatching network-vif-unplugged-9d03baea-c746-4c97-9661-07d0e2e03291 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG nova.compute.manager [req-f3aa4700-0445-4047-9384-5380fe3f209e req-3710afb4-aba4-4bb4-a827-b88442f32521 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Received event network-vif-unplugged-9d03baea-c746-4c97-9661-07d0e2e03291 for instance with task_state deleting. {{(pid=72129) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG nova.compute.manager [req-f3aa4700-0445-4047-9384-5380fe3f209e req-3710afb4-aba4-4bb4-a827-b88442f32521 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Received event network-vif-plugged-9d03baea-c746-4c97-9661-07d0e2e03291 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f3aa4700-0445-4047-9384-5380fe3f209e req-3710afb4-aba4-4bb4-a827-b88442f32521 service nova] Acquiring lock "1490f922-a4b0-43be-8826-ab527f66a350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f3aa4700-0445-4047-9384-5380fe3f209e req-3710afb4-aba4-4bb4-a827-b88442f32521 service nova] Lock "1490f922-a4b0-43be-8826-ab527f66a350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f3aa4700-0445-4047-9384-5380fe3f209e req-3710afb4-aba4-4bb4-a827-b88442f32521 service nova] Lock "1490f922-a4b0-43be-8826-ab527f66a350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG nova.compute.manager [req-f3aa4700-0445-4047-9384-5380fe3f209e req-3710afb4-aba4-4bb4-a827-b88442f32521 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] No waiting events found dispatching network-vif-plugged-9d03baea-c746-4c97-9661-07d0e2e03291 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:52:39 user nova-compute[72129]: WARNING nova.compute.manager [req-f3aa4700-0445-4047-9384-5380fe3f209e req-3710afb4-aba4-4bb4-a827-b88442f32521 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Received unexpected event network-vif-plugged-9d03baea-c746-4c97-9661-07d0e2e03291 for instance with vm_state active and task_state deleting.
Aug 01 13:52:39 user nova-compute[72129]: DEBUG nova.compute.manager [req-f3aa4700-0445-4047-9384-5380fe3f209e req-3710afb4-aba4-4bb4-a827-b88442f32521 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Received event network-vif-unplugged-13cf26e5-e302-48ae-abeb-d63bbf4c0572 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f3aa4700-0445-4047-9384-5380fe3f209e req-3710afb4-aba4-4bb4-a827-b88442f32521 service nova] Acquiring lock "1490f922-a4b0-43be-8826-ab527f66a350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f3aa4700-0445-4047-9384-5380fe3f209e req-3710afb4-aba4-4bb4-a827-b88442f32521 service nova] Lock "1490f922-a4b0-43be-8826-ab527f66a350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f3aa4700-0445-4047-9384-5380fe3f209e req-3710afb4-aba4-4bb4-a827-b88442f32521 service nova] Lock "1490f922-a4b0-43be-8826-ab527f66a350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG nova.compute.manager [req-f3aa4700-0445-4047-9384-5380fe3f209e req-3710afb4-aba4-4bb4-a827-b88442f32521 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] No waiting events found dispatching network-vif-unplugged-13cf26e5-e302-48ae-abeb-d63bbf4c0572 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG nova.compute.manager [req-f3aa4700-0445-4047-9384-5380fe3f209e req-3710afb4-aba4-4bb4-a827-b88442f32521 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Received event network-vif-unplugged-13cf26e5-e302-48ae-abeb-d63bbf4c0572 for instance with task_state deleting. {{(pid=72129) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG nova.compute.manager [req-f3aa4700-0445-4047-9384-5380fe3f209e req-3710afb4-aba4-4bb4-a827-b88442f32521 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Received event network-vif-plugged-13cf26e5-e302-48ae-abeb-d63bbf4c0572 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f3aa4700-0445-4047-9384-5380fe3f209e req-3710afb4-aba4-4bb4-a827-b88442f32521 service nova] Acquiring lock "1490f922-a4b0-43be-8826-ab527f66a350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f3aa4700-0445-4047-9384-5380fe3f209e req-3710afb4-aba4-4bb4-a827-b88442f32521 service nova] Lock "1490f922-a4b0-43be-8826-ab527f66a350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f3aa4700-0445-4047-9384-5380fe3f209e req-3710afb4-aba4-4bb4-a827-b88442f32521 service nova] Lock "1490f922-a4b0-43be-8826-ab527f66a350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG nova.compute.manager [req-f3aa4700-0445-4047-9384-5380fe3f209e req-3710afb4-aba4-4bb4-a827-b88442f32521 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] No waiting events found dispatching network-vif-plugged-13cf26e5-e302-48ae-abeb-d63bbf4c0572 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:52:39 user nova-compute[72129]: WARNING nova.compute.manager [req-f3aa4700-0445-4047-9384-5380fe3f209e req-3710afb4-aba4-4bb4-a827-b88442f32521 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Received unexpected event network-vif-plugged-13cf26e5-e302-48ae-abeb-d63bbf4c0572 for instance with vm_state active and task_state deleting.
Aug 01 13:52:39 user nova-compute[72129]: DEBUG nova.compute.manager [req-f3aa4700-0445-4047-9384-5380fe3f209e req-3710afb4-aba4-4bb4-a827-b88442f32521 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Received event network-vif-unplugged-17974af1-27e5-41f4-9c13-31fb31cd6cc2 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f3aa4700-0445-4047-9384-5380fe3f209e req-3710afb4-aba4-4bb4-a827-b88442f32521 service nova] Acquiring lock "1490f922-a4b0-43be-8826-ab527f66a350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f3aa4700-0445-4047-9384-5380fe3f209e req-3710afb4-aba4-4bb4-a827-b88442f32521 service nova] Lock "1490f922-a4b0-43be-8826-ab527f66a350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f3aa4700-0445-4047-9384-5380fe3f209e req-3710afb4-aba4-4bb4-a827-b88442f32521 service nova] Lock "1490f922-a4b0-43be-8826-ab527f66a350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG nova.compute.manager [req-f3aa4700-0445-4047-9384-5380fe3f209e req-3710afb4-aba4-4bb4-a827-b88442f32521 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] No waiting events found dispatching network-vif-unplugged-17974af1-27e5-41f4-9c13-31fb31cd6cc2 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG nova.compute.manager [req-f3aa4700-0445-4047-9384-5380fe3f209e req-3710afb4-aba4-4bb4-a827-b88442f32521 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Received event network-vif-unplugged-17974af1-27e5-41f4-9c13-31fb31cd6cc2 for instance with task_state deleting. {{(pid=72129) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6bb3800-021b-4924-b3ae-1fb00732856b]: (4, ('- - 0', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-99d2ebaf-8bf3-49a8-beaa-cb55a52ed991 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Searching for a device in session 13 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d2ebaf-8bf3-49a8-beaa-cb55a52ed991 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wpUkcKQv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:39 user nova-compute[72129]: INFO os_vif [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:fb:0d,bridge_name='br-int',has_traffic_filtering=True,id=9d03baea-c746-4c97-9661-07d0e2e03291,network=Network(9c8a1041-95f3-463f-a449-858dfa63c555),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d03baea-c7')
Aug 01 13:52:39 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T13:50:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1928450351',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1928450351',id=10,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtHDuqy+Nzk7emhGVzyG8Atlb399fl8z1ienNkLDirkAyqlRTHVGlJWt3v5Ylsze6Lfcjp3h4DkXA64Z4aXGVM7KBd/eKPTCqWIQv8vR8ce9fDSbLU6nYkdK54CW21tJw==',key_name='tempest-keypair-1892312772',keypairs=<?>,launch_index=0,launched_at=2023-08-01T13:51:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='12210d07b1b040b192bdbf59bf952a8b',ramdisk_id='',reservation_id='r-go2wk8ji',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1903474152',owner_user_name='tempest-TaggedBootDevicesTest_v242-1903474152-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T13:51:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4057f22dc0c4e3dbdc55a6a0decebd8',uuid=1490f922-a4b0-43be-8826-ab527f66a350,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7ee53caa-f8d2-4ff3-b29f-131d386cbc14", "address": "fa:16:3e:f6:0d:dc", "network": {"id": "5a66b974-bfc2-4121-92e0-4c22ae1e3290", "bridge": "br-int", "label": "tempest-device-tagging-net1-1666088374", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee53caa-f8", "ovs_interfaceid": "7ee53caa-f8d2-4ff3-b29f-131d386cbc14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Converting VIF {"id": "7ee53caa-f8d2-4ff3-b29f-131d386cbc14", "address": "fa:16:3e:f6:0d:dc", "network": {"id": "5a66b974-bfc2-4121-92e0-4c22ae1e3290", "bridge": "br-int", "label": "tempest-device-tagging-net1-1666088374", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee53caa-f8", "ovs_interfaceid": "7ee53caa-f8d2-4ff3-b29f-131d386cbc14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:0d:dc,bridge_name='br-int',has_traffic_filtering=True,id=7ee53caa-f8d2-4ff3-b29f-131d386cbc14,network=Network(5a66b974-bfc2-4121-92e0-4c22ae1e3290),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7ee53caa-f8') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG os_vif [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:0d:dc,bridge_name='br-int',has_traffic_filtering=True,id=7ee53caa-f8d2-4ff3-b29f-131d386cbc14,network=Network(5a66b974-bfc2-4121-92e0-4c22ae1e3290),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7ee53caa-f8') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7ee53caa-f8, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:39 user nova-compute[72129]: INFO os_vif [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:0d:dc,bridge_name='br-int',has_traffic_filtering=True,id=7ee53caa-f8d2-4ff3-b29f-131d386cbc14,network=Network(5a66b974-bfc2-4121-92e0-4c22ae1e3290),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7ee53caa-f8')
Aug 01 13:52:39 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T13:50:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1928450351',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1928450351',id=10,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtHDuqy+Nzk7emhGVzyG8Atlb399fl8z1ienNkLDirkAyqlRTHVGlJWt3v5Ylsze6Lfcjp3h4DkXA64Z4aXGVM7KBd/eKPTCqWIQv8vR8ce9fDSbLU6nYkdK54CW21tJw==',key_name='tempest-keypair-1892312772',keypairs=<?>,launch_index=0,launched_at=2023-08-01T13:51:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='12210d07b1b040b192bdbf59bf952a8b',ramdisk_id='',reservation_id='r-go2wk8ji',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1903474152',owner_user_name='tempest-TaggedBootDevicesTest_v242-1903474152-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T13:51:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4057f22dc0c4e3dbdc55a6a0decebd8',uuid=1490f922-a4b0-43be-8826-ab527f66a350,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "13cf26e5-e302-48ae-abeb-d63bbf4c0572", "address": "fa:16:3e:97:83:19", "network": {"id": "5a66b974-bfc2-4121-92e0-4c22ae1e3290", "bridge": "br-int", "label": "tempest-device-tagging-net1-1666088374", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13cf26e5-e3", "ovs_interfaceid": "13cf26e5-e302-48ae-abeb-d63bbf4c0572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Converting VIF {"id": "13cf26e5-e302-48ae-abeb-d63bbf4c0572", "address": "fa:16:3e:97:83:19", "network": {"id": "5a66b974-bfc2-4121-92e0-4c22ae1e3290", "bridge": "br-int", "label": "tempest-device-tagging-net1-1666088374", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13cf26e5-e3", "ovs_interfaceid": "13cf26e5-e302-48ae-abeb-d63bbf4c0572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:83:19,bridge_name='br-int',has_traffic_filtering=True,id=13cf26e5-e302-48ae-abeb-d63bbf4c0572,network=Network(5a66b974-bfc2-4121-92e0-4c22ae1e3290),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap13cf26e5-e3') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG os_vif [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:83:19,bridge_name='br-int',has_traffic_filtering=True,id=13cf26e5-e302-48ae-abeb-d63bbf4c0572,network=Network(5a66b974-bfc2-4121-92e0-4c22ae1e3290),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap13cf26e5-e3') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap13cf26e5-e3, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:39 user nova-compute[72129]: INFO os_vif [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:83:19,bridge_name='br-int',has_traffic_filtering=True,id=13cf26e5-e302-48ae-abeb-d63bbf4c0572,network=Network(5a66b974-bfc2-4121-92e0-4c22ae1e3290),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap13cf26e5-e3')
Aug 01 13:52:39 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T13:50:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1928450351',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1928450351',id=10,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtHDuqy+Nzk7emhGVzyG8Atlb399fl8z1ienNkLDirkAyqlRTHVGlJWt3v5Ylsze6Lfcjp3h4DkXA64Z4aXGVM7KBd/eKPTCqWIQv8vR8ce9fDSbLU6nYkdK54CW21tJw==',key_name='tempest-keypair-1892312772',keypairs=<?>,launch_index=0,launched_at=2023-08-01T13:51:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='12210d07b1b040b192bdbf59bf952a8b',ramdisk_id='',reservation_id='r-go2wk8ji',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1903474152',owner_user_name='tempest-TaggedBootDevicesTest_v242-1903474152-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T13:51:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4057f22dc0c4e3dbdc55a6a0decebd8',uuid=1490f922-a4b0-43be-8826-ab527f66a350,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "71c06aee-1c23-4a9b-9d91-73cc48cb7c23", "address": "fa:16:3e:98:bf:66", "network": {"id": "5a66b974-bfc2-4121-92e0-4c22ae1e3290", "bridge": "br-int", "label": "tempest-device-tagging-net1-1666088374", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71c06aee-1c", "ovs_interfaceid": "71c06aee-1c23-4a9b-9d91-73cc48cb7c23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Converting VIF {"id": "71c06aee-1c23-4a9b-9d91-73cc48cb7c23", "address": "fa:16:3e:98:bf:66", "network": {"id": "5a66b974-bfc2-4121-92e0-4c22ae1e3290", "bridge": "br-int", "label": "tempest-device-tagging-net1-1666088374", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71c06aee-1c", "ovs_interfaceid": "71c06aee-1c23-4a9b-9d91-73cc48cb7c23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:bf:66,bridge_name='br-int',has_traffic_filtering=True,id=71c06aee-1c23-4a9b-9d91-73cc48cb7c23,network=Network(5a66b974-bfc2-4121-92e0-4c22ae1e3290),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71c06aee-1c') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG os_vif [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:bf:66,bridge_name='br-int',has_traffic_filtering=True,id=71c06aee-1c23-4a9b-9d91-73cc48cb7c23,network=Network(5a66b974-bfc2-4121-92e0-4c22ae1e3290),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71c06aee-1c') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap71c06aee-1c, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:39 user nova-compute[72129]: INFO os_vif [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:bf:66,bridge_name='br-int',has_traffic_filtering=True,id=71c06aee-1c23-4a9b-9d91-73cc48cb7c23,network=Network(5a66b974-bfc2-4121-92e0-4c22ae1e3290),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71c06aee-1c')
Aug 01 13:52:39 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T13:50:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1928450351',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1928450351',id=10,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtHDuqy+Nzk7emhGVzyG8Atlb399fl8z1ienNkLDirkAyqlRTHVGlJWt3v5Ylsze6Lfcjp3h4DkXA64Z4aXGVM7KBd/eKPTCqWIQv8vR8ce9fDSbLU6nYkdK54CW21tJw==',key_name='tempest-keypair-1892312772',keypairs=<?>,launch_index=0,launched_at=2023-08-01T13:51:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='12210d07b1b040b192bdbf59bf952a8b',ramdisk_id='',reservation_id='r-go2wk8ji',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1903474152',owner_user_name='tempest-TaggedBootDevicesTest_v242-1903474152-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T13:51:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4057f22dc0c4e3dbdc55a6a0decebd8',uuid=1490f922-a4b0-43be-8826-ab527f66a350,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "17974af1-27e5-41f4-9c13-31fb31cd6cc2", "address": "fa:16:3e:a1:d7:1f", "network": {"id": "5a66b974-bfc2-4121-92e0-4c22ae1e3290", "bridge": "br-int", "label": "tempest-device-tagging-net1-1666088374", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17974af1-27", "ovs_interfaceid": "17974af1-27e5-41f4-9c13-31fb31cd6cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Converting VIF {"id": "17974af1-27e5-41f4-9c13-31fb31cd6cc2", "address": "fa:16:3e:a1:d7:1f", "network": {"id": "5a66b974-bfc2-4121-92e0-4c22ae1e3290", "bridge": "br-int", "label": "tempest-device-tagging-net1-1666088374", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17974af1-27", "ovs_interfaceid": "17974af1-27e5-41f4-9c13-31fb31cd6cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:d7:1f,bridge_name='br-int',has_traffic_filtering=True,id=17974af1-27e5-41f4-9c13-31fb31cd6cc2,network=Network(5a66b974-bfc2-4121-92e0-4c22ae1e3290),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17974af1-27') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG os_vif [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:d7:1f,bridge_name='br-int',has_traffic_filtering=True,id=17974af1-27e5-41f4-9c13-31fb31cd6cc2,network=Network(5a66b974-bfc2-4121-92e0-4c22ae1e3290),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17974af1-27') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap17974af1-27, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:39 user nova-compute[72129]: INFO os_vif [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:d7:1f,bridge_name='br-int',has_traffic_filtering=True,id=17974af1-27e5-41f4-9c13-31fb31cd6cc2,network=Network(5a66b974-bfc2-4121-92e0-4c22ae1e3290),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17974af1-27')
Aug 01 13:52:39 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T13:50:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1928450351',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1928450351',id=10,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtHDuqy+Nzk7emhGVzyG8Atlb399fl8z1ienNkLDirkAyqlRTHVGlJWt3v5Ylsze6Lfcjp3h4DkXA64Z4aXGVM7KBd/eKPTCqWIQv8vR8ce9fDSbLU6nYkdK54CW21tJw==',key_name='tempest-keypair-1892312772',keypairs=<?>,launch_index=0,launched_at=2023-08-01T13:51:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='12210d07b1b040b192bdbf59bf952a8b',ramdisk_id='',reservation_id='r-go2wk8ji',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1903474152',owner_user_name='tempest-TaggedBootDevicesTest_v242-1903474152-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T13:51:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4057f22dc0c4e3dbdc55a6a0decebd8',uuid=1490f922-a4b0-43be-8826-ab527f66a350,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a3697523-c958-4f9f-92a2-ec52e2ee249b", "address": "fa:16:3e:9f:03:16", "network": {"id": "ce8bea02-998e-4055-9ac6-e226a89f103c", "bridge": "br-int", "label": "tempest-device-tagging-net2-808946084", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3697523-c9", "ovs_interfaceid": "a3697523-c958-4f9f-92a2-ec52e2ee249b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Converting VIF {"id": "a3697523-c958-4f9f-92a2-ec52e2ee249b", "address": "fa:16:3e:9f:03:16", "network": {"id": "ce8bea02-998e-4055-9ac6-e226a89f103c", "bridge": "br-int", "label": "tempest-device-tagging-net2-808946084", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3697523-c9", "ovs_interfaceid": "a3697523-c958-4f9f-92a2-ec52e2ee249b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:03:16,bridge_name='br-int',has_traffic_filtering=True,id=a3697523-c958-4f9f-92a2-ec52e2ee249b,network=Network(ce8bea02-998e-4055-9ac6-e226a89f103c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3697523-c9') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG os_vif [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:03:16,bridge_name='br-int',has_traffic_filtering=True,id=a3697523-c958-4f9f-92a2-ec52e2ee249b,network=Network(ce8bea02-998e-4055-9ac6-e226a89f103c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3697523-c9') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa3697523-c9, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:39 user nova-compute[72129]: INFO os_vif [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:03:16,bridge_name='br-int',has_traffic_filtering=True,id=a3697523-c958-4f9f-92a2-ec52e2ee249b,network=Network(ce8bea02-998e-4055-9ac6-e226a89f103c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3697523-c9')
Aug 01 13:52:39 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T13:50:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1928450351',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1928450351',id=10,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtHDuqy+Nzk7emhGVzyG8Atlb399fl8z1ienNkLDirkAyqlRTHVGlJWt3v5Ylsze6Lfcjp3h4DkXA64Z4aXGVM7KBd/eKPTCqWIQv8vR8ce9fDSbLU6nYkdK54CW21tJw==',key_name='tempest-keypair-1892312772',keypairs=<?>,launch_index=0,launched_at=2023-08-01T13:51:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='12210d07b1b040b192bdbf59bf952a8b',ramdisk_id='',reservation_id='r-go2wk8ji',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1903474152',owner_user_name='tempest-TaggedBootDevicesTest_v242-1903474152-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T13:51:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4057f22dc0c4e3dbdc55a6a0decebd8',uuid=1490f922-a4b0-43be-8826-ab527f66a350,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b23e74f7-64a8-466e-840b-0365e486355f", "address": "fa:16:3e:4f:8b:2c", "network": {"id": "ce8bea02-998e-4055-9ac6-e226a89f103c", "bridge": "br-int", "label": "tempest-device-tagging-net2-808946084", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb23e74f7-64", "ovs_interfaceid": "b23e74f7-64a8-466e-840b-0365e486355f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Converting VIF {"id": "b23e74f7-64a8-466e-840b-0365e486355f", "address": "fa:16:3e:4f:8b:2c", "network": {"id": "ce8bea02-998e-4055-9ac6-e226a89f103c", "bridge": "br-int", "label": "tempest-device-tagging-net2-808946084", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb23e74f7-64", "ovs_interfaceid": "b23e74f7-64a8-466e-840b-0365e486355f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:8b:2c,bridge_name='br-int',has_traffic_filtering=True,id=b23e74f7-64a8-466e-840b-0365e486355f,network=Network(ce8bea02-998e-4055-9ac6-e226a89f103c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb23e74f7-64') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG os_vif [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:8b:2c,bridge_name='br-int',has_traffic_filtering=True,id=b23e74f7-64a8-466e-840b-0365e486355f,network=Network(ce8bea02-998e-4055-9ac6-e226a89f103c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb23e74f7-64') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb23e74f7-64, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:39 user nova-compute[72129]: INFO os_vif [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:8b:2c,bridge_name='br-int',has_traffic_filtering=True,id=b23e74f7-64a8-466e-840b-0365e486355f,network=Network(ce8bea02-998e-4055-9ac6-e226a89f103c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb23e74f7-64')
Aug 01 13:52:39 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Updating instance_info_cache with network_info: [{"id": "d59c6949-2748-4a57-b089-6219f9102815", "address": "fa:16:3e:20:eb:cf", "network": {"id": "4de0d3ee-7981-427b-9013-99cf0bc22cf8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-289359635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d693a983e4a44434b64c7983239371a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd59c6949-27", "ovs_interfaceid": "d59c6949-2748-4a57-b089-6219f9102815", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] calling os-brick to detach iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, {'target_iqns': ['iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vbtHKUSY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:52:39 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 13:52:39 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Releasing lock "refresh_cache-2efa87a6-1dd6-4441-a55e-8e86be7f0a35" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Updated the network info_cache for instance {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Auditing locally available compute resources for user (node: user) {{(pid=72129) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG nova.compute.manager [req-7bead975-66b2-427e-838b-f3ede52d33c2 req-574a3709-fe53-4fe8-bc5c-f770baf392df service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Received event network-vif-plugged-7ee53caa-f8d2-4ff3-b29f-131d386cbc14 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-7bead975-66b2-427e-838b-f3ede52d33c2 req-574a3709-fe53-4fe8-bc5c-f770baf392df service nova] Acquiring lock "1490f922-a4b0-43be-8826-ab527f66a350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-7bead975-66b2-427e-838b-f3ede52d33c2 req-574a3709-fe53-4fe8-bc5c-f770baf392df service nova] Lock "1490f922-a4b0-43be-8826-ab527f66a350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-7bead975-66b2-427e-838b-f3ede52d33c2 req-574a3709-fe53-4fe8-bc5c-f770baf392df service nova] Lock "1490f922-a4b0-43be-8826-ab527f66a350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG nova.compute.manager [req-7bead975-66b2-427e-838b-f3ede52d33c2 req-574a3709-fe53-4fe8-bc5c-f770baf392df service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] No waiting events found dispatching network-vif-plugged-7ee53caa-f8d2-4ff3-b29f-131d386cbc14 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:52:39 user nova-compute[72129]: WARNING nova.compute.manager [req-7bead975-66b2-427e-838b-f3ede52d33c2 req-574a3709-fe53-4fe8-bc5c-f770baf392df service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Received unexpected event network-vif-plugged-7ee53caa-f8d2-4ff3-b29f-131d386cbc14 for instance with vm_state active and task_state deleting.
Aug 01 13:52:39 user nova-compute[72129]: DEBUG nova.compute.manager [req-7bead975-66b2-427e-838b-f3ede52d33c2 req-574a3709-fe53-4fe8-bc5c-f770baf392df service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Received event network-vif-unplugged-71c06aee-1c23-4a9b-9d91-73cc48cb7c23 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-7bead975-66b2-427e-838b-f3ede52d33c2 req-574a3709-fe53-4fe8-bc5c-f770baf392df service nova] Acquiring lock "1490f922-a4b0-43be-8826-ab527f66a350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-7bead975-66b2-427e-838b-f3ede52d33c2 req-574a3709-fe53-4fe8-bc5c-f770baf392df service nova] Lock "1490f922-a4b0-43be-8826-ab527f66a350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-7bead975-66b2-427e-838b-f3ede52d33c2 req-574a3709-fe53-4fe8-bc5c-f770baf392df service nova] Lock "1490f922-a4b0-43be-8826-ab527f66a350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG nova.compute.manager [req-7bead975-66b2-427e-838b-f3ede52d33c2 req-574a3709-fe53-4fe8-bc5c-f770baf392df service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] No waiting events found dispatching network-vif-unplugged-71c06aee-1c23-4a9b-9d91-73cc48cb7c23 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG nova.compute.manager [req-7bead975-66b2-427e-838b-f3ede52d33c2 req-574a3709-fe53-4fe8-bc5c-f770baf392df service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Received event network-vif-unplugged-71c06aee-1c23-4a9b-9d91-73cc48cb7c23 for instance with task_state deleting. {{(pid=72129) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG nova.compute.manager [req-7bead975-66b2-427e-838b-f3ede52d33c2 req-574a3709-fe53-4fe8-bc5c-f770baf392df service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Received event network-vif-plugged-71c06aee-1c23-4a9b-9d91-73cc48cb7c23 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-7bead975-66b2-427e-838b-f3ede52d33c2 req-574a3709-fe53-4fe8-bc5c-f770baf392df service nova] Acquiring lock "1490f922-a4b0-43be-8826-ab527f66a350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-7bead975-66b2-427e-838b-f3ede52d33c2 req-574a3709-fe53-4fe8-bc5c-f770baf392df service nova] Lock "1490f922-a4b0-43be-8826-ab527f66a350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-7bead975-66b2-427e-838b-f3ede52d33c2 req-574a3709-fe53-4fe8-bc5c-f770baf392df service nova] Lock "1490f922-a4b0-43be-8826-ab527f66a350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG nova.compute.manager [req-7bead975-66b2-427e-838b-f3ede52d33c2 req-574a3709-fe53-4fe8-bc5c-f770baf392df service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] No waiting events found dispatching network-vif-plugged-71c06aee-1c23-4a9b-9d91-73cc48cb7c23 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:52:39 user nova-compute[72129]: WARNING nova.compute.manager [req-7bead975-66b2-427e-838b-f3ede52d33c2 req-574a3709-fe53-4fe8-bc5c-f770baf392df service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Received unexpected event network-vif-plugged-71c06aee-1c23-4a9b-9d91-73cc48cb7c23 for instance with vm_state active and task_state deleting.
Aug 01 13:52:39 user nova-compute[72129]: DEBUG nova.compute.manager [req-7bead975-66b2-427e-838b-f3ede52d33c2 req-574a3709-fe53-4fe8-bc5c-f770baf392df service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Received event network-vif-unplugged-b23e74f7-64a8-466e-840b-0365e486355f {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-7bead975-66b2-427e-838b-f3ede52d33c2 req-574a3709-fe53-4fe8-bc5c-f770baf392df service nova] Acquiring lock "1490f922-a4b0-43be-8826-ab527f66a350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-7bead975-66b2-427e-838b-f3ede52d33c2 req-574a3709-fe53-4fe8-bc5c-f770baf392df service nova] Lock "1490f922-a4b0-43be-8826-ab527f66a350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-7bead975-66b2-427e-838b-f3ede52d33c2 req-574a3709-fe53-4fe8-bc5c-f770baf392df service nova] Lock "1490f922-a4b0-43be-8826-ab527f66a350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG nova.compute.manager [req-7bead975-66b2-427e-838b-f3ede52d33c2 req-574a3709-fe53-4fe8-bc5c-f770baf392df service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] No waiting events found dispatching network-vif-unplugged-b23e74f7-64a8-466e-840b-0365e486355f {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG nova.compute.manager [req-7bead975-66b2-427e-838b-f3ede52d33c2 req-574a3709-fe53-4fe8-bc5c-f770baf392df service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Received event network-vif-unplugged-b23e74f7-64a8-466e-840b-0365e486355f for instance with task_state deleting. {{(pid=72129) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG nova.compute.manager [req-7bead975-66b2-427e-838b-f3ede52d33c2 req-574a3709-fe53-4fe8-bc5c-f770baf392df service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Received event network-vif-plugged-b23e74f7-64a8-466e-840b-0365e486355f {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-7bead975-66b2-427e-838b-f3ede52d33c2 req-574a3709-fe53-4fe8-bc5c-f770baf392df service nova] Acquiring lock "1490f922-a4b0-43be-8826-ab527f66a350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-7bead975-66b2-427e-838b-f3ede52d33c2 req-574a3709-fe53-4fe8-bc5c-f770baf392df service nova] Lock "1490f922-a4b0-43be-8826-ab527f66a350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-7bead975-66b2-427e-838b-f3ede52d33c2 req-574a3709-fe53-4fe8-bc5c-f770baf392df service nova] Lock "1490f922-a4b0-43be-8826-ab527f66a350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG nova.compute.manager [req-7bead975-66b2-427e-838b-f3ede52d33c2 req-574a3709-fe53-4fe8-bc5c-f770baf392df service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] No waiting events found dispatching network-vif-plugged-b23e74f7-64a8-466e-840b-0365e486355f {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:52:39 user nova-compute[72129]: WARNING nova.compute.manager [req-7bead975-66b2-427e-838b-f3ede52d33c2 req-574a3709-fe53-4fe8-bc5c-f770baf392df service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Received unexpected event network-vif-plugged-b23e74f7-64a8-466e-840b-0365e486355f for instance with vm_state active and task_state deleting.
Aug 01 13:52:39 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:39 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c1f751a-e2aa-4447-b72f-9dc88c4c1a84/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-99d2ebaf-8bf3-49a8-beaa-cb55a52ed991 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.635s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-99d2ebaf-8bf3-49a8-beaa-cb55a52ed991 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] <== connect_volume: return (1639ms) {'type': 'block', 'scsi_wwn': '23739393835656462', 'path': '/dev/sdj'} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99d2ebaf-8bf3-49a8-beaa-cb55a52ed991 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23739393835656462', 'path': '/dev/sdj'} {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-bd6ecdf1-bc13-433a-bcc6-9a735726df18 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.215s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd6ecdf1-bc13-433a-bcc6-9a735726df18 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1ab9c7e-7cec-4b1c-b1fb-1fbfa40c9f32', 0)] {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c1f751a-e2aa-4447-b72f-9dc88c4c1a84/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c1f751a-e2aa-4447-b72f-9dc88c4c1a84/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd86b94a-74c6-400b-b9e5-75d8ef80dcc8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1ab9c7e-7cec-4b1c-b1fb-1fbfa40c9f32\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG nova.objects.instance [None req-99d2ebaf-8bf3-49a8-beaa-cb55a52ed991 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Lazy-loading 'flavor' on Instance uuid 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-99d2ebaf-8bf3-49a8-beaa-cb55a52ed991 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 13:52:40 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 13:52:40 user nova-compute[72129]:   <source dev="/dev/sdj"/>
Aug 01 13:52:40 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 13:52:40 user nova-compute[72129]:   <serial>43c1b008-ef2f-494c-8ba1-6c55ed0085a5</serial>
Aug 01 13:52:40 user nova-compute[72129]: </disk>
Aug 01 13:52:40 user nova-compute[72129]:  {{(pid=72129) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa4380a-f2a8-4053-ae03-0be9eba2bd49]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ab9c7e-7cec-4b1c-b1fb-1fbfa40c9f32 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd6ecdf1-bc13-433a-bcc6-9a735726df18 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ab9c7e-7cec-4b1c-b1fb-1fbfa40c9f32 (non-flash)
Aug 01 13:52:40 user nova-compute[72129]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 (non-flash)
Aug 01 13:52:40 user nova-compute[72129]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)
Aug 01 13:52:40 user nova-compute[72129]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)
Aug 01 13:52:40 user nova-compute[72129]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)
Aug 01 13:52:40 user nova-compute[72129]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)
Aug 01 13:52:40 user nova-compute[72129]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 (non-flash)
Aug 01 13:52:40 user nova-compute[72129]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 (non-flash)
Aug 01 13:52:40 user nova-compute[72129]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)
Aug 01 13:52:40 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd6ecdf1-bc13-433a-bcc6-9a735726df18 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ab9c7e-7cec-4b1c-b1fb-1fbfa40c9f32 (non-flash)
Aug 01 13:52:40 user nova-compute[72129]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 (non-flash)
Aug 01 13:52:40 user nova-compute[72129]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)
Aug 01 13:52:40 user nova-compute[72129]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)
Aug 01 13:52:40 user nova-compute[72129]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)
Aug 01 13:52:40 user nova-compute[72129]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)
Aug 01 13:52:40 user nova-compute[72129]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 (non-flash)
Aug 01 13:52:40 user nova-compute[72129]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 (non-flash)
Aug 01 13:52:40 user nova-compute[72129]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)
Aug 01 13:52:40 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd6ecdf1-bc13-433a-bcc6-9a735726df18 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f28202d25f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1ab9c7e-7cec-4b1c-b1fb-1fbfa40c9f32'): ({'sdi'}, set())}) {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-bd6ecdf1-bc13-433a-bcc6-9a735726df18 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Removing single pathed devices sdi {{(pid=72129) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aeb8798-ee16-43a6-909d-16163b5e4696]: (4, ('path checker states:\nup                  7\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[2423f416-60b5-4c99-a6a6-869a27a41f0d]: (4, ('ok\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-bd6ecdf1-bc13-433a-bcc6-9a735726df18 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Flushing IO for device /dev/sdi {{(pid=72129) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c1f751a-e2aa-4447-b72f-9dc88c4c1a84/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[43faa5f8-4d3d-4ad2-b8c8-06a7000c8b11]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-bd6ecdf1-bc13-433a-bcc6-9a735726df18 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=72129) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28115c7d-544a-4504-98da-2398e0e354d8/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.058s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5438bdb-2a23-4434-9bc6-53684b9a9b22]: (4, ('1', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-bd6ecdf1-bc13-433a-bcc6-9a735726df18 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-bd6ecdf1-bc13-433a-bcc6-9a735726df18 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] SCSI volumes sdi have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd6ecdf1-bc13-433a-bcc6-9a735726df18 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1ab9c7e-7cec-4b1c-b1fb-1fbfa40c9f32')] {{(pid=72129) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ab9c7e-7cec-4b1c-b1fb-1fbfa40c9f32 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ab9c7e-7cec-4b1c-b1fb-1fbfa40c9f32 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a90383-4d99-45d8-b80f-6efb6206a62d]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd6ecdf1-bc13-433a-bcc6-9a735726df18 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ab9c7e-7cec-4b1c-b1fb-1fbfa40c9f32 -p 172.16.0.220:3260 --logout {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28115c7d-544a-4504-98da-2398e0e354d8/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28115c7d-544a-4504-98da-2398e0e354d8/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-fbec0646-5fad-4cff-ae6a-547672968dea tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Acquiring lock "78b77b93-6f25-447f-80a7-d64374fee14d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-fbec0646-5fad-4cff-ae6a-547672968dea tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Lock "78b77b93-6f25-447f-80a7-d64374fee14d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-fbec0646-5fad-4cff-ae6a-547672968dea tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Acquiring lock "78b77b93-6f25-447f-80a7-d64374fee14d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-fbec0646-5fad-4cff-ae6a-547672968dea tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Lock "78b77b93-6f25-447f-80a7-d64374fee14d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-fbec0646-5fad-4cff-ae6a-547672968dea tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Lock "78b77b93-6f25-447f-80a7-d64374fee14d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ab9c7e-7cec-4b1c-b1fb-1fbfa40c9f32 -p 172.16.0.220:3260 --logout" returned: 0 in 0.088s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a684b4-7140-4650-b1dd-41f79d39c553]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:b1ab9c7e-7cec-4b1c-b1fb-1fbfa40c9f32, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:b1ab9c7e-7cec-4b1c-b1fb-1fbfa40c9f32, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd6ecdf1-bc13-433a-bcc6-9a735726df18 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:b1ab9c7e-7cec-4b1c-b1fb-1fbfa40c9f32, portal: 172.16.0.220,3260]
Aug 01 13:52:40 user nova-compute[72129]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:b1ab9c7e-7cec-4b1c-b1fb-1fbfa40c9f32, portal: 172.16.0.220,3260] successful.
Aug 01 13:52:40 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:40 user nova-compute[72129]: INFO nova.compute.manager [None req-fbec0646-5fad-4cff-ae6a-547672968dea tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] Terminating instance
Aug 01 13:52:40 user nova-compute[72129]: DEBUG nova.compute.manager [None req-fbec0646-5fad-4cff-ae6a-547672968dea tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] Start destroying the instance on the hypervisor. {{(pid=72129) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ab9c7e-7cec-4b1c-b1fb-1fbfa40c9f32 -p 172.16.0.220:3260 --op delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ab9c7e-7cec-4b1c-b1fb-1fbfa40c9f32 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c877231-7aec-4569-bbaa-0147946b6698]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd6ecdf1-bc13-433a-bcc6-9a735726df18 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-bd6ecdf1-bc13-433a-bcc6-9a735726df18 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.404s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd6ecdf1-bc13-433a-bcc6-9a735726df18 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] <== disconnect_volume: return (1620ms) None {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd6ecdf1-bc13-433a-bcc6-9a735726df18 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Disconnected iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.110s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86', 0)] {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28115c7d-544a-4504-98da-2398e0e354d8/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4a46fe-e82e-45af-b016-23ac2d0732a0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31781ddf-6764-4c41-8047-21adfc25d610/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.048s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[3372a70b-332a-44a4-ace2-8f7e1fd79616]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 (non-flash)
Aug 01 13:52:40 user nova-compute[72129]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)
Aug 01 13:52:40 user nova-compute[72129]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)
Aug 01 13:52:40 user nova-compute[72129]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)
Aug 01 13:52:40 user nova-compute[72129]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)
Aug 01 13:52:40 user nova-compute[72129]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 (non-flash)
Aug 01 13:52:40 user nova-compute[72129]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 (non-flash)
Aug 01 13:52:40 user nova-compute[72129]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)
Aug 01 13:52:40 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 (non-flash)
Aug 01 13:52:40 user nova-compute[72129]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 (non-flash)
Aug 01 13:52:40 user nova-compute[72129]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)
Aug 01 13:52:40 user nova-compute[72129]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)
Aug 01 13:52:40 user nova-compute[72129]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)
Aug 01 13:52:40 user nova-compute[72129]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 (non-flash)
Aug 01 13:52:40 user nova-compute[72129]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 (non-flash)
Aug 01 13:52:40 user nova-compute[72129]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)
Aug 01 13:52:40 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f282dfc49d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86'): ({'sdb'}, set())}) {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Removing single pathed devices sdb {{(pid=72129) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.143s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e673dfa-8cd8-4e22-b96f-9b0ef71ba5ff]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31781ddf-6764-4c41-8047-21adfc25d610/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Acquiring lock "e1ee9e5e-0bd8-4986-8641-d44680f97724" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Lock "e1ee9e5e-0bd8-4986-8641-d44680f97724" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Acquiring lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31781ddf-6764-4c41-8047-21adfc25d610/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.031s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[55290ce1-269e-4a87-8c02-8831965cf2a5]: (4, ('ok\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:40 user nova-compute[72129]: INFO nova.compute.manager [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Terminating instance
Aug 01 13:52:40 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Flushing IO for device /dev/sdb {{(pid=72129) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG nova.compute.manager [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Start destroying the instance on the hypervisor. {{(pid=72129) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-99d2ebaf-8bf3-49a8-beaa-cb55a52ed991 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-99d2ebaf-8bf3-49a8-beaa-cb55a52ed991 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-99d2ebaf-8bf3-49a8-beaa-cb55a52ed991 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] No VIF found with MAC fa:16:3e:a2:d0:6d, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a263f05-256e-4cbc-ab42-f685cf79101b]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72129) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b90472-41e1-4a62-ac08-ff93472f1035]: (4, ('1', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 13:52:40 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] SCSI volumes sdb have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86')] {{(pid=72129) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31781ddf-6764-4c41-8047-21adfc25d610/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[3079ed24-ecda-40d5-ad9b-e24889ea0dec]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 -p 172.16.0.220:3260 --logout {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba95aabd-b279-44c0-b0cb-e07e7d6bdf8b]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86, portal: 172.16.0.220,3260]
Aug 01 13:52:41 user nova-compute[72129]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86, portal: 172.16.0.220,3260] successful.
Aug 01 13:52:41 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 -p 172.16.0.220:3260 --op delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-99d2ebaf-8bf3-49a8-beaa-cb55a52ed991 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Lock "33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.075s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:698306a3-291f-4aba-8f16-5068cd476b86 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2e845f-8be0-4a68-9e2a-5107debb9c2f]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.619s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] <== disconnect_volume: return (1729ms) None {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Disconnected iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] calling os-brick to detach iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, {'target_iqns': ['iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uJFKvesp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:52:41 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 13:52:41 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350', 0)] {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG nova.compute.manager [req-ec02f367-12ef-4d81-8638-6c5e8cd95763 req-b9b3a5de-062b-4843-8556-16114ad20076 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Received event network-vif-plugged-17974af1-27e5-41f4-9c13-31fb31cd6cc2 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ec02f367-12ef-4d81-8638-6c5e8cd95763 req-b9b3a5de-062b-4843-8556-16114ad20076 service nova] Acquiring lock "1490f922-a4b0-43be-8826-ab527f66a350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ec02f367-12ef-4d81-8638-6c5e8cd95763 req-b9b3a5de-062b-4843-8556-16114ad20076 service nova] Lock "1490f922-a4b0-43be-8826-ab527f66a350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ec02f367-12ef-4d81-8638-6c5e8cd95763 req-b9b3a5de-062b-4843-8556-16114ad20076 service nova] Lock "1490f922-a4b0-43be-8826-ab527f66a350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG nova.compute.manager [req-ec02f367-12ef-4d81-8638-6c5e8cd95763 req-b9b3a5de-062b-4843-8556-16114ad20076 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] No waiting events found dispatching network-vif-plugged-17974af1-27e5-41f4-9c13-31fb31cd6cc2 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:52:41 user nova-compute[72129]: WARNING nova.compute.manager [req-ec02f367-12ef-4d81-8638-6c5e8cd95763 req-b9b3a5de-062b-4843-8556-16114ad20076 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Received unexpected event network-vif-plugged-17974af1-27e5-41f4-9c13-31fb31cd6cc2 for instance with vm_state active and task_state deleting.
Aug 01 13:52:41 user nova-compute[72129]: DEBUG nova.compute.manager [req-ec02f367-12ef-4d81-8638-6c5e8cd95763 req-b9b3a5de-062b-4843-8556-16114ad20076 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Received event network-vif-unplugged-a3697523-c958-4f9f-92a2-ec52e2ee249b {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ec02f367-12ef-4d81-8638-6c5e8cd95763 req-b9b3a5de-062b-4843-8556-16114ad20076 service nova] Acquiring lock "1490f922-a4b0-43be-8826-ab527f66a350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ec02f367-12ef-4d81-8638-6c5e8cd95763 req-b9b3a5de-062b-4843-8556-16114ad20076 service nova] Lock "1490f922-a4b0-43be-8826-ab527f66a350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ec02f367-12ef-4d81-8638-6c5e8cd95763 req-b9b3a5de-062b-4843-8556-16114ad20076 service nova] Lock "1490f922-a4b0-43be-8826-ab527f66a350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG nova.compute.manager [req-ec02f367-12ef-4d81-8638-6c5e8cd95763 req-b9b3a5de-062b-4843-8556-16114ad20076 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] No waiting events found dispatching network-vif-unplugged-a3697523-c958-4f9f-92a2-ec52e2ee249b {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG nova.compute.manager [req-ec02f367-12ef-4d81-8638-6c5e8cd95763 req-b9b3a5de-062b-4843-8556-16114ad20076 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Received event network-vif-unplugged-a3697523-c958-4f9f-92a2-ec52e2ee249b for instance with task_state deleting. {{(pid=72129) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG nova.compute.manager [req-ec02f367-12ef-4d81-8638-6c5e8cd95763 req-b9b3a5de-062b-4843-8556-16114ad20076 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Received event network-vif-plugged-a3697523-c958-4f9f-92a2-ec52e2ee249b {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ec02f367-12ef-4d81-8638-6c5e8cd95763 req-b9b3a5de-062b-4843-8556-16114ad20076 service nova] Acquiring lock "1490f922-a4b0-43be-8826-ab527f66a350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ec02f367-12ef-4d81-8638-6c5e8cd95763 req-b9b3a5de-062b-4843-8556-16114ad20076 service nova] Lock "1490f922-a4b0-43be-8826-ab527f66a350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ec02f367-12ef-4d81-8638-6c5e8cd95763 req-b9b3a5de-062b-4843-8556-16114ad20076 service nova] Lock "1490f922-a4b0-43be-8826-ab527f66a350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG nova.compute.manager [req-ec02f367-12ef-4d81-8638-6c5e8cd95763 req-b9b3a5de-062b-4843-8556-16114ad20076 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] No waiting events found dispatching network-vif-plugged-a3697523-c958-4f9f-92a2-ec52e2ee249b {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:52:41 user nova-compute[72129]: WARNING nova.compute.manager [req-ec02f367-12ef-4d81-8638-6c5e8cd95763 req-b9b3a5de-062b-4843-8556-16114ad20076 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Received unexpected event network-vif-plugged-a3697523-c958-4f9f-92a2-ec52e2ee249b for instance with vm_state active and task_state deleting.
Aug 01 13:52:41 user nova-compute[72129]: DEBUG nova.compute.manager [req-ec02f367-12ef-4d81-8638-6c5e8cd95763 req-b9b3a5de-062b-4843-8556-16114ad20076 service nova] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] Received event network-vif-unplugged-31519672-974b-48c8-a361-e36ef1177d4e {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ec02f367-12ef-4d81-8638-6c5e8cd95763 req-b9b3a5de-062b-4843-8556-16114ad20076 service nova] Acquiring lock "78b77b93-6f25-447f-80a7-d64374fee14d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ec02f367-12ef-4d81-8638-6c5e8cd95763 req-b9b3a5de-062b-4843-8556-16114ad20076 service nova] Lock "78b77b93-6f25-447f-80a7-d64374fee14d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ec02f367-12ef-4d81-8638-6c5e8cd95763 req-b9b3a5de-062b-4843-8556-16114ad20076 service nova] Lock "78b77b93-6f25-447f-80a7-d64374fee14d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG nova.compute.manager [req-ec02f367-12ef-4d81-8638-6c5e8cd95763 req-b9b3a5de-062b-4843-8556-16114ad20076 service nova] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] No waiting events found dispatching network-vif-unplugged-31519672-974b-48c8-a361-e36ef1177d4e {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG nova.compute.manager [req-ec02f367-12ef-4d81-8638-6c5e8cd95763 req-b9b3a5de-062b-4843-8556-16114ad20076 service nova] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] Received event network-vif-unplugged-31519672-974b-48c8-a361-e36ef1177d4e for instance with task_state deleting. {{(pid=72129) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc80f1b-256c-4a4b-a468-d67d59e5c4fe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[03126d88-1fb5-4d44-92c4-68c219badeaa]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 (non-flash)
Aug 01 13:52:41 user nova-compute[72129]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)
Aug 01 13:52:41 user nova-compute[72129]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)
Aug 01 13:52:41 user nova-compute[72129]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)
Aug 01 13:52:41 user nova-compute[72129]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 (non-flash)
Aug 01 13:52:41 user nova-compute[72129]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 (non-flash)
Aug 01 13:52:41 user nova-compute[72129]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)
Aug 01 13:52:41 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 (non-flash)
Aug 01 13:52:41 user nova-compute[72129]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 (non-flash)
Aug 01 13:52:41 user nova-compute[72129]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)
Aug 01 13:52:41 user nova-compute[72129]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)
Aug 01 13:52:41 user nova-compute[72129]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 (non-flash)
Aug 01 13:52:41 user nova-compute[72129]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 (non-flash)
Aug 01 13:52:41 user nova-compute[72129]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)
Aug 01 13:52:41 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f282812a560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350'): ({'sdc'}, set())}) {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Removing single pathed devices sdc {{(pid=72129) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d608b1db-e300-43ff-97c5-6074c4f55541]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[2489d9a2-61dc-4a62-853d-84a6b22eab28]: (4, ('ok\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Flushing IO for device /dev/sdc {{(pid=72129) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4876fd-af80-49af-bc0b-3dbf48a02452]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72129) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:41 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] Instance destroyed successfully.
Aug 01 13:52:41 user nova-compute[72129]: DEBUG nova.objects.instance [None req-fbec0646-5fad-4cff-ae6a-547672968dea tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Lazy-loading 'resources' on Instance uuid 78b77b93-6f25-447f-80a7-d64374fee14d {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b77b93-6f25-447f-80a7-d64374fee14d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-fbec0646-5fad-4cff-ae6a-547672968dea tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T13:50:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1874739145',display_name='tempest-AttachSCSIVolumeTestJSON-server-1874739145',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1874739145',id=6,image_ref='6854a249-a918-42d1-ba04-b804de43a465',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzyL1bToxqc1hbexph3GbnXjiGaTrpfZqwZA2ih43noBPQ5JFRGckVi7zGChnA7fYGHpAJ6ft2MiR8Uv4wYWcw+5QnVtjIPbX949zQIlYwg3ygtbSeGr5jjiqAbyzrTWw==',key_name='tempest-keypair-338556798',keypairs=<?>,launch_index=0,launched_at=2023-08-01T13:50:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='70b05bc50bbd461296d701a4b3a58edc',ramdisk_id='',reservation_id='r-t0eq4f0y',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6854a249-a918-42d1-ba04-b804de43a465',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1269943649',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1269943649-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T13:50:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc93ae7498d64699b3fbd76cacb94cd4',uuid=78b77b93-6f25-447f-80a7-d64374fee14d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "31519672-974b-48c8-a361-e36ef1177d4e", "address": "fa:16:3e:4c:0e:3b", "network": {"id": "2bfb447a-e137-4844-8659-2d8d008da293", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-168024472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70b05bc50bbd461296d701a4b3a58edc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31519672-97", "ovs_interfaceid": "31519672-974b-48c8-a361-e36ef1177d4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-fbec0646-5fad-4cff-ae6a-547672968dea tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Converting VIF {"id": "31519672-974b-48c8-a361-e36ef1177d4e", "address": "fa:16:3e:4c:0e:3b", "network": {"id": "2bfb447a-e137-4844-8659-2d8d008da293", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-168024472-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70b05bc50bbd461296d701a4b3a58edc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31519672-97", "ovs_interfaceid": "31519672-974b-48c8-a361-e36ef1177d4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-fbec0646-5fad-4cff-ae6a-547672968dea tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4c:0e:3b,bridge_name='br-int',has_traffic_filtering=True,id=31519672-974b-48c8-a361-e36ef1177d4e,network=Network(2bfb447a-e137-4844-8659-2d8d008da293),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31519672-97') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG os_vif [None req-fbec0646-5fad-4cff-ae6a-547672968dea tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:0e:3b,bridge_name='br-int',has_traffic_filtering=True,id=31519672-974b-48c8-a361-e36ef1177d4e,network=Network(2bfb447a-e137-4844-8659-2d8d008da293),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31519672-97') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap31519672-97, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.070s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a5237b-6e4b-4e61-9095-bccc4c546a11]: (4, ('1', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] SCSI volumes sdc have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350')] {{(pid=72129) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[264f2ff4-c4a3-45a9-a3a0-5d5df3e32cd8]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 -p 172.16.0.220:3260 --logout {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b77b93-6f25-447f-80a7-d64374fee14d/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b77b93-6f25-447f-80a7-d64374fee14d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:41 user nova-compute[72129]: INFO os_vif [None req-fbec0646-5fad-4cff-ae6a-547672968dea tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:0e:3b,bridge_name='br-int',has_traffic_filtering=True,id=31519672-974b-48c8-a361-e36ef1177d4e,network=Network(2bfb447a-e137-4844-8659-2d8d008da293),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31519672-97')
Aug 01 13:52:41 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-fbec0646-5fad-4cff-ae6a-547672968dea tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] Deleting instance files /opt/stack/data/nova/instances/78b77b93-6f25-447f-80a7-d64374fee14d_del
Aug 01 13:52:41 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-fbec0646-5fad-4cff-ae6a-547672968dea tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] Deletion of /opt/stack/data/nova/instances/78b77b93-6f25-447f-80a7-d64374fee14d_del complete
Aug 01 13:52:41 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 -p 172.16.0.220:3260 --logout" returned: 0 in 0.095s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[68747404-2a25-464c-8dc3-940c647c93d4]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG nova.compute.manager [req-c42e8627-69a4-4643-8fd9-632344577af1 req-4e249f0f-13f9-4742-9888-77ca467183eb service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Received event network-vif-unplugged-c3fc041a-b39f-448a-a5d6-3e2b67368d50 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-c42e8627-69a4-4643-8fd9-632344577af1 req-4e249f0f-13f9-4742-9888-77ca467183eb service nova] Acquiring lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-c42e8627-69a4-4643-8fd9-632344577af1 req-4e249f0f-13f9-4742-9888-77ca467183eb service nova] Lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-c42e8627-69a4-4643-8fd9-632344577af1 req-4e249f0f-13f9-4742-9888-77ca467183eb service nova] Lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG nova.compute.manager [req-c42e8627-69a4-4643-8fd9-632344577af1 req-4e249f0f-13f9-4742-9888-77ca467183eb service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] No waiting events found dispatching network-vif-unplugged-c3fc041a-b39f-448a-a5d6-3e2b67368d50 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG nova.compute.manager [req-c42e8627-69a4-4643-8fd9-632344577af1 req-4e249f0f-13f9-4742-9888-77ca467183eb service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Received event network-vif-unplugged-c3fc041a-b39f-448a-a5d6-3e2b67368d50 for instance with task_state deleting. {{(pid=72129) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350, portal: 172.16.0.220,3260]
Aug 01 13:52:41 user nova-compute[72129]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350, portal: 172.16.0.220,3260] successful.
Aug 01 13:52:41 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 -p 172.16.0.220:3260 --op delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e57b1e53-283d-4411-8bba-a7e82c1fb350 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.055s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef06bd7-dcf2-433d-93d6-db3c5404b48b]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.467s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] <== disconnect_volume: return (469ms) None {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Disconnected iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 13:52:41 user nova-compute[72129]: INFO nova.compute.manager [None req-fbec0646-5fad-4cff-ae6a-547672968dea tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] Took 1.17 seconds to destroy the instance on the hypervisor.
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo.service.loopingcall [None req-fbec0646-5fad-4cff-ae6a-547672968dea tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72129) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG nova.compute.manager [-] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] Deallocating network for instance {{(pid=72129) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] deallocate_for_instance() {{(pid=72129) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b77b93-6f25-447f-80a7-d64374fee14d/disk --force-share --output=json" returned: 1 in 0.178s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] '/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78b77b93-6f25-447f-80a7-d64374fee14d/disk --force-share --output=json' failed. Not Retrying. {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] calling os-brick to detach iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, {'target_iqns': ['iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sCyiUNRF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:52:41 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 13:52:41 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512', 0)] {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 13:52:41 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000006, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/78b77b93-6f25-447f-80a7-d64374fee14d/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/78b77b93-6f25-447f-80a7-d64374fee14d/disk
Aug 01 13:52:41 user nova-compute[72129]: DEBUG nova.objects.instance [None req-bd6ecdf1-bc13-433a-bcc6-9a735726df18 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Lazy-loading 'flavor' on Instance uuid 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.032s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[224cfee3-0714-461d-9bae-7b4e787fd2e6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31105963-52fa-4aff-9270-075cd98f08a5/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c863de-99e7-4e84-8639-8f29e4e1bda6]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 (non-flash)
Aug 01 13:52:41 user nova-compute[72129]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)
Aug 01 13:52:41 user nova-compute[72129]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)
Aug 01 13:52:41 user nova-compute[72129]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 (non-flash)
Aug 01 13:52:41 user nova-compute[72129]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 (non-flash)
Aug 01 13:52:41 user nova-compute[72129]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)
Aug 01 13:52:41 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 (non-flash)
Aug 01 13:52:41 user nova-compute[72129]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 (non-flash)
Aug 01 13:52:41 user nova-compute[72129]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)
Aug 01 13:52:41 user nova-compute[72129]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 (non-flash)
Aug 01 13:52:41 user nova-compute[72129]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 (non-flash)
Aug 01 13:52:41 user nova-compute[72129]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)
Aug 01 13:52:41 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f28201f56c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512'): ({'sdd'}, set())}) {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Removing single pathed devices sdd {{(pid=72129) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-bd6ecdf1-bc13-433a-bcc6-9a735726df18 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Lock "3c1f751a-e2aa-4447-b72f-9dc88c4c1a84" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.992s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[e822e80e-ec3c-4125-8e8d-767391bc5393]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.029s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ca9530-17bd-419a-9ddc-3e66628d796f]: (4, ('ok\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Flushing IO for device /dev/sdd {{(pid=72129) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[00df6fc2-da6b-4f64-bfc3-a5a1d6700c4d]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72129) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31105963-52fa-4aff-9270-075cd98f08a5/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31105963-52fa-4aff-9270-075cd98f08a5/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:41 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.060s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[23bfea84-84bc-45b5-b806-9c9fee3116e1]: (4, ('1', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] SCSI volumes sdd have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512')] {{(pid=72129) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG nova.compute.manager [req-f0cd12d0-2b6e-41d6-bc0a-e740c640a501 req-45baf30c-f200-422b-82b8-852a73ef3473 service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Received event network-vif-unplugged-4856f394-91dc-4fd0-9fff-8a45f53f0e01 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f0cd12d0-2b6e-41d6-bc0a-e740c640a501 req-45baf30c-f200-422b-82b8-852a73ef3473 service nova] Acquiring lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f0cd12d0-2b6e-41d6-bc0a-e740c640a501 req-45baf30c-f200-422b-82b8-852a73ef3473 service nova] Lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f0cd12d0-2b6e-41d6-bc0a-e740c640a501 req-45baf30c-f200-422b-82b8-852a73ef3473 service nova] Lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG nova.compute.manager [req-f0cd12d0-2b6e-41d6-bc0a-e740c640a501 req-45baf30c-f200-422b-82b8-852a73ef3473 service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] No waiting events found dispatching network-vif-unplugged-4856f394-91dc-4fd0-9fff-8a45f53f0e01 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG nova.compute.manager [req-f0cd12d0-2b6e-41d6-bc0a-e740c640a501 req-45baf30c-f200-422b-82b8-852a73ef3473 service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Received event network-vif-unplugged-4856f394-91dc-4fd0-9fff-8a45f53f0e01 for instance with task_state deleting. {{(pid=72129) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31105963-52fa-4aff-9270-075cd98f08a5/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63c0c1fe-7e4d-4763-8ede-a7662747a4c0/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.081s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf7f3de1-af0b-4bb6-858c-709c60508d8e]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 -p 172.16.0.220:3260 --logout {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63c0c1fe-7e4d-4763-8ede-a7662747a4c0/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63c0c1fe-7e4d-4763-8ede-a7662747a4c0/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 -p 172.16.0.220:3260 --logout" returned: 0 in 0.173s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ecf585-e3b6-4001-a6cd-6f4a7c77183c]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512, portal: 172.16.0.220,3260]
Aug 01 13:52:42 user nova-compute[72129]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512, portal: 172.16.0.220,3260] successful.
Aug 01 13:52:42 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 -p 172.16.0.220:3260 --op delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66fe3cf1-a10e-4af9-b3ac-fe234b59a512 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8cb028-95eb-4570-bdc7-a966db9c69d5]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.728s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] <== disconnect_volume: return (729ms) None {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Disconnected iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 13:52:42 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Deleting instance files /opt/stack/data/nova/instances/1490f922-a4b0-43be-8826-ab527f66a350_del
Aug 01 13:52:42 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Deletion of /opt/stack/data/nova/instances/1490f922-a4b0-43be-8826-ab527f66a350_del complete
Aug 01 13:52:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63c0c1fe-7e4d-4763-8ede-a7662747a4c0/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d99bd9fb-f6a6-498b-bf37-1b18646e27ab tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Acquiring lock "interface-3c1f751a-e2aa-4447-b72f-9dc88c4c1a84-f5389e5c-c039-4fbf-a851-8a8b1c8c5a4c" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d99bd9fb-f6a6-498b-bf37-1b18646e27ab tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Lock "interface-3c1f751a-e2aa-4447-b72f-9dc88c4c1a84-f5389e5c-c039-4fbf-a851-8a8b1c8c5a4c" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efa87a6-1dd6-4441-a55e-8e86be7f0a35/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG nova.objects.instance [None req-d99bd9fb-f6a6-498b-bf37-1b18646e27ab tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Lazy-loading 'flavor' on Instance uuid 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:42 user nova-compute[72129]: INFO nova.compute.manager [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Took 5.67 seconds to destroy the instance on the hypervisor.
Aug 01 13:52:42 user nova-compute[72129]: DEBUG oslo.service.loopingcall [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72129) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG nova.compute.manager [-] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Deallocating network for instance {{(pid=72129) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] deallocate_for_instance() {{(pid=72129) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-d99bd9fb-f6a6-498b-bf37-1b18646e27ab tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T13:50:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1732967996',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1732967996',id=8,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLV9A0exWrqx9JsfbE2qI31l+qAJAoY1ILqBBhJy25PwbbuJ9xEqV3MLcWWfDrGgYOcUOAwPrjT+u/vasbyQv8o1AhTEdbBmNL+fkWaNh0TGgFByD46Z+LnLlJ94XdbvJQ==',key_name='tempest-keypair-1026124919',keypairs=<?>,launch_index=0,launched_at=2023-08-01T13:50:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2184fb8ab16d482ea3ca397fbb5515ff',ramdisk_id='',reservation_id='r-qogqtpk0',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1582776521',owner_user_name='tempest-TaggedAttachmentsTest-1582776521-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T13:50:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ded159a3c395418d9e4d699ed249eabb',uuid=3c1f751a-e2aa-4447-b72f-9dc88c4c1a84,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5389e5c-c039-4fbf-a851-8a8b1c8c5a4c", "address": "fa:16:3e:08:82:8a", "network": {"id": "18cced8e-a715-4226-89e6-39ea504b5746", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-521965974", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2184fb8ab16d482ea3ca397fbb5515ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5389e5c-c0", "ovs_interfaceid": "f5389e5c-c039-4fbf-a851-8a8b1c8c5a4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-d99bd9fb-f6a6-498b-bf37-1b18646e27ab tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Converting VIF {"id": "f5389e5c-c039-4fbf-a851-8a8b1c8c5a4c", "address": "fa:16:3e:08:82:8a", "network": {"id": "18cced8e-a715-4226-89e6-39ea504b5746", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-521965974", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2184fb8ab16d482ea3ca397fbb5515ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5389e5c-c0", "ovs_interfaceid": "f5389e5c-c039-4fbf-a851-8a8b1c8c5a4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-d99bd9fb-f6a6-498b-bf37-1b18646e27ab tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:82:8a,bridge_name='br-int',has_traffic_filtering=True,id=f5389e5c-c039-4fbf-a851-8a8b1c8c5a4c,network=Network(18cced8e-a715-4226-89e6-39ea504b5746),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5389e5c-c0') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-d99bd9fb-f6a6-498b-bf37-1b18646e27ab tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:08:82:8a"/><model type="virtio"/><mtu size="1442"/><target dev="tapf5389e5c-c0"/></interface> {{(pid=72129) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] Acquiring lock "33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] Lock "33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-d99bd9fb-f6a6-498b-bf37-1b18646e27ab tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:08:82:8a"/><model type="virtio"/><mtu size="1442"/><target dev="tapf5389e5c-c0"/></interface> {{(pid=72129) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efa87a6-1dd6-4441-a55e-8e86be7f0a35/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efa87a6-1dd6-4441-a55e-8e86be7f0a35/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG os_brick.utils [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-d99bd9fb-f6a6-498b-bf37-1b18646e27ab tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Attempting to detach device tapf5389e5c-c0 from instance 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84 from the persistent domain config. {{(pid=72129) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-d99bd9fb-f6a6-498b-bf37-1b18646e27ab tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] detach device xml: <interface type="ethernet">
Aug 01 13:52:42 user nova-compute[72129]:   <mac address="fa:16:3e:08:82:8a"/>
Aug 01 13:52:42 user nova-compute[72129]:   <model type="virtio"/>
Aug 01 13:52:42 user nova-compute[72129]:   <mtu size="1442"/>
Aug 01 13:52:42 user nova-compute[72129]:   <target dev="tapf5389e5c-c0"/>
Aug 01 13:52:42 user nova-compute[72129]: </interface>
Aug 01 13:52:42 user nova-compute[72129]:  {{(pid=72129) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-d99bd9fb-f6a6-498b-bf37-1b18646e27ab tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:08:82:8a"/><model type="virtio"/><mtu size="1442"/><target dev="tapf5389e5c-c0"/></interface> {{(pid=72129) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-d99bd9fb-f6a6-498b-bf37-1b18646e27ab tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:08:82:8a"/><model type="virtio"/><mtu size="1442"/><target dev="tapf5389e5c-c0"/></interface>not found in domain: <domain type='kvm' id='8'>
Aug 01 13:52:42 user nova-compute[72129]:   <name>instance-00000008</name>
Aug 01 13:52:42 user nova-compute[72129]:   <uuid>3c1f751a-e2aa-4447-b72f-9dc88c4c1a84</uuid>
Aug 01 13:52:42 user nova-compute[72129]:   <metadata>
Aug 01 13:52:42 user nova-compute[72129]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 13:52:42 user nova-compute[72129]:   <nova:package version="0.0.0"/>
Aug 01 13:52:42 user nova-compute[72129]:   <nova:name>tempest-device-tagging-server-1732967996</nova:name>
Aug 01 13:52:42 user nova-compute[72129]:   <nova:creationTime>2023-08-01 13:52:22</nova:creationTime>
Aug 01 13:52:42 user nova-compute[72129]:   <nova:flavor name="m1.tiny">
Aug 01 13:52:42 user nova-compute[72129]:     <nova:memory>512</nova:memory>
Aug 01 13:52:42 user nova-compute[72129]:     <nova:disk>1</nova:disk>
Aug 01 13:52:42 user nova-compute[72129]:     <nova:swap>0</nova:swap>
Aug 01 13:52:42 user nova-compute[72129]:     <nova:ephemeral>0</nova:ephemeral>
Aug 01 13:52:42 user nova-compute[72129]:     <nova:vcpus>1</nova:vcpus>
Aug 01 13:52:42 user nova-compute[72129]:   </nova:flavor>
Aug 01 13:52:42 user nova-compute[72129]:   <nova:owner>
Aug 01 13:52:42 user nova-compute[72129]:     <nova:user uuid="ded159a3c395418d9e4d699ed249eabb">tempest-TaggedAttachmentsTest-1582776521-project-member</nova:user>
Aug 01 13:52:42 user nova-compute[72129]:     <nova:project uuid="2184fb8ab16d482ea3ca397fbb5515ff">tempest-TaggedAttachmentsTest-1582776521</nova:project>
Aug 01 13:52:42 user nova-compute[72129]:   </nova:owner>
Aug 01 13:52:42 user nova-compute[72129]:   <nova:root type="image" uuid="b6472c34-1b0f-4034-ba3a-7e8eb5103715"/>
Aug 01 13:52:42 user nova-compute[72129]:   <nova:ports>
Aug 01 13:52:42 user nova-compute[72129]:     <nova:port uuid="7b1167ce-d40a-4355-8411-6a1dd005465f">
Aug 01 13:52:42 user nova-compute[72129]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 01 13:52:42 user nova-compute[72129]:     </nova:port>
Aug 01 13:52:42 user nova-compute[72129]:     <nova:port uuid="f5389e5c-c039-4fbf-a851-8a8b1c8c5a4c">
Aug 01 13:52:42 user nova-compute[72129]:       <nova:ip type="fixed" address="10.10.10.129" ipVersion="4"/>
Aug 01 13:52:42 user nova-compute[72129]:     </nova:port>
Aug 01 13:52:42 user nova-compute[72129]:   </nova:ports>
Aug 01 13:52:42 user nova-compute[72129]: </nova:instance>
Aug 01 13:52:42 user nova-compute[72129]:   </metadata>
Aug 01 13:52:42 user nova-compute[72129]:   <memory unit='KiB'>524288</memory>
Aug 01 13:52:42 user nova-compute[72129]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 01 13:52:42 user nova-compute[72129]:   <vcpu placement='static'>1</vcpu>
Aug 01 13:52:42 user nova-compute[72129]:   <resource>
Aug 01 13:52:42 user nova-compute[72129]:     <partition>/machine</partition>
Aug 01 13:52:42 user nova-compute[72129]:   </resource>
Aug 01 13:52:42 user nova-compute[72129]:   <sysinfo type='smbios'>
Aug 01 13:52:42 user nova-compute[72129]:     <system>
Aug 01 13:52:42 user nova-compute[72129]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 01 13:52:42 user nova-compute[72129]:       <entry name='product'>OpenStack Nova</entry>
Aug 01 13:52:42 user nova-compute[72129]:       <entry name='version'>0.0.0</entry>
Aug 01 13:52:42 user nova-compute[72129]:       <entry name='serial'>3c1f751a-e2aa-4447-b72f-9dc88c4c1a84</entry>
Aug 01 13:52:42 user nova-compute[72129]:       <entry name='uuid'>3c1f751a-e2aa-4447-b72f-9dc88c4c1a84</entry>
Aug 01 13:52:42 user nova-compute[72129]:       <entry name='family'>Virtual Machine</entry>
Aug 01 13:52:42 user nova-compute[72129]:     </system>
Aug 01 13:52:42 user nova-compute[72129]:   </sysinfo>
Aug 01 13:52:42 user nova-compute[72129]:   <os>
Aug 01 13:52:42 user nova-compute[72129]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 01 13:52:42 user nova-compute[72129]:     <boot dev='hd'/>
Aug 01 13:52:42 user nova-compute[72129]:     <smbios mode='sysinfo'/>
Aug 01 13:52:42 user nova-compute[72129]:   </os>
Aug 01 13:52:42 user nova-compute[72129]:   <features>
Aug 01 13:52:42 user nova-compute[72129]:     <acpi/>
Aug 01 13:52:42 user nova-compute[72129]:     <apic/>
Aug 01 13:52:42 user nova-compute[72129]:     <vmcoreinfo state='on'/>
Aug 01 13:52:42 user nova-compute[72129]:   </features>
Aug 01 13:52:42 user nova-compute[72129]:   <cpu mode='custom' match='exact' check='full'>
Aug 01 13:52:42 user nova-compute[72129]:     <model fallback='forbid'>Nehalem</model>
Aug 01 13:52:42 user nova-compute[72129]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 01 13:52:42 user nova-compute[72129]:     <feature policy='require' name='vme'/>
Aug 01 13:52:42 user nova-compute[72129]:     <feature policy='require' name='x2apic'/>
Aug 01 13:52:42 user nova-compute[72129]:     <feature policy='require' name='hypervisor'/>
Aug 01 13:52:42 user nova-compute[72129]:   </cpu>
Aug 01 13:52:42 user nova-compute[72129]:   <clock offset='utc'>
Aug 01 13:52:42 user nova-compute[72129]:     <timer name='pit' tickpolicy='delay'/>
Aug 01 13:52:42 user nova-compute[72129]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 01 13:52:42 user nova-compute[72129]:     <timer name='hpet' present='no'/>
Aug 01 13:52:42 user nova-compute[72129]:   </clock>
Aug 01 13:52:42 user nova-compute[72129]:   <on_poweroff>destroy</on_poweroff>
Aug 01 13:52:42 user nova-compute[72129]:   <on_reboot>restart</on_reboot>
Aug 01 13:52:42 user nova-compute[72129]:   <on_crash>destroy</on_crash>
Aug 01 13:52:42 user nova-compute[72129]:   <devices>
Aug 01 13:52:42 user nova-compute[72129]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 01 13:52:42 user nova-compute[72129]:     <disk type='file' device='disk'>
Aug 01 13:52:42 user nova-compute[72129]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 01 13:52:42 user nova-compute[72129]:       <source file='/opt/stack/data/nova/instances/3c1f751a-e2aa-4447-b72f-9dc88c4c1a84/disk' index='2'/>
Aug 01 13:52:42 user nova-compute[72129]:       <backingStore type='file' index='3'>
Aug 01 13:52:42 user nova-compute[72129]:         <format type='raw'/>
Aug 01 13:52:42 user nova-compute[72129]:         <source file='/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1'/>
Aug 01 13:52:42 user nova-compute[72129]:         <backingStore/>
Aug 01 13:52:42 user nova-compute[72129]:       </backingStore>
Aug 01 13:52:42 user nova-compute[72129]:       <target dev='vda' bus='virtio'/>
Aug 01 13:52:42 user nova-compute[72129]:       <alias name='virtio-disk0'/>
Aug 01 13:52:42 user nova-compute[72129]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 01 13:52:42 user nova-compute[72129]:     </disk>
Aug 01 13:52:42 user nova-compute[72129]:     <disk type='file' device='cdrom'>
Aug 01 13:52:42 user nova-compute[72129]:       <driver name='qemu' type='raw' cache='none'/>
Aug 01 13:52:42 user nova-compute[72129]:       <source file='/opt/stack/data/nova/instances/3c1f751a-e2aa-4447-b72f-9dc88c4c1a84/disk.config' index='1'/>
Aug 01 13:52:42 user nova-compute[72129]:       <backingStore/>
Aug 01 13:52:42 user nova-compute[72129]:       <target dev='hda' bus='ide'/>
Aug 01 13:52:42 user nova-compute[72129]:       <readonly/>
Aug 01 13:52:42 user nova-compute[72129]:       <alias name='ide0-0-0'/>
Aug 01 13:52:42 user nova-compute[72129]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 01 13:52:42 user nova-compute[72129]:     </disk>
Aug 01 13:52:42 user nova-compute[72129]:     <controller type='usb' index='0' model='none'>
Aug 01 13:52:42 user nova-compute[72129]:       <alias name='usb'/>
Aug 01 13:52:42 user nova-compute[72129]:     </controller>
Aug 01 13:52:42 user nova-compute[72129]:     <controller type='pci' index='0' model='pci-root'>
Aug 01 13:52:42 user nova-compute[72129]:       <alias name='pci.0'/>
Aug 01 13:52:42 user nova-compute[72129]:     </controller>
Aug 01 13:52:42 user nova-compute[72129]:     <controller type='ide' index='0'>
Aug 01 13:52:42 user nova-compute[72129]:       <alias name='ide'/>
Aug 01 13:52:42 user nova-compute[72129]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 01 13:52:42 user nova-compute[72129]:     </controller>
Aug 01 13:52:42 user nova-compute[72129]:     <interface type='ethernet'>
Aug 01 13:52:42 user nova-compute[72129]:       <mac address='fa:16:3e:58:10:73'/>
Aug 01 13:52:42 user nova-compute[72129]:       <target dev='tap7b1167ce-d4'/>
Aug 01 13:52:42 user nova-compute[72129]:       <model type='virtio'/>
Aug 01 13:52:42 user nova-compute[72129]:       <mtu size='1442'/>
Aug 01 13:52:42 user nova-compute[72129]:       <alias name='net0'/>
Aug 01 13:52:42 user nova-compute[72129]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 01 13:52:42 user nova-compute[72129]:     </interface>
Aug 01 13:52:42 user nova-compute[72129]:     <interface type='ethernet'>
Aug 01 13:52:42 user nova-compute[72129]:       <mac address='fa:16:3e:08:82:8a'/>
Aug 01 13:52:42 user nova-compute[72129]:       <target dev='tapf5389e5c-c0'/>
Aug 01 13:52:42 user nova-compute[72129]:       <model type='virtio'/>
Aug 01 13:52:42 user nova-compute[72129]:       <mtu size='1442'/>
Aug 01 13:52:42 user nova-compute[72129]:       <alias name='net1'/>
Aug 01 13:52:42 user nova-compute[72129]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Aug 01 13:52:42 user nova-compute[72129]:     </interface>
Aug 01 13:52:42 user nova-compute[72129]:     <serial type='pty'>
Aug 01 13:52:42 user nova-compute[72129]:       <source path='/dev/pts/7'/>
Aug 01 13:52:42 user nova-compute[72129]:       <log file='/opt/stack/data/nova/instances/3c1f751a-e2aa-4447-b72f-9dc88c4c1a84/console.log' append='off'/>
Aug 01 13:52:42 user nova-compute[72129]:       <target type='isa-serial' port='0'>
Aug 01 13:52:42 user nova-compute[72129]:         <model name='isa-serial'/>
Aug 01 13:52:42 user nova-compute[72129]:       </target>
Aug 01 13:52:42 user nova-compute[72129]:       <alias name='serial0'/>
Aug 01 13:52:42 user nova-compute[72129]:     </serial>
Aug 01 13:52:42 user nova-compute[72129]:     <console type='pty' tty='/dev/pts/7'>
Aug 01 13:52:42 user nova-compute[72129]:       <source path='/dev/pts/7'/>
Aug 01 13:52:42 user nova-compute[72129]:       <log file='/opt/stack/data/nova/instances/3c1f751a-e2aa-4447-b72f-9dc88c4c1a84/console.log' append='off'/>
Aug 01 13:52:42 user nova-compute[72129]:       <target type='serial' port='0'/>
Aug 01 13:52:42 user nova-compute[72129]:       <alias name='serial0'/>
Aug 01 13:52:42 user nova-compute[72129]:     </console>
Aug 01 13:52:42 user nova-compute[72129]:     <input type='mouse' bus='ps2'>
Aug 01 13:52:42 user nova-compute[72129]:       <alias name='input0'/>
Aug 01 13:52:42 user nova-compute[72129]:     </input>
Aug 01 13:52:42 user nova-compute[72129]:     <input type='keyboard' bus='ps2'>
Aug 01 13:52:42 user nova-compute[72129]:       <alias name='input1'/>
Aug 01 13:52:42 user nova-compute[72129]:     </input>
Aug 01 13:52:42 user nova-compute[72129]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Aug 01 13:52:42 user nova-compute[72129]:       <listen type='address' address='0.0.0.0'/>
Aug 01 13:52:42 user nova-compute[72129]:     </graphics>
Aug 01 13:52:42 user nova-compute[72129]:     <audio id='1' type='none'/>
Aug 01 13:52:42 user nova-compute[72129]:     <video>
Aug 01 13:52:42 user nova-compute[72129]:       <model type='virtio' heads='1' primary='yes'/>
Aug 01 13:52:42 user nova-compute[72129]:       <alias name='video0'/>
Aug 01 13:52:42 user nova-compute[72129]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 01 13:52:42 user nova-compute[72129]:     </video>
Aug 01 13:52:42 user nova-compute[72129]:     <memballoon model='virtio'>
Aug 01 13:52:42 user nova-compute[72129]:       <stats period='10'/>
Aug 01 13:52:42 user nova-compute[72129]:       <alias name='balloon0'/>
Aug 01 13:52:42 user nova-compute[72129]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 01 13:52:42 user nova-compute[72129]:     </memballoon>
Aug 01 13:52:42 user nova-compute[72129]:     <rng model='virtio'>
Aug 01 13:52:42 user nova-compute[72129]:       <backend model='random'>/dev/urandom</backend>
Aug 01 13:52:42 user nova-compute[72129]:       <alias name='rng0'/>
Aug 01 13:52:42 user nova-compute[72129]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 01 13:52:42 user nova-compute[72129]:     </rng>
Aug 01 13:52:42 user nova-compute[72129]:   </devices>
Aug 01 13:52:42 user nova-compute[72129]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 01 13:52:42 user nova-compute[72129]:     <label>libvirt-3c1f751a-e2aa-4447-b72f-9dc88c4c1a84</label>
Aug 01 13:52:42 user nova-compute[72129]:     <imagelabel>libvirt-3c1f751a-e2aa-4447-b72f-9dc88c4c1a84</imagelabel>
Aug 01 13:52:42 user nova-compute[72129]:   </seclabel>
Aug 01 13:52:42 user nova-compute[72129]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 01 13:52:42 user nova-compute[72129]:     <label>+64055:+108</label>
Aug 01 13:52:42 user nova-compute[72129]:     <imagelabel>+64055:+108</imagelabel>
Aug 01 13:52:42 user nova-compute[72129]:   </seclabel>
Aug 01 13:52:42 user nova-compute[72129]: </domain>
Aug 01 13:52:42 user nova-compute[72129]:  {{(pid=72129) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 01 13:52:42 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-d99bd9fb-f6a6-498b-bf37-1b18646e27ab tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Successfully detached device tapf5389e5c-c0 from instance 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84 from the persistent domain config.
Aug 01 13:52:42 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-d99bd9fb-f6a6-498b-bf37-1b18646e27ab tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] (1/8): Attempting to detach device tapf5389e5c-c0 with device alias net1 from instance 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84 from the live domain config. {{(pid=72129) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-d99bd9fb-f6a6-498b-bf37-1b18646e27ab tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] detach device xml: <interface type="ethernet">
Aug 01 13:52:42 user nova-compute[72129]:   <mac address="fa:16:3e:08:82:8a"/>
Aug 01 13:52:42 user nova-compute[72129]:   <model type="virtio"/>
Aug 01 13:52:42 user nova-compute[72129]:   <mtu size="1442"/>
Aug 01 13:52:42 user nova-compute[72129]:   <target dev="tapf5389e5c-c0"/>
Aug 01 13:52:42 user nova-compute[72129]: </interface>
Aug 01 13:52:42 user nova-compute[72129]:  {{(pid=72129) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.025s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c80081-ba3c-4fb3-aed2-8ec09314851a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f9b449c2cd3d\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51d7b83-4feb-4aca-8e9d-acbfd27b2255]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[af31ffa7-21b8-45be-99a8-19c2a7126401]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a17427-d428-4b4e-b809-61ceab5d3651]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] Running cmd (subprocess): nvme version {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] nvme not present on system {{(pid=72129) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efa87a6-1dd6-4441-a55e-8e86be7f0a35/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 13:52:42 user nova-compute[72129]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 13:52:42 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[842f2a14-3308-4b1c-9b60-864fbad9860c]: (4, '') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72129) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] LIGHTOS: no hostnqn found. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG os_brick.utils [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f9b449c2cd3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 13:52:42 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Instance destroyed successfully.
Aug 01 13:52:42 user nova-compute[72129]: DEBUG nova.objects.instance [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Lazy-loading 'resources' on Instance uuid e1ee9e5e-0bd8-4986-8641-d44680f97724 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T13:50:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1241803801',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1241803801',id=11,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+QtfmHSYayd423+Jyi4G3aVMwHbijAAkXCDfLEQf4gBJATuD2dk3LYaj/9StA19vP6tOnx01tyID845MCigJxBrCNqDQZakylTkXzkcsXu0p0VQpMF87v9qpWxh97hvQ==',key_name='tempest-keypair-38580498',keypairs=<?>,launch_index=0,launched_at=2023-08-01T13:51:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2b3a8ce92ea64365b59ae1e4cd450941',ramdisk_id='',reservation_id='r-n7fx3bly',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1602482701',owner_user_name='tempest-TaggedBootDevicesTest-1602482701-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T13:51:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1283f74fc4f74184a36fddf17c319ae1',uuid=e1ee9e5e-0bd8-4986-8641-d44680f97724,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4856f394-91dc-4fd0-9fff-8a45f53f0e01", "address": "fa:16:3e:39:15:ba", "network": {"id": "2dfa2891-a873-4a7a-8460-b78ee7a967e1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1716980837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4856f394-91", "ovs_interfaceid": "4856f394-91dc-4fd0-9fff-8a45f53f0e01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Converting VIF {"id": "4856f394-91dc-4fd0-9fff-8a45f53f0e01", "address": "fa:16:3e:39:15:ba", "network": {"id": "2dfa2891-a873-4a7a-8460-b78ee7a967e1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1716980837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4856f394-91", "ovs_interfaceid": "4856f394-91dc-4fd0-9fff-8a45f53f0e01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:39:15:ba,bridge_name='br-int',has_traffic_filtering=True,id=4856f394-91dc-4fd0-9fff-8a45f53f0e01,network=Network(2dfa2891-a873-4a7a-8460-b78ee7a967e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4856f394-91') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:52:42 user nova-compute[72129]: DEBUG os_vif [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:15:ba,bridge_name='br-int',has_traffic_filtering=True,id=4856f394-91dc-4fd0-9fff-8a45f53f0e01,network=Network(2dfa2891-a873-4a7a-8460-b78ee7a967e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4856f394-91') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 13:52:43 user nova-compute[72129]: INFO nova.compute.manager [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Swapping volume 43c1b008-ef2f-494c-8ba1-6c55ed0085a5 for 09126dac-6afb-45c4-8ec4-9bd3c88593db
Aug 01 13:52:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4856f394-91, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Received event <DeviceRemovedEvent: 1690897963.133487, 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72129) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690897948.3049185, 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c => Stopped> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:52:43 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c] VM Stopped (Lifecycle Event)
Aug 01 13:52:43 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-d99bd9fb-f6a6-498b-bf37-1b18646e27ab tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Start waiting for the detach event from libvirt for device tapf5389e5c-c0 with device alias net1 for instance 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84 {{(pid=72129) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-d99bd9fb-f6a6-498b-bf37-1b18646e27ab tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:08:82:8a"/><model type="virtio"/><mtu size="1442"/><target dev="tapf5389e5c-c0"/></interface> {{(pid=72129) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG nova.compute.manager [req-ebaa41d0-0dd3-404a-b78b-14647d88f85b req-aab93b40-0042-4602-8d38-fc29c778d033 service nova] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] Received event network-vif-plugged-31519672-974b-48c8-a361-e36ef1177d4e {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ebaa41d0-0dd3-404a-b78b-14647d88f85b req-aab93b40-0042-4602-8d38-fc29c778d033 service nova] Acquiring lock "78b77b93-6f25-447f-80a7-d64374fee14d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ebaa41d0-0dd3-404a-b78b-14647d88f85b req-aab93b40-0042-4602-8d38-fc29c778d033 service nova] Lock "78b77b93-6f25-447f-80a7-d64374fee14d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ebaa41d0-0dd3-404a-b78b-14647d88f85b req-aab93b40-0042-4602-8d38-fc29c778d033 service nova] Lock "78b77b93-6f25-447f-80a7-d64374fee14d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG nova.compute.manager [req-ebaa41d0-0dd3-404a-b78b-14647d88f85b req-aab93b40-0042-4602-8d38-fc29c778d033 service nova] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] No waiting events found dispatching network-vif-plugged-31519672-974b-48c8-a361-e36ef1177d4e {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:52:43 user nova-compute[72129]: WARNING nova.compute.manager [req-ebaa41d0-0dd3-404a-b78b-14647d88f85b req-aab93b40-0042-4602-8d38-fc29c778d033 service nova] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] Received unexpected event network-vif-plugged-31519672-974b-48c8-a361-e36ef1177d4e for instance with vm_state active and task_state deleting.
Aug 01 13:52:43 user nova-compute[72129]: DEBUG nova.compute.manager [req-ebaa41d0-0dd3-404a-b78b-14647d88f85b req-aab93b40-0042-4602-8d38-fc29c778d033 service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Received event network-vif-unplugged-1a10af43-8f79-43a4-b847-2c4471576097 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ebaa41d0-0dd3-404a-b78b-14647d88f85b req-aab93b40-0042-4602-8d38-fc29c778d033 service nova] Acquiring lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ebaa41d0-0dd3-404a-b78b-14647d88f85b req-aab93b40-0042-4602-8d38-fc29c778d033 service nova] Lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ebaa41d0-0dd3-404a-b78b-14647d88f85b req-aab93b40-0042-4602-8d38-fc29c778d033 service nova] Lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG nova.compute.manager [req-ebaa41d0-0dd3-404a-b78b-14647d88f85b req-aab93b40-0042-4602-8d38-fc29c778d033 service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] No waiting events found dispatching network-vif-unplugged-1a10af43-8f79-43a4-b847-2c4471576097 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG nova.compute.manager [req-ebaa41d0-0dd3-404a-b78b-14647d88f85b req-aab93b40-0042-4602-8d38-fc29c778d033 service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Received event network-vif-unplugged-1a10af43-8f79-43a4-b847-2c4471576097 for instance with task_state deleting. {{(pid=72129) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG nova.compute.manager [req-ebaa41d0-0dd3-404a-b78b-14647d88f85b req-aab93b40-0042-4602-8d38-fc29c778d033 service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Received event network-vif-plugged-1a10af43-8f79-43a4-b847-2c4471576097 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ebaa41d0-0dd3-404a-b78b-14647d88f85b req-aab93b40-0042-4602-8d38-fc29c778d033 service nova] Acquiring lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ebaa41d0-0dd3-404a-b78b-14647d88f85b req-aab93b40-0042-4602-8d38-fc29c778d033 service nova] Lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ebaa41d0-0dd3-404a-b78b-14647d88f85b req-aab93b40-0042-4602-8d38-fc29c778d033 service nova] Lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG nova.compute.manager [req-ebaa41d0-0dd3-404a-b78b-14647d88f85b req-aab93b40-0042-4602-8d38-fc29c778d033 service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] No waiting events found dispatching network-vif-plugged-1a10af43-8f79-43a4-b847-2c4471576097 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:52:43 user nova-compute[72129]: WARNING nova.compute.manager [req-ebaa41d0-0dd3-404a-b78b-14647d88f85b req-aab93b40-0042-4602-8d38-fc29c778d033 service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Received unexpected event network-vif-plugged-1a10af43-8f79-43a4-b847-2c4471576097 for instance with vm_state active and task_state deleting.
Aug 01 13:52:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG nova.compute.manager [req-7b8cb86a-4142-4971-b90f-6eedcf96a4aa req-37c19407-9066-4ee5-a77a-435494ef1b50 service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Received event network-vif-plugged-c3fc041a-b39f-448a-a5d6-3e2b67368d50 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-7b8cb86a-4142-4971-b90f-6eedcf96a4aa req-37c19407-9066-4ee5-a77a-435494ef1b50 service nova] Acquiring lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-7b8cb86a-4142-4971-b90f-6eedcf96a4aa req-37c19407-9066-4ee5-a77a-435494ef1b50 service nova] Lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-7b8cb86a-4142-4971-b90f-6eedcf96a4aa req-37c19407-9066-4ee5-a77a-435494ef1b50 service nova] Lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG nova.compute.manager [req-7b8cb86a-4142-4971-b90f-6eedcf96a4aa req-37c19407-9066-4ee5-a77a-435494ef1b50 service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] No waiting events found dispatching network-vif-plugged-c3fc041a-b39f-448a-a5d6-3e2b67368d50 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:52:43 user nova-compute[72129]: WARNING nova.compute.manager [req-7b8cb86a-4142-4971-b90f-6eedcf96a4aa req-37c19407-9066-4ee5-a77a-435494ef1b50 service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Received unexpected event network-vif-plugged-c3fc041a-b39f-448a-a5d6-3e2b67368d50 for instance with vm_state active and task_state deleting.
Aug 01 13:52:43 user nova-compute[72129]: DEBUG nova.compute.manager [None req-f6d47720-7629-46c5-96fa-bab2a080f095 None None] [instance: 0ce22ea1-b01c-47c6-b9e4-bf28aebc125c] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-d99bd9fb-f6a6-498b-bf37-1b18646e27ab tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:08:82:8a"/><model type="virtio"/><mtu size="1442"/><target dev="tapf5389e5c-c0"/></interface>not found in domain: <domain type='kvm' id='8'>
Aug 01 13:52:43 user nova-compute[72129]:   <name>instance-00000008</name>
Aug 01 13:52:43 user nova-compute[72129]:   <uuid>3c1f751a-e2aa-4447-b72f-9dc88c4c1a84</uuid>
Aug 01 13:52:43 user nova-compute[72129]:   <metadata>
Aug 01 13:52:43 user nova-compute[72129]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 13:52:43 user nova-compute[72129]:   <nova:package version="0.0.0"/>
Aug 01 13:52:43 user nova-compute[72129]:   <nova:name>tempest-device-tagging-server-1732967996</nova:name>
Aug 01 13:52:43 user nova-compute[72129]:   <nova:creationTime>2023-08-01 13:52:22</nova:creationTime>
Aug 01 13:52:43 user nova-compute[72129]:   <nova:flavor name="m1.tiny">
Aug 01 13:52:43 user nova-compute[72129]:     <nova:memory>512</nova:memory>
Aug 01 13:52:43 user nova-compute[72129]:     <nova:disk>1</nova:disk>
Aug 01 13:52:43 user nova-compute[72129]:     <nova:swap>0</nova:swap>
Aug 01 13:52:43 user nova-compute[72129]:     <nova:ephemeral>0</nova:ephemeral>
Aug 01 13:52:43 user nova-compute[72129]:     <nova:vcpus>1</nova:vcpus>
Aug 01 13:52:43 user nova-compute[72129]:   </nova:flavor>
Aug 01 13:52:43 user nova-compute[72129]:   <nova:owner>
Aug 01 13:52:43 user nova-compute[72129]:     <nova:user uuid="ded159a3c395418d9e4d699ed249eabb">tempest-TaggedAttachmentsTest-1582776521-project-member</nova:user>
Aug 01 13:52:43 user nova-compute[72129]:     <nova:project uuid="2184fb8ab16d482ea3ca397fbb5515ff">tempest-TaggedAttachmentsTest-1582776521</nova:project>
Aug 01 13:52:43 user nova-compute[72129]:   </nova:owner>
Aug 01 13:52:43 user nova-compute[72129]:   <nova:root type="image" uuid="b6472c34-1b0f-4034-ba3a-7e8eb5103715"/>
Aug 01 13:52:43 user nova-compute[72129]:   <nova:ports>
Aug 01 13:52:43 user nova-compute[72129]:     <nova:port uuid="7b1167ce-d40a-4355-8411-6a1dd005465f">
Aug 01 13:52:43 user nova-compute[72129]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 01 13:52:43 user nova-compute[72129]:     </nova:port>
Aug 01 13:52:43 user nova-compute[72129]:     <nova:port uuid="f5389e5c-c039-4fbf-a851-8a8b1c8c5a4c">
Aug 01 13:52:43 user nova-compute[72129]:       <nova:ip type="fixed" address="10.10.10.129" ipVersion="4"/>
Aug 01 13:52:43 user nova-compute[72129]:     </nova:port>
Aug 01 13:52:43 user nova-compute[72129]:   </nova:ports>
Aug 01 13:52:43 user nova-compute[72129]: </nova:instance>
Aug 01 13:52:43 user nova-compute[72129]:   </metadata>
Aug 01 13:52:43 user nova-compute[72129]:   <memory unit='KiB'>524288</memory>
Aug 01 13:52:43 user nova-compute[72129]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 01 13:52:43 user nova-compute[72129]:   <vcpu placement='static'>1</vcpu>
Aug 01 13:52:43 user nova-compute[72129]:   <resource>
Aug 01 13:52:43 user nova-compute[72129]:     <partition>/machine</partition>
Aug 01 13:52:43 user nova-compute[72129]:   </resource>
Aug 01 13:52:43 user nova-compute[72129]:   <sysinfo type='smbios'>
Aug 01 13:52:43 user nova-compute[72129]:     <system>
Aug 01 13:52:43 user nova-compute[72129]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 01 13:52:43 user nova-compute[72129]:       <entry name='product'>OpenStack Nova</entry>
Aug 01 13:52:43 user nova-compute[72129]:       <entry name='version'>0.0.0</entry>
Aug 01 13:52:43 user nova-compute[72129]:       <entry name='serial'>3c1f751a-e2aa-4447-b72f-9dc88c4c1a84</entry>
Aug 01 13:52:43 user nova-compute[72129]:       <entry name='uuid'>3c1f751a-e2aa-4447-b72f-9dc88c4c1a84</entry>
Aug 01 13:52:43 user nova-compute[72129]:       <entry name='family'>Virtual Machine</entry>
Aug 01 13:52:43 user nova-compute[72129]:     </system>
Aug 01 13:52:43 user nova-compute[72129]:   </sysinfo>
Aug 01 13:52:43 user nova-compute[72129]:   <os>
Aug 01 13:52:43 user nova-compute[72129]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 01 13:52:43 user nova-compute[72129]:     <boot dev='hd'/>
Aug 01 13:52:43 user nova-compute[72129]:     <smbios mode='sysinfo'/>
Aug 01 13:52:43 user nova-compute[72129]:   </os>
Aug 01 13:52:43 user nova-compute[72129]:   <features>
Aug 01 13:52:43 user nova-compute[72129]:     <acpi/>
Aug 01 13:52:43 user nova-compute[72129]:     <apic/>
Aug 01 13:52:43 user nova-compute[72129]:     <vmcoreinfo state='on'/>
Aug 01 13:52:43 user nova-compute[72129]:   </features>
Aug 01 13:52:43 user nova-compute[72129]:   <cpu mode='custom' match='exact' check='full'>
Aug 01 13:52:43 user nova-compute[72129]:     <model fallback='forbid'>Nehalem</model>
Aug 01 13:52:43 user nova-compute[72129]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 01 13:52:43 user nova-compute[72129]:     <feature policy='require' name='vme'/>
Aug 01 13:52:43 user nova-compute[72129]:     <feature policy='require' name='x2apic'/>
Aug 01 13:52:43 user nova-compute[72129]:     <feature policy='require' name='hypervisor'/>
Aug 01 13:52:43 user nova-compute[72129]:   </cpu>
Aug 01 13:52:43 user nova-compute[72129]:   <clock offset='utc'>
Aug 01 13:52:43 user nova-compute[72129]:     <timer name='pit' tickpolicy='delay'/>
Aug 01 13:52:43 user nova-compute[72129]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 01 13:52:43 user nova-compute[72129]:     <timer name='hpet' present='no'/>
Aug 01 13:52:43 user nova-compute[72129]:   </clock>
Aug 01 13:52:43 user nova-compute[72129]:   <on_poweroff>destroy</on_poweroff>
Aug 01 13:52:43 user nova-compute[72129]:   <on_reboot>restart</on_reboot>
Aug 01 13:52:43 user nova-compute[72129]:   <on_crash>destroy</on_crash>
Aug 01 13:52:43 user nova-compute[72129]:   <devices>
Aug 01 13:52:43 user nova-compute[72129]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 01 13:52:43 user nova-compute[72129]:     <disk type='file' device='disk'>
Aug 01 13:52:43 user nova-compute[72129]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 01 13:52:43 user nova-compute[72129]:       <source file='/opt/stack/data/nova/instances/3c1f751a-e2aa-4447-b72f-9dc88c4c1a84/disk' index='2'/>
Aug 01 13:52:43 user nova-compute[72129]:       <backingStore type='file' index='3'>
Aug 01 13:52:43 user nova-compute[72129]:         <format type='raw'/>
Aug 01 13:52:43 user nova-compute[72129]:         <source file='/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1'/>
Aug 01 13:52:43 user nova-compute[72129]:         <backingStore/>
Aug 01 13:52:43 user nova-compute[72129]:       </backingStore>
Aug 01 13:52:43 user nova-compute[72129]:       <target dev='vda' bus='virtio'/>
Aug 01 13:52:43 user nova-compute[72129]:       <alias name='virtio-disk0'/>
Aug 01 13:52:43 user nova-compute[72129]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 01 13:52:43 user nova-compute[72129]:     </disk>
Aug 01 13:52:43 user nova-compute[72129]:     <disk type='file' device='cdrom'>
Aug 01 13:52:43 user nova-compute[72129]:       <driver name='qemu' type='raw' cache='none'/>
Aug 01 13:52:43 user nova-compute[72129]:       <source file='/opt/stack/data/nova/instances/3c1f751a-e2aa-4447-b72f-9dc88c4c1a84/disk.config' index='1'/>
Aug 01 13:52:43 user nova-compute[72129]:       <backingStore/>
Aug 01 13:52:43 user nova-compute[72129]:       <target dev='hda' bus='ide'/>
Aug 01 13:52:43 user nova-compute[72129]:       <readonly/>
Aug 01 13:52:43 user nova-compute[72129]:       <alias name='ide0-0-0'/>
Aug 01 13:52:43 user nova-compute[72129]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 01 13:52:43 user nova-compute[72129]:     </disk>
Aug 01 13:52:43 user nova-compute[72129]:     <controller type='usb' index='0' model='none'>
Aug 01 13:52:43 user nova-compute[72129]:       <alias name='usb'/>
Aug 01 13:52:43 user nova-compute[72129]:     </controller>
Aug 01 13:52:43 user nova-compute[72129]:     <controller type='pci' index='0' model='pci-root'>
Aug 01 13:52:43 user nova-compute[72129]:       <alias name='pci.0'/>
Aug 01 13:52:43 user nova-compute[72129]:     </controller>
Aug 01 13:52:43 user nova-compute[72129]:     <controller type='ide' index='0'>
Aug 01 13:52:43 user nova-compute[72129]:       <alias name='ide'/>
Aug 01 13:52:43 user nova-compute[72129]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 01 13:52:43 user nova-compute[72129]:     </controller>
Aug 01 13:52:43 user nova-compute[72129]:     <interface type='ethernet'>
Aug 01 13:52:43 user nova-compute[72129]:       <mac address='fa:16:3e:58:10:73'/>
Aug 01 13:52:43 user nova-compute[72129]:       <target dev='tap7b1167ce-d4'/>
Aug 01 13:52:43 user nova-compute[72129]:       <model type='virtio'/>
Aug 01 13:52:43 user nova-compute[72129]:       <mtu size='1442'/>
Aug 01 13:52:43 user nova-compute[72129]:       <alias name='net0'/>
Aug 01 13:52:43 user nova-compute[72129]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 01 13:52:43 user nova-compute[72129]:     </interface>
Aug 01 13:52:43 user nova-compute[72129]:     <serial type='pty'>
Aug 01 13:52:43 user nova-compute[72129]:       <source path='/dev/pts/7'/>
Aug 01 13:52:43 user nova-compute[72129]:       <log file='/opt/stack/data/nova/instances/3c1f751a-e2aa-4447-b72f-9dc88c4c1a84/console.log' append='off'/>
Aug 01 13:52:43 user nova-compute[72129]:       <target type='isa-serial' port='0'>
Aug 01 13:52:43 user nova-compute[72129]:         <model name='isa-serial'/>
Aug 01 13:52:43 user nova-compute[72129]:       </target>
Aug 01 13:52:43 user nova-compute[72129]:       <alias name='serial0'/>
Aug 01 13:52:43 user nova-compute[72129]:     </serial>
Aug 01 13:52:43 user nova-compute[72129]:     <console type='pty' tty='/dev/pts/7'>
Aug 01 13:52:43 user nova-compute[72129]:       <source path='/dev/pts/7'/>
Aug 01 13:52:43 user nova-compute[72129]:       <log file='/opt/stack/data/nova/instances/3c1f751a-e2aa-4447-b72f-9dc88c4c1a84/console.log' append='off'/>
Aug 01 13:52:43 user nova-compute[72129]:       <target type='serial' port='0'/>
Aug 01 13:52:43 user nova-compute[72129]:       <alias name='serial0'/>
Aug 01 13:52:43 user nova-compute[72129]:     </console>
Aug 01 13:52:43 user nova-compute[72129]:     <input type='mouse' bus='ps2'>
Aug 01 13:52:43 user nova-compute[72129]:       <alias name='input0'/>
Aug 01 13:52:43 user nova-compute[72129]:     </input>
Aug 01 13:52:43 user nova-compute[72129]:     <input type='keyboard' bus='ps2'>
Aug 01 13:52:43 user nova-compute[72129]:       <alias name='input1'/>
Aug 01 13:52:43 user nova-compute[72129]:     </input>
Aug 01 13:52:43 user nova-compute[72129]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Aug 01 13:52:43 user nova-compute[72129]:       <listen type='address' address='0.0.0.0'/>
Aug 01 13:52:43 user nova-compute[72129]:     </graphics>
Aug 01 13:52:43 user nova-compute[72129]:     <audio id='1' type='none'/>
Aug 01 13:52:43 user nova-compute[72129]:     <video>
Aug 01 13:52:43 user nova-compute[72129]:       <model type='virtio' heads='1' primary='yes'/>
Aug 01 13:52:43 user nova-compute[72129]:       <alias name='video0'/>
Aug 01 13:52:43 user nova-compute[72129]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 01 13:52:43 user nova-compute[72129]:     </video>
Aug 01 13:52:43 user nova-compute[72129]:     <memballoon model='virtio'>
Aug 01 13:52:43 user nova-compute[72129]:       <stats period='10'/>
Aug 01 13:52:43 user nova-compute[72129]:       <alias name='balloon0'/>
Aug 01 13:52:43 user nova-compute[72129]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 01 13:52:43 user nova-compute[72129]:     </memballoon>
Aug 01 13:52:43 user nova-compute[72129]:     <rng model='virtio'>
Aug 01 13:52:43 user nova-compute[72129]:       <backend model='random'>/dev/urandom</backend>
Aug 01 13:52:43 user nova-compute[72129]:       <alias name='rng0'/>
Aug 01 13:52:43 user nova-compute[72129]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 01 13:52:43 user nova-compute[72129]:     </rng>
Aug 01 13:52:43 user nova-compute[72129]:   </devices>
Aug 01 13:52:43 user nova-compute[72129]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 01 13:52:43 user nova-compute[72129]:     <label>libvirt-3c1f751a-e2aa-4447-b72f-9dc88c4c1a84</label>
Aug 01 13:52:43 user nova-compute[72129]:     <imagelabel>libvirt-3c1f751a-e2aa-4447-b72f-9dc88c4c1a84</imagelabel>
Aug 01 13:52:43 user nova-compute[72129]:   </seclabel>
Aug 01 13:52:43 user nova-compute[72129]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 01 13:52:43 user nova-compute[72129]:     <label>+64055:+108</label>
Aug 01 13:52:43 user nova-compute[72129]:     <imagelabel>+64055:+108</imagelabel>
Aug 01 13:52:43 user nova-compute[72129]:   </seclabel>
Aug 01 13:52:43 user nova-compute[72129]: </domain>
Aug 01 13:52:43 user nova-compute[72129]:  {{(pid=72129) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 01 13:52:43 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-d99bd9fb-f6a6-498b-bf37-1b18646e27ab tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Successfully detached device tapf5389e5c-c0 from instance 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84 from the live domain config.
Aug 01 13:52:43 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-d99bd9fb-f6a6-498b-bf37-1b18646e27ab tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T13:50:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1732967996',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1732967996',id=8,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLV9A0exWrqx9JsfbE2qI31l+qAJAoY1ILqBBhJy25PwbbuJ9xEqV3MLcWWfDrGgYOcUOAwPrjT+u/vasbyQv8o1AhTEdbBmNL+fkWaNh0TGgFByD46Z+LnLlJ94XdbvJQ==',key_name='tempest-keypair-1026124919',keypairs=<?>,launch_index=0,launched_at=2023-08-01T13:50:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2184fb8ab16d482ea3ca397fbb5515ff',ramdisk_id='',reservation_id='r-qogqtpk0',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1582776521',owner_user_name='tempest-TaggedAttachmentsTest-1582776521-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T13:50:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ded159a3c395418d9e4d699ed249eabb',uuid=3c1f751a-e2aa-4447-b72f-9dc88c4c1a84,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5389e5c-c039-4fbf-a851-8a8b1c8c5a4c", "address": "fa:16:3e:08:82:8a", "network": {"id": "18cced8e-a715-4226-89e6-39ea504b5746", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-521965974", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2184fb8ab16d482ea3ca397fbb5515ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5389e5c-c0", "ovs_interfaceid": "f5389e5c-c039-4fbf-a851-8a8b1c8c5a4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-d99bd9fb-f6a6-498b-bf37-1b18646e27ab tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Converting VIF {"id": "f5389e5c-c039-4fbf-a851-8a8b1c8c5a4c", "address": "fa:16:3e:08:82:8a", "network": {"id": "18cced8e-a715-4226-89e6-39ea504b5746", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-521965974", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "2184fb8ab16d482ea3ca397fbb5515ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5389e5c-c0", "ovs_interfaceid": "f5389e5c-c039-4fbf-a851-8a8b1c8c5a4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-d99bd9fb-f6a6-498b-bf37-1b18646e27ab tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:82:8a,bridge_name='br-int',has_traffic_filtering=True,id=f5389e5c-c039-4fbf-a851-8a8b1c8c5a4c,network=Network(18cced8e-a715-4226-89e6-39ea504b5746),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5389e5c-c0') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG os_vif [None req-d99bd9fb-f6a6-498b-bf37-1b18646e27ab tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:82:8a,bridge_name='br-int',has_traffic_filtering=True,id=f5389e5c-c039-4fbf-a851-8a8b1c8c5a4c,network=Network(18cced8e-a715-4226-89e6-39ea504b5746),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5389e5c-c0') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 13:52:43 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:52:43 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:52:43 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Hypervisor/Node resource view: name=user free_ram=7045MB free_disk=25.579345703125GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72129) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf5389e5c-c0, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:52:43 user nova-compute[72129]: INFO os_vif [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:15:ba,bridge_name='br-int',has_traffic_filtering=True,id=4856f394-91dc-4fd0-9fff-8a45f53f0e01,network=Network(2dfa2891-a873-4a7a-8460-b78ee7a967e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4856f394-91')
Aug 01 13:52:43 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T13:50:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1241803801',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1241803801',id=11,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+QtfmHSYayd423+Jyi4G3aVMwHbijAAkXCDfLEQf4gBJATuD2dk3LYaj/9StA19vP6tOnx01tyID845MCigJxBrCNqDQZakylTkXzkcsXu0p0VQpMF87v9qpWxh97hvQ==',key_name='tempest-keypair-38580498',keypairs=<?>,launch_index=0,launched_at=2023-08-01T13:51:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2b3a8ce92ea64365b59ae1e4cd450941',ramdisk_id='',reservation_id='r-n7fx3bly',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1602482701',owner_user_name='tempest-TaggedBootDevicesTest-1602482701-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T13:51:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1283f74fc4f74184a36fddf17c319ae1',uuid=e1ee9e5e-0bd8-4986-8641-d44680f97724,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3da4a68a-4d20-4f36-bf85-e74a93a6c9f2", "address": "fa:16:3e:3a:cf:74", "network": {"id": "0238d661-fbc1-4955-8933-92891b6a621e", "bridge": "br-int", "label": "tempest-device-tagging-net1-78670494", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3da4a68a-4d", "ovs_interfaceid": "3da4a68a-4d20-4f36-bf85-e74a93a6c9f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Converting VIF {"id": "3da4a68a-4d20-4f36-bf85-e74a93a6c9f2", "address": "fa:16:3e:3a:cf:74", "network": {"id": "0238d661-fbc1-4955-8933-92891b6a621e", "bridge": "br-int", "label": "tempest-device-tagging-net1-78670494", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3da4a68a-4d", "ovs_interfaceid": "3da4a68a-4d20-4f36-bf85-e74a93a6c9f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:cf:74,bridge_name='br-int',has_traffic_filtering=True,id=3da4a68a-4d20-4f36-bf85-e74a93a6c9f2,network=Network(0238d661-fbc1-4955-8933-92891b6a621e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3da4a68a-4d') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG os_vif [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:cf:74,bridge_name='br-int',has_traffic_filtering=True,id=3da4a68a-4d20-4f36-bf85-e74a93a6c9f2,network=Network(0238d661-fbc1-4955-8933-92891b6a621e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3da4a68a-4d') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3da4a68a-4d, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:52:43 user nova-compute[72129]: INFO os_vif [None req-d99bd9fb-f6a6-498b-bf37-1b18646e27ab tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:82:8a,bridge_name='br-int',has_traffic_filtering=True,id=f5389e5c-c039-4fbf-a851-8a8b1c8c5a4c,network=Network(18cced8e-a715-4226-89e6-39ea504b5746),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5389e5c-c0')
Aug 01 13:52:43 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-d99bd9fb-f6a6-498b-bf37-1b18646e27ab tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 13:52:43 user nova-compute[72129]:   <nova:package version="0.0.0"/>
Aug 01 13:52:43 user nova-compute[72129]:   <nova:name>tempest-device-tagging-server-1732967996</nova:name>
Aug 01 13:52:43 user nova-compute[72129]:   <nova:creationTime>2023-08-01 13:52:43</nova:creationTime>
Aug 01 13:52:43 user nova-compute[72129]:   <nova:flavor name="m1.tiny">
Aug 01 13:52:43 user nova-compute[72129]:     <nova:memory>512</nova:memory>
Aug 01 13:52:43 user nova-compute[72129]:     <nova:disk>1</nova:disk>
Aug 01 13:52:43 user nova-compute[72129]:     <nova:swap>0</nova:swap>
Aug 01 13:52:43 user nova-compute[72129]:     <nova:ephemeral>0</nova:ephemeral>
Aug 01 13:52:43 user nova-compute[72129]:     <nova:vcpus>1</nova:vcpus>
Aug 01 13:52:43 user nova-compute[72129]:   </nova:flavor>
Aug 01 13:52:43 user nova-compute[72129]:   <nova:owner>
Aug 01 13:52:43 user nova-compute[72129]:     <nova:user uuid="ded159a3c395418d9e4d699ed249eabb">tempest-TaggedAttachmentsTest-1582776521-project-member</nova:user>
Aug 01 13:52:43 user nova-compute[72129]:     <nova:project uuid="2184fb8ab16d482ea3ca397fbb5515ff">tempest-TaggedAttachmentsTest-1582776521</nova:project>
Aug 01 13:52:43 user nova-compute[72129]:   </nova:owner>
Aug 01 13:52:43 user nova-compute[72129]:   <nova:root type="image" uuid="b6472c34-1b0f-4034-ba3a-7e8eb5103715"/>
Aug 01 13:52:43 user nova-compute[72129]:   <nova:ports>
Aug 01 13:52:43 user nova-compute[72129]:     <nova:port uuid="7b1167ce-d40a-4355-8411-6a1dd005465f">
Aug 01 13:52:43 user nova-compute[72129]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 01 13:52:43 user nova-compute[72129]:     </nova:port>
Aug 01 13:52:43 user nova-compute[72129]:   </nova:ports>
Aug 01 13:52:43 user nova-compute[72129]: </nova:instance>
Aug 01 13:52:43 user nova-compute[72129]:  {{(pid=72129) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:43 user nova-compute[72129]: INFO os_vif [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:cf:74,bridge_name='br-int',has_traffic_filtering=True,id=3da4a68a-4d20-4f36-bf85-e74a93a6c9f2,network=Network(0238d661-fbc1-4955-8933-92891b6a621e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3da4a68a-4d')
Aug 01 13:52:43 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T13:50:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1241803801',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1241803801',id=11,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+QtfmHSYayd423+Jyi4G3aVMwHbijAAkXCDfLEQf4gBJATuD2dk3LYaj/9StA19vP6tOnx01tyID845MCigJxBrCNqDQZakylTkXzkcsXu0p0VQpMF87v9qpWxh97hvQ==',key_name='tempest-keypair-38580498',keypairs=<?>,launch_index=0,launched_at=2023-08-01T13:51:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2b3a8ce92ea64365b59ae1e4cd450941',ramdisk_id='',reservation_id='r-n7fx3bly',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1602482701',owner_user_name='tempest-TaggedBootDevicesTest-1602482701-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T13:51:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1283f74fc4f74184a36fddf17c319ae1',uuid=e1ee9e5e-0bd8-4986-8641-d44680f97724,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c3fc041a-b39f-448a-a5d6-3e2b67368d50", "address": "fa:16:3e:31:e8:5e", "network": {"id": "0238d661-fbc1-4955-8933-92891b6a621e", "bridge": "br-int", "label": "tempest-device-tagging-net1-78670494", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3fc041a-b3", "ovs_interfaceid": "c3fc041a-b39f-448a-a5d6-3e2b67368d50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Converting VIF {"id": "c3fc041a-b39f-448a-a5d6-3e2b67368d50", "address": "fa:16:3e:31:e8:5e", "network": {"id": "0238d661-fbc1-4955-8933-92891b6a621e", "bridge": "br-int", "label": "tempest-device-tagging-net1-78670494", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3fc041a-b3", "ovs_interfaceid": "c3fc041a-b39f-448a-a5d6-3e2b67368d50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:e8:5e,bridge_name='br-int',has_traffic_filtering=True,id=c3fc041a-b39f-448a-a5d6-3e2b67368d50,network=Network(0238d661-fbc1-4955-8933-92891b6a621e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc3fc041a-b3') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG os_vif [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:e8:5e,bridge_name='br-int',has_traffic_filtering=True,id=c3fc041a-b39f-448a-a5d6-3e2b67368d50,network=Network(0238d661-fbc1-4955-8933-92891b6a621e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc3fc041a-b3') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc3fc041a-b3, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 63c0c1fe-7e4d-4763-8ede-a7662747a4c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 2efa87a6-1dd6-4441-a55e-8e86be7f0a35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 28115c7d-544a-4504-98da-2398e0e354d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 31105963-52fa-4aff-9270-075cd98f08a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 78b77b93-6f25-447f-80a7-d64374fee14d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 1490f922-a4b0-43be-8826-ab527f66a350 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance e1ee9e5e-0bd8-4986-8641-d44680f97724 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 31781ddf-6764-4c41-8047-21adfc25d610 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance a07aaeaa-322d-419e-86f5-65cd448c39e7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:43 user nova-compute[72129]: INFO os_vif [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:e8:5e,bridge_name='br-int',has_traffic_filtering=True,id=c3fc041a-b39f-448a-a5d6-3e2b67368d50,network=Network(0238d661-fbc1-4955-8933-92891b6a621e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc3fc041a-b3')
Aug 01 13:52:43 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T13:50:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1241803801',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1241803801',id=11,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+QtfmHSYayd423+Jyi4G3aVMwHbijAAkXCDfLEQf4gBJATuD2dk3LYaj/9StA19vP6tOnx01tyID845MCigJxBrCNqDQZakylTkXzkcsXu0p0VQpMF87v9qpWxh97hvQ==',key_name='tempest-keypair-38580498',keypairs=<?>,launch_index=0,launched_at=2023-08-01T13:51:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2b3a8ce92ea64365b59ae1e4cd450941',ramdisk_id='',reservation_id='r-n7fx3bly',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1602482701',owner_user_name='tempest-TaggedBootDevicesTest-1602482701-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T13:51:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1283f74fc4f74184a36fddf17c319ae1',uuid=e1ee9e5e-0bd8-4986-8641-d44680f97724,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1a10af43-8f79-43a4-b847-2c4471576097", "address": "fa:16:3e:d9:f3:84", "network": {"id": "0238d661-fbc1-4955-8933-92891b6a621e", "bridge": "br-int", "label": "tempest-device-tagging-net1-78670494", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a10af43-8f", "ovs_interfaceid": "1a10af43-8f79-43a4-b847-2c4471576097", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Converting VIF {"id": "1a10af43-8f79-43a4-b847-2c4471576097", "address": "fa:16:3e:d9:f3:84", "network": {"id": "0238d661-fbc1-4955-8933-92891b6a621e", "bridge": "br-int", "label": "tempest-device-tagging-net1-78670494", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a10af43-8f", "ovs_interfaceid": "1a10af43-8f79-43a4-b847-2c4471576097", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:f3:84,bridge_name='br-int',has_traffic_filtering=True,id=1a10af43-8f79-43a4-b847-2c4471576097,network=Network(0238d661-fbc1-4955-8933-92891b6a621e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a10af43-8f') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG os_vif [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:f3:84,bridge_name='br-int',has_traffic_filtering=True,id=1a10af43-8f79-43a4-b847-2c4471576097,network=Network(0238d661-fbc1-4955-8933-92891b6a621e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a10af43-8f') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 13:52:43 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] Took 2.23 seconds to deallocate network for instance.
Aug 01 13:52:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1a10af43-8f, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:43 user nova-compute[72129]: INFO os_vif [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:f3:84,bridge_name='br-int',has_traffic_filtering=True,id=1a10af43-8f79-43a4-b847-2c4471576097,network=Network(0238d661-fbc1-4955-8933-92891b6a621e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a10af43-8f')
Aug 01 13:52:43 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T13:50:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1241803801',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1241803801',id=11,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+QtfmHSYayd423+Jyi4G3aVMwHbijAAkXCDfLEQf4gBJATuD2dk3LYaj/9StA19vP6tOnx01tyID845MCigJxBrCNqDQZakylTkXzkcsXu0p0VQpMF87v9qpWxh97hvQ==',key_name='tempest-keypair-38580498',keypairs=<?>,launch_index=0,launched_at=2023-08-01T13:51:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2b3a8ce92ea64365b59ae1e4cd450941',ramdisk_id='',reservation_id='r-n7fx3bly',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1602482701',owner_user_name='tempest-TaggedBootDevicesTest-1602482701-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T13:51:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1283f74fc4f74184a36fddf17c319ae1',uuid=e1ee9e5e-0bd8-4986-8641-d44680f97724,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e4a333bd-6565-4da1-ae2c-4953c3a14f53", "address": "fa:16:3e:06:c9:e4", "network": {"id": "0238d661-fbc1-4955-8933-92891b6a621e", "bridge": "br-int", "label": "tempest-device-tagging-net1-78670494", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4a333bd-65", "ovs_interfaceid": "e4a333bd-6565-4da1-ae2c-4953c3a14f53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Converting VIF {"id": "e4a333bd-6565-4da1-ae2c-4953c3a14f53", "address": "fa:16:3e:06:c9:e4", "network": {"id": "0238d661-fbc1-4955-8933-92891b6a621e", "bridge": "br-int", "label": "tempest-device-tagging-net1-78670494", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4a333bd-65", "ovs_interfaceid": "e4a333bd-6565-4da1-ae2c-4953c3a14f53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:c9:e4,bridge_name='br-int',has_traffic_filtering=True,id=e4a333bd-6565-4da1-ae2c-4953c3a14f53,network=Network(0238d661-fbc1-4955-8933-92891b6a621e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4a333bd-65') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG os_vif [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:c9:e4,bridge_name='br-int',has_traffic_filtering=True,id=e4a333bd-6565-4da1-ae2c-4953c3a14f53,network=Network(0238d661-fbc1-4955-8933-92891b6a621e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4a333bd-65') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape4a333bd-65, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-fbec0646-5fad-4cff-ae6a-547672968dea tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:43 user nova-compute[72129]: INFO os_vif [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:c9:e4,bridge_name='br-int',has_traffic_filtering=True,id=e4a333bd-6565-4da1-ae2c-4953c3a14f53,network=Network(0238d661-fbc1-4955-8933-92891b6a621e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4a333bd-65')
Aug 01 13:52:43 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T13:50:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1241803801',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1241803801',id=11,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+QtfmHSYayd423+Jyi4G3aVMwHbijAAkXCDfLEQf4gBJATuD2dk3LYaj/9StA19vP6tOnx01tyID845MCigJxBrCNqDQZakylTkXzkcsXu0p0VQpMF87v9qpWxh97hvQ==',key_name='tempest-keypair-38580498',keypairs=<?>,launch_index=0,launched_at=2023-08-01T13:51:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2b3a8ce92ea64365b59ae1e4cd450941',ramdisk_id='',reservation_id='r-n7fx3bly',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1602482701',owner_user_name='tempest-TaggedBootDevicesTest-1602482701-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T13:51:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1283f74fc4f74184a36fddf17c319ae1',uuid=e1ee9e5e-0bd8-4986-8641-d44680f97724,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e1d5b511-b4c8-4d81-8b78-e58ffdfb3015", "address": "fa:16:3e:e1:69:b3", "network": {"id": "a7073672-c19c-45cb-8549-4c0e25c52255", "bridge": "br-int", "label": "tempest-device-tagging-net2-1432218036", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d5b511-b4", "ovs_interfaceid": "e1d5b511-b4c8-4d81-8b78-e58ffdfb3015", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Converting VIF {"id": "e1d5b511-b4c8-4d81-8b78-e58ffdfb3015", "address": "fa:16:3e:e1:69:b3", "network": {"id": "a7073672-c19c-45cb-8549-4c0e25c52255", "bridge": "br-int", "label": "tempest-device-tagging-net2-1432218036", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d5b511-b4", "ovs_interfaceid": "e1d5b511-b4c8-4d81-8b78-e58ffdfb3015", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:69:b3,bridge_name='br-int',has_traffic_filtering=True,id=e1d5b511-b4c8-4d81-8b78-e58ffdfb3015,network=Network(a7073672-c19c-45cb-8549-4c0e25c52255),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1d5b511-b4') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG os_vif [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:69:b3,bridge_name='br-int',has_traffic_filtering=True,id=e1d5b511-b4c8-4d81-8b78-e58ffdfb3015,network=Network(a7073672-c19c-45cb-8549-4c0e25c52255),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1d5b511-b4') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape1d5b511-b4, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG nova.compute.manager [req-ff4707ed-2e42-4900-9172-ce0191c5520a req-b979c638-5074-4eee-b8e3-56f6ef1b231a service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Received event network-vif-plugged-4856f394-91dc-4fd0-9fff-8a45f53f0e01 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ff4707ed-2e42-4900-9172-ce0191c5520a req-b979c638-5074-4eee-b8e3-56f6ef1b231a service nova] Acquiring lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ff4707ed-2e42-4900-9172-ce0191c5520a req-b979c638-5074-4eee-b8e3-56f6ef1b231a service nova] Lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ff4707ed-2e42-4900-9172-ce0191c5520a req-b979c638-5074-4eee-b8e3-56f6ef1b231a service nova] Lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG nova.compute.manager [req-ff4707ed-2e42-4900-9172-ce0191c5520a req-b979c638-5074-4eee-b8e3-56f6ef1b231a service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] No waiting events found dispatching network-vif-plugged-4856f394-91dc-4fd0-9fff-8a45f53f0e01 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:52:44 user nova-compute[72129]: WARNING nova.compute.manager [req-ff4707ed-2e42-4900-9172-ce0191c5520a req-b979c638-5074-4eee-b8e3-56f6ef1b231a service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Received unexpected event network-vif-plugged-4856f394-91dc-4fd0-9fff-8a45f53f0e01 for instance with vm_state active and task_state deleting.
Aug 01 13:52:44 user nova-compute[72129]: DEBUG nova.compute.manager [req-ff4707ed-2e42-4900-9172-ce0191c5520a req-b979c638-5074-4eee-b8e3-56f6ef1b231a service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Received event network-vif-unplugged-3da4a68a-4d20-4f36-bf85-e74a93a6c9f2 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ff4707ed-2e42-4900-9172-ce0191c5520a req-b979c638-5074-4eee-b8e3-56f6ef1b231a service nova] Acquiring lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ff4707ed-2e42-4900-9172-ce0191c5520a req-b979c638-5074-4eee-b8e3-56f6ef1b231a service nova] Lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ff4707ed-2e42-4900-9172-ce0191c5520a req-b979c638-5074-4eee-b8e3-56f6ef1b231a service nova] Lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG nova.compute.manager [req-ff4707ed-2e42-4900-9172-ce0191c5520a req-b979c638-5074-4eee-b8e3-56f6ef1b231a service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] No waiting events found dispatching network-vif-unplugged-3da4a68a-4d20-4f36-bf85-e74a93a6c9f2 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG nova.compute.manager [req-ff4707ed-2e42-4900-9172-ce0191c5520a req-b979c638-5074-4eee-b8e3-56f6ef1b231a service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Received event network-vif-unplugged-3da4a68a-4d20-4f36-bf85-e74a93a6c9f2 for instance with task_state deleting. {{(pid=72129) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG nova.compute.manager [req-ff4707ed-2e42-4900-9172-ce0191c5520a req-b979c638-5074-4eee-b8e3-56f6ef1b231a service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Received event network-vif-plugged-3da4a68a-4d20-4f36-bf85-e74a93a6c9f2 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ff4707ed-2e42-4900-9172-ce0191c5520a req-b979c638-5074-4eee-b8e3-56f6ef1b231a service nova] Acquiring lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ff4707ed-2e42-4900-9172-ce0191c5520a req-b979c638-5074-4eee-b8e3-56f6ef1b231a service nova] Lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ff4707ed-2e42-4900-9172-ce0191c5520a req-b979c638-5074-4eee-b8e3-56f6ef1b231a service nova] Lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG nova.compute.manager [req-ff4707ed-2e42-4900-9172-ce0191c5520a req-b979c638-5074-4eee-b8e3-56f6ef1b231a service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] No waiting events found dispatching network-vif-plugged-3da4a68a-4d20-4f36-bf85-e74a93a6c9f2 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:52:44 user nova-compute[72129]: WARNING nova.compute.manager [req-ff4707ed-2e42-4900-9172-ce0191c5520a req-b979c638-5074-4eee-b8e3-56f6ef1b231a service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Received unexpected event network-vif-plugged-3da4a68a-4d20-4f36-bf85-e74a93a6c9f2 for instance with vm_state active and task_state deleting.
Aug 01 13:52:44 user nova-compute[72129]: DEBUG nova.compute.manager [req-ff4707ed-2e42-4900-9172-ce0191c5520a req-b979c638-5074-4eee-b8e3-56f6ef1b231a service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Received event network-vif-unplugged-e4a333bd-6565-4da1-ae2c-4953c3a14f53 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ff4707ed-2e42-4900-9172-ce0191c5520a req-b979c638-5074-4eee-b8e3-56f6ef1b231a service nova] Acquiring lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ff4707ed-2e42-4900-9172-ce0191c5520a req-b979c638-5074-4eee-b8e3-56f6ef1b231a service nova] Lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ff4707ed-2e42-4900-9172-ce0191c5520a req-b979c638-5074-4eee-b8e3-56f6ef1b231a service nova] Lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG nova.compute.manager [req-ff4707ed-2e42-4900-9172-ce0191c5520a req-b979c638-5074-4eee-b8e3-56f6ef1b231a service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] No waiting events found dispatching network-vif-unplugged-e4a333bd-6565-4da1-ae2c-4953c3a14f53 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG nova.compute.manager [req-ff4707ed-2e42-4900-9172-ce0191c5520a req-b979c638-5074-4eee-b8e3-56f6ef1b231a service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Received event network-vif-unplugged-e4a333bd-6565-4da1-ae2c-4953c3a14f53 for instance with task_state deleting. {{(pid=72129) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG nova.compute.manager [req-ff4707ed-2e42-4900-9172-ce0191c5520a req-b979c638-5074-4eee-b8e3-56f6ef1b231a service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Received event network-vif-plugged-e4a333bd-6565-4da1-ae2c-4953c3a14f53 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ff4707ed-2e42-4900-9172-ce0191c5520a req-b979c638-5074-4eee-b8e3-56f6ef1b231a service nova] Acquiring lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ff4707ed-2e42-4900-9172-ce0191c5520a req-b979c638-5074-4eee-b8e3-56f6ef1b231a service nova] Lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ff4707ed-2e42-4900-9172-ce0191c5520a req-b979c638-5074-4eee-b8e3-56f6ef1b231a service nova] Lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG nova.compute.manager [req-ff4707ed-2e42-4900-9172-ce0191c5520a req-b979c638-5074-4eee-b8e3-56f6ef1b231a service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] No waiting events found dispatching network-vif-plugged-e4a333bd-6565-4da1-ae2c-4953c3a14f53 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:52:44 user nova-compute[72129]: WARNING nova.compute.manager [req-ff4707ed-2e42-4900-9172-ce0191c5520a req-b979c638-5074-4eee-b8e3-56f6ef1b231a service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Received unexpected event network-vif-plugged-e4a333bd-6565-4da1-ae2c-4953c3a14f53 for instance with vm_state active and task_state deleting.
Aug 01 13:52:44 user nova-compute[72129]: DEBUG nova.compute.manager [req-ff4707ed-2e42-4900-9172-ce0191c5520a req-b979c638-5074-4eee-b8e3-56f6ef1b231a service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Received event network-vif-unplugged-4bb0a232-3a92-4b85-9a12-29f8d822362e {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ff4707ed-2e42-4900-9172-ce0191c5520a req-b979c638-5074-4eee-b8e3-56f6ef1b231a service nova] Acquiring lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ff4707ed-2e42-4900-9172-ce0191c5520a req-b979c638-5074-4eee-b8e3-56f6ef1b231a service nova] Lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ff4707ed-2e42-4900-9172-ce0191c5520a req-b979c638-5074-4eee-b8e3-56f6ef1b231a service nova] Lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG nova.compute.manager [req-ff4707ed-2e42-4900-9172-ce0191c5520a req-b979c638-5074-4eee-b8e3-56f6ef1b231a service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] No waiting events found dispatching network-vif-unplugged-4bb0a232-3a92-4b85-9a12-29f8d822362e {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG nova.compute.manager [req-ff4707ed-2e42-4900-9172-ce0191c5520a req-b979c638-5074-4eee-b8e3-56f6ef1b231a service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Received event network-vif-unplugged-4bb0a232-3a92-4b85-9a12-29f8d822362e for instance with task_state deleting. {{(pid=72129) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG nova.compute.manager [req-ff4707ed-2e42-4900-9172-ce0191c5520a req-b979c638-5074-4eee-b8e3-56f6ef1b231a service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Received event network-vif-plugged-4bb0a232-3a92-4b85-9a12-29f8d822362e {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ff4707ed-2e42-4900-9172-ce0191c5520a req-b979c638-5074-4eee-b8e3-56f6ef1b231a service nova] Acquiring lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ff4707ed-2e42-4900-9172-ce0191c5520a req-b979c638-5074-4eee-b8e3-56f6ef1b231a service nova] Lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ff4707ed-2e42-4900-9172-ce0191c5520a req-b979c638-5074-4eee-b8e3-56f6ef1b231a service nova] Lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG nova.compute.manager [req-ff4707ed-2e42-4900-9172-ce0191c5520a req-b979c638-5074-4eee-b8e3-56f6ef1b231a service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] No waiting events found dispatching network-vif-plugged-4bb0a232-3a92-4b85-9a12-29f8d822362e {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:52:44 user nova-compute[72129]: WARNING nova.compute.manager [req-ff4707ed-2e42-4900-9172-ce0191c5520a req-b979c638-5074-4eee-b8e3-56f6ef1b231a service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Received unexpected event network-vif-plugged-4bb0a232-3a92-4b85-9a12-29f8d822362e for instance with vm_state active and task_state deleting.
Aug 01 13:52:44 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:44 user nova-compute[72129]: INFO os_vif [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:69:b3,bridge_name='br-int',has_traffic_filtering=True,id=e1d5b511-b4c8-4d81-8b78-e58ffdfb3015,network=Network(a7073672-c19c-45cb-8549-4c0e25c52255),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1d5b511-b4')
Aug 01 13:52:44 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T13:50:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1241803801',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1241803801',id=11,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+QtfmHSYayd423+Jyi4G3aVMwHbijAAkXCDfLEQf4gBJATuD2dk3LYaj/9StA19vP6tOnx01tyID845MCigJxBrCNqDQZakylTkXzkcsXu0p0VQpMF87v9qpWxh97hvQ==',key_name='tempest-keypair-38580498',keypairs=<?>,launch_index=0,launched_at=2023-08-01T13:51:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2b3a8ce92ea64365b59ae1e4cd450941',ramdisk_id='',reservation_id='r-n7fx3bly',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1602482701',owner_user_name='tempest-TaggedBootDevicesTest-1602482701-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T13:51:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1283f74fc4f74184a36fddf17c319ae1',uuid=e1ee9e5e-0bd8-4986-8641-d44680f97724,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4bb0a232-3a92-4b85-9a12-29f8d822362e", "address": "fa:16:3e:a2:99:fb", "network": {"id": "a7073672-c19c-45cb-8549-4c0e25c52255", "bridge": "br-int", "label": "tempest-device-tagging-net2-1432218036", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bb0a232-3a", "ovs_interfaceid": "4bb0a232-3a92-4b85-9a12-29f8d822362e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Converting VIF {"id": "4bb0a232-3a92-4b85-9a12-29f8d822362e", "address": "fa:16:3e:a2:99:fb", "network": {"id": "a7073672-c19c-45cb-8549-4c0e25c52255", "bridge": "br-int", "label": "tempest-device-tagging-net2-1432218036", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bb0a232-3a", "ovs_interfaceid": "4bb0a232-3a92-4b85-9a12-29f8d822362e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:99:fb,bridge_name='br-int',has_traffic_filtering=True,id=4bb0a232-3a92-4b85-9a12-29f8d822362e,network=Network(a7073672-c19c-45cb-8549-4c0e25c52255),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bb0a232-3a') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG os_vif [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:99:fb,bridge_name='br-int',has_traffic_filtering=True,id=4bb0a232-3a92-4b85-9a12-29f8d822362e,network=Network(a7073672-c19c-45cb-8549-4c0e25c52255),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bb0a232-3a') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4bb0a232-3a, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 13:52:44 user nova-compute[72129]: INFO os_vif [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:99:fb,bridge_name='br-int',has_traffic_filtering=True,id=4bb0a232-3a92-4b85-9a12-29f8d822362e,network=Network(a7073672-c19c-45cb-8549-4c0e25c52255),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bb0a232-3a')
Aug 01 13:52:44 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] calling os-brick to detach iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, {'target_iqns': ['iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WjrNARPV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:52:44 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 13:52:44 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08', 0)] {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[560e031c-3916-42d7-9fc5-eedfd52d7afa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c94b21-850d-4f42-a633-85b230c1e877]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 (non-flash)
Aug 01 13:52:44 user nova-compute[72129]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)
Aug 01 13:52:44 user nova-compute[72129]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 (non-flash)
Aug 01 13:52:44 user nova-compute[72129]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 (non-flash)
Aug 01 13:52:44 user nova-compute[72129]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)
Aug 01 13:52:44 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 (non-flash)
Aug 01 13:52:44 user nova-compute[72129]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 (non-flash)
Aug 01 13:52:44 user nova-compute[72129]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 (non-flash)
Aug 01 13:52:44 user nova-compute[72129]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 (non-flash)
Aug 01 13:52:44 user nova-compute[72129]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)
Aug 01 13:52:44 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f282dfc5ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08'): ({'sde'}, set())}) {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Removing single pathed devices sde {{(pid=72129) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4ad877-385a-4928-b5f9-757214c8b33e]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[39fb3ecb-ef60-420f-9aea-09d3e8fa81c8]: (4, ('ok\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Flushing IO for device /dev/sde {{(pid=72129) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[01364f57-a79c-4dca-ae44-ce155ecd7945]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72129) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.049s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[20802343-695e-42c7-b6e1-10fae040e5ed]: (4, ('1', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] SCSI volumes sde have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08')] {{(pid=72129) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc60062-ca29-4540-9208-392eeb47d17f]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 -p 172.16.0.220:3260 --logout {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Compute_service record updated for user:user {{(pid=72129) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.604s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-fbec0646-5fad-4cff-ae6a-547672968dea tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.308s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[1628532c-2ae0-4b6f-a63a-2cd7a9c793ec]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08, portal: 172.16.0.220,3260]
Aug 01 13:52:44 user nova-compute[72129]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08, portal: 172.16.0.220,3260] successful.
Aug 01 13:52:44 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 -p 172.16.0.220:3260 --op delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b931025d-0e61-46c7-8838-619aeff58f08 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[637c67cf-046b-4275-812d-72d9387e90f3]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] <== disconnect_volume: return (327ms) None {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Disconnected iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] calling os-brick to detach iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, {'target_iqns': ['iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ONpRYLvh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:52:44 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 13:52:44 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61', 0)] {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c5e34d-331c-481c-a239-02024ea9e980]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a750980b-7838-460e-aced-b571c67854cc]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 (non-flash)
Aug 01 13:52:44 user nova-compute[72129]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 (non-flash)
Aug 01 13:52:44 user nova-compute[72129]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 (non-flash)
Aug 01 13:52:44 user nova-compute[72129]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)
Aug 01 13:52:44 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 (non-flash)
Aug 01 13:52:44 user nova-compute[72129]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 (non-flash)
Aug 01 13:52:44 user nova-compute[72129]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 (non-flash)
Aug 01 13:52:44 user nova-compute[72129]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)
Aug 01 13:52:44 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f28200f6a70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61'): ({'sdf'}, set())}) {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Removing single pathed devices sdf {{(pid=72129) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a9794d-d552-49af-b863-1e53f34719c7]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[506e1f84-391d-4812-9936-6d4e3fdbff7e]: (4, ('ok\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Flushing IO for device /dev/sdf {{(pid=72129) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[031972ab-bf59-4b4e-beb4-67be26439235]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72129) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.048s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8946216-389b-4112-bf10-2d65fb46ad51]: (4, ('1', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] SCSI volumes sdf have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61')] {{(pid=72129) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ae70e9-c7f9-4188-bf95-27305733b489]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 -p 172.16.0.220:3260 --logout {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccaab9d5-3543-4c62-8f95-ed691096b7ee]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61, portal: 172.16.0.220,3260]
Aug 01 13:52:44 user nova-compute[72129]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61, portal: 172.16.0.220,3260] successful.
Aug 01 13:52:44 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 -p 172.16.0.220:3260 --op delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0565343-ef40-41a1-bb6a-d7d01d463a61 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[24da08fe-b140-4b5f-90be-8095cf665afb]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] <== disconnect_volume: return (315ms) None {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Disconnected iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] calling os-brick to detach iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, {'target_iqns': ['iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SQziXWIc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:52:44 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 13:52:44 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23', 0)] {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb3b3d0-329d-4bae-a0f9-bb55a0e0af15]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd982f95-9177-42b7-9294-ba324a4400ba]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 (non-flash)
Aug 01 13:52:44 user nova-compute[72129]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 (non-flash)
Aug 01 13:52:44 user nova-compute[72129]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)
Aug 01 13:52:44 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 (non-flash)
Aug 01 13:52:44 user nova-compute[72129]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 (non-flash)
Aug 01 13:52:44 user nova-compute[72129]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)
Aug 01 13:52:44 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f28200f6b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23'): ({'sdg'}, set())}) {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Removing single pathed devices sdg {{(pid=72129) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-fbec0646-5fad-4cff-ae6a-547672968dea tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[373734bb-8702-43de-a00e-5902fc67dd9c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-fbec0646-5fad-4cff-ae6a-547672968dea tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d99bd9fb-f6a6-498b-bf37-1b18646e27ab tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Acquiring lock "refresh_cache-3c1f751a-e2aa-4447-b72f-9dc88c4c1a84" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d99bd9fb-f6a6-498b-bf37-1b18646e27ab tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Acquired lock "refresh_cache-3c1f751a-e2aa-4447-b72f-9dc88c4c1a84" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG nova.network.neutron [None req-d99bd9fb-f6a6-498b-bf37-1b18646e27ab tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.025s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a42577af-c587-41a8-ba2c-844721601c50]: (4, ('ok\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Flushing IO for device /dev/sdg {{(pid=72129) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-fbec0646-5fad-4cff-ae6a-547672968dea tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.558s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86d569c-c56a-4895-9a1a-3acd7aec876e]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72129) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:44 user nova-compute[72129]: INFO nova.scheduler.client.report [None req-fbec0646-5fad-4cff-ae6a-547672968dea tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Deleted allocations for instance 78b77b93-6f25-447f-80a7-d64374fee14d
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.050s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5128b5f-8ca2-420f-b9a2-23831a308da1]: (4, ('1', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] SCSI volumes sdg have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23')] {{(pid=72129) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[17443172-6552-4900-a23a-5810779dab45]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 -p 172.16.0.220:3260 --logout {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-fbec0646-5fad-4cff-ae6a-547672968dea tempest-AttachSCSIVolumeTestJSON-1269943649 tempest-AttachSCSIVolumeTestJSON-1269943649-project-member] Lock "78b77b93-6f25-447f-80a7-d64374fee14d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.525s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:52:45 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:45 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[455df34c-805b-4a1d-9a07-511d54a4b79d]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:45 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23, portal: 172.16.0.220,3260]
Aug 01 13:52:45 user nova-compute[72129]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23, portal: 172.16.0.220,3260] successful.
Aug 01 13:52:45 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:45 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 -p 172.16.0.220:3260 --op delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:45 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04cc4a1c-f25d-4ff4-8eb9-d75de40bdb23 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:45 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[af5f8244-b784-4a6a-8262-c5fd5cda4b31]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:45 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:45 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:52:45 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] <== disconnect_volume: return (337ms) None {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:52:45 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Disconnected iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 13:52:45 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Deleting instance files /opt/stack/data/nova/instances/e1ee9e5e-0bd8-4986-8641-d44680f97724_del
Aug 01 13:52:45 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Deletion of /opt/stack/data/nova/instances/e1ee9e5e-0bd8-4986-8641-d44680f97724_del complete
Aug 01 13:52:45 user nova-compute[72129]: INFO nova.compute.manager [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Took 4.19 seconds to destroy the instance on the hypervisor.
Aug 01 13:52:45 user nova-compute[72129]: DEBUG oslo.service.loopingcall [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72129) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 13:52:45 user nova-compute[72129]: DEBUG nova.compute.manager [-] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Deallocating network for instance {{(pid=72129) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 13:52:45 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] deallocate_for_instance() {{(pid=72129) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 13:52:45 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:52:45 user nova-compute[72129]: DEBUG nova.compute.manager [req-33b39474-e695-4448-a920-38cf9dadd57a req-f28f9d5b-3f8a-46b3-b8be-9c8d64f684dd service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Received event network-vif-unplugged-e1d5b511-b4c8-4d81-8b78-e58ffdfb3015 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:52:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-33b39474-e695-4448-a920-38cf9dadd57a req-f28f9d5b-3f8a-46b3-b8be-9c8d64f684dd service nova] Acquiring lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:52:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-33b39474-e695-4448-a920-38cf9dadd57a req-f28f9d5b-3f8a-46b3-b8be-9c8d64f684dd service nova] Lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:52:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-33b39474-e695-4448-a920-38cf9dadd57a req-f28f9d5b-3f8a-46b3-b8be-9c8d64f684dd service nova] Lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:52:45 user nova-compute[72129]: DEBUG nova.compute.manager [req-33b39474-e695-4448-a920-38cf9dadd57a req-f28f9d5b-3f8a-46b3-b8be-9c8d64f684dd service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] No waiting events found dispatching network-vif-unplugged-e1d5b511-b4c8-4d81-8b78-e58ffdfb3015 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:52:45 user nova-compute[72129]: DEBUG nova.compute.manager [req-33b39474-e695-4448-a920-38cf9dadd57a req-f28f9d5b-3f8a-46b3-b8be-9c8d64f684dd service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Received event network-vif-unplugged-e1d5b511-b4c8-4d81-8b78-e58ffdfb3015 for instance with task_state deleting. {{(pid=72129) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 13:52:45 user nova-compute[72129]: DEBUG nova.compute.manager [req-33b39474-e695-4448-a920-38cf9dadd57a req-f28f9d5b-3f8a-46b3-b8be-9c8d64f684dd service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Received event network-vif-plugged-e1d5b511-b4c8-4d81-8b78-e58ffdfb3015 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:52:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-33b39474-e695-4448-a920-38cf9dadd57a req-f28f9d5b-3f8a-46b3-b8be-9c8d64f684dd service nova] Acquiring lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:52:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-33b39474-e695-4448-a920-38cf9dadd57a req-f28f9d5b-3f8a-46b3-b8be-9c8d64f684dd service nova] Lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:52:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-33b39474-e695-4448-a920-38cf9dadd57a req-f28f9d5b-3f8a-46b3-b8be-9c8d64f684dd service nova] Lock "e1ee9e5e-0bd8-4986-8641-d44680f97724-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:52:45 user nova-compute[72129]: DEBUG nova.compute.manager [req-33b39474-e695-4448-a920-38cf9dadd57a req-f28f9d5b-3f8a-46b3-b8be-9c8d64f684dd service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] No waiting events found dispatching network-vif-plugged-e1d5b511-b4c8-4d81-8b78-e58ffdfb3015 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:52:45 user nova-compute[72129]: WARNING nova.compute.manager [req-33b39474-e695-4448-a920-38cf9dadd57a req-f28f9d5b-3f8a-46b3-b8be-9c8d64f684dd service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Received unexpected event network-vif-plugged-e1d5b511-b4c8-4d81-8b78-e58ffdfb3015 for instance with vm_state active and task_state deleting.
Aug 01 13:52:45 user nova-compute[72129]: DEBUG nova.compute.manager [req-33b39474-e695-4448-a920-38cf9dadd57a req-f28f9d5b-3f8a-46b3-b8be-9c8d64f684dd service nova] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] Received event network-vif-deleted-31519672-974b-48c8-a361-e36ef1177d4e {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:52:45 user nova-compute[72129]: DEBUG nova.compute.manager [req-33b39474-e695-4448-a920-38cf9dadd57a req-f28f9d5b-3f8a-46b3-b8be-9c8d64f684dd service nova] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Received event network-vif-unplugged-f5389e5c-c039-4fbf-a851-8a8b1c8c5a4c {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:52:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-33b39474-e695-4448-a920-38cf9dadd57a req-f28f9d5b-3f8a-46b3-b8be-9c8d64f684dd service nova] Acquiring lock "3c1f751a-e2aa-4447-b72f-9dc88c4c1a84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:52:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-33b39474-e695-4448-a920-38cf9dadd57a req-f28f9d5b-3f8a-46b3-b8be-9c8d64f684dd service nova] Lock "3c1f751a-e2aa-4447-b72f-9dc88c4c1a84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:52:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-33b39474-e695-4448-a920-38cf9dadd57a req-f28f9d5b-3f8a-46b3-b8be-9c8d64f684dd service nova] Lock "3c1f751a-e2aa-4447-b72f-9dc88c4c1a84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:52:45 user nova-compute[72129]: DEBUG nova.compute.manager [req-33b39474-e695-4448-a920-38cf9dadd57a req-f28f9d5b-3f8a-46b3-b8be-9c8d64f684dd service nova] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] No waiting events found dispatching network-vif-unplugged-f5389e5c-c039-4fbf-a851-8a8b1c8c5a4c {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:52:45 user nova-compute[72129]: WARNING nova.compute.manager [req-33b39474-e695-4448-a920-38cf9dadd57a req-f28f9d5b-3f8a-46b3-b8be-9c8d64f684dd service nova] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Received unexpected event network-vif-unplugged-f5389e5c-c039-4fbf-a851-8a8b1c8c5a4c for instance with vm_state active and task_state None.
Aug 01 13:52:45 user nova-compute[72129]: DEBUG nova.compute.manager [req-33b39474-e695-4448-a920-38cf9dadd57a req-f28f9d5b-3f8a-46b3-b8be-9c8d64f684dd service nova] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Received event network-vif-plugged-f5389e5c-c039-4fbf-a851-8a8b1c8c5a4c {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:52:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-33b39474-e695-4448-a920-38cf9dadd57a req-f28f9d5b-3f8a-46b3-b8be-9c8d64f684dd service nova] Acquiring lock "3c1f751a-e2aa-4447-b72f-9dc88c4c1a84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:52:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-33b39474-e695-4448-a920-38cf9dadd57a req-f28f9d5b-3f8a-46b3-b8be-9c8d64f684dd service nova] Lock "3c1f751a-e2aa-4447-b72f-9dc88c4c1a84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:52:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-33b39474-e695-4448-a920-38cf9dadd57a req-f28f9d5b-3f8a-46b3-b8be-9c8d64f684dd service nova] Lock "3c1f751a-e2aa-4447-b72f-9dc88c4c1a84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:52:45 user nova-compute[72129]: DEBUG nova.compute.manager [req-33b39474-e695-4448-a920-38cf9dadd57a req-f28f9d5b-3f8a-46b3-b8be-9c8d64f684dd service nova] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] No waiting events found dispatching network-vif-plugged-f5389e5c-c039-4fbf-a851-8a8b1c8c5a4c {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:52:45 user nova-compute[72129]: WARNING nova.compute.manager [req-33b39474-e695-4448-a920-38cf9dadd57a req-f28f9d5b-3f8a-46b3-b8be-9c8d64f684dd service nova] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Received unexpected event network-vif-plugged-f5389e5c-c039-4fbf-a851-8a8b1c8c5a4c for instance with vm_state active and task_state None.
Aug 01 13:52:45 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:45 user nova-compute[72129]: INFO nova.network.neutron [None req-d99bd9fb-f6a6-498b-bf37-1b18646e27ab tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Port f5389e5c-c039-4fbf-a851-8a8b1c8c5a4c from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Aug 01 13:52:45 user nova-compute[72129]: DEBUG nova.network.neutron [None req-d99bd9fb-f6a6-498b-bf37-1b18646e27ab tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Updating instance_info_cache with network_info: [{"id": "7b1167ce-d40a-4355-8411-6a1dd005465f", "address": "fa:16:3e:58:10:73", "network": {"id": "5ae4ed86-1215-49ba-97b9-b9ca5b7d90ba", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-461203891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2184fb8ab16d482ea3ca397fbb5515ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b1167ce-d4", "ovs_interfaceid": "7b1167ce-d40a-4355-8411-6a1dd005465f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:52:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d99bd9fb-f6a6-498b-bf37-1b18646e27ab tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Releasing lock "refresh_cache-3c1f751a-e2aa-4447-b72f-9dc88c4c1a84" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:52:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d99bd9fb-f6a6-498b-bf37-1b18646e27ab tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Lock "interface-3c1f751a-e2aa-4447-b72f-9dc88c4c1a84-f5389e5c-c039-4fbf-a851-8a8b1c8c5a4c" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 3.169s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:52:45 user nova-compute[72129]: DEBUG nova.compute.manager [req-5dab78a8-af84-4430-b38f-b368c1687aea req-427ab935-ac82-45ba-888f-43ec17ca3384 service nova] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Received event network-vif-deleted-f5389e5c-c039-4fbf-a851-8a8b1c8c5a4c {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:52:47 user nova-compute[72129]: DEBUG nova.compute.manager [req-63cb8399-f820-4073-b072-d0c6469abd6f req-4000c86c-414c-435e-83d7-0fdd057124b3 service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Received event network-vif-deleted-4bb0a232-3a92-4b85-9a12-29f8d822362e {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:52:47 user nova-compute[72129]: INFO nova.compute.manager [req-63cb8399-f820-4073-b072-d0c6469abd6f req-4000c86c-414c-435e-83d7-0fdd057124b3 service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Neutron deleted interface 4bb0a232-3a92-4b85-9a12-29f8d822362e; detaching it from the instance and deleting it from the info cache
Aug 01 13:52:47 user nova-compute[72129]: DEBUG nova.network.neutron [req-63cb8399-f820-4073-b072-d0c6469abd6f req-4000c86c-414c-435e-83d7-0fdd057124b3 service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Updating instance_info_cache with network_info: [{"id": "4856f394-91dc-4fd0-9fff-8a45f53f0e01", "address": "fa:16:3e:39:15:ba", "network": {"id": "2dfa2891-a873-4a7a-8460-b78ee7a967e1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1716980837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4856f394-91", "ovs_interfaceid": "4856f394-91dc-4fd0-9fff-8a45f53f0e01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3da4a68a-4d20-4f36-bf85-e74a93a6c9f2", "address": "fa:16:3e:3a:cf:74", "network": {"id": "0238d661-fbc1-4955-8933-92891b6a621e", "bridge": "br-int", "label": "tempest-device-tagging-net1-78670494", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3da4a68a-4d", "ovs_interfaceid": "3da4a68a-4d20-4f36-bf85-e74a93a6c9f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c3fc041a-b39f-448a-a5d6-3e2b67368d50", "address": "fa:16:3e:31:e8:5e", "network": {"id": "0238d661-fbc1-4955-8933-92891b6a621e", "bridge": "br-int", "label": "tempest-device-tagging-net1-78670494", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3fc041a-b3", "ovs_interfaceid": "c3fc041a-b39f-448a-a5d6-3e2b67368d50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1a10af43-8f79-43a4-b847-2c4471576097", "address": "fa:16:3e:d9:f3:84", "network": {"id": "0238d661-fbc1-4955-8933-92891b6a621e", "bridge": "br-int", "label": "tempest-device-tagging-net1-78670494", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a10af43-8f", "ovs_interfaceid": "1a10af43-8f79-43a4-b847-2c4471576097", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e4a333bd-6565-4da1-ae2c-4953c3a14f53", "address": "fa:16:3e:06:c9:e4", "network": {"id": "0238d661-fbc1-4955-8933-92891b6a621e", "bridge": "br-int", "label": "tempest-device-tagging-net1-78670494", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4a333bd-65", "ovs_interfaceid": "e4a333bd-6565-4da1-ae2c-4953c3a14f53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e1d5b511-b4c8-4d81-8b78-e58ffdfb3015", "address": "fa:16:3e:e1:69:b3", "network": {"id": "a7073672-c19c-45cb-8549-4c0e25c52255", "bridge": "br-int", "label": "tempest-device-tagging-net2-1432218036", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1d5b511-b4", "ovs_interfaceid": "e1d5b511-b4c8-4d81-8b78-e58ffdfb3015", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:52:47 user nova-compute[72129]: DEBUG nova.compute.manager [req-63cb8399-f820-4073-b072-d0c6469abd6f req-4000c86c-414c-435e-83d7-0fdd057124b3 service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Detach interface failed, port_id=4bb0a232-3a92-4b85-9a12-29f8d822362e, reason: Instance e1ee9e5e-0bd8-4986-8641-d44680f97724 could not be found. {{(pid=72129) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 13:52:47 user nova-compute[72129]: DEBUG nova.compute.manager [req-63cb8399-f820-4073-b072-d0c6469abd6f req-4000c86c-414c-435e-83d7-0fdd057124b3 service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Received event network-vif-deleted-e1d5b511-b4c8-4d81-8b78-e58ffdfb3015 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:52:47 user nova-compute[72129]: INFO nova.compute.manager [req-63cb8399-f820-4073-b072-d0c6469abd6f req-4000c86c-414c-435e-83d7-0fdd057124b3 service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Neutron deleted interface e1d5b511-b4c8-4d81-8b78-e58ffdfb3015; detaching it from the instance and deleting it from the info cache
Aug 01 13:52:47 user nova-compute[72129]: DEBUG nova.network.neutron [req-63cb8399-f820-4073-b072-d0c6469abd6f req-4000c86c-414c-435e-83d7-0fdd057124b3 service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Updating instance_info_cache with network_info: [{"id": "4856f394-91dc-4fd0-9fff-8a45f53f0e01", "address": "fa:16:3e:39:15:ba", "network": {"id": "2dfa2891-a873-4a7a-8460-b78ee7a967e1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1716980837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4856f394-91", "ovs_interfaceid": "4856f394-91dc-4fd0-9fff-8a45f53f0e01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3da4a68a-4d20-4f36-bf85-e74a93a6c9f2", "address": "fa:16:3e:3a:cf:74", "network": {"id": "0238d661-fbc1-4955-8933-92891b6a621e", "bridge": "br-int", "label": "tempest-device-tagging-net1-78670494", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3da4a68a-4d", "ovs_interfaceid": "3da4a68a-4d20-4f36-bf85-e74a93a6c9f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c3fc041a-b39f-448a-a5d6-3e2b67368d50", "address": "fa:16:3e:31:e8:5e", "network": {"id": "0238d661-fbc1-4955-8933-92891b6a621e", "bridge": "br-int", "label": "tempest-device-tagging-net1-78670494", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3fc041a-b3", "ovs_interfaceid": "c3fc041a-b39f-448a-a5d6-3e2b67368d50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1a10af43-8f79-43a4-b847-2c4471576097", "address": "fa:16:3e:d9:f3:84", "network": {"id": "0238d661-fbc1-4955-8933-92891b6a621e", "bridge": "br-int", "label": "tempest-device-tagging-net1-78670494", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a10af43-8f", "ovs_interfaceid": "1a10af43-8f79-43a4-b847-2c4471576097", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e4a333bd-6565-4da1-ae2c-4953c3a14f53", "address": "fa:16:3e:06:c9:e4", "network": {"id": "0238d661-fbc1-4955-8933-92891b6a621e", "bridge": "br-int", "label": "tempest-device-tagging-net1-78670494", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.99", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2b3a8ce92ea64365b59ae1e4cd450941", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4a333bd-65", "ovs_interfaceid": "e4a333bd-6565-4da1-ae2c-4953c3a14f53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:52:47 user nova-compute[72129]: DEBUG nova.compute.manager [req-63cb8399-f820-4073-b072-d0c6469abd6f req-4000c86c-414c-435e-83d7-0fdd057124b3 service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Detach interface failed, port_id=e1d5b511-b4c8-4d81-8b78-e58ffdfb3015, reason: Instance e1ee9e5e-0bd8-4986-8641-d44680f97724 could not be found. {{(pid=72129) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 13:52:47 user nova-compute[72129]: DEBUG nova.compute.manager [req-d2f10b27-8433-4069-aac3-ea55d0f532c0 req-1d82d66e-e53a-4286-9616-d91717289fe9 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Received event network-vif-deleted-71c06aee-1c23-4a9b-9d91-73cc48cb7c23 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:52:47 user nova-compute[72129]: INFO nova.compute.manager [req-d2f10b27-8433-4069-aac3-ea55d0f532c0 req-1d82d66e-e53a-4286-9616-d91717289fe9 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Neutron deleted interface 71c06aee-1c23-4a9b-9d91-73cc48cb7c23; detaching it from the instance and deleting it from the info cache
Aug 01 13:52:47 user nova-compute[72129]: DEBUG nova.network.neutron [req-d2f10b27-8433-4069-aac3-ea55d0f532c0 req-1d82d66e-e53a-4286-9616-d91717289fe9 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Updating instance_info_cache with network_info: [{"id": "9d03baea-c746-4c97-9661-07d0e2e03291", "address": "fa:16:3e:92:fb:0d", "network": {"id": "9c8a1041-95f3-463f-a449-858dfa63c555", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-88919181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d03baea-c7", "ovs_interfaceid": "9d03baea-c746-4c97-9661-07d0e2e03291", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7ee53caa-f8d2-4ff3-b29f-131d386cbc14", "address": "fa:16:3e:f6:0d:dc", "network": {"id": "5a66b974-bfc2-4121-92e0-4c22ae1e3290", "bridge": "br-int", "label": "tempest-device-tagging-net1-1666088374", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee53caa-f8", "ovs_interfaceid": "7ee53caa-f8d2-4ff3-b29f-131d386cbc14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "13cf26e5-e302-48ae-abeb-d63bbf4c0572", "address": "fa:16:3e:97:83:19", "network": {"id": "5a66b974-bfc2-4121-92e0-4c22ae1e3290", "bridge": "br-int", "label": "tempest-device-tagging-net1-1666088374", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13cf26e5-e3", "ovs_interfaceid": "13cf26e5-e302-48ae-abeb-d63bbf4c0572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "17974af1-27e5-41f4-9c13-31fb31cd6cc2", "address": "fa:16:3e:a1:d7:1f", "network": {"id": "5a66b974-bfc2-4121-92e0-4c22ae1e3290", "bridge": "br-int", "label": "tempest-device-tagging-net1-1666088374", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17974af1-27", "ovs_interfaceid": "17974af1-27e5-41f4-9c13-31fb31cd6cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a3697523-c958-4f9f-92a2-ec52e2ee249b", "address": "fa:16:3e:9f:03:16", "network": {"id": "ce8bea02-998e-4055-9ac6-e226a89f103c", "bridge": "br-int", "label": "tempest-device-tagging-net2-808946084", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3697523-c9", "ovs_interfaceid": "a3697523-c958-4f9f-92a2-ec52e2ee249b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b23e74f7-64a8-466e-840b-0365e486355f", "address": "fa:16:3e:4f:8b:2c", "network": {"id": "ce8bea02-998e-4055-9ac6-e226a89f103c", "bridge": "br-int", "label": "tempest-device-tagging-net2-808946084", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb23e74f7-64", "ovs_interfaceid": "b23e74f7-64a8-466e-840b-0365e486355f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:52:47 user nova-compute[72129]: DEBUG nova.compute.manager [req-d2f10b27-8433-4069-aac3-ea55d0f532c0 req-1d82d66e-e53a-4286-9616-d91717289fe9 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Detach interface failed, port_id=71c06aee-1c23-4a9b-9d91-73cc48cb7c23, reason: Instance 1490f922-a4b0-43be-8826-ab527f66a350 could not be found. {{(pid=72129) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 13:52:47 user nova-compute[72129]: DEBUG nova.compute.manager [req-d2f10b27-8433-4069-aac3-ea55d0f532c0 req-1d82d66e-e53a-4286-9616-d91717289fe9 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Received event network-vif-deleted-9d03baea-c746-4c97-9661-07d0e2e03291 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:52:47 user nova-compute[72129]: INFO nova.compute.manager [req-d2f10b27-8433-4069-aac3-ea55d0f532c0 req-1d82d66e-e53a-4286-9616-d91717289fe9 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Neutron deleted interface 9d03baea-c746-4c97-9661-07d0e2e03291; detaching it from the instance and deleting it from the info cache
Aug 01 13:52:47 user nova-compute[72129]: DEBUG nova.network.neutron [req-d2f10b27-8433-4069-aac3-ea55d0f532c0 req-1d82d66e-e53a-4286-9616-d91717289fe9 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Updating instance_info_cache with network_info: [{"id": "7ee53caa-f8d2-4ff3-b29f-131d386cbc14", "address": "fa:16:3e:f6:0d:dc", "network": {"id": "5a66b974-bfc2-4121-92e0-4c22ae1e3290", "bridge": "br-int", "label": "tempest-device-tagging-net1-1666088374", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee53caa-f8", "ovs_interfaceid": "7ee53caa-f8d2-4ff3-b29f-131d386cbc14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "13cf26e5-e302-48ae-abeb-d63bbf4c0572", "address": "fa:16:3e:97:83:19", "network": {"id": "5a66b974-bfc2-4121-92e0-4c22ae1e3290", "bridge": "br-int", "label": "tempest-device-tagging-net1-1666088374", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13cf26e5-e3", "ovs_interfaceid": "13cf26e5-e302-48ae-abeb-d63bbf4c0572", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "17974af1-27e5-41f4-9c13-31fb31cd6cc2", "address": "fa:16:3e:a1:d7:1f", "network": {"id": "5a66b974-bfc2-4121-92e0-4c22ae1e3290", "bridge": "br-int", "label": "tempest-device-tagging-net1-1666088374", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17974af1-27", "ovs_interfaceid": "17974af1-27e5-41f4-9c13-31fb31cd6cc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a3697523-c958-4f9f-92a2-ec52e2ee249b", "address": "fa:16:3e:9f:03:16", "network": {"id": "ce8bea02-998e-4055-9ac6-e226a89f103c", "bridge": "br-int", "label": "tempest-device-tagging-net2-808946084", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3697523-c9", "ovs_interfaceid": "a3697523-c958-4f9f-92a2-ec52e2ee249b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b23e74f7-64a8-466e-840b-0365e486355f", "address": "fa:16:3e:4f:8b:2c", "network": {"id": "ce8bea02-998e-4055-9ac6-e226a89f103c", "bridge": "br-int", "label": "tempest-device-tagging-net2-808946084", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "12210d07b1b040b192bdbf59bf952a8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb23e74f7-64", "ovs_interfaceid": "b23e74f7-64a8-466e-840b-0365e486355f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:52:47 user nova-compute[72129]: DEBUG nova.compute.manager [req-d2f10b27-8433-4069-aac3-ea55d0f532c0 req-1d82d66e-e53a-4286-9616-d91717289fe9 service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Detach interface failed, port_id=9d03baea-c746-4c97-9661-07d0e2e03291, reason: Instance 1490f922-a4b0-43be-8826-ab527f66a350 could not be found. {{(pid=72129) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 13:52:48 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:52:48 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Took 6.21 seconds to deallocate network for instance.
Aug 01 13:52:49 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:49 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:52:49 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Took 4.00 seconds to deallocate network for instance.
Aug 01 13:52:49 user nova-compute[72129]: DEBUG nova.compute.manager [req-75c59c79-f5d9-442e-bd11-e89ff77ccd28 req-c666d9da-dbb1-420a-b6bb-c3e972d2f4ae service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Received event network-vif-deleted-4856f394-91dc-4fd0-9fff-8a45f53f0e01 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:52:49 user nova-compute[72129]: DEBUG nova.compute.manager [req-75c59c79-f5d9-442e-bd11-e89ff77ccd28 req-c666d9da-dbb1-420a-b6bb-c3e972d2f4ae service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Received event network-vif-deleted-e4a333bd-6565-4da1-ae2c-4953c3a14f53 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:52:49 user nova-compute[72129]: DEBUG nova.compute.manager [req-75c59c79-f5d9-442e-bd11-e89ff77ccd28 req-c666d9da-dbb1-420a-b6bb-c3e972d2f4ae service nova] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Received event network-vif-deleted-1a10af43-8f79-43a4-b847-2c4471576097 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:52:49 user nova-compute[72129]: DEBUG nova.compute.manager [req-6a14e377-6565-477f-bce7-b4d882a5fc99 req-4334a483-be09-4091-ab9c-dc91a1f6847a service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Received event network-vif-deleted-b23e74f7-64a8-466e-840b-0365e486355f {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:52:49 user nova-compute[72129]: DEBUG nova.compute.manager [req-6a14e377-6565-477f-bce7-b4d882a5fc99 req-4334a483-be09-4091-ab9c-dc91a1f6847a service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Received event network-vif-deleted-a3697523-c958-4f9f-92a2-ec52e2ee249b {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:52:49 user nova-compute[72129]: DEBUG nova.compute.manager [req-6a14e377-6565-477f-bce7-b4d882a5fc99 req-4334a483-be09-4091-ab9c-dc91a1f6847a service nova] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Received event network-vif-deleted-17974af1-27e5-41f4-9c13-31fb31cd6cc2 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:52:50 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:51 user nova-compute[72129]: INFO nova.compute.manager [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Took 2.43 seconds to detach 3 volumes for instance.
Aug 01 13:52:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:52:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:52:51 user nova-compute[72129]: INFO nova.compute.manager [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Took 2.30 seconds to detach 3 volumes for instance.
Aug 01 13:52:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:52:51 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 13:52:51 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 13:52:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.432s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:52:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.279s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:52:51 user nova-compute[72129]: INFO nova.scheduler.client.report [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Deleted allocations for instance 1490f922-a4b0-43be-8826-ab527f66a350
Aug 01 13:52:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-71931e44-3f12-4eee-b7ee-f036ff011a5b tempest-TaggedBootDevicesTest_v242-1903474152 tempest-TaggedBootDevicesTest_v242-1903474152-project-member] Lock "1490f922-a4b0-43be-8826-ab527f66a350" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 14.993s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:52:52 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 13:52:52 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 13:52:52 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.292s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:52:52 user nova-compute[72129]: INFO nova.scheduler.client.report [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Deleted allocations for instance e1ee9e5e-0bd8-4986-8641-d44680f97724
Aug 01 13:52:52 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-de3de3ee-aa28-4a53-a4c1-ea31097490a0 tempest-TaggedBootDevicesTest-1602482701 tempest-TaggedBootDevicesTest-1602482701-project-member] Lock "e1ee9e5e-0bd8-4986-8641-d44680f97724" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.310s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:52:54 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:54 user nova-compute[72129]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690897959.0347707, 1490f922-a4b0-43be-8826-ab527f66a350 => Stopped> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:52:54 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] VM Stopped (Lifecycle Event)
Aug 01 13:52:54 user nova-compute[72129]: DEBUG nova.compute.manager [None req-ab7d9e5b-95a4-47ab-944f-0aab12fcac14 None None] [instance: 1490f922-a4b0-43be-8826-ab527f66a350] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:52:54 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:55 user nova-compute[72129]: DEBUG nova.compute.manager [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:09126dac-6afb-45c4-8ec4-9bd3c88593db'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'phlPZaJk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0', 'attached_at': '', 'detached_at': '', 'volume_id': '09126dac-6afb-45c4-8ec4-9bd3c88593db', 'serial': '09126dac-6afb-45c4-8ec4-9bd3c88593db'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wpUkcKQv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': '33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0', 'attached_at': '', 'detached_at': '', 'volume_id': '43c1b008-ef2f-494c-8ba1-6c55ed0085a5', 'serial'} {{(pid=72129) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 01 13:52:55 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Calling os-brick to attach iSCSI Volume {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 13:52:55 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:09126dac-6afb-45c4-8ec4-9bd3c88593db'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'phlPZaJk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:52:55 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 13:52:55 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:52:55 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:52:55 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 13:52:55 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09126dac-6afb-45c4-8ec4-9bd3c88593db" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:52:55 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09126dac-6afb-45c4-8ec4-9bd3c88593db" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:52:55 user nova-compute[72129]: INFO os_brick.initiator.connectors.iscsi [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 13:52:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09126dac-6afb-45c4-8ec4-9bd3c88593db -p 172.16.0.220:3260 {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09126dac-6afb-45c4-8ec4-9bd3c88593db -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:55 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5b22da-58d6-40a9-b7d0-cad76ac58496]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:55 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 13:52:55 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09126dac-6afb-45c4-8ec4-9bd3c88593db -p 172.16.0.220:3260 --interface default --op new {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09126dac-6afb-45c4-8ec4-9bd3c88593db -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:55 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad91541c-819c-4d3d-a5eb-86fee71d8039]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09126dac-6afb-45c4-8ec4-9bd3c88593db] added\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:55 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09126dac-6afb-45c4-8ec4-9bd3c88593db] added
Aug 01 13:52:55 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09126dac-6afb-45c4-8ec4-9bd3c88593db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09126dac-6afb-45c4-8ec4-9bd3c88593db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.038s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:56 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba64e35-a7e9-43db-8642-897a6b650c57]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:56 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09126dac-6afb-45c4-8ec4-9bd3c88593db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09126dac-6afb-45c4-8ec4-9bd3c88593db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:56 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49dfa64-b630-4f3c-b1a7-524fc01f2597]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:56 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09126dac-6afb-45c4-8ec4-9bd3c88593db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v phlPZaJk {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09126dac-6afb-45c4-8ec4-9bd3c88593db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v phlPZaJk" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:56 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[7731878e-20bf-410a-ac66-a14cf13fb304]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:56 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'phlPZaJk'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09126dac-6afb-45c4-8ec4-9bd3c88593db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09126dac-6afb-45c4-8ec4-9bd3c88593db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:56 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c3b260-13d5-43c5-af75-d1743c937f5e]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:56 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:56 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a55087b-c605-4ba5-ae93-162261c87b6f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:56 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 (non-flash)
Aug 01 13:52:56 user nova-compute[72129]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)
Aug 01 13:52:56 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:52:56 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 (non-flash)
Aug 01 13:52:56 user nova-compute[72129]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)
Aug 01 13:52:56 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:52:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09126dac-6afb-45c4-8ec4-9bd3c88593db -p 172.16.0.220:3260 --login {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09126dac-6afb-45c4-8ec4-9bd3c88593db -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:56 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b4b9c8b-044e-41f8-8c44-aee5f4d1c491]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:09126dac-6afb-45c4-8ec4-9bd3c88593db, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:09126dac-6afb-45c4-8ec4-9bd3c88593db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:56 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:09126dac-6afb-45c4-8ec4-9bd3c88593db, portal: 172.16.0.220,3260]
Aug 01 13:52:56 user nova-compute[72129]: Login to [iface: default, target: iqn.2010-10.org.openstack:09126dac-6afb-45c4-8ec4-9bd3c88593db, portal: 172.16.0.220,3260] successful.
Aug 01 13:52:56 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09126dac-6afb-45c4-8ec4-9bd3c88593db -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09126dac-6afb-45c4-8ec4-9bd3c88593db -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:56 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[3abb6f0a-3b61-4ea6-a336-5b1cd574bb86]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:56 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:52:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:56 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e1d113-4cab-4f73-9ea7-77c8cd1f0229]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09126dac-6afb-45c4-8ec4-9bd3c88593db (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:56 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 (non-flash)
Aug 01 13:52:56 user nova-compute[72129]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09126dac-6afb-45c4-8ec4-9bd3c88593db (non-flash)
Aug 01 13:52:56 user nova-compute[72129]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)
Aug 01 13:52:56 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:52:56 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 (non-flash)
Aug 01 13:52:56 user nova-compute[72129]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09126dac-6afb-45c4-8ec4-9bd3c88593db (non-flash)
Aug 01 13:52:56 user nova-compute[72129]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)
Aug 01 13:52:56 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:52:56 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09126dac-6afb-45c4-8ec4-9bd3c88593db" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:52:56 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] Connected to 172.16.0.220:3260 {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 13:52:56 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=72129) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 13:52:56 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=72129) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 13:52:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:52:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:52:56 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a333d3-658d-447d-afe9-ccb02ca8d957]: (4, ('- - 0', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:52:56 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 13:52:56 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'phlPZaJk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 13:52:56 user nova-compute[72129]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690897961.3404243, 78b77b93-6f25-447f-80a7-d64374fee14d => Stopped> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:52:56 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] VM Stopped (Lifecycle Event)
Aug 01 13:52:56 user nova-compute[72129]: DEBUG nova.compute.manager [None req-de78f898-810b-4ff3-a159-f4ff856e45a6 None None] [instance: 78b77b93-6f25-447f-80a7-d64374fee14d] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:52:57 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:52:57 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '23337656361306635', 'path': '/dev/sdb'} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:52:57 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337656361306635', 'path': '/dev/sdb'} {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 13:52:57 user nova-compute[72129]: DEBUG nova.objects.instance [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] Lazy-loading 'flavor' on Instance uuid 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:52:57 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=72129) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 13:52:57 user nova-compute[72129]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690897962.919794, e1ee9e5e-0bd8-4986-8641-d44680f97724 => Stopped> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:52:57 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] VM Stopped (Lifecycle Event)
Aug 01 13:52:57 user nova-compute[72129]: DEBUG nova.compute.manager [None req-f04bcaf5-22e1-488f-a5e0-3e5e58006c16 None None] [instance: e1ee9e5e-0bd8-4986-8641-d44680f97724] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:52:58 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] COPY block job progress, current cursor: 65011712 final cursor: 1073741824 {{(pid=72129) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 13:52:59 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:52:59 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] COPY block job progress, current cursor: 229638144 final cursor: 1073741824 {{(pid=72129) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 13:52:59 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] COPY block job progress, current cursor: 354418688 final cursor: 1073741824 {{(pid=72129) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 13:53:00 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] COPY block job progress, current cursor: 521142272 final cursor: 1073741824 {{(pid=72129) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 13:53:00 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:00 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] COPY block job progress, current cursor: 658505728 final cursor: 1073741824 {{(pid=72129) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 13:53:01 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] COPY block job progress, current cursor: 804257792 final cursor: 1073741824 {{(pid=72129) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 13:53:01 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] COPY block job progress, current cursor: 925892608 final cursor: 1073741824 {{(pid=72129) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 13:53:01 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:02 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72129) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 13:53:02 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] calling os-brick to detach iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 13:53:02 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, {'target_iqns': ['iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wpUkcKQv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:53:02 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 13:53:02 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:53:02 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:53:02 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5', 0)] {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 13:53:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:02 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9bb120d-6193-4525-a089-0f3277d27ea8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09126dac-6afb-45c4-8ec4-9bd3c88593db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:02 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a12ca5b-06a9-43db-a2d9-99ca74719ae4]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09126dac-6afb-45c4-8ec4-9bd3c88593db (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:02 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 (non-flash)
Aug 01 13:53:02 user nova-compute[72129]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09126dac-6afb-45c4-8ec4-9bd3c88593db (non-flash)
Aug 01 13:53:02 user nova-compute[72129]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)
Aug 01 13:53:02 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:53:02 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 (non-flash)
Aug 01 13:53:02 user nova-compute[72129]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09126dac-6afb-45c4-8ec4-9bd3c88593db (non-flash)
Aug 01 13:53:02 user nova-compute[72129]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)
Aug 01 13:53:02 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:53:02 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f28281181f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5'): ({'sdj'}, set())}) {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 13:53:02 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] Removing single pathed devices sdj {{(pid=72129) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 13:53:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:02 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db73231-588b-41ec-8ee2-f1ee6fd0253f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.023s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:02 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b0cc37d-1ca3-4008-b169-f01cac5aae5c]: (4, ('ok\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:02 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] Flushing IO for device /dev/sdj {{(pid=72129) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 13:53:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.016s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:02 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59e2fd4-339c-49bc-b96b-d72320a992d4]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:02 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=72129) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 13:53:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.040s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:02 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[10fe50ac-78dc-4d85-9f8e-077009fb7708]: (4, ('1', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:02 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] Checking to see if SCSI volumes sdj have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 13:53:02 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] SCSI volumes sdj have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 13:53:02 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5')] {{(pid=72129) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 13:53:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:02 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[132c1f06-ca6a-429f-9130-87063426aab6]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:02 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:53:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 -p 172.16.0.220:3260 --logout {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:02 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[73cad87b-840a-4b1e-a9fd-8d6b6156da88]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:02 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5, portal: 172.16.0.220,3260]
Aug 01 13:53:02 user nova-compute[72129]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5, portal: 172.16.0.220,3260] successful.
Aug 01 13:53:02 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:53:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 -p 172.16.0.220:3260 --op delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:02 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd35558-f844-4828-9705-7973e448cef7]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:02 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:53:02 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:53:02 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] <== disconnect_volume: return (309ms) None {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:53:02 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Disconnected iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 13:53:02 user nova-compute[72129]: DEBUG nova.compute.manager [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:09126dac-6afb-45c4-8ec4-9bd3c88593db'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'phlPZaJk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0', 'attached_at': '', 'detached_at': '', 'volume_id': '09126dac-6afb-45c4-8ec4-9bd3c88593db', 'serial'} {{(pid=72129) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 01 13:53:02 user nova-compute[72129]: DEBUG nova.compute.manager [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] swap_volume: removing Cinder connection for volume 43c1b008-ef2f-494c-8ba1-6c55ed0085a5 {{(pid=72129) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 01 13:53:03 user nova-compute[72129]: DEBUG nova.compute.manager [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] swap_volume: Updating volume 43c1b008-ef2f-494c-8ba1-6c55ed0085a5 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:09126dac-6afb-45c4-8ec4-9bd3c88593db"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "phlPZaJk", "auth_password": "ocKgjBiP5arRVt", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "09126dac-6afb-45c4-8ec4-9bd3c88593db"}, "status": "reserved", "instance": "33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0", "attached_at": "", "detached_at": "", "volume_id": "09126dac-6afb-45c4-8ec4-9bd3c88593db", "serial": "09126dac-6afb-45c4-8ec4-9bd3c88593db"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '09126dac-6afb-45c4-8ec4-9bd3c88593db', 'no_device': None, 'attachment_id': '4206b945-cb88-48d2-b5d2-6d04f4782e34'} {{(pid=72129) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 01 13:53:03 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-dc0b79e1-06da-4f72-b4a6-59a9e55f3c98 tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] Lock "33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 20.829s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:53:04 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:04 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:05 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] Acquiring lock "33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:53:05 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] Lock "33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:53:05 user nova-compute[72129]: DEBUG os_brick.utils [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:53:05 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:05 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:05 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b10f59-3f77-4c1a-b379-a01828f1871e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f9b449c2cd3d\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:05 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:05 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:05 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7b1442-2eea-47b3-8b6b-bb107beadf53]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:05 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:05 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:05 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad84173f-e24f-4d4b-9557-009c7c1279b2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:05 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[f755dff5-42d5-49de-8d8b-41bd981d1f9f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:05 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] Running cmd (subprocess): nvme version {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:05 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 13:53:05 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] nvme not present on system {{(pid=72129) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 13:53:05 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:05 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 13:53:05 user nova-compute[72129]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 13:53:05 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7bedbbb-e42f-44ad-8deb-570924fcc3de]: (4, '') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:05 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72129) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 13:53:05 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 13:53:05 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] LIGHTOS: no hostnqn found. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 13:53:05 user nova-compute[72129]: DEBUG os_brick.utils [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f9b449c2cd3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:53:05 user nova-compute[72129]: INFO nova.compute.manager [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Swapping volume 09126dac-6afb-45c4-8ec4-9bd3c88593db for 43c1b008-ef2f-494c-8ba1-6c55ed0085a5
Aug 01 13:53:05 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Acquiring lock "97a5dccf-b499-443a-b332-cfa293a16047" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:53:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "97a5dccf-b499-443a-b332-cfa293a16047" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:53:07 user nova-compute[72129]: DEBUG nova.compute.manager [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Starting instance... {{(pid=72129) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 13:53:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:53:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:53:07 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72129) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 13:53:07 user nova-compute[72129]: INFO nova.compute.claims [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Claim successful on node user
Aug 01 13:53:07 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 13:53:07 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 13:53:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.409s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:53:07 user nova-compute[72129]: DEBUG nova.compute.manager [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Start building networks asynchronously for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 13:53:07 user nova-compute[72129]: DEBUG nova.compute.manager [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Allocating IP information in the background. {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 13:53:07 user nova-compute[72129]: DEBUG nova.network.neutron [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] allocate_for_instance() {{(pid=72129) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 13:53:07 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 13:53:07 user nova-compute[72129]: DEBUG nova.compute.manager [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Start building block device mappings for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 13:53:07 user nova-compute[72129]: DEBUG nova.policy [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1f35620862694e7295f782ab15e290a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e85d9b73a546dc95e0ace26233f2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72129) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 13:53:07 user nova-compute[72129]: DEBUG nova.compute.manager [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Start spawning the instance on the hypervisor. {{(pid=72129) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 13:53:07 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Creating instance directory {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 13:53:07 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Creating image(s)
Aug 01 13:53:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Acquiring lock "/opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:53:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "/opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:53:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "/opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:53:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.138s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Acquiring lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:53:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:53:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.140s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk 1073741824 {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk 1073741824" returned: 0 in 0.049s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:08 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:53:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.142s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:08 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Checking if we can resize image /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk. size=1073741824 {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 13:53:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:08 user nova-compute[72129]: DEBUG nova.network.neutron [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Successfully created port: 4871bc74-6594-49e6-a6ef-343bc3800742 {{(pid=72129) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 13:53:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:08 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Cannot resize image /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk to a smaller size. {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 13:53:08 user nova-compute[72129]: DEBUG nova.objects.instance [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lazy-loading 'migration_context' on Instance uuid 97a5dccf-b499-443a-b332-cfa293a16047 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:53:08 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Created local disks {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 13:53:08 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Ensure instance console log exists: /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/console.log {{(pid=72129) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 13:53:08 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:53:08 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:53:08 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:53:09 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:09 user nova-compute[72129]: DEBUG nova.network.neutron [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Successfully updated port: 4871bc74-6594-49e6-a6ef-343bc3800742 {{(pid=72129) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 13:53:09 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Acquiring lock "refresh_cache-97a5dccf-b499-443a-b332-cfa293a16047" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:53:09 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Acquired lock "refresh_cache-97a5dccf-b499-443a-b332-cfa293a16047" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:53:09 user nova-compute[72129]: DEBUG nova.network.neutron [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 13:53:09 user nova-compute[72129]: DEBUG nova.compute.manager [req-9b3717f3-3773-404f-b16b-0f3645e0a387 req-5b666372-21ed-496b-a78f-44977e36ba5f service nova] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Received event network-changed-4871bc74-6594-49e6-a6ef-343bc3800742 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:53:09 user nova-compute[72129]: DEBUG nova.compute.manager [req-9b3717f3-3773-404f-b16b-0f3645e0a387 req-5b666372-21ed-496b-a78f-44977e36ba5f service nova] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Refreshing instance network info cache due to event network-changed-4871bc74-6594-49e6-a6ef-343bc3800742. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 13:53:09 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-9b3717f3-3773-404f-b16b-0f3645e0a387 req-5b666372-21ed-496b-a78f-44977e36ba5f service nova] Acquiring lock "refresh_cache-97a5dccf-b499-443a-b332-cfa293a16047" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:53:09 user nova-compute[72129]: DEBUG nova.network.neutron [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Instance cache missing network info. {{(pid=72129) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 13:53:09 user nova-compute[72129]: DEBUG nova.network.neutron [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Updating instance_info_cache with network_info: [{"id": "4871bc74-6594-49e6-a6ef-343bc3800742", "address": "fa:16:3e:a3:52:a2", "network": {"id": "4b93ad92-9a3a-4472-ba6c-d215329da98b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-734108983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0e85d9b73a546dc95e0ace26233f2a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4871bc74-65", "ovs_interfaceid": "4871bc74-6594-49e6-a6ef-343bc3800742", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:53:09 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Releasing lock "refresh_cache-97a5dccf-b499-443a-b332-cfa293a16047" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:53:09 user nova-compute[72129]: DEBUG nova.compute.manager [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Instance network_info: |[{"id": "4871bc74-6594-49e6-a6ef-343bc3800742", "address": "fa:16:3e:a3:52:a2", "network": {"id": "4b93ad92-9a3a-4472-ba6c-d215329da98b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-734108983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0e85d9b73a546dc95e0ace26233f2a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4871bc74-65", "ovs_interfaceid": "4871bc74-6594-49e6-a6ef-343bc3800742", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 13:53:09 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-9b3717f3-3773-404f-b16b-0f3645e0a387 req-5b666372-21ed-496b-a78f-44977e36ba5f service nova] Acquired lock "refresh_cache-97a5dccf-b499-443a-b332-cfa293a16047" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:53:09 user nova-compute[72129]: DEBUG nova.network.neutron [req-9b3717f3-3773-404f-b16b-0f3645e0a387 req-5b666372-21ed-496b-a78f-44977e36ba5f service nova] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Refreshing network info cache for port 4871bc74-6594-49e6-a6ef-343bc3800742 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 13:53:09 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Start _get_guest_xml network_info=[{"id": "4871bc74-6594-49e6-a6ef-343bc3800742", "address": "fa:16:3e:a3:52:a2", "network": {"id": "4b93ad92-9a3a-4472-ba6c-d215329da98b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-734108983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0e85d9b73a546dc95e0ace26233f2a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4871bc74-65", "ovs_interfaceid": "4871bc74-6594-49e6-a6ef-343bc3800742", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'image_id': 'b6472c34-1b0f-4034-ba3a-7e8eb5103715'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 13:53:09 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:53:09 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:53:09 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 13:53:09 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] CPU controller missing on host. {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 13:53:09 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 13:53:09 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] CPU controller found on host. {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 13:53:09 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72129) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 13:53:09 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T13:45:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 13:53:09 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Flavor limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 13:53:09 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Image limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 13:53:09 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Flavor pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 13:53:09 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Image pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 13:53:09 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 13:53:09 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 13:53:09 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 13:53:09 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Got 1 possible topologies {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 13:53:09 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 13:53:09 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 13:53:09 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:53:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1047779358',display_name='tempest-ServerActionsTestOtherA-server-1047779358',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1047779358',id=14,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMKxgVYWQdVKRLV+QIEDxsF4RC9I5wENeCwXhryJ2sr+8oNRgK2W8XmwhDYsUxLBCXzQXdaopDtUa2pfT9PfB2oRmI83WPjT6V3uSmwDrvE9fHgGK0Xxc5yPsVieUvlqoA==',key_name='tempest-keypair-1687158208',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b0e85d9b73a546dc95e0ace26233f2a7',ramdisk_id='',reservation_id='r-hn67ks7n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1440097443',owner_user_name='tempest-ServerActionsTestOtherA-1440097443-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:53:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f35620862694e7295f782ab15e290a8',uuid=97a5dccf-b499-443a-b332-cfa293a16047,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4871bc74-6594-49e6-a6ef-343bc3800742", "address": "fa:16:3e:a3:52:a2", "network": {"id": "4b93ad92-9a3a-4472-ba6c-d215329da98b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-734108983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0e85d9b73a546dc95e0ace26233f2a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4871bc74-65", "ovs_interfaceid": "4871bc74-6594-49e6-a6ef-343bc3800742", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 13:53:09 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Converting VIF {"id": "4871bc74-6594-49e6-a6ef-343bc3800742", "address": "fa:16:3e:a3:52:a2", "network": {"id": "4b93ad92-9a3a-4472-ba6c-d215329da98b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-734108983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0e85d9b73a546dc95e0ace26233f2a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4871bc74-65", "ovs_interfaceid": "4871bc74-6594-49e6-a6ef-343bc3800742", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:53:09 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:52:a2,bridge_name='br-int',has_traffic_filtering=True,id=4871bc74-6594-49e6-a6ef-343bc3800742,network=Network(4b93ad92-9a3a-4472-ba6c-d215329da98b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4871bc74-65') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:53:09 user nova-compute[72129]: DEBUG nova.objects.instance [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lazy-loading 'pci_devices' on Instance uuid 97a5dccf-b499-443a-b332-cfa293a16047 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:53:09 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] End _get_guest_xml xml=<domain type="kvm">
Aug 01 13:53:09 user nova-compute[72129]:   <uuid>97a5dccf-b499-443a-b332-cfa293a16047</uuid>
Aug 01 13:53:09 user nova-compute[72129]:   <name>instance-0000000e</name>
Aug 01 13:53:09 user nova-compute[72129]:   <memory>524288</memory>
Aug 01 13:53:09 user nova-compute[72129]:   <vcpu>1</vcpu>
Aug 01 13:53:09 user nova-compute[72129]:   <metadata>
Aug 01 13:53:09 user nova-compute[72129]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 13:53:09 user nova-compute[72129]:       <nova:package version="0.0.0"/>
Aug 01 13:53:09 user nova-compute[72129]:       <nova:name>tempest-ServerActionsTestOtherA-server-1047779358</nova:name>
Aug 01 13:53:09 user nova-compute[72129]:       <nova:creationTime>2023-08-01 13:53:09</nova:creationTime>
Aug 01 13:53:09 user nova-compute[72129]:       <nova:flavor name="m1.tiny">
Aug 01 13:53:09 user nova-compute[72129]:         <nova:memory>512</nova:memory>
Aug 01 13:53:09 user nova-compute[72129]:         <nova:disk>1</nova:disk>
Aug 01 13:53:09 user nova-compute[72129]:         <nova:swap>0</nova:swap>
Aug 01 13:53:09 user nova-compute[72129]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 13:53:09 user nova-compute[72129]:         <nova:vcpus>1</nova:vcpus>
Aug 01 13:53:09 user nova-compute[72129]:       </nova:flavor>
Aug 01 13:53:09 user nova-compute[72129]:       <nova:owner>
Aug 01 13:53:09 user nova-compute[72129]:         <nova:user uuid="1f35620862694e7295f782ab15e290a8">tempest-ServerActionsTestOtherA-1440097443-project-member</nova:user>
Aug 01 13:53:09 user nova-compute[72129]:         <nova:project uuid="b0e85d9b73a546dc95e0ace26233f2a7">tempest-ServerActionsTestOtherA-1440097443</nova:project>
Aug 01 13:53:09 user nova-compute[72129]:       </nova:owner>
Aug 01 13:53:09 user nova-compute[72129]:       <nova:root type="image" uuid="b6472c34-1b0f-4034-ba3a-7e8eb5103715"/>
Aug 01 13:53:09 user nova-compute[72129]:       <nova:ports>
Aug 01 13:53:09 user nova-compute[72129]:         <nova:port uuid="4871bc74-6594-49e6-a6ef-343bc3800742">
Aug 01 13:53:09 user nova-compute[72129]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 01 13:53:09 user nova-compute[72129]:         </nova:port>
Aug 01 13:53:09 user nova-compute[72129]:       </nova:ports>
Aug 01 13:53:09 user nova-compute[72129]:     </nova:instance>
Aug 01 13:53:09 user nova-compute[72129]:   </metadata>
Aug 01 13:53:09 user nova-compute[72129]:   <sysinfo type="smbios">
Aug 01 13:53:09 user nova-compute[72129]:     <system>
Aug 01 13:53:09 user nova-compute[72129]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 13:53:09 user nova-compute[72129]:       <entry name="product">OpenStack Nova</entry>
Aug 01 13:53:09 user nova-compute[72129]:       <entry name="version">0.0.0</entry>
Aug 01 13:53:09 user nova-compute[72129]:       <entry name="serial">97a5dccf-b499-443a-b332-cfa293a16047</entry>
Aug 01 13:53:09 user nova-compute[72129]:       <entry name="uuid">97a5dccf-b499-443a-b332-cfa293a16047</entry>
Aug 01 13:53:09 user nova-compute[72129]:       <entry name="family">Virtual Machine</entry>
Aug 01 13:53:09 user nova-compute[72129]:     </system>
Aug 01 13:53:09 user nova-compute[72129]:   </sysinfo>
Aug 01 13:53:09 user nova-compute[72129]:   <os>
Aug 01 13:53:09 user nova-compute[72129]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 13:53:09 user nova-compute[72129]:     <boot dev="hd"/>
Aug 01 13:53:09 user nova-compute[72129]:     <smbios mode="sysinfo"/>
Aug 01 13:53:09 user nova-compute[72129]:   </os>
Aug 01 13:53:09 user nova-compute[72129]:   <features>
Aug 01 13:53:09 user nova-compute[72129]:     <acpi/>
Aug 01 13:53:09 user nova-compute[72129]:     <apic/>
Aug 01 13:53:09 user nova-compute[72129]:     <vmcoreinfo/>
Aug 01 13:53:09 user nova-compute[72129]:   </features>
Aug 01 13:53:09 user nova-compute[72129]:   <clock offset="utc">
Aug 01 13:53:09 user nova-compute[72129]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 13:53:09 user nova-compute[72129]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 13:53:09 user nova-compute[72129]:     <timer name="hpet" present="no"/>
Aug 01 13:53:09 user nova-compute[72129]:   </clock>
Aug 01 13:53:09 user nova-compute[72129]:   <cpu mode="custom" match="exact">
Aug 01 13:53:09 user nova-compute[72129]:     <model>Nehalem</model>
Aug 01 13:53:09 user nova-compute[72129]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 13:53:09 user nova-compute[72129]:   </cpu>
Aug 01 13:53:09 user nova-compute[72129]:   <devices>
Aug 01 13:53:09 user nova-compute[72129]:     <disk type="file" device="disk">
Aug 01 13:53:09 user nova-compute[72129]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 13:53:09 user nova-compute[72129]:       <source file="/opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk"/>
Aug 01 13:53:09 user nova-compute[72129]:       <target dev="vda" bus="virtio"/>
Aug 01 13:53:09 user nova-compute[72129]:     </disk>
Aug 01 13:53:09 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 13:53:09 user nova-compute[72129]:       <mac address="fa:16:3e:a3:52:a2"/>
Aug 01 13:53:09 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 13:53:09 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 13:53:09 user nova-compute[72129]:       <target dev="tap4871bc74-65"/>
Aug 01 13:53:09 user nova-compute[72129]:     </interface>
Aug 01 13:53:09 user nova-compute[72129]:     <serial type="pty">
Aug 01 13:53:09 user nova-compute[72129]:       <log file="/opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/console.log" append="off"/>
Aug 01 13:53:09 user nova-compute[72129]:     </serial>
Aug 01 13:53:09 user nova-compute[72129]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 13:53:09 user nova-compute[72129]:     <video>
Aug 01 13:53:09 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 13:53:09 user nova-compute[72129]:     </video>
Aug 01 13:53:09 user nova-compute[72129]:     <rng model="virtio">
Aug 01 13:53:09 user nova-compute[72129]:       <backend model="random">/dev/urandom</backend>
Aug 01 13:53:09 user nova-compute[72129]:     </rng>
Aug 01 13:53:09 user nova-compute[72129]:     <controller type="usb" index="0" model="none"/>
Aug 01 13:53:09 user nova-compute[72129]:     <memballoon model="virtio">
Aug 01 13:53:09 user nova-compute[72129]:       <stats period="10"/>
Aug 01 13:53:09 user nova-compute[72129]:     </memballoon>
Aug 01 13:53:09 user nova-compute[72129]:   </devices>
Aug 01 13:53:09 user nova-compute[72129]: </domain>
Aug 01 13:53:09 user nova-compute[72129]:  {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 13:53:09 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:53:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1047779358',display_name='tempest-ServerActionsTestOtherA-server-1047779358',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1047779358',id=14,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMKxgVYWQdVKRLV+QIEDxsF4RC9I5wENeCwXhryJ2sr+8oNRgK2W8XmwhDYsUxLBCXzQXdaopDtUa2pfT9PfB2oRmI83WPjT6V3uSmwDrvE9fHgGK0Xxc5yPsVieUvlqoA==',key_name='tempest-keypair-1687158208',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b0e85d9b73a546dc95e0ace26233f2a7',ramdisk_id='',reservation_id='r-hn67ks7n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1440097443',owner_user_name='tempest-ServerActionsTestOtherA-1440097443-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:53:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f35620862694e7295f782ab15e290a8',uuid=97a5dccf-b499-443a-b332-cfa293a16047,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4871bc74-6594-49e6-a6ef-343bc3800742", "address": "fa:16:3e:a3:52:a2", "network": {"id": "4b93ad92-9a3a-4472-ba6c-d215329da98b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-734108983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0e85d9b73a546dc95e0ace26233f2a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4871bc74-65", "ovs_interfaceid": "4871bc74-6594-49e6-a6ef-343bc3800742", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 13:53:09 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Converting VIF {"id": "4871bc74-6594-49e6-a6ef-343bc3800742", "address": "fa:16:3e:a3:52:a2", "network": {"id": "4b93ad92-9a3a-4472-ba6c-d215329da98b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-734108983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0e85d9b73a546dc95e0ace26233f2a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4871bc74-65", "ovs_interfaceid": "4871bc74-6594-49e6-a6ef-343bc3800742", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:53:09 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:52:a2,bridge_name='br-int',has_traffic_filtering=True,id=4871bc74-6594-49e6-a6ef-343bc3800742,network=Network(4b93ad92-9a3a-4472-ba6c-d215329da98b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4871bc74-65') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:53:09 user nova-compute[72129]: DEBUG os_vif [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:52:a2,bridge_name='br-int',has_traffic_filtering=True,id=4871bc74-6594-49e6-a6ef-343bc3800742,network=Network(4b93ad92-9a3a-4472-ba6c-d215329da98b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4871bc74-65') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 13:53:09 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:09 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:53:09 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 13:53:09 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:09 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4871bc74-65, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:53:09 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4871bc74-65, col_values=(('external_ids', {'iface-id': '4871bc74-6594-49e6-a6ef-343bc3800742', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:52:a2', 'vm-uuid': '97a5dccf-b499-443a-b332-cfa293a16047'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:53:09 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 13:53:09 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:09 user nova-compute[72129]: INFO os_vif [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:52:a2,bridge_name='br-int',has_traffic_filtering=True,id=4871bc74-6594-49e6-a6ef-343bc3800742,network=Network(4b93ad92-9a3a-4472-ba6c-d215329da98b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4871bc74-65')
Aug 01 13:53:09 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 13:53:09 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] No VIF found with MAC fa:16:3e:a3:52:a2, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 13:53:10 user nova-compute[72129]: DEBUG nova.network.neutron [req-9b3717f3-3773-404f-b16b-0f3645e0a387 req-5b666372-21ed-496b-a78f-44977e36ba5f service nova] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Updated VIF entry in instance network info cache for port 4871bc74-6594-49e6-a6ef-343bc3800742. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 13:53:10 user nova-compute[72129]: DEBUG nova.network.neutron [req-9b3717f3-3773-404f-b16b-0f3645e0a387 req-5b666372-21ed-496b-a78f-44977e36ba5f service nova] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Updating instance_info_cache with network_info: [{"id": "4871bc74-6594-49e6-a6ef-343bc3800742", "address": "fa:16:3e:a3:52:a2", "network": {"id": "4b93ad92-9a3a-4472-ba6c-d215329da98b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-734108983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0e85d9b73a546dc95e0ace26233f2a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4871bc74-65", "ovs_interfaceid": "4871bc74-6594-49e6-a6ef-343bc3800742", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:53:10 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-9b3717f3-3773-404f-b16b-0f3645e0a387 req-5b666372-21ed-496b-a78f-44977e36ba5f service nova] Releasing lock "refresh_cache-97a5dccf-b499-443a-b332-cfa293a16047" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:53:10 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:11 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:11 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:11 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:11 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:11 user nova-compute[72129]: DEBUG nova.compute.manager [req-1cadcf0f-9d72-43cc-b6de-9ba819f3c3e9 req-c059f2da-5e15-49f5-bd22-c1f150b32c50 service nova] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Received event network-vif-plugged-4871bc74-6594-49e6-a6ef-343bc3800742 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:53:11 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-1cadcf0f-9d72-43cc-b6de-9ba819f3c3e9 req-c059f2da-5e15-49f5-bd22-c1f150b32c50 service nova] Acquiring lock "97a5dccf-b499-443a-b332-cfa293a16047-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:53:11 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-1cadcf0f-9d72-43cc-b6de-9ba819f3c3e9 req-c059f2da-5e15-49f5-bd22-c1f150b32c50 service nova] Lock "97a5dccf-b499-443a-b332-cfa293a16047-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:53:11 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-1cadcf0f-9d72-43cc-b6de-9ba819f3c3e9 req-c059f2da-5e15-49f5-bd22-c1f150b32c50 service nova] Lock "97a5dccf-b499-443a-b332-cfa293a16047-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:53:11 user nova-compute[72129]: DEBUG nova.compute.manager [req-1cadcf0f-9d72-43cc-b6de-9ba819f3c3e9 req-c059f2da-5e15-49f5-bd22-c1f150b32c50 service nova] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] No waiting events found dispatching network-vif-plugged-4871bc74-6594-49e6-a6ef-343bc3800742 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:53:11 user nova-compute[72129]: WARNING nova.compute.manager [req-1cadcf0f-9d72-43cc-b6de-9ba819f3c3e9 req-c059f2da-5e15-49f5-bd22-c1f150b32c50 service nova] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Received unexpected event network-vif-plugged-4871bc74-6594-49e6-a6ef-343bc3800742 for instance with vm_state building and task_state spawning.
Aug 01 13:53:11 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:11 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:13 user nova-compute[72129]: DEBUG nova.compute.manager [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wpUkcKQv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0', 'attached_at': '', 'detached_at': '', 'volume_id': '43c1b008-ef2f-494c-8ba1-6c55ed0085a5', 'serial': '43c1b008-ef2f-494c-8ba1-6c55ed0085a5'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:09126dac-6afb-45c4-8ec4-9bd3c88593db'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'phlPZaJk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '09126dac-6afb-45c4-8ec4-9bd3c88593db'}, 'status': 'reserved', 'instance': '33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0', 'attached_at': '', 'detached_at': '', 'volume_id': '09126dac-6afb-45c4-8ec4-9bd3c88593db', 'serial'} {{(pid=72129) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 01 13:53:13 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Calling os-brick to attach iSCSI Volume {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 13:53:13 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wpUkcKQv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:53:13 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 13:53:13 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:53:13 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:53:13 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 13:53:13 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:53:13 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:53:13 user nova-compute[72129]: INFO os_brick.initiator.connectors.iscsi [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 13:53:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 -p 172.16.0.220:3260 {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:13 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[11cc69e5-ab38-4efd-874f-2a662f0fb4d1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:13 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 13:53:13 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:53:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 -p 172.16.0.220:3260 --interface default --op new {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:13 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e453fd1-216d-404a-a625-831860f5a157]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5] added\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:13 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5] added
Aug 01 13:53:13 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:53:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:13 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[097cbb7b-1df2-4880-ab1f-5094b10dea87]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:13 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:53:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:13 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fad95f0-fb54-41e6-a88e-b65fe37dcbc1]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:13 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:53:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wpUkcKQv {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wpUkcKQv" returned: 0 in 0.023s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:13 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9fcda09-790a-4d28-8b8a-f851a651533a]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:13 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wpUkcKQv'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:53:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:13 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b83624f-602a-4c1a-99f4-674c6d57cad0]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:13 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:53:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:13 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690897993.3020988, 97a5dccf-b499-443a-b332-cfa293a16047 => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:53:13 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] VM Resumed (Lifecycle Event)
Aug 01 13:53:13 user nova-compute[72129]: DEBUG nova.compute.manager [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Instance event wait completed in 0 seconds for  {{(pid=72129) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 13:53:13 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Guest created on hypervisor {{(pid=72129) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 13:53:13 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Instance spawned successfully.
Aug 01 13:53:13 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 13:53:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:13 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:53:13 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3999243-d6d8-4196-947f-d8e80b8f0751]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09126dac-6afb-45c4-8ec4-9bd3c88593db (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:13 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09126dac-6afb-45c4-8ec4-9bd3c88593db (non-flash)
Aug 01 13:53:13 user nova-compute[72129]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)
Aug 01 13:53:13 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:53:13 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09126dac-6afb-45c4-8ec4-9bd3c88593db (non-flash)
Aug 01 13:53:13 user nova-compute[72129]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)
Aug 01 13:53:13 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:53:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 -p 172.16.0.220:3260 --login {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:13 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 13:53:13 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Found default for hw_cdrom_bus of ide {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:53:13 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Found default for hw_disk_bus of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:53:13 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Found default for hw_input_bus of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:53:13 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Found default for hw_pointer_model of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:53:13 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Found default for hw_video_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:53:13 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Found default for hw_vif_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:53:13 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 13:53:13 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690897993.303043, 97a5dccf-b499-443a-b332-cfa293a16047 => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:53:13 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] VM Started (Lifecycle Event)
Aug 01 13:53:13 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:53:13 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 13:53:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:13 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d9a39ba-b2c5-4126-a99d-9eb46ceaf9c6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:13 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5, portal: 172.16.0.220,3260]
Aug 01 13:53:13 user nova-compute[72129]: Login to [iface: default, target: iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5, portal: 172.16.0.220,3260] successful.
Aug 01 13:53:13 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:53:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:13 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 13:53:13 user nova-compute[72129]: INFO nova.compute.manager [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Took 5.59 seconds to spawn the instance on the hypervisor.
Aug 01 13:53:13 user nova-compute[72129]: DEBUG nova.compute.manager [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:53:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:13 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e3cbaaa-067d-438b-96a8-e25dcb72b562]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:13 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:53:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:13 user nova-compute[72129]: DEBUG nova.compute.manager [req-f7c42747-622f-4860-97fe-6207dd74c895 req-d0ce7b0e-887d-489f-be03-54f7a93f80d0 service nova] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Received event network-vif-plugged-4871bc74-6594-49e6-a6ef-343bc3800742 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:53:13 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f7c42747-622f-4860-97fe-6207dd74c895 req-d0ce7b0e-887d-489f-be03-54f7a93f80d0 service nova] Acquiring lock "97a5dccf-b499-443a-b332-cfa293a16047-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:53:13 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f7c42747-622f-4860-97fe-6207dd74c895 req-d0ce7b0e-887d-489f-be03-54f7a93f80d0 service nova] Lock "97a5dccf-b499-443a-b332-cfa293a16047-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:53:13 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f7c42747-622f-4860-97fe-6207dd74c895 req-d0ce7b0e-887d-489f-be03-54f7a93f80d0 service nova] Lock "97a5dccf-b499-443a-b332-cfa293a16047-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:53:13 user nova-compute[72129]: DEBUG nova.compute.manager [req-f7c42747-622f-4860-97fe-6207dd74c895 req-d0ce7b0e-887d-489f-be03-54f7a93f80d0 service nova] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] No waiting events found dispatching network-vif-plugged-4871bc74-6594-49e6-a6ef-343bc3800742 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:53:13 user nova-compute[72129]: WARNING nova.compute.manager [req-f7c42747-622f-4860-97fe-6207dd74c895 req-d0ce7b0e-887d-489f-be03-54f7a93f80d0 service nova] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Received unexpected event network-vif-plugged-4871bc74-6594-49e6-a6ef-343bc3800742 for instance with vm_state building and task_state spawning.
Aug 01 13:53:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:13 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[205a187b-2ed1-4a93-bf2d-4dce8403c53e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09126dac-6afb-45c4-8ec4-9bd3c88593db (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:13 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09126dac-6afb-45c4-8ec4-9bd3c88593db (non-flash)
Aug 01 13:53:13 user nova-compute[72129]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 (non-flash)
Aug 01 13:53:13 user nova-compute[72129]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)
Aug 01 13:53:13 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:53:13 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09126dac-6afb-45c4-8ec4-9bd3c88593db (non-flash)
Aug 01 13:53:13 user nova-compute[72129]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 (non-flash)
Aug 01 13:53:13 user nova-compute[72129]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)
Aug 01 13:53:13 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:53:13 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:53:13 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] Connected to 172.16.0.220:3260 {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 13:53:13 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] HCTL ('34', '-', '-', 0) found on session 15 with lun 0 {{(pid=72129) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 13:53:13 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] Scanning host 34 c: -, t: -, l: 0) {{(pid=72129) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 13:53:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:13 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[31cc47de-6b56-42f8-b12c-66ba6246df09]: (4, ('- - 0', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:13 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 13:53:13 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wpUkcKQv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 13:53:13 user nova-compute[72129]: INFO nova.compute.manager [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Took 6.34 seconds to build instance.
Aug 01 13:53:13 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-f06be7bf-bb05-4405-8756-0d1fc6e1eb1a tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "97a5dccf-b499-443a-b332-cfa293a16047" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.451s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:53:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:53:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '23739393835656462', 'path': '/dev/sdc'} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:53:14 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23739393835656462', 'path': '/dev/sdc'} {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 13:53:14 user nova-compute[72129]: DEBUG nova.objects.instance [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] Lazy-loading 'flavor' on Instance uuid 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:53:14 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:14 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=72129) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 13:53:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Acquiring lock "3a915d04-faf8-4987-9233-130524dfe655" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:53:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Lock "3a915d04-faf8-4987-9233-130524dfe655" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:53:15 user nova-compute[72129]: DEBUG nova.compute.manager [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 3a915d04-faf8-4987-9233-130524dfe655] Starting instance... {{(pid=72129) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 13:53:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:53:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:53:15 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72129) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 13:53:15 user nova-compute[72129]: INFO nova.compute.claims [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 3a915d04-faf8-4987-9233-130524dfe655] Claim successful on node user
Aug 01 13:53:15 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:15 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] COPY block job progress, current cursor: 117440512 final cursor: 1073741824 {{(pid=72129) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 13:53:15 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 13:53:15 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 13:53:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.761s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:53:15 user nova-compute[72129]: DEBUG nova.compute.manager [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 3a915d04-faf8-4987-9233-130524dfe655] Start building networks asynchronously for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 13:53:15 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] COPY block job progress, current cursor: 278921216 final cursor: 1073741824 {{(pid=72129) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 13:53:16 user nova-compute[72129]: DEBUG nova.compute.manager [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 3a915d04-faf8-4987-9233-130524dfe655] Allocating IP information in the background. {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 13:53:16 user nova-compute[72129]: DEBUG nova.network.neutron [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 3a915d04-faf8-4987-9233-130524dfe655] allocate_for_instance() {{(pid=72129) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 13:53:16 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 3a915d04-faf8-4987-9233-130524dfe655] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 13:53:16 user nova-compute[72129]: DEBUG nova.compute.manager [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 3a915d04-faf8-4987-9233-130524dfe655] Start building block device mappings for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 13:53:16 user nova-compute[72129]: DEBUG nova.policy [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '42662c28ee804a399b2ba6467e3c3926', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8fd0bc919dc4f39a702173f8be6a847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72129) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 13:53:16 user nova-compute[72129]: DEBUG nova.compute.manager [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 3a915d04-faf8-4987-9233-130524dfe655] Start spawning the instance on the hypervisor. {{(pid=72129) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 13:53:16 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 3a915d04-faf8-4987-9233-130524dfe655] Creating instance directory {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 13:53:16 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 3a915d04-faf8-4987-9233-130524dfe655] Creating image(s)
Aug 01 13:53:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Acquiring lock "/opt/stack/data/nova/instances/3a915d04-faf8-4987-9233-130524dfe655/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:53:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Lock "/opt/stack/data/nova/instances/3a915d04-faf8-4987-9233-130524dfe655/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.003s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:53:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Lock "/opt/stack/data/nova/instances/3a915d04-faf8-4987-9233-130524dfe655/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:53:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:16 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] COPY block job progress, current cursor: 439353344 final cursor: 1073741824 {{(pid=72129) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 13:53:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.190s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Acquiring lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:53:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:53:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.187s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/3a915d04-faf8-4987-9233-130524dfe655/disk 1073741824 {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/3a915d04-faf8-4987-9233-130524dfe655/disk 1073741824" returned: 0 in 0.060s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:53:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.188s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:17 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3a915d04-faf8-4987-9233-130524dfe655/disk. size=1073741824 {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 13:53:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a915d04-faf8-4987-9233-130524dfe655/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:17 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] COPY block job progress, current cursor: 597688320 final cursor: 1073741824 {{(pid=72129) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 13:53:17 user nova-compute[72129]: DEBUG nova.network.neutron [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 3a915d04-faf8-4987-9233-130524dfe655] Successfully created port: 163ebe07-e21c-4208-b902-29c309adcef1 {{(pid=72129) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 13:53:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a915d04-faf8-4987-9233-130524dfe655/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:17 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Cannot resize image /opt/stack/data/nova/instances/3a915d04-faf8-4987-9233-130524dfe655/disk to a smaller size. {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 13:53:17 user nova-compute[72129]: DEBUG nova.objects.instance [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Lazy-loading 'migration_context' on Instance uuid 3a915d04-faf8-4987-9233-130524dfe655 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:53:17 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 3a915d04-faf8-4987-9233-130524dfe655] Created local disks {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 13:53:17 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 3a915d04-faf8-4987-9233-130524dfe655] Ensure instance console log exists: /opt/stack/data/nova/instances/3a915d04-faf8-4987-9233-130524dfe655/console.log {{(pid=72129) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 13:53:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:53:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:53:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:53:17 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] COPY block job progress, current cursor: 735051776 final cursor: 1073741824 {{(pid=72129) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] COPY block job progress, current cursor: 919601152 final cursor: 1073741824 {{(pid=72129) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG nova.network.neutron [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 3a915d04-faf8-4987-9233-130524dfe655] Successfully updated port: 163ebe07-e21c-4208-b902-29c309adcef1 {{(pid=72129) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Acquiring lock "refresh_cache-3a915d04-faf8-4987-9233-130524dfe655" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Acquired lock "refresh_cache-3a915d04-faf8-4987-9233-130524dfe655" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG nova.network.neutron [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 3a915d04-faf8-4987-9233-130524dfe655] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG nova.compute.manager [req-0a7c79b7-a878-4f4e-92fa-b722faf7a898 req-426487ba-285c-4aad-9fd6-7f2cfedbeb0c service nova] [instance: 3a915d04-faf8-4987-9233-130524dfe655] Received event network-changed-163ebe07-e21c-4208-b902-29c309adcef1 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG nova.compute.manager [req-0a7c79b7-a878-4f4e-92fa-b722faf7a898 req-426487ba-285c-4aad-9fd6-7f2cfedbeb0c service nova] [instance: 3a915d04-faf8-4987-9233-130524dfe655] Refreshing instance network info cache due to event network-changed-163ebe07-e21c-4208-b902-29c309adcef1. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-0a7c79b7-a878-4f4e-92fa-b722faf7a898 req-426487ba-285c-4aad-9fd6-7f2cfedbeb0c service nova] Acquiring lock "refresh_cache-3a915d04-faf8-4987-9233-130524dfe655" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG nova.network.neutron [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 3a915d04-faf8-4987-9233-130524dfe655] Instance cache missing network info. {{(pid=72129) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72129) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG nova.network.neutron [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 3a915d04-faf8-4987-9233-130524dfe655] Updating instance_info_cache with network_info: [{"id": "163ebe07-e21c-4208-b902-29c309adcef1", "address": "fa:16:3e:fc:4f:6f", "network": {"id": "8c424a77-2cdc-4519-bad7-e5c4498aa600", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1161619305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8fd0bc919dc4f39a702173f8be6a847", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap163ebe07-e2", "ovs_interfaceid": "163ebe07-e21c-4208-b902-29c309adcef1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Releasing lock "refresh_cache-3a915d04-faf8-4987-9233-130524dfe655" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG nova.compute.manager [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 3a915d04-faf8-4987-9233-130524dfe655] Instance network_info: |[{"id": "163ebe07-e21c-4208-b902-29c309adcef1", "address": "fa:16:3e:fc:4f:6f", "network": {"id": "8c424a77-2cdc-4519-bad7-e5c4498aa600", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1161619305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8fd0bc919dc4f39a702173f8be6a847", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap163ebe07-e2", "ovs_interfaceid": "163ebe07-e21c-4208-b902-29c309adcef1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-0a7c79b7-a878-4f4e-92fa-b722faf7a898 req-426487ba-285c-4aad-9fd6-7f2cfedbeb0c service nova] Acquired lock "refresh_cache-3a915d04-faf8-4987-9233-130524dfe655" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG nova.network.neutron [req-0a7c79b7-a878-4f4e-92fa-b722faf7a898 req-426487ba-285c-4aad-9fd6-7f2cfedbeb0c service nova] [instance: 3a915d04-faf8-4987-9233-130524dfe655] Refreshing network info cache for port 163ebe07-e21c-4208-b902-29c309adcef1 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 3a915d04-faf8-4987-9233-130524dfe655] Start _get_guest_xml network_info=[{"id": "163ebe07-e21c-4208-b902-29c309adcef1", "address": "fa:16:3e:fc:4f:6f", "network": {"id": "8c424a77-2cdc-4519-bad7-e5c4498aa600", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1161619305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8fd0bc919dc4f39a702173f8be6a847", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap163ebe07-e2", "ovs_interfaceid": "163ebe07-e21c-4208-b902-29c309adcef1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'image_id': 'b6472c34-1b0f-4034-ba3a-7e8eb5103715'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] calling os-brick to detach iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, {'target_iqns': ['iqn.2010-10.org.openstack:09126dac-6afb-45c4-8ec4-9bd3c88593db'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'phlPZaJk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '09126dac-6afb-45c4-8ec4-9bd3c88593db'}, None), 'kwargs': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:53:18 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 13:53:18 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09126dac-6afb-45c4-8ec4-9bd3c88593db', 0)] {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 13:53:18 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:53:18 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:53:18 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] CPU controller missing on host. {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] CPU controller found on host. {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72129) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T13:45:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Flavor limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Image limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Flavor pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Image pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Got 1 possible topologies {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:53:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-715351820',display_name='tempest-VolumesAdminNegativeTest-server-715351820',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-715351820',id=15,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e8fd0bc919dc4f39a702173f8be6a847',ramdisk_id='',reservation_id='r-6ay87fb7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1822759437',owner_user_name='tempest-VolumesAdminNegativeTest-1822759437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:53:16Z,user_data=None,user_id='42662c28ee804a399b2ba6467e3c3926',uuid=3a915d04-faf8-4987-9233-130524dfe655,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "163ebe07-e21c-4208-b902-29c309adcef1", "address": "fa:16:3e:fc:4f:6f", "network": {"id": "8c424a77-2cdc-4519-bad7-e5c4498aa600", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1161619305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8fd0bc919dc4f39a702173f8be6a847", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap163ebe07-e2", "ovs_interfaceid": "163ebe07-e21c-4208-b902-29c309adcef1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Converting VIF {"id": "163ebe07-e21c-4208-b902-29c309adcef1", "address": "fa:16:3e:fc:4f:6f", "network": {"id": "8c424a77-2cdc-4519-bad7-e5c4498aa600", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1161619305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8fd0bc919dc4f39a702173f8be6a847", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap163ebe07-e2", "ovs_interfaceid": "163ebe07-e21c-4208-b902-29c309adcef1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:4f:6f,bridge_name='br-int',has_traffic_filtering=True,id=163ebe07-e21c-4208-b902-29c309adcef1,network=Network(8c424a77-2cdc-4519-bad7-e5c4498aa600),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap163ebe07-e2') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG nova.objects.instance [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Lazy-loading 'pci_devices' on Instance uuid 3a915d04-faf8-4987-9233-130524dfe655 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a87ec9-e938-4178-9363-a8ffd3f9454a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09126dac-6afb-45c4-8ec4-9bd3c88593db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 3a915d04-faf8-4987-9233-130524dfe655] End _get_guest_xml xml=<domain type="kvm">
Aug 01 13:53:18 user nova-compute[72129]:   <uuid>3a915d04-faf8-4987-9233-130524dfe655</uuid>
Aug 01 13:53:18 user nova-compute[72129]:   <name>instance-0000000f</name>
Aug 01 13:53:18 user nova-compute[72129]:   <memory>524288</memory>
Aug 01 13:53:18 user nova-compute[72129]:   <vcpu>1</vcpu>
Aug 01 13:53:18 user nova-compute[72129]:   <metadata>
Aug 01 13:53:18 user nova-compute[72129]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 13:53:18 user nova-compute[72129]:       <nova:package version="0.0.0"/>
Aug 01 13:53:18 user nova-compute[72129]:       <nova:name>tempest-VolumesAdminNegativeTest-server-715351820</nova:name>
Aug 01 13:53:18 user nova-compute[72129]:       <nova:creationTime>2023-08-01 13:53:18</nova:creationTime>
Aug 01 13:53:18 user nova-compute[72129]:       <nova:flavor name="m1.tiny">
Aug 01 13:53:18 user nova-compute[72129]:         <nova:memory>512</nova:memory>
Aug 01 13:53:18 user nova-compute[72129]:         <nova:disk>1</nova:disk>
Aug 01 13:53:18 user nova-compute[72129]:         <nova:swap>0</nova:swap>
Aug 01 13:53:18 user nova-compute[72129]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 13:53:18 user nova-compute[72129]:         <nova:vcpus>1</nova:vcpus>
Aug 01 13:53:18 user nova-compute[72129]:       </nova:flavor>
Aug 01 13:53:18 user nova-compute[72129]:       <nova:owner>
Aug 01 13:53:18 user nova-compute[72129]:         <nova:user uuid="42662c28ee804a399b2ba6467e3c3926">tempest-VolumesAdminNegativeTest-1822759437-project-member</nova:user>
Aug 01 13:53:18 user nova-compute[72129]:         <nova:project uuid="e8fd0bc919dc4f39a702173f8be6a847">tempest-VolumesAdminNegativeTest-1822759437</nova:project>
Aug 01 13:53:18 user nova-compute[72129]:       </nova:owner>
Aug 01 13:53:18 user nova-compute[72129]:       <nova:root type="image" uuid="b6472c34-1b0f-4034-ba3a-7e8eb5103715"/>
Aug 01 13:53:18 user nova-compute[72129]:       <nova:ports>
Aug 01 13:53:18 user nova-compute[72129]:         <nova:port uuid="163ebe07-e21c-4208-b902-29c309adcef1">
Aug 01 13:53:18 user nova-compute[72129]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 01 13:53:18 user nova-compute[72129]:         </nova:port>
Aug 01 13:53:18 user nova-compute[72129]:       </nova:ports>
Aug 01 13:53:18 user nova-compute[72129]:     </nova:instance>
Aug 01 13:53:18 user nova-compute[72129]:   </metadata>
Aug 01 13:53:18 user nova-compute[72129]:   <sysinfo type="smbios">
Aug 01 13:53:18 user nova-compute[72129]:     <system>
Aug 01 13:53:18 user nova-compute[72129]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 13:53:18 user nova-compute[72129]:       <entry name="product">OpenStack Nova</entry>
Aug 01 13:53:18 user nova-compute[72129]:       <entry name="version">0.0.0</entry>
Aug 01 13:53:18 user nova-compute[72129]:       <entry name="serial">3a915d04-faf8-4987-9233-130524dfe655</entry>
Aug 01 13:53:18 user nova-compute[72129]:       <entry name="uuid">3a915d04-faf8-4987-9233-130524dfe655</entry>
Aug 01 13:53:18 user nova-compute[72129]:       <entry name="family">Virtual Machine</entry>
Aug 01 13:53:18 user nova-compute[72129]:     </system>
Aug 01 13:53:18 user nova-compute[72129]:   </sysinfo>
Aug 01 13:53:18 user nova-compute[72129]:   <os>
Aug 01 13:53:18 user nova-compute[72129]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 13:53:18 user nova-compute[72129]:     <boot dev="hd"/>
Aug 01 13:53:18 user nova-compute[72129]:     <smbios mode="sysinfo"/>
Aug 01 13:53:18 user nova-compute[72129]:   </os>
Aug 01 13:53:18 user nova-compute[72129]:   <features>
Aug 01 13:53:18 user nova-compute[72129]:     <acpi/>
Aug 01 13:53:18 user nova-compute[72129]:     <apic/>
Aug 01 13:53:18 user nova-compute[72129]:     <vmcoreinfo/>
Aug 01 13:53:18 user nova-compute[72129]:   </features>
Aug 01 13:53:18 user nova-compute[72129]:   <clock offset="utc">
Aug 01 13:53:18 user nova-compute[72129]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 13:53:18 user nova-compute[72129]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 13:53:18 user nova-compute[72129]:     <timer name="hpet" present="no"/>
Aug 01 13:53:18 user nova-compute[72129]:   </clock>
Aug 01 13:53:18 user nova-compute[72129]:   <cpu mode="custom" match="exact">
Aug 01 13:53:18 user nova-compute[72129]:     <model>Nehalem</model>
Aug 01 13:53:18 user nova-compute[72129]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 13:53:18 user nova-compute[72129]:   </cpu>
Aug 01 13:53:18 user nova-compute[72129]:   <devices>
Aug 01 13:53:18 user nova-compute[72129]:     <disk type="file" device="disk">
Aug 01 13:53:18 user nova-compute[72129]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 13:53:18 user nova-compute[72129]:       <source file="/opt/stack/data/nova/instances/3a915d04-faf8-4987-9233-130524dfe655/disk"/>
Aug 01 13:53:18 user nova-compute[72129]:       <target dev="vda" bus="virtio"/>
Aug 01 13:53:18 user nova-compute[72129]:     </disk>
Aug 01 13:53:18 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 13:53:18 user nova-compute[72129]:       <mac address="fa:16:3e:fc:4f:6f"/>
Aug 01 13:53:18 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 13:53:18 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 13:53:18 user nova-compute[72129]:       <target dev="tap163ebe07-e2"/>
Aug 01 13:53:18 user nova-compute[72129]:     </interface>
Aug 01 13:53:18 user nova-compute[72129]:     <serial type="pty">
Aug 01 13:53:18 user nova-compute[72129]:       <log file="/opt/stack/data/nova/instances/3a915d04-faf8-4987-9233-130524dfe655/console.log" append="off"/>
Aug 01 13:53:18 user nova-compute[72129]:     </serial>
Aug 01 13:53:18 user nova-compute[72129]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 13:53:18 user nova-compute[72129]:     <video>
Aug 01 13:53:18 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 13:53:18 user nova-compute[72129]:     </video>
Aug 01 13:53:18 user nova-compute[72129]:     <rng model="virtio">
Aug 01 13:53:18 user nova-compute[72129]:       <backend model="random">/dev/urandom</backend>
Aug 01 13:53:18 user nova-compute[72129]:     </rng>
Aug 01 13:53:18 user nova-compute[72129]:     <controller type="usb" index="0" model="none"/>
Aug 01 13:53:18 user nova-compute[72129]:     <memballoon model="virtio">
Aug 01 13:53:18 user nova-compute[72129]:       <stats period="10"/>
Aug 01 13:53:18 user nova-compute[72129]:     </memballoon>
Aug 01 13:53:18 user nova-compute[72129]:   </devices>
Aug 01 13:53:18 user nova-compute[72129]: </domain>
Aug 01 13:53:18 user nova-compute[72129]:  {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:53:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-715351820',display_name='tempest-VolumesAdminNegativeTest-server-715351820',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-715351820',id=15,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e8fd0bc919dc4f39a702173f8be6a847',ramdisk_id='',reservation_id='r-6ay87fb7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1822759437',owner_user_name='tempest-VolumesAdminNegativeTest-1822759437-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:53:16Z,user_data=None,user_id='42662c28ee804a399b2ba6467e3c3926',uuid=3a915d04-faf8-4987-9233-130524dfe655,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "163ebe07-e21c-4208-b902-29c309adcef1", "address": "fa:16:3e:fc:4f:6f", "network": {"id": "8c424a77-2cdc-4519-bad7-e5c4498aa600", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1161619305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8fd0bc919dc4f39a702173f8be6a847", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap163ebe07-e2", "ovs_interfaceid": "163ebe07-e21c-4208-b902-29c309adcef1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Converting VIF {"id": "163ebe07-e21c-4208-b902-29c309adcef1", "address": "fa:16:3e:fc:4f:6f", "network": {"id": "8c424a77-2cdc-4519-bad7-e5c4498aa600", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1161619305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8fd0bc919dc4f39a702173f8be6a847", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap163ebe07-e2", "ovs_interfaceid": "163ebe07-e21c-4208-b902-29c309adcef1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:4f:6f,bridge_name='br-int',has_traffic_filtering=True,id=163ebe07-e21c-4208-b902-29c309adcef1,network=Network(8c424a77-2cdc-4519-bad7-e5c4498aa600),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap163ebe07-e2') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG os_vif [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:4f:6f,bridge_name='br-int',has_traffic_filtering=True,id=163ebe07-e21c-4208-b902-29c309adcef1,network=Network(8c424a77-2cdc-4519-bad7-e5c4498aa600),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap163ebe07-e2') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap163ebe07-e2, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap163ebe07-e2, col_values=(('external_ids', {'iface-id': '163ebe07-e21c-4208-b902-29c309adcef1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:4f:6f', 'vm-uuid': '3a915d04-faf8-4987-9233-130524dfe655'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e74c1b-ad86-4751-b0f7-0e0f13fa588c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09126dac-6afb-45c4-8ec4-9bd3c88593db (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09126dac-6afb-45c4-8ec4-9bd3c88593db (non-flash)
Aug 01 13:53:18 user nova-compute[72129]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 (non-flash)
Aug 01 13:53:18 user nova-compute[72129]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)
Aug 01 13:53:18 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09126dac-6afb-45c4-8ec4-9bd3c88593db (non-flash)
Aug 01 13:53:18 user nova-compute[72129]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 (non-flash)
Aug 01 13:53:18 user nova-compute[72129]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)
Aug 01 13:53:18 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f28281192d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09126dac-6afb-45c4-8ec4-9bd3c88593db'): ({'sdb'}, set())}) {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] Removing single pathed devices sdb {{(pid=72129) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:18 user nova-compute[72129]: INFO os_vif [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:4f:6f,bridge_name='br-int',has_traffic_filtering=True,id=163ebe07-e21c-4208-b902-29c309adcef1,network=Network(8c424a77-2cdc-4519-bad7-e5c4498aa600),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap163ebe07-e2')
Aug 01 13:53:18 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6147165-0a8b-4558-812b-056ec8fb8bee]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c9815a-4007-45e8-96b0-5df56940fa52]: (4, ('ok\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] Flushing IO for device /dev/sdb {{(pid=72129) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] No VIF found with MAC fa:16:3e:fc:4f:6f, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a43d672-17e0-4887-b4c5-4955c912e01e]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72129) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c61bd8-0346-4a79-96c6-4f0824c4f0c5]: (4, ('1', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] SCSI volumes sdb have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09126dac-6afb-45c4-8ec4-9bd3c88593db')] {{(pid=72129) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09126dac-6afb-45c4-8ec4-9bd3c88593db -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09126dac-6afb-45c4-8ec4-9bd3c88593db -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c3f4da-64ff-41ec-a3f6-c781ec789334]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:53:18 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09126dac-6afb-45c4-8ec4-9bd3c88593db -p 172.16.0.220:3260 --logout {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09126dac-6afb-45c4-8ec4-9bd3c88593db -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:19 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[3075e071-fbf4-4c91-a14a-98176a3c5596]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:09126dac-6afb-45c4-8ec4-9bd3c88593db, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:09126dac-6afb-45c4-8ec4-9bd3c88593db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:19 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:09126dac-6afb-45c4-8ec4-9bd3c88593db, portal: 172.16.0.220,3260]
Aug 01 13:53:19 user nova-compute[72129]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:09126dac-6afb-45c4-8ec4-9bd3c88593db, portal: 172.16.0.220,3260] successful.
Aug 01 13:53:19 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:53:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09126dac-6afb-45c4-8ec4-9bd3c88593db -p 172.16.0.220:3260 --op delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09126dac-6afb-45c4-8ec4-9bd3c88593db -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:19 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5631db-98dd-4f4f-b706-7d103866f8bd]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:19 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:53:19 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:53:19 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] <== disconnect_volume: return (352ms) None {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:53:19 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Disconnected iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 13:53:19 user nova-compute[72129]: DEBUG nova.compute.manager [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wpUkcKQv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0', 'attached_at': '', 'detached_at': '', 'volume_id': '43c1b008-ef2f-494c-8ba1-6c55ed0085a5', 'serial'} {{(pid=72129) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 01 13:53:19 user nova-compute[72129]: DEBUG nova.compute.manager [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] swap_volume: removing Cinder connection for volume 09126dac-6afb-45c4-8ec4-9bd3c88593db {{(pid=72129) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 01 13:53:19 user nova-compute[72129]: DEBUG nova.network.neutron [req-0a7c79b7-a878-4f4e-92fa-b722faf7a898 req-426487ba-285c-4aad-9fd6-7f2cfedbeb0c service nova] [instance: 3a915d04-faf8-4987-9233-130524dfe655] Updated VIF entry in instance network info cache for port 163ebe07-e21c-4208-b902-29c309adcef1. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 13:53:19 user nova-compute[72129]: DEBUG nova.network.neutron [req-0a7c79b7-a878-4f4e-92fa-b722faf7a898 req-426487ba-285c-4aad-9fd6-7f2cfedbeb0c service nova] [instance: 3a915d04-faf8-4987-9233-130524dfe655] Updating instance_info_cache with network_info: [{"id": "163ebe07-e21c-4208-b902-29c309adcef1", "address": "fa:16:3e:fc:4f:6f", "network": {"id": "8c424a77-2cdc-4519-bad7-e5c4498aa600", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1161619305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8fd0bc919dc4f39a702173f8be6a847", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap163ebe07-e2", "ovs_interfaceid": "163ebe07-e21c-4208-b902-29c309adcef1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:53:19 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-0a7c79b7-a878-4f4e-92fa-b722faf7a898 req-426487ba-285c-4aad-9fd6-7f2cfedbeb0c service nova] Releasing lock "refresh_cache-3a915d04-faf8-4987-9233-130524dfe655" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:53:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:20 user nova-compute[72129]: DEBUG nova.compute.manager [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] swap_volume: Updating volume 09126dac-6afb-45c4-8ec4-9bd3c88593db BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "wpUkcKQv", "auth_password": "3L2ejzDA6PMY5F", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdc", "volume_id": "43c1b008-ef2f-494c-8ba1-6c55ed0085a5"}, "status": "reserved", "instance": "33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0", "attached_at": "", "detached_at": "", "volume_id": "43c1b008-ef2f-494c-8ba1-6c55ed0085a5", "serial": "43c1b008-ef2f-494c-8ba1-6c55ed0085a5"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '43c1b008-ef2f-494c-8ba1-6c55ed0085a5', 'no_device': None, 'attachment_id': '48bfcbbf-312a-43d0-89d4-85e518376417'} {{(pid=72129) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 01 13:53:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-2f5b6c03-f43c-49e1-beac-d610469808ec tempest-TestVolumeSwap-472406899 tempest-TestVolumeSwap-472406899-project-admin] Lock "33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 15.372s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:53:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:20 user nova-compute[72129]: DEBUG nova.compute.manager [req-cea9e527-a114-4a62-838e-c3c68876cfd6 req-55ba2e1c-5ed8-4bda-a463-b827deb96202 service nova] [instance: 3a915d04-faf8-4987-9233-130524dfe655] Received event network-vif-plugged-163ebe07-e21c-4208-b902-29c309adcef1 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:53:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-cea9e527-a114-4a62-838e-c3c68876cfd6 req-55ba2e1c-5ed8-4bda-a463-b827deb96202 service nova] Acquiring lock "3a915d04-faf8-4987-9233-130524dfe655-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:53:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-cea9e527-a114-4a62-838e-c3c68876cfd6 req-55ba2e1c-5ed8-4bda-a463-b827deb96202 service nova] Lock "3a915d04-faf8-4987-9233-130524dfe655-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:53:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-cea9e527-a114-4a62-838e-c3c68876cfd6 req-55ba2e1c-5ed8-4bda-a463-b827deb96202 service nova] Lock "3a915d04-faf8-4987-9233-130524dfe655-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:53:20 user nova-compute[72129]: DEBUG nova.compute.manager [req-cea9e527-a114-4a62-838e-c3c68876cfd6 req-55ba2e1c-5ed8-4bda-a463-b827deb96202 service nova] [instance: 3a915d04-faf8-4987-9233-130524dfe655] No waiting events found dispatching network-vif-plugged-163ebe07-e21c-4208-b902-29c309adcef1 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:53:20 user nova-compute[72129]: WARNING nova.compute.manager [req-cea9e527-a114-4a62-838e-c3c68876cfd6 req-55ba2e1c-5ed8-4bda-a463-b827deb96202 service nova] [instance: 3a915d04-faf8-4987-9233-130524dfe655] Received unexpected event network-vif-plugged-163ebe07-e21c-4208-b902-29c309adcef1 for instance with vm_state building and task_state spawning.
Aug 01 13:53:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-aeb99de3-6a8e-4605-ac8f-a135c1d9eb0f tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Acquiring lock "33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:53:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-aeb99de3-6a8e-4605-ac8f-a135c1d9eb0f tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Lock "33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:53:22 user nova-compute[72129]: INFO nova.compute.manager [None req-aeb99de3-6a8e-4605-ac8f-a135c1d9eb0f tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Detaching volume 43c1b008-ef2f-494c-8ba1-6c55ed0085a5
Aug 01 13:53:22 user nova-compute[72129]: INFO nova.virt.block_device [None req-aeb99de3-6a8e-4605-ac8f-a135c1d9eb0f tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Attempting to driver detach volume 43c1b008-ef2f-494c-8ba1-6c55ed0085a5 from mountpoint /dev/vdb
Aug 01 13:53:22 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-aeb99de3-6a8e-4605-ac8f-a135c1d9eb0f tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Attempting to detach device vdb from instance 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0 from the persistent domain config. {{(pid=72129) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 13:53:22 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-aeb99de3-6a8e-4605-ac8f-a135c1d9eb0f tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 13:53:22 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 13:53:22 user nova-compute[72129]:   <source dev="/dev/sdc"/>
Aug 01 13:53:22 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 13:53:22 user nova-compute[72129]:   <serial>43c1b008-ef2f-494c-8ba1-6c55ed0085a5</serial>
Aug 01 13:53:22 user nova-compute[72129]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 13:53:22 user nova-compute[72129]: </disk>
Aug 01 13:53:22 user nova-compute[72129]:  {{(pid=72129) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 13:53:22 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-aeb99de3-6a8e-4605-ac8f-a135c1d9eb0f tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Successfully detached device vdb from instance 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0 from the persistent domain config.
Aug 01 13:53:22 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-aeb99de3-6a8e-4605-ac8f-a135c1d9eb0f tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0 from the live domain config. {{(pid=72129) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 13:53:22 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-aeb99de3-6a8e-4605-ac8f-a135c1d9eb0f tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 13:53:22 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 13:53:22 user nova-compute[72129]:   <source dev="/dev/sdc"/>
Aug 01 13:53:22 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 13:53:22 user nova-compute[72129]:   <serial>43c1b008-ef2f-494c-8ba1-6c55ed0085a5</serial>
Aug 01 13:53:22 user nova-compute[72129]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 13:53:22 user nova-compute[72129]: </disk>
Aug 01 13:53:22 user nova-compute[72129]:  {{(pid=72129) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 13:53:22 user nova-compute[72129]: DEBUG nova.compute.manager [req-d9892306-f3a4-4266-8699-7351348063b9 req-2d8a6c5e-8c66-4893-b6b6-aa588c8fe1f2 service nova] [instance: 3a915d04-faf8-4987-9233-130524dfe655] Received event network-vif-plugged-163ebe07-e21c-4208-b902-29c309adcef1 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:53:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-d9892306-f3a4-4266-8699-7351348063b9 req-2d8a6c5e-8c66-4893-b6b6-aa588c8fe1f2 service nova] Acquiring lock "3a915d04-faf8-4987-9233-130524dfe655-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:53:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-d9892306-f3a4-4266-8699-7351348063b9 req-2d8a6c5e-8c66-4893-b6b6-aa588c8fe1f2 service nova] Lock "3a915d04-faf8-4987-9233-130524dfe655-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:53:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-d9892306-f3a4-4266-8699-7351348063b9 req-2d8a6c5e-8c66-4893-b6b6-aa588c8fe1f2 service nova] Lock "3a915d04-faf8-4987-9233-130524dfe655-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:53:22 user nova-compute[72129]: DEBUG nova.compute.manager [req-d9892306-f3a4-4266-8699-7351348063b9 req-2d8a6c5e-8c66-4893-b6b6-aa588c8fe1f2 service nova] [instance: 3a915d04-faf8-4987-9233-130524dfe655] No waiting events found dispatching network-vif-plugged-163ebe07-e21c-4208-b902-29c309adcef1 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:53:22 user nova-compute[72129]: WARNING nova.compute.manager [req-d9892306-f3a4-4266-8699-7351348063b9 req-2d8a6c5e-8c66-4893-b6b6-aa588c8fe1f2 service nova] [instance: 3a915d04-faf8-4987-9233-130524dfe655] Received unexpected event network-vif-plugged-163ebe07-e21c-4208-b902-29c309adcef1 for instance with vm_state building and task_state spawning.
Aug 01 13:53:22 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Received event <DeviceRemovedEvent: 1690898002.7270057, 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72129) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 13:53:22 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-aeb99de3-6a8e-4605-ac8f-a135c1d9eb0f tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0 {{(pid=72129) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 13:53:22 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-aeb99de3-6a8e-4605-ac8f-a135c1d9eb0f tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Successfully detached device vdb from instance 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0 from the live domain config.
Aug 01 13:53:22 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aeb99de3-6a8e-4605-ac8f-a135c1d9eb0f tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] calling os-brick to detach iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 13:53:22 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeb99de3-6a8e-4605-ac8f-a135c1d9eb0f tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, {'target_iqns': ['iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wpUkcKQv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': '43c1b008-ef2f-494c-8ba1-6c55ed0085a5'}, None), 'kwargs': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:53:22 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-aeb99de3-6a8e-4605-ac8f-a135c1d9eb0f tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 13:53:22 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-aeb99de3-6a8e-4605-ac8f-a135c1d9eb0f tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:53:22 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-aeb99de3-6a8e-4605-ac8f-a135c1d9eb0f tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:53:22 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeb99de3-6a8e-4605-ac8f-a135c1d9eb0f tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5', 0)] {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 13:53:22 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:22 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:22 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f3e5f3-0016-4788-ad4e-b612892f086b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:22 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:22 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898002.7700253, 3a915d04-faf8-4987-9233-130524dfe655 => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:53:22 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 3a915d04-faf8-4987-9233-130524dfe655] VM Resumed (Lifecycle Event)
Aug 01 13:53:22 user nova-compute[72129]: DEBUG nova.compute.manager [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 3a915d04-faf8-4987-9233-130524dfe655] Instance event wait completed in 0 seconds for  {{(pid=72129) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 13:53:22 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 3a915d04-faf8-4987-9233-130524dfe655] Guest created on hypervisor {{(pid=72129) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 13:53:22 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 3a915d04-faf8-4987-9233-130524dfe655] Instance spawned successfully.
Aug 01 13:53:22 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 3a915d04-faf8-4987-9233-130524dfe655] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 13:53:22 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 3a915d04-faf8-4987-9233-130524dfe655] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:53:22 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:22 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be96e0c-664a-4249-b832-b1cc07a32140]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:22 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeb99de3-6a8e-4605-ac8f-a135c1d9eb0f tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 (non-flash)
Aug 01 13:53:22 user nova-compute[72129]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)
Aug 01 13:53:22 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:53:22 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeb99de3-6a8e-4605-ac8f-a135c1d9eb0f tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 (non-flash)
Aug 01 13:53:22 user nova-compute[72129]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)
Aug 01 13:53:22 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:53:22 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeb99de3-6a8e-4605-ac8f-a135c1d9eb0f tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f28202d2a70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5'): ({'sdc'}, set())}) {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 13:53:22 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-aeb99de3-6a8e-4605-ac8f-a135c1d9eb0f tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Removing single pathed devices sdc {{(pid=72129) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 13:53:22 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:22 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 3a915d04-faf8-4987-9233-130524dfe655] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 13:53:22 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 3a915d04-faf8-4987-9233-130524dfe655] Found default for hw_cdrom_bus of ide {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:53:22 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 3a915d04-faf8-4987-9233-130524dfe655] Found default for hw_disk_bus of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:53:22 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 3a915d04-faf8-4987-9233-130524dfe655] Found default for hw_input_bus of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:53:22 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 3a915d04-faf8-4987-9233-130524dfe655] Found default for hw_pointer_model of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:53:22 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 3a915d04-faf8-4987-9233-130524dfe655] Found default for hw_video_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:53:22 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 3a915d04-faf8-4987-9233-130524dfe655] Found default for hw_vif_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:53:22 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:22 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac4daea-1c6d-499b-ba74-a3b7f88944fb]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:22 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:22 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 3a915d04-faf8-4987-9233-130524dfe655] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 13:53:22 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898002.770169, 3a915d04-faf8-4987-9233-130524dfe655 => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:53:22 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 3a915d04-faf8-4987-9233-130524dfe655] VM Started (Lifecycle Event)
Aug 01 13:53:22 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:22 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f48f39-eaeb-4ca4-b75d-429f7d6044e3]: (4, ('ok\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:22 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-aeb99de3-6a8e-4605-ac8f-a135c1d9eb0f tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Flushing IO for device /dev/sdc {{(pid=72129) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 13:53:22 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:22 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 3a915d04-faf8-4987-9233-130524dfe655] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:53:22 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 3a915d04-faf8-4987-9233-130524dfe655] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 13:53:22 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:22 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce965ab-bfd7-46a5-9aa1-3894938adb53]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:22 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-aeb99de3-6a8e-4605-ac8f-a135c1d9eb0f tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72129) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 13:53:22 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:22 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 3a915d04-faf8-4987-9233-130524dfe655] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 13:53:22 user nova-compute[72129]: INFO nova.compute.manager [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 3a915d04-faf8-4987-9233-130524dfe655] Took 6.59 seconds to spawn the instance on the hypervisor.
Aug 01 13:53:22 user nova-compute[72129]: DEBUG nova.compute.manager [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 3a915d04-faf8-4987-9233-130524dfe655] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:53:22 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:22 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9b26c8-f595-4d5b-8a19-423823273120]: (4, ('1', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:22 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-aeb99de3-6a8e-4605-ac8f-a135c1d9eb0f tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 13:53:22 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-aeb99de3-6a8e-4605-ac8f-a135c1d9eb0f tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] SCSI volumes sdc have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 13:53:22 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeb99de3-6a8e-4605-ac8f-a135c1d9eb0f tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5')] {{(pid=72129) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 13:53:22 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:22 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:22 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b9ad18-e32e-4e7b-998c-8d0bed83a6fb]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:22 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeb99de3-6a8e-4605-ac8f-a135c1d9eb0f tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:53:22 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 -p 172.16.0.220:3260 --logout {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:23 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd943ee-6137-4a20-8fe0-9fef05244972]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:23 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeb99de3-6a8e-4605-ac8f-a135c1d9eb0f tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5, portal: 172.16.0.220,3260]
Aug 01 13:53:23 user nova-compute[72129]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5, portal: 172.16.0.220,3260] successful.
Aug 01 13:53:23 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:53:23 user nova-compute[72129]: INFO nova.compute.manager [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 3a915d04-faf8-4987-9233-130524dfe655] Took 7.89 seconds to build instance.
Aug 01 13:53:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 -p 172.16.0.220:3260 --op delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:23 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-63e1017a-34a2-438a-8f76-f9f3b751c8f6 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Lock "3a915d04-faf8-4987-9233-130524dfe655" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.982s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:53:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43c1b008-ef2f-494c-8ba1-6c55ed0085a5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:23 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b76b38cf-79fd-4871-b32a-cbc7896e5a60]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:23 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeb99de3-6a8e-4605-ac8f-a135c1d9eb0f tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:53:23 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-aeb99de3-6a8e-4605-ac8f-a135c1d9eb0f tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:53:23 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeb99de3-6a8e-4605-ac8f-a135c1d9eb0f tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] <== disconnect_volume: return (321ms) None {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:53:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aeb99de3-6a8e-4605-ac8f-a135c1d9eb0f tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Disconnected iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 13:53:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:24 user nova-compute[72129]: DEBUG nova.objects.instance [None req-aeb99de3-6a8e-4605-ac8f-a135c1d9eb0f tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Lazy-loading 'flavor' on Instance uuid 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:53:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-aeb99de3-6a8e-4605-ac8f-a135c1d9eb0f tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Lock "33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.952s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:53:25 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:28 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:30 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:33 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-72faa9b3-0129-4c89-a8a7-468402720ba5 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Acquiring lock "31781ddf-6764-4c41-8047-21adfc25d610" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:53:33 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-72faa9b3-0129-4c89-a8a7-468402720ba5 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Lock "31781ddf-6764-4c41-8047-21adfc25d610" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:53:33 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-72faa9b3-0129-4c89-a8a7-468402720ba5 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Acquiring lock "31781ddf-6764-4c41-8047-21adfc25d610-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:53:33 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-72faa9b3-0129-4c89-a8a7-468402720ba5 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Lock "31781ddf-6764-4c41-8047-21adfc25d610-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:53:33 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-72faa9b3-0129-4c89-a8a7-468402720ba5 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Lock "31781ddf-6764-4c41-8047-21adfc25d610-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.003s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:53:33 user nova-compute[72129]: INFO nova.compute.manager [None req-72faa9b3-0129-4c89-a8a7-468402720ba5 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] Terminating instance
Aug 01 13:53:33 user nova-compute[72129]: DEBUG nova.compute.manager [None req-72faa9b3-0129-4c89-a8a7-468402720ba5 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] Start destroying the instance on the hypervisor. {{(pid=72129) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 13:53:33 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:33 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:33 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-851d3677-76ea-4fbe-99d7-fce256137861 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Acquiring lock "3c1f751a-e2aa-4447-b72f-9dc88c4c1a84" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:53:33 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-851d3677-76ea-4fbe-99d7-fce256137861 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Lock "3c1f751a-e2aa-4447-b72f-9dc88c4c1a84" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:53:33 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-851d3677-76ea-4fbe-99d7-fce256137861 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Acquiring lock "3c1f751a-e2aa-4447-b72f-9dc88c4c1a84-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:53:33 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-851d3677-76ea-4fbe-99d7-fce256137861 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Lock "3c1f751a-e2aa-4447-b72f-9dc88c4c1a84-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:53:33 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-851d3677-76ea-4fbe-99d7-fce256137861 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Lock "3c1f751a-e2aa-4447-b72f-9dc88c4c1a84-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:53:33 user nova-compute[72129]: INFO nova.compute.manager [None req-851d3677-76ea-4fbe-99d7-fce256137861 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Terminating instance
Aug 01 13:53:33 user nova-compute[72129]: DEBUG nova.compute.manager [None req-851d3677-76ea-4fbe-99d7-fce256137861 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Start destroying the instance on the hypervisor. {{(pid=72129) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 13:53:33 user nova-compute[72129]: DEBUG nova.compute.manager [req-d160bee5-b3de-4657-8405-ef02461c26bf req-38e50b6c-8f2e-4edf-9e7a-4d21aa771a36 service nova] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] Received event network-vif-unplugged-bd36aadb-c36c-4c08-80c9-75f12b422c3d {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:53:33 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-d160bee5-b3de-4657-8405-ef02461c26bf req-38e50b6c-8f2e-4edf-9e7a-4d21aa771a36 service nova] Acquiring lock "31781ddf-6764-4c41-8047-21adfc25d610-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:53:33 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-d160bee5-b3de-4657-8405-ef02461c26bf req-38e50b6c-8f2e-4edf-9e7a-4d21aa771a36 service nova] Lock "31781ddf-6764-4c41-8047-21adfc25d610-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:53:33 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-d160bee5-b3de-4657-8405-ef02461c26bf req-38e50b6c-8f2e-4edf-9e7a-4d21aa771a36 service nova] Lock "31781ddf-6764-4c41-8047-21adfc25d610-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:53:33 user nova-compute[72129]: DEBUG nova.compute.manager [req-d160bee5-b3de-4657-8405-ef02461c26bf req-38e50b6c-8f2e-4edf-9e7a-4d21aa771a36 service nova] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] No waiting events found dispatching network-vif-unplugged-bd36aadb-c36c-4c08-80c9-75f12b422c3d {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:53:33 user nova-compute[72129]: DEBUG nova.compute.manager [req-d160bee5-b3de-4657-8405-ef02461c26bf req-38e50b6c-8f2e-4edf-9e7a-4d21aa771a36 service nova] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] Received event network-vif-unplugged-bd36aadb-c36c-4c08-80c9-75f12b422c3d for instance with task_state deleting. {{(pid=72129) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 13:53:33 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:33 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:33 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:33 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:33 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:33 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:33 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:33 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:33 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:34 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:34 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:34 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:34 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] Instance destroyed successfully.
Aug 01 13:53:34 user nova-compute[72129]: DEBUG nova.objects.instance [None req-72faa9b3-0129-4c89-a8a7-468402720ba5 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Lazy-loading 'resources' on Instance uuid 31781ddf-6764-4c41-8047-21adfc25d610 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:53:34 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-72faa9b3-0129-4c89-a8a7-468402720ba5 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:51:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-859811517',display_name='tempest-ServersNegativeTestJSON-server-859811517',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-859811517',id=12,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T13:51:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f34719c31d18460fa308e1f40130ed24',ramdisk_id='',reservation_id='r-5xh56j0i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-281733508',owner_user_name='tempest-ServersNegativeTestJSON-281733508-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T13:51:51Z,user_data=None,user_id='14a1a4faeffb41a8bcebc292a7d73cb2',uuid=31781ddf-6764-4c41-8047-21adfc25d610,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bd36aadb-c36c-4c08-80c9-75f12b422c3d", "address": "fa:16:3e:1e:1e:07", "network": {"id": "90839969-290c-4555-ab2f-2215c33e89e9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1983064867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f34719c31d18460fa308e1f40130ed24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd36aadb-c3", "ovs_interfaceid": "bd36aadb-c36c-4c08-80c9-75f12b422c3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 13:53:34 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-72faa9b3-0129-4c89-a8a7-468402720ba5 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Converting VIF {"id": "bd36aadb-c36c-4c08-80c9-75f12b422c3d", "address": "fa:16:3e:1e:1e:07", "network": {"id": "90839969-290c-4555-ab2f-2215c33e89e9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1983064867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f34719c31d18460fa308e1f40130ed24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd36aadb-c3", "ovs_interfaceid": "bd36aadb-c36c-4c08-80c9-75f12b422c3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:53:34 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-72faa9b3-0129-4c89-a8a7-468402720ba5 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:1e:07,bridge_name='br-int',has_traffic_filtering=True,id=bd36aadb-c36c-4c08-80c9-75f12b422c3d,network=Network(90839969-290c-4555-ab2f-2215c33e89e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd36aadb-c3') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:53:34 user nova-compute[72129]: DEBUG os_vif [None req-72faa9b3-0129-4c89-a8a7-468402720ba5 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:1e:07,bridge_name='br-int',has_traffic_filtering=True,id=bd36aadb-c36c-4c08-80c9-75f12b422c3d,network=Network(90839969-290c-4555-ab2f-2215c33e89e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd36aadb-c3') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 13:53:34 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:34 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbd36aadb-c3, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:53:34 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:34 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 13:53:34 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Instance destroyed successfully.
Aug 01 13:53:34 user nova-compute[72129]: DEBUG nova.objects.instance [None req-851d3677-76ea-4fbe-99d7-fce256137861 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Lazy-loading 'resources' on Instance uuid 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:53:34 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:34 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-851d3677-76ea-4fbe-99d7-fce256137861 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T13:50:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1732967996',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1732967996',id=8,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLV9A0exWrqx9JsfbE2qI31l+qAJAoY1ILqBBhJy25PwbbuJ9xEqV3MLcWWfDrGgYOcUOAwPrjT+u/vasbyQv8o1AhTEdbBmNL+fkWaNh0TGgFByD46Z+LnLlJ94XdbvJQ==',key_name='tempest-keypair-1026124919',keypairs=<?>,launch_index=0,launched_at=2023-08-01T13:50:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2184fb8ab16d482ea3ca397fbb5515ff',ramdisk_id='',reservation_id='r-qogqtpk0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1582776521',owner_user_name='tempest-TaggedAttachmentsTest-1582776521-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T13:50:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ded159a3c395418d9e4d699ed249eabb',uuid=3c1f751a-e2aa-4447-b72f-9dc88c4c1a84,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7b1167ce-d40a-4355-8411-6a1dd005465f", "address": "fa:16:3e:58:10:73", "network": {"id": "5ae4ed86-1215-49ba-97b9-b9ca5b7d90ba", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-461203891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2184fb8ab16d482ea3ca397fbb5515ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b1167ce-d4", "ovs_interfaceid": "7b1167ce-d40a-4355-8411-6a1dd005465f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 13:53:34 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-851d3677-76ea-4fbe-99d7-fce256137861 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Converting VIF {"id": "7b1167ce-d40a-4355-8411-6a1dd005465f", "address": "fa:16:3e:58:10:73", "network": {"id": "5ae4ed86-1215-49ba-97b9-b9ca5b7d90ba", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-461203891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2184fb8ab16d482ea3ca397fbb5515ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b1167ce-d4", "ovs_interfaceid": "7b1167ce-d40a-4355-8411-6a1dd005465f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:53:34 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-851d3677-76ea-4fbe-99d7-fce256137861 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:58:10:73,bridge_name='br-int',has_traffic_filtering=True,id=7b1167ce-d40a-4355-8411-6a1dd005465f,network=Network(5ae4ed86-1215-49ba-97b9-b9ca5b7d90ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b1167ce-d4') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:53:34 user nova-compute[72129]: DEBUG os_vif [None req-851d3677-76ea-4fbe-99d7-fce256137861 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:10:73,bridge_name='br-int',has_traffic_filtering=True,id=7b1167ce-d40a-4355-8411-6a1dd005465f,network=Network(5ae4ed86-1215-49ba-97b9-b9ca5b7d90ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b1167ce-d4') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 13:53:34 user nova-compute[72129]: INFO os_vif [None req-72faa9b3-0129-4c89-a8a7-468402720ba5 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:1e:07,bridge_name='br-int',has_traffic_filtering=True,id=bd36aadb-c36c-4c08-80c9-75f12b422c3d,network=Network(90839969-290c-4555-ab2f-2215c33e89e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd36aadb-c3')
Aug 01 13:53:34 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-72faa9b3-0129-4c89-a8a7-468402720ba5 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] Deleting instance files /opt/stack/data/nova/instances/31781ddf-6764-4c41-8047-21adfc25d610_del
Aug 01 13:53:34 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-72faa9b3-0129-4c89-a8a7-468402720ba5 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] Deletion of /opt/stack/data/nova/instances/31781ddf-6764-4c41-8047-21adfc25d610_del complete
Aug 01 13:53:34 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:34 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7b1167ce-d4, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:53:34 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:34 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 13:53:34 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:34 user nova-compute[72129]: INFO os_vif [None req-851d3677-76ea-4fbe-99d7-fce256137861 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:10:73,bridge_name='br-int',has_traffic_filtering=True,id=7b1167ce-d40a-4355-8411-6a1dd005465f,network=Network(5ae4ed86-1215-49ba-97b9-b9ca5b7d90ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b1167ce-d4')
Aug 01 13:53:34 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-851d3677-76ea-4fbe-99d7-fce256137861 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Deleting instance files /opt/stack/data/nova/instances/3c1f751a-e2aa-4447-b72f-9dc88c4c1a84_del
Aug 01 13:53:34 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-851d3677-76ea-4fbe-99d7-fce256137861 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Deletion of /opt/stack/data/nova/instances/3c1f751a-e2aa-4447-b72f-9dc88c4c1a84_del complete
Aug 01 13:53:34 user nova-compute[72129]: INFO nova.compute.manager [None req-72faa9b3-0129-4c89-a8a7-468402720ba5 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] Took 1.33 seconds to destroy the instance on the hypervisor.
Aug 01 13:53:34 user nova-compute[72129]: DEBUG oslo.service.loopingcall [None req-72faa9b3-0129-4c89-a8a7-468402720ba5 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72129) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 13:53:34 user nova-compute[72129]: DEBUG nova.compute.manager [-] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] Deallocating network for instance {{(pid=72129) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 13:53:34 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] deallocate_for_instance() {{(pid=72129) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 13:53:34 user nova-compute[72129]: INFO nova.compute.manager [None req-851d3677-76ea-4fbe-99d7-fce256137861 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Took 1.09 seconds to destroy the instance on the hypervisor.
Aug 01 13:53:34 user nova-compute[72129]: DEBUG oslo.service.loopingcall [None req-851d3677-76ea-4fbe-99d7-fce256137861 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72129) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 13:53:34 user nova-compute[72129]: DEBUG nova.compute.manager [-] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Deallocating network for instance {{(pid=72129) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 13:53:34 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] deallocate_for_instance() {{(pid=72129) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 13:53:34 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:34 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:35 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:53:35 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:35 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:53:35 user nova-compute[72129]: DEBUG nova.compute.manager [req-661ea942-a184-45da-9d09-76c6589218bb req-e854551f-b2e2-4864-8e64-f247d6535192 service nova] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] Received event network-vif-plugged-bd36aadb-c36c-4c08-80c9-75f12b422c3d {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:53:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-661ea942-a184-45da-9d09-76c6589218bb req-e854551f-b2e2-4864-8e64-f247d6535192 service nova] Acquiring lock "31781ddf-6764-4c41-8047-21adfc25d610-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:53:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-661ea942-a184-45da-9d09-76c6589218bb req-e854551f-b2e2-4864-8e64-f247d6535192 service nova] Lock "31781ddf-6764-4c41-8047-21adfc25d610-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:53:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-661ea942-a184-45da-9d09-76c6589218bb req-e854551f-b2e2-4864-8e64-f247d6535192 service nova] Lock "31781ddf-6764-4c41-8047-21adfc25d610-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:53:35 user nova-compute[72129]: DEBUG nova.compute.manager [req-661ea942-a184-45da-9d09-76c6589218bb req-e854551f-b2e2-4864-8e64-f247d6535192 service nova] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] No waiting events found dispatching network-vif-plugged-bd36aadb-c36c-4c08-80c9-75f12b422c3d {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:53:35 user nova-compute[72129]: WARNING nova.compute.manager [req-661ea942-a184-45da-9d09-76c6589218bb req-e854551f-b2e2-4864-8e64-f247d6535192 service nova] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] Received unexpected event network-vif-plugged-bd36aadb-c36c-4c08-80c9-75f12b422c3d for instance with vm_state active and task_state deleting.
Aug 01 13:53:35 user nova-compute[72129]: DEBUG nova.compute.manager [req-661ea942-a184-45da-9d09-76c6589218bb req-e854551f-b2e2-4864-8e64-f247d6535192 service nova] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Received event network-vif-unplugged-7b1167ce-d40a-4355-8411-6a1dd005465f {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:53:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-661ea942-a184-45da-9d09-76c6589218bb req-e854551f-b2e2-4864-8e64-f247d6535192 service nova] Acquiring lock "3c1f751a-e2aa-4447-b72f-9dc88c4c1a84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:53:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-661ea942-a184-45da-9d09-76c6589218bb req-e854551f-b2e2-4864-8e64-f247d6535192 service nova] Lock "3c1f751a-e2aa-4447-b72f-9dc88c4c1a84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:53:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-661ea942-a184-45da-9d09-76c6589218bb req-e854551f-b2e2-4864-8e64-f247d6535192 service nova] Lock "3c1f751a-e2aa-4447-b72f-9dc88c4c1a84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:53:35 user nova-compute[72129]: DEBUG nova.compute.manager [req-661ea942-a184-45da-9d09-76c6589218bb req-e854551f-b2e2-4864-8e64-f247d6535192 service nova] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] No waiting events found dispatching network-vif-unplugged-7b1167ce-d40a-4355-8411-6a1dd005465f {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:53:35 user nova-compute[72129]: DEBUG nova.compute.manager [req-661ea942-a184-45da-9d09-76c6589218bb req-e854551f-b2e2-4864-8e64-f247d6535192 service nova] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Received event network-vif-unplugged-7b1167ce-d40a-4355-8411-6a1dd005465f for instance with task_state deleting. {{(pid=72129) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 13:53:35 user nova-compute[72129]: DEBUG nova.compute.manager [req-661ea942-a184-45da-9d09-76c6589218bb req-e854551f-b2e2-4864-8e64-f247d6535192 service nova] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Received event network-vif-plugged-7b1167ce-d40a-4355-8411-6a1dd005465f {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:53:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-661ea942-a184-45da-9d09-76c6589218bb req-e854551f-b2e2-4864-8e64-f247d6535192 service nova] Acquiring lock "3c1f751a-e2aa-4447-b72f-9dc88c4c1a84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:53:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-661ea942-a184-45da-9d09-76c6589218bb req-e854551f-b2e2-4864-8e64-f247d6535192 service nova] Lock "3c1f751a-e2aa-4447-b72f-9dc88c4c1a84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:53:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-661ea942-a184-45da-9d09-76c6589218bb req-e854551f-b2e2-4864-8e64-f247d6535192 service nova] Lock "3c1f751a-e2aa-4447-b72f-9dc88c4c1a84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:53:35 user nova-compute[72129]: DEBUG nova.compute.manager [req-661ea942-a184-45da-9d09-76c6589218bb req-e854551f-b2e2-4864-8e64-f247d6535192 service nova] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] No waiting events found dispatching network-vif-plugged-7b1167ce-d40a-4355-8411-6a1dd005465f {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:53:35 user nova-compute[72129]: WARNING nova.compute.manager [req-661ea942-a184-45da-9d09-76c6589218bb req-e854551f-b2e2-4864-8e64-f247d6535192 service nova] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Received unexpected event network-vif-plugged-7b1167ce-d40a-4355-8411-6a1dd005465f for instance with vm_state active and task_state deleting.
Aug 01 13:53:35 user nova-compute[72129]: DEBUG nova.compute.manager [req-661ea942-a184-45da-9d09-76c6589218bb req-e854551f-b2e2-4864-8e64-f247d6535192 service nova] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] Received event network-vif-plugged-bd36aadb-c36c-4c08-80c9-75f12b422c3d {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:53:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-661ea942-a184-45da-9d09-76c6589218bb req-e854551f-b2e2-4864-8e64-f247d6535192 service nova] Acquiring lock "31781ddf-6764-4c41-8047-21adfc25d610-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:53:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-661ea942-a184-45da-9d09-76c6589218bb req-e854551f-b2e2-4864-8e64-f247d6535192 service nova] Lock "31781ddf-6764-4c41-8047-21adfc25d610-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:53:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-661ea942-a184-45da-9d09-76c6589218bb req-e854551f-b2e2-4864-8e64-f247d6535192 service nova] Lock "31781ddf-6764-4c41-8047-21adfc25d610-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:53:35 user nova-compute[72129]: DEBUG nova.compute.manager [req-661ea942-a184-45da-9d09-76c6589218bb req-e854551f-b2e2-4864-8e64-f247d6535192 service nova] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] No waiting events found dispatching network-vif-plugged-bd36aadb-c36c-4c08-80c9-75f12b422c3d {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:53:35 user nova-compute[72129]: WARNING nova.compute.manager [req-661ea942-a184-45da-9d09-76c6589218bb req-e854551f-b2e2-4864-8e64-f247d6535192 service nova] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] Received unexpected event network-vif-plugged-bd36aadb-c36c-4c08-80c9-75f12b422c3d for instance with vm_state active and task_state deleting.
Aug 01 13:53:35 user nova-compute[72129]: DEBUG nova.compute.manager [req-661ea942-a184-45da-9d09-76c6589218bb req-e854551f-b2e2-4864-8e64-f247d6535192 service nova] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] Received event network-vif-plugged-bd36aadb-c36c-4c08-80c9-75f12b422c3d {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:53:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-661ea942-a184-45da-9d09-76c6589218bb req-e854551f-b2e2-4864-8e64-f247d6535192 service nova] Acquiring lock "31781ddf-6764-4c41-8047-21adfc25d610-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:53:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-661ea942-a184-45da-9d09-76c6589218bb req-e854551f-b2e2-4864-8e64-f247d6535192 service nova] Lock "31781ddf-6764-4c41-8047-21adfc25d610-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:53:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-661ea942-a184-45da-9d09-76c6589218bb req-e854551f-b2e2-4864-8e64-f247d6535192 service nova] Lock "31781ddf-6764-4c41-8047-21adfc25d610-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:53:35 user nova-compute[72129]: DEBUG nova.compute.manager [req-661ea942-a184-45da-9d09-76c6589218bb req-e854551f-b2e2-4864-8e64-f247d6535192 service nova] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] No waiting events found dispatching network-vif-plugged-bd36aadb-c36c-4c08-80c9-75f12b422c3d {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:53:35 user nova-compute[72129]: WARNING nova.compute.manager [req-661ea942-a184-45da-9d09-76c6589218bb req-e854551f-b2e2-4864-8e64-f247d6535192 service nova] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] Received unexpected event network-vif-plugged-bd36aadb-c36c-4c08-80c9-75f12b422c3d for instance with vm_state active and task_state deleting.
Aug 01 13:53:35 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] Took 1.17 seconds to deallocate network for instance.
Aug 01 13:53:35 user nova-compute[72129]: DEBUG nova.compute.manager [req-2b48d1da-85c3-4a4c-af75-42f5029cf66d req-f3f5b120-6a94-4f1c-a7f9-7d9262b87e20 service nova] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] Received event network-vif-deleted-bd36aadb-c36c-4c08-80c9-75f12b422c3d {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:53:35 user nova-compute[72129]: INFO nova.compute.manager [req-2b48d1da-85c3-4a4c-af75-42f5029cf66d req-f3f5b120-6a94-4f1c-a7f9-7d9262b87e20 service nova] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] Neutron deleted interface bd36aadb-c36c-4c08-80c9-75f12b422c3d; detaching it from the instance and deleting it from the info cache
Aug 01 13:53:35 user nova-compute[72129]: DEBUG nova.network.neutron [req-2b48d1da-85c3-4a4c-af75-42f5029cf66d req-f3f5b120-6a94-4f1c-a7f9-7d9262b87e20 service nova] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:53:35 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:53:35 user nova-compute[72129]: DEBUG nova.compute.manager [req-2b48d1da-85c3-4a4c-af75-42f5029cf66d req-f3f5b120-6a94-4f1c-a7f9-7d9262b87e20 service nova] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] Detach interface failed, port_id=bd36aadb-c36c-4c08-80c9-75f12b422c3d, reason: Instance 31781ddf-6764-4c41-8047-21adfc25d610 could not be found. {{(pid=72129) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 13:53:35 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Took 1.18 seconds to deallocate network for instance.
Aug 01 13:53:35 user nova-compute[72129]: DEBUG nova.compute.manager [req-145fc6b7-2799-44c8-b176-c9d6ade5f94e req-9004abf2-5b47-4a13-8108-d19f8284232a service nova] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Received event network-vif-deleted-7b1167ce-d40a-4355-8411-6a1dd005465f {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:53:35 user nova-compute[72129]: INFO nova.compute.manager [req-145fc6b7-2799-44c8-b176-c9d6ade5f94e req-9004abf2-5b47-4a13-8108-d19f8284232a service nova] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Neutron deleted interface 7b1167ce-d40a-4355-8411-6a1dd005465f; detaching it from the instance and deleting it from the info cache
Aug 01 13:53:35 user nova-compute[72129]: DEBUG nova.network.neutron [req-145fc6b7-2799-44c8-b176-c9d6ade5f94e req-9004abf2-5b47-4a13-8108-d19f8284232a service nova] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:53:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-72faa9b3-0129-4c89-a8a7-468402720ba5 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:53:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-72faa9b3-0129-4c89-a8a7-468402720ba5 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:53:35 user nova-compute[72129]: DEBUG nova.compute.manager [req-145fc6b7-2799-44c8-b176-c9d6ade5f94e req-9004abf2-5b47-4a13-8108-d19f8284232a service nova] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Detach interface failed, port_id=7b1167ce-d40a-4355-8411-6a1dd005465f, reason: Instance 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84 could not be found. {{(pid=72129) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 13:53:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-851d3677-76ea-4fbe-99d7-fce256137861 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:53:36 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-72faa9b3-0129-4c89-a8a7-468402720ba5 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 13:53:36 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-72faa9b3-0129-4c89-a8a7-468402720ba5 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 13:53:36 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-72faa9b3-0129-4c89-a8a7-468402720ba5 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.369s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:53:36 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-851d3677-76ea-4fbe-99d7-fce256137861 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.351s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:53:36 user nova-compute[72129]: INFO nova.scheduler.client.report [None req-72faa9b3-0129-4c89-a8a7-468402720ba5 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Deleted allocations for instance 31781ddf-6764-4c41-8047-21adfc25d610
Aug 01 13:53:36 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-72faa9b3-0129-4c89-a8a7-468402720ba5 tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Lock "31781ddf-6764-4c41-8047-21adfc25d610" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.140s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:53:36 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-851d3677-76ea-4fbe-99d7-fce256137861 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 13:53:36 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-851d3677-76ea-4fbe-99d7-fce256137861 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 13:53:36 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-851d3677-76ea-4fbe-99d7-fce256137861 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.530s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:53:36 user nova-compute[72129]: INFO nova.scheduler.client.report [None req-851d3677-76ea-4fbe-99d7-fce256137861 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Deleted allocations for instance 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84
Aug 01 13:53:36 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-851d3677-76ea-4fbe-99d7-fce256137861 tempest-TaggedAttachmentsTest-1582776521 tempest-TaggedAttachmentsTest-1582776521-project-member] Lock "3c1f751a-e2aa-4447-b72f-9dc88c4c1a84" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.395s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:53:37 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:53:37 user nova-compute[72129]: DEBUG nova.compute.manager [req-d31511d0-8e60-4a45-951d-878e15e860ee req-bdd57b4a-615f-46b1-ac1b-aba930e9a0a6 service nova] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] Received event network-vif-plugged-bd36aadb-c36c-4c08-80c9-75f12b422c3d {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:53:37 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-d31511d0-8e60-4a45-951d-878e15e860ee req-bdd57b4a-615f-46b1-ac1b-aba930e9a0a6 service nova] Acquiring lock "31781ddf-6764-4c41-8047-21adfc25d610-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:53:37 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-d31511d0-8e60-4a45-951d-878e15e860ee req-bdd57b4a-615f-46b1-ac1b-aba930e9a0a6 service nova] Lock "31781ddf-6764-4c41-8047-21adfc25d610-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:53:37 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-d31511d0-8e60-4a45-951d-878e15e860ee req-bdd57b4a-615f-46b1-ac1b-aba930e9a0a6 service nova] Lock "31781ddf-6764-4c41-8047-21adfc25d610-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:53:37 user nova-compute[72129]: DEBUG nova.compute.manager [req-d31511d0-8e60-4a45-951d-878e15e860ee req-bdd57b4a-615f-46b1-ac1b-aba930e9a0a6 service nova] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] No waiting events found dispatching network-vif-plugged-bd36aadb-c36c-4c08-80c9-75f12b422c3d {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:53:37 user nova-compute[72129]: WARNING nova.compute.manager [req-d31511d0-8e60-4a45-951d-878e15e860ee req-bdd57b4a-615f-46b1-ac1b-aba930e9a0a6 service nova] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] Received unexpected event network-vif-plugged-bd36aadb-c36c-4c08-80c9-75f12b422c3d for instance with vm_state deleted and task_state None.
Aug 01 13:53:38 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:53:38 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:53:38 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:53:39 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:53:39 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Starting heal instance info cache {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 13:53:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "refresh_cache-28115c7d-544a-4504-98da-2398e0e354d8" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:53:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquired lock "refresh_cache-28115c7d-544a-4504-98da-2398e0e354d8" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:53:39 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] Forcefully refreshing network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 13:53:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:39 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] Updating instance_info_cache with network_info: [{"id": "85708040-d7bf-4951-a29c-68cd6d3c4c42", "address": "fa:16:3e:ed:f5:6f", "network": {"id": "2338fb81-87b6-4976-a6ab-b4ea0218fa9b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-606840206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebef26e9d3654bf99ecf391ccb263330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85708040-d7", "ovs_interfaceid": "85708040-d7bf-4951-a29c-68cd6d3c4c42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:53:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Releasing lock "refresh_cache-28115c7d-544a-4504-98da-2398e0e354d8" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:53:39 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] Updated the network info_cache for instance {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 13:53:39 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:53:39 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:53:39 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72129) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 13:53:39 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:53:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:53:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:53:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:53:39 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Auditing locally available compute resources for user (node: user) {{(pid=72129) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 13:53:39 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:39 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:39 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:40 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:40 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28115c7d-544a-4504-98da-2398e0e354d8/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:40 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28115c7d-544a-4504-98da-2398e0e354d8/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:40 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28115c7d-544a-4504-98da-2398e0e354d8/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:40 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:40 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28115c7d-544a-4504-98da-2398e0e354d8/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:40 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:40 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:40 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:40 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:40 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a915d04-faf8-4987-9233-130524dfe655/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a915d04-faf8-4987-9233-130524dfe655/disk --force-share --output=json" returned: 0 in 0.282s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a915d04-faf8-4987-9233-130524dfe655/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a915d04-faf8-4987-9233-130524dfe655/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31105963-52fa-4aff-9270-075cd98f08a5/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31105963-52fa-4aff-9270-075cd98f08a5/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31105963-52fa-4aff-9270-075cd98f08a5/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31105963-52fa-4aff-9270-075cd98f08a5/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63c0c1fe-7e4d-4763-8ede-a7662747a4c0/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63c0c1fe-7e4d-4763-8ede-a7662747a4c0/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63c0c1fe-7e4d-4763-8ede-a7662747a4c0/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d31e1d16-df97-4d9a-acc2-04cb1f84ed6b tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Acquiring lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:53:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d31e1d16-df97-4d9a-acc2-04cb1f84ed6b tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:53:42 user nova-compute[72129]: DEBUG nova.objects.instance [None req-d31e1d16-df97-4d9a-acc2-04cb1f84ed6b tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Lazy-loading 'flavor' on Instance uuid 2efa87a6-1dd6-4441-a55e-8e86be7f0a35 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:53:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63c0c1fe-7e4d-4763-8ede-a7662747a4c0/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efa87a6-1dd6-4441-a55e-8e86be7f0a35/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d31e1d16-df97-4d9a-acc2-04cb1f84ed6b tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.101s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:53:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efa87a6-1dd6-4441-a55e-8e86be7f0a35/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efa87a6-1dd6-4441-a55e-8e86be7f0a35/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d31e1d16-df97-4d9a-acc2-04cb1f84ed6b tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Acquiring lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:53:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d31e1d16-df97-4d9a-acc2-04cb1f84ed6b tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:53:42 user nova-compute[72129]: INFO nova.compute.manager [None req-d31e1d16-df97-4d9a-acc2-04cb1f84ed6b tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Attaching volume 4abb01c8-017a-4ccc-a2dd-024a94775c17 to /dev/vdb
Aug 01 13:53:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efa87a6-1dd6-4441-a55e-8e86be7f0a35/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:42 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 13:53:42 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:42 user nova-compute[72129]: DEBUG os_brick.utils [None req-d31e1d16-df97-4d9a-acc2-04cb1f84ed6b tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:53:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:42 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:53:42 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:53:42 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Hypervisor/Node resource view: name=user free_ram=7584MB free_disk=25.626052856445312GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72129) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 13:53:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:53:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:53:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:42 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5acade4-e299-42cf-9a40-54510eddb806]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f9b449c2cd3d\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:43 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b936f32d-1b62-4f57-9675-ea04e690cd3f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:43 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8633c5b-6bf9-4bd3-a2a1-1c699ace3535]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:43 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f108f6-10ac-487c-be61-c2923da3aacd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-d31e1d16-df97-4d9a-acc2-04cb1f84ed6b tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Running cmd (subprocess): nvme version {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-d31e1d16-df97-4d9a-acc2-04cb1f84ed6b tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] 'nvme version' failed. Not Retrying. {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 13:53:43 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d31e1d16-df97-4d9a-acc2-04cb1f84ed6b tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] nvme not present on system {{(pid=72129) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 13:53:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 13:53:43 user nova-compute[72129]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 13:53:43 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[17730c5b-2219-4a94-baa7-e45b5ae6c0a8]: (4, '') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:43 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-d31e1d16-df97-4d9a-acc2-04cb1f84ed6b tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72129) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 13:53:43 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-d31e1d16-df97-4d9a-acc2-04cb1f84ed6b tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 13:53:43 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-d31e1d16-df97-4d9a-acc2-04cb1f84ed6b tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] LIGHTOS: no hostnqn found. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 13:53:43 user nova-compute[72129]: DEBUG os_brick.utils [None req-d31e1d16-df97-4d9a-acc2-04cb1f84ed6b tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f9b449c2cd3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:53:43 user nova-compute[72129]: DEBUG nova.virt.block_device [None req-d31e1d16-df97-4d9a-acc2-04cb1f84ed6b tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Updating existing volume attachment record: 87fcfadf-928a-4cef-8e54-3fe63579872d {{(pid=72129) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 13:53:43 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 63c0c1fe-7e4d-4763-8ede-a7662747a4c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:53:43 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 2efa87a6-1dd6-4441-a55e-8e86be7f0a35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:53:43 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 28115c7d-544a-4504-98da-2398e0e354d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:53:43 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 31105963-52fa-4aff-9270-075cd98f08a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:53:43 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:53:43 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance a07aaeaa-322d-419e-86f5-65cd448c39e7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:53:43 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 97a5dccf-b499-443a-b332-cfa293a16047 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:53:43 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 3a915d04-faf8-4987-9233-130524dfe655 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:53:43 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 13:53:43 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 13:53:43 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 13:53:43 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 13:53:43 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Compute_service record updated for user:user {{(pid=72129) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 13:53:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.539s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:53:44 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:44 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:53:45 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:45 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:46 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:47 user nova-compute[72129]: DEBUG nova.compute.manager [req-e6223c7d-8904-46b8-be33-2104559983ef req-8ae9f615-53f8-4201-a9be-8b963706b7b1 service nova] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Received event network-changed-f3403639-00ba-4c7c-983a-7995f60f2519 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:53:47 user nova-compute[72129]: DEBUG nova.compute.manager [req-e6223c7d-8904-46b8-be33-2104559983ef req-8ae9f615-53f8-4201-a9be-8b963706b7b1 service nova] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Refreshing instance network info cache due to event network-changed-f3403639-00ba-4c7c-983a-7995f60f2519. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 13:53:47 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-e6223c7d-8904-46b8-be33-2104559983ef req-8ae9f615-53f8-4201-a9be-8b963706b7b1 service nova] Acquiring lock "refresh_cache-a07aaeaa-322d-419e-86f5-65cd448c39e7" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:53:47 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-e6223c7d-8904-46b8-be33-2104559983ef req-8ae9f615-53f8-4201-a9be-8b963706b7b1 service nova] Acquired lock "refresh_cache-a07aaeaa-322d-419e-86f5-65cd448c39e7" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:53:47 user nova-compute[72129]: DEBUG nova.network.neutron [req-e6223c7d-8904-46b8-be33-2104559983ef req-8ae9f615-53f8-4201-a9be-8b963706b7b1 service nova] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Refreshing network info cache for port f3403639-00ba-4c7c-983a-7995f60f2519 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 13:53:48 user nova-compute[72129]: DEBUG nova.network.neutron [req-e6223c7d-8904-46b8-be33-2104559983ef req-8ae9f615-53f8-4201-a9be-8b963706b7b1 service nova] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Updated VIF entry in instance network info cache for port f3403639-00ba-4c7c-983a-7995f60f2519. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 13:53:48 user nova-compute[72129]: DEBUG nova.network.neutron [req-e6223c7d-8904-46b8-be33-2104559983ef req-8ae9f615-53f8-4201-a9be-8b963706b7b1 service nova] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Updating instance_info_cache with network_info: [{"id": "f3403639-00ba-4c7c-983a-7995f60f2519", "address": "fa:16:3e:4b:01:bd", "network": {"id": "2338fb81-87b6-4976-a6ab-b4ea0218fa9b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-606840206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebef26e9d3654bf99ecf391ccb263330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3403639-00", "ovs_interfaceid": "f3403639-00ba-4c7c-983a-7995f60f2519", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:53:48 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-e6223c7d-8904-46b8-be33-2104559983ef req-8ae9f615-53f8-4201-a9be-8b963706b7b1 service nova] Releasing lock "refresh_cache-a07aaeaa-322d-419e-86f5-65cd448c39e7" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:53:48 user nova-compute[72129]: INFO nova.compute.manager [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Rebuilding instance
Aug 01 13:53:49 user nova-compute[72129]: DEBUG nova.objects.instance [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Lazy-loading 'trusted_certs' on Instance uuid a07aaeaa-322d-419e-86f5-65cd448c39e7 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:53:49 user nova-compute[72129]: DEBUG nova.compute.manager [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:53:49 user nova-compute[72129]: DEBUG nova.objects.instance [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Lazy-loading 'pci_requests' on Instance uuid a07aaeaa-322d-419e-86f5-65cd448c39e7 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:53:49 user nova-compute[72129]: DEBUG nova.objects.instance [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Lazy-loading 'pci_devices' on Instance uuid a07aaeaa-322d-419e-86f5-65cd448c39e7 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:53:49 user nova-compute[72129]: DEBUG nova.objects.instance [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Lazy-loading 'resources' on Instance uuid a07aaeaa-322d-419e-86f5-65cd448c39e7 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:53:49 user nova-compute[72129]: DEBUG nova.objects.instance [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Lazy-loading 'migration_context' on Instance uuid a07aaeaa-322d-419e-86f5-65cd448c39e7 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:53:49 user nova-compute[72129]: DEBUG nova.objects.instance [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72129) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Aug 01 13:53:49 user nova-compute[72129]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690898014.2780852, 31781ddf-6764-4c41-8047-21adfc25d610 => Stopped> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:53:49 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] VM Stopped (Lifecycle Event)
Aug 01 13:53:49 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:49 user nova-compute[72129]: DEBUG nova.compute.manager [None req-fa116b38-319c-4abc-a6ce-885a62c52281 None None] [instance: 31781ddf-6764-4c41-8047-21adfc25d610] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:53:49 user nova-compute[72129]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690898014.3387208, 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84 => Stopped> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:53:49 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] VM Stopped (Lifecycle Event)
Aug 01 13:53:49 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:49 user nova-compute[72129]: DEBUG nova.compute.manager [None req-7bc4545b-3b96-44cf-98f1-a9d6d4c8ca35 None None] [instance: 3c1f751a-e2aa-4447-b72f-9dc88c4c1a84] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:53:49 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:49 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:49 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:49 user nova-compute[72129]: DEBUG nova.compute.manager [req-9476396a-5f65-4957-8e42-f5a4a37a8b5d req-82df12a0-c9e0-4dee-a731-4a422160d581 service nova] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Received event network-vif-unplugged-f3403639-00ba-4c7c-983a-7995f60f2519 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:53:49 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-9476396a-5f65-4957-8e42-f5a4a37a8b5d req-82df12a0-c9e0-4dee-a731-4a422160d581 service nova] Acquiring lock "a07aaeaa-322d-419e-86f5-65cd448c39e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:53:49 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-9476396a-5f65-4957-8e42-f5a4a37a8b5d req-82df12a0-c9e0-4dee-a731-4a422160d581 service nova] Lock "a07aaeaa-322d-419e-86f5-65cd448c39e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:53:49 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-9476396a-5f65-4957-8e42-f5a4a37a8b5d req-82df12a0-c9e0-4dee-a731-4a422160d581 service nova] Lock "a07aaeaa-322d-419e-86f5-65cd448c39e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:53:49 user nova-compute[72129]: DEBUG nova.compute.manager [req-9476396a-5f65-4957-8e42-f5a4a37a8b5d req-82df12a0-c9e0-4dee-a731-4a422160d581 service nova] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] No waiting events found dispatching network-vif-unplugged-f3403639-00ba-4c7c-983a-7995f60f2519 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:53:49 user nova-compute[72129]: WARNING nova.compute.manager [req-9476396a-5f65-4957-8e42-f5a4a37a8b5d req-82df12a0-c9e0-4dee-a731-4a422160d581 service nova] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Received unexpected event network-vif-unplugged-f3403639-00ba-4c7c-983a-7995f60f2519 for instance with vm_state active and task_state rebuilding.
Aug 01 13:53:49 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Instance destroyed successfully.
Aug 01 13:53:50 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Instance destroyed successfully.
Aug 01 13:53:50 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:51:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2145562199',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-582848887',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHP4lq6QUMPS3pezcVQZPAh44QK9Cjc2FafAnYqVVnXmR/G2I0IR/iHbmL/nrBBWAYHzkIVIbYY+6AfkD3E0LtsteDcaYMG5TC80GmI1zAMDyri/eMn3gWGPdMZtuTTfcw==',key_name='tempest-keypair-1869868466',keypairs=<?>,launch_index=0,launched_at=2023-08-01T13:52:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ebef26e9d3654bf99ecf391ccb263330',ramdisk_id='',reservation_id='r-mcwbm2vy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1852542004',owner_user_name='tempest-ServerActionsV293TestJSON-1852542004-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:53:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37e6bf606d3041d9928c5e5d6f4a9063',uuid=a07aaeaa-322d-419e-86f5-65cd448c39e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f3403639-00ba-4c7c-983a-7995f60f2519", "address": "fa:16:3e:4b:01:bd", "network": {"id": "2338fb81-87b6-4976-a6ab-b4ea0218fa9b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-606840206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebef26e9d3654bf99ecf391ccb263330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3403639-00", "ovs_interfaceid": "f3403639-00ba-4c7c-983a-7995f60f2519", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 13:53:50 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Converting VIF {"id": "f3403639-00ba-4c7c-983a-7995f60f2519", "address": "fa:16:3e:4b:01:bd", "network": {"id": "2338fb81-87b6-4976-a6ab-b4ea0218fa9b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-606840206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebef26e9d3654bf99ecf391ccb263330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3403639-00", "ovs_interfaceid": "f3403639-00ba-4c7c-983a-7995f60f2519", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:53:50 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4b:01:bd,bridge_name='br-int',has_traffic_filtering=True,id=f3403639-00ba-4c7c-983a-7995f60f2519,network=Network(2338fb81-87b6-4976-a6ab-b4ea0218fa9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3403639-00') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:53:50 user nova-compute[72129]: DEBUG os_vif [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:01:bd,bridge_name='br-int',has_traffic_filtering=True,id=f3403639-00ba-4c7c-983a-7995f60f2519,network=Network(2338fb81-87b6-4976-a6ab-b4ea0218fa9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3403639-00') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 13:53:50 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:50 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf3403639-00, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:53:50 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:50 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 13:53:50 user nova-compute[72129]: INFO os_vif [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:01:bd,bridge_name='br-int',has_traffic_filtering=True,id=f3403639-00ba-4c7c-983a-7995f60f2519,network=Network(2338fb81-87b6-4976-a6ab-b4ea0218fa9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3403639-00')
Aug 01 13:53:50 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] calling os-brick to detach iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 13:53:50 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, {'target_iqns': ['iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gilTSBJb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:53:50 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 01 13:53:50 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:53:50 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:53:50 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b', 0)] {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 13:53:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:50 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e438e6d-5e5c-47bf-8c54-19da63afd6fe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:50 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[235f51d0-b5ba-4294-9f27-b5ee4ddf8705]: (4, ('tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:50 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)
Aug 01 13:53:50 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:53:50 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] iscsi session list stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)
Aug 01 13:53:50 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:53:50 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2828119900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b'): ({'sdh'}, set())}) {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 13:53:50 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Removing single pathed devices sdh {{(pid=72129) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 13:53:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:50 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80a2a8a-a67b-41be-bf13-c2868782451c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:50 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a66f65bb-c4e3-4908-b00e-ddaa1178a6a5]: (4, ('ok\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:50 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Flushing IO for device /dev/sdh {{(pid=72129) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 13:53:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.016s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:50 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[4211fb87-1dae-4843-9140-1c2154368952]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:50 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72129) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 13:53:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.054s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:50 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ee6b81-2e2f-4b38-92bf-8eacb208cfdc]: (4, ('1', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:50 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 13:53:50 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] SCSI volumes sdh have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 13:53:50 user nova-compute[72129]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26164333761333862', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_ca461b8d', '/dev/disk/by-id/scsi-1SCST_BIOca461b8d-ad37a38b188da541') {{(pid=82887) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 01 13:53:50 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b82e3f78-9c40-49c4-86ee-7c259279770c]: (4, None) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:50 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b')] {{(pid=72129) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 13:53:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:50 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d5bd66f-51ed-49fb-9bbc-5f905ef87376]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:50 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:53:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b -p 172.16.0.220:3260 --logout {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:50 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[11192765-2b56-4457-9c1a-551c25e80555]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:50 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b, portal: 172.16.0.220,3260]
Aug 01 13:53:50 user nova-compute[72129]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b, portal: 172.16.0.220,3260] successful.
Aug 01 13:53:50 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:53:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b -p 172.16.0.220:3260 --op delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:50 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.073s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:50 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e51296a-53aa-4403-9fa1-77a2ee9de08a]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:50 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:53:50 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.392s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:53:50 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] <== disconnect_volume: return (395ms) None {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:53:50 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Disconnected iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 13:53:50 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Deleting instance files /opt/stack/data/nova/instances/a07aaeaa-322d-419e-86f5-65cd448c39e7_del
Aug 01 13:53:50 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Deletion of /opt/stack/data/nova/instances/a07aaeaa-322d-419e-86f5-65cd448c39e7_del complete
Aug 01 13:53:50 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance a07aaeaa-322d-419e-86f5-65cd448c39e7 could not be found.
Aug 01 13:53:50 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] calling os-brick to detach iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 13:53:50 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, {'target_iqns': ['iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gilTSBJb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:53:50 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 01 13:53:50 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:53:50 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:53:50 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b', 0)] {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 13:53:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 21 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:50 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e9305d-fd85-4565-ae4b-a2c3610a1ab6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:50 user nova-compute[72129]: WARNING os_brick.initiator.connectors.iscsi [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Couldn't find iSCSI nodes because iscsiadm err: iscsiadm: No records found
Aug 01 13:53:50 user nova-compute[72129]: : NotImplementedError
Aug 01 13:53:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:50 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f345f73-4d29-4001-83c9-371a230f67e0]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:50 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 13:53:50 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:53:50 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 13:53:50 user nova-compute[72129]:  {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:53:50 user nova-compute[72129]: WARNING os_brick.initiator.connectors.iscsi [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 13:53:50 user nova-compute[72129]: : NotImplementedError
Aug 01 13:53:50 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f282e02bd00>, {}) {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 13:53:50 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Disconnecting from: [] {{(pid=72129) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 13:53:50 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.055s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:53:50 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] <== disconnect_volume: return (57ms) None {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:53:50 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Disconnected iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 13:53:51 user nova-compute[72129]: DEBUG nova.compute.manager [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Preparing to wait for external event volume-reimaged-5b0dd53d-1f22-4c51-adec-a83e1193589b {{(pid=72129) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Aug 01 13:53:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Acquiring lock "a07aaeaa-322d-419e-86f5-65cd448c39e7-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:53:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Lock "a07aaeaa-322d-419e-86f5-65cd448c39e7-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:53:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Lock "a07aaeaa-322d-419e-86f5-65cd448c39e7-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:53:51 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d31e1d16-df97-4d9a-acc2-04cb1f84ed6b tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Calling os-brick to attach iSCSI Volume {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 13:53:51 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31e1d16-df97-4d9a-acc2-04cb1f84ed6b tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gmPMFjbA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:53:51 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-d31e1d16-df97-4d9a-acc2-04cb1f84ed6b tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 13:53:51 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-d31e1d16-df97-4d9a-acc2-04cb1f84ed6b tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:53:51 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-d31e1d16-df97-4d9a-acc2-04cb1f84ed6b tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:53:51 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-d31e1d16-df97-4d9a-acc2-04cb1f84ed6b tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 13:53:51 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-d31e1d16-df97-4d9a-acc2-04cb1f84ed6b tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:53:51 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-d31e1d16-df97-4d9a-acc2-04cb1f84ed6b tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:53:51 user nova-compute[72129]: INFO os_brick.initiator.connectors.iscsi [None req-d31e1d16-df97-4d9a-acc2-04cb1f84ed6b tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 13:53:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 -p 172.16.0.220:3260 {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:51 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e3c35c-d25c-4cc8-8ff5-d33357c6bd09]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:51 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31e1d16-df97-4d9a-acc2-04cb1f84ed6b tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 13:53:51 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:53:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 -p 172.16.0.220:3260 --interface default --op new {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:51 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e604db-ac48-45e3-b9ed-222976b6c93f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17] added\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:51 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31e1d16-df97-4d9a-acc2-04cb1f84ed6b tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17] added
Aug 01 13:53:51 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:53:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:51 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[64362d2f-5774-494e-83ef-449228484b6e]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:51 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31e1d16-df97-4d9a-acc2-04cb1f84ed6b tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:53:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:51 user nova-compute[72129]: DEBUG nova.compute.manager [req-e01f5a58-f75a-48a8-b059-fba3e169d12b req-ae11e061-916a-4b5e-97fb-8e715454aa03 service nova] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Received event network-vif-plugged-f3403639-00ba-4c7c-983a-7995f60f2519 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:53:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-e01f5a58-f75a-48a8-b059-fba3e169d12b req-ae11e061-916a-4b5e-97fb-8e715454aa03 service nova] Acquiring lock "a07aaeaa-322d-419e-86f5-65cd448c39e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:53:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-e01f5a58-f75a-48a8-b059-fba3e169d12b req-ae11e061-916a-4b5e-97fb-8e715454aa03 service nova] Lock "a07aaeaa-322d-419e-86f5-65cd448c39e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:53:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-e01f5a58-f75a-48a8-b059-fba3e169d12b req-ae11e061-916a-4b5e-97fb-8e715454aa03 service nova] Lock "a07aaeaa-322d-419e-86f5-65cd448c39e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:53:51 user nova-compute[72129]: DEBUG nova.compute.manager [req-e01f5a58-f75a-48a8-b059-fba3e169d12b req-ae11e061-916a-4b5e-97fb-8e715454aa03 service nova] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] No event matching network-vif-plugged-f3403639-00ba-4c7c-983a-7995f60f2519 in dict_keys([('volume-reimaged', '5b0dd53d-1f22-4c51-adec-a83e1193589b')]) {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:325}}
Aug 01 13:53:51 user nova-compute[72129]: WARNING nova.compute.manager [req-e01f5a58-f75a-48a8-b059-fba3e169d12b req-ae11e061-916a-4b5e-97fb-8e715454aa03 service nova] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Received unexpected event network-vif-plugged-f3403639-00ba-4c7c-983a-7995f60f2519 for instance with vm_state active and task_state rebuilding.
Aug 01 13:53:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:51 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab30c10e-1572-4b2a-80cb-cb1d5682116e]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:51 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31e1d16-df97-4d9a-acc2-04cb1f84ed6b tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:53:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gmPMFjbA {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gmPMFjbA" returned: 0 in 0.027s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:51 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4834be-cdbf-4a42-a846-2acc369800f5]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:51 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31e1d16-df97-4d9a-acc2-04cb1f84ed6b tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gmPMFjbA'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:53:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:51 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[186fdebf-4d41-49d4-8d71-6c8140ded83e]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:51 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31e1d16-df97-4d9a-acc2-04cb1f84ed6b tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:53:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:51 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecbfbd46-bbc4-4347-8432-c7ab13d60b61]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:51 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31e1d16-df97-4d9a-acc2-04cb1f84ed6b tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 13:53:51 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:53:51 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31e1d16-df97-4d9a-acc2-04cb1f84ed6b tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 13:53:51 user nova-compute[72129]:  {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:53:51 user nova-compute[72129]: WARNING os_brick.initiator.connectors.iscsi [None req-d31e1d16-df97-4d9a-acc2-04cb1f84ed6b tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 13:53:51 user nova-compute[72129]: 
Aug 01 13:53:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 -p 172.16.0.220:3260 --login {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:51 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[45dc6a82-07cc-4668-ac5a-af971dbc79b4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:51 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31e1d16-df97-4d9a-acc2-04cb1f84ed6b tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17, portal: 172.16.0.220,3260]
Aug 01 13:53:51 user nova-compute[72129]: Login to [iface: default, target: iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17, portal: 172.16.0.220,3260] successful.
Aug 01 13:53:51 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:53:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:52 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:52 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[117b5e0f-d74d-4cbb-9bb0-64b620968361]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:52 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31e1d16-df97-4d9a-acc2-04cb1f84ed6b tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:53:52 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:52 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:52 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d239cce7-2623-4e17-beaa-7094c575b344]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:52 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31e1d16-df97-4d9a-acc2-04cb1f84ed6b tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)
Aug 01 13:53:52 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:53:52 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31e1d16-df97-4d9a-acc2-04cb1f84ed6b tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)
Aug 01 13:53:52 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:53:52 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-d31e1d16-df97-4d9a-acc2-04cb1f84ed6b tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:53:52 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31e1d16-df97-4d9a-acc2-04cb1f84ed6b tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Connected to 172.16.0.220:3260 {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 13:53:52 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-d31e1d16-df97-4d9a-acc2-04cb1f84ed6b tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=72129) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 13:53:52 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-d31e1d16-df97-4d9a-acc2-04cb1f84ed6b tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72129) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 13:53:52 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:52 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:52 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c0f2f6-9e2e-46e2-a020-44f39b545684]: (4, ('- - 0', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:52 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-d31e1d16-df97-4d9a-acc2-04cb1f84ed6b tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 13:53:52 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31e1d16-df97-4d9a-acc2-04cb1f84ed6b tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gmPMFjbA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 13:53:53 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-d31e1d16-df97-4d9a-acc2-04cb1f84ed6b tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:53:53 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31e1d16-df97-4d9a-acc2-04cb1f84ed6b tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '23463373065393332', 'path': '/dev/sdb'} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:53:53 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d31e1d16-df97-4d9a-acc2-04cb1f84ed6b tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23463373065393332', 'path': '/dev/sdb'} {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 13:53:53 user nova-compute[72129]: DEBUG nova.objects.instance [None req-d31e1d16-df97-4d9a-acc2-04cb1f84ed6b tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Lazy-loading 'flavor' on Instance uuid 2efa87a6-1dd6-4441-a55e-8e86be7f0a35 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:53:53 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-d31e1d16-df97-4d9a-acc2-04cb1f84ed6b tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 13:53:53 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 13:53:53 user nova-compute[72129]:   <source dev="/dev/sdb"/>
Aug 01 13:53:53 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 13:53:53 user nova-compute[72129]:   <serial>4abb01c8-017a-4ccc-a2dd-024a94775c17</serial>
Aug 01 13:53:53 user nova-compute[72129]: </disk>
Aug 01 13:53:53 user nova-compute[72129]:  {{(pid=72129) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 13:53:53 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-d31e1d16-df97-4d9a-acc2-04cb1f84ed6b tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 13:53:53 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-d31e1d16-df97-4d9a-acc2-04cb1f84ed6b tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 13:53:53 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-d31e1d16-df97-4d9a-acc2-04cb1f84ed6b tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] No VIF found with MAC fa:16:3e:20:eb:cf, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 13:53:53 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d31e1d16-df97-4d9a-acc2-04cb1f84ed6b tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.420s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:53:54 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:56 user nova-compute[72129]: DEBUG nova.compute.manager [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Stashing vm_state: active {{(pid=72129) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 01 13:53:56 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:53:56 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:53:56 user nova-compute[72129]: DEBUG nova.objects.instance [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Lazy-loading 'pci_requests' on Instance uuid 2efa87a6-1dd6-4441-a55e-8e86be7f0a35 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:53:56 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72129) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 13:53:56 user nova-compute[72129]: INFO nova.compute.claims [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Claim successful on node user
Aug 01 13:53:56 user nova-compute[72129]: DEBUG nova.objects.instance [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Lazy-loading 'resources' on Instance uuid 2efa87a6-1dd6-4441-a55e-8e86be7f0a35 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:53:56 user nova-compute[72129]: DEBUG nova.objects.instance [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Lazy-loading 'pci_devices' on Instance uuid 2efa87a6-1dd6-4441-a55e-8e86be7f0a35 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:53:56 user nova-compute[72129]: INFO nova.compute.resource_tracker [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Updating resource usage from migration 4d3294df-2b0a-4f01-b65f-59aefa59e918
Aug 01 13:53:56 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:56 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 13:53:56 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 13:53:56 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.509s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:53:56 user nova-compute[72129]: INFO nova.compute.manager [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Migrating
Aug 01 13:53:56 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:53:56 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Acquired lock "compute-rpcapi-router" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:53:56 user nova-compute[72129]: INFO nova.compute.rpcapi [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Aug 01 13:53:56 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Releasing lock "compute-rpcapi-router" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:53:56 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Acquiring lock "refresh_cache-2efa87a6-1dd6-4441-a55e-8e86be7f0a35" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:53:56 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Acquired lock "refresh_cache-2efa87a6-1dd6-4441-a55e-8e86be7f0a35" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:53:56 user nova-compute[72129]: DEBUG nova.network.neutron [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 13:53:57 user nova-compute[72129]: DEBUG nova.network.neutron [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Updating instance_info_cache with network_info: [{"id": "d59c6949-2748-4a57-b089-6219f9102815", "address": "fa:16:3e:20:eb:cf", "network": {"id": "4de0d3ee-7981-427b-9013-99cf0bc22cf8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-289359635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d693a983e4a44434b64c7983239371a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd59c6949-27", "ovs_interfaceid": "d59c6949-2748-4a57-b089-6219f9102815", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:53:57 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Releasing lock "refresh_cache-2efa87a6-1dd6-4441-a55e-8e86be7f0a35" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:53:58 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Starting migrate_disk_and_power_off {{(pid=72129) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 01 13:53:58 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:58 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:58 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:58 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:58 user nova-compute[72129]: DEBUG nova.compute.manager [req-d5a36015-415a-495d-bb30-563c20a18374 req-effa2118-d123-481c-855e-67a70e16db5f service nova] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Received event network-vif-unplugged-d59c6949-2748-4a57-b089-6219f9102815 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:53:58 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-d5a36015-415a-495d-bb30-563c20a18374 req-effa2118-d123-481c-855e-67a70e16db5f service nova] Acquiring lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:53:58 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-d5a36015-415a-495d-bb30-563c20a18374 req-effa2118-d123-481c-855e-67a70e16db5f service nova] Lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:53:58 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-d5a36015-415a-495d-bb30-563c20a18374 req-effa2118-d123-481c-855e-67a70e16db5f service nova] Lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:53:58 user nova-compute[72129]: DEBUG nova.compute.manager [req-d5a36015-415a-495d-bb30-563c20a18374 req-effa2118-d123-481c-855e-67a70e16db5f service nova] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] No waiting events found dispatching network-vif-unplugged-d59c6949-2748-4a57-b089-6219f9102815 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:53:58 user nova-compute[72129]: WARNING nova.compute.manager [req-d5a36015-415a-495d-bb30-563c20a18374 req-effa2118-d123-481c-855e-67a70e16db5f service nova] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Received unexpected event network-vif-unplugged-d59c6949-2748-4a57-b089-6219f9102815 for instance with vm_state active and task_state resize_migrating.
Aug 01 13:53:58 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:58 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:58 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:58 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:58 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:58 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Instance destroyed successfully.
Aug 01 13:53:58 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:49:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1892996256',display_name='tempest-ServerActionsTestOtherB-server-1892996256',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1892996256',id=3,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEv1XQzBjYoYpbhYYzAkxCcHUbemRkkK9uL3KJrV3p8Too9wSnun/4eb7cYSvdSK/lx7EWwYazfwFvI3n8xQWjsYEP2mWFNbGfwKAUlfbILCQIuiMev2z7hB1YDNH/wWXQ==',key_name='tempest-keypair-539050345',keypairs=<?>,launch_index=0,launched_at=2023-08-01T13:50:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d693a983e4a44434b64c7983239371a4',ramdisk_id='',reservation_id='r-ghzodbos',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-398231514',owner_user_name='tempest-ServerActionsTestOtherB-398231514-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T13:53:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1936f560fd794910af1fa6e9c4fffa90',uuid=2efa87a6-1dd6-4441-a55e-8e86be7f0a35,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d59c6949-2748-4a57-b089-6219f9102815", "address": "fa:16:3e:20:eb:cf", "network": {"id": "4de0d3ee-7981-427b-9013-99cf0bc22cf8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-289359635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-289359635-network", "vif_mac": "fa:16:3e:20:eb:cf"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d693a983e4a44434b64c7983239371a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd59c6949-27", "ovs_interfaceid": "d59c6949-2748-4a57-b089-6219f9102815", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 13:53:58 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Converting VIF {"id": "d59c6949-2748-4a57-b089-6219f9102815", "address": "fa:16:3e:20:eb:cf", "network": {"id": "4de0d3ee-7981-427b-9013-99cf0bc22cf8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-289359635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-289359635-network", "vif_mac": "fa:16:3e:20:eb:cf"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d693a983e4a44434b64c7983239371a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd59c6949-27", "ovs_interfaceid": "d59c6949-2748-4a57-b089-6219f9102815", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:53:58 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:20:eb:cf,bridge_name='br-int',has_traffic_filtering=True,id=d59c6949-2748-4a57-b089-6219f9102815,network=Network(4de0d3ee-7981-427b-9013-99cf0bc22cf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd59c6949-27') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:53:58 user nova-compute[72129]: DEBUG os_vif [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:eb:cf,bridge_name='br-int',has_traffic_filtering=True,id=d59c6949-2748-4a57-b089-6219f9102815,network=Network(4de0d3ee-7981-427b-9013-99cf0bc22cf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd59c6949-27') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 13:53:58 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:58 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd59c6949-27, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:53:58 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:58 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:58 user nova-compute[72129]: INFO os_vif [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:eb:cf,bridge_name='br-int',has_traffic_filtering=True,id=d59c6949-2748-4a57-b089-6219f9102815,network=Network(4de0d3ee-7981-427b-9013-99cf0bc22cf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd59c6949-27')
Aug 01 13:53:58 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] calling os-brick to detach iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 13:53:58 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, {'target_iqns': ['iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gmPMFjbA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:53:58 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 13:53:58 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:53:58 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:53:58 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17', 0)] {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 13:53:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:58 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[f05dc8f9-cfc3-4b4e-8a1e-88bac3e4f311]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:58 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b335bd-d322-4425-855d-3375c86cfe53]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:58 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)
Aug 01 13:53:58 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:53:58 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)
Aug 01 13:53:58 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:53:58 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f28200f67a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17'): ({'sdb'}, set())}) {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 13:53:58 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Removing single pathed devices sdb {{(pid=72129) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 13:53:58 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:59 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:59 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6f2f33-9142-4fbc-8292-47383a822440]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:59 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:59 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:59 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[57392035-6439-4a5a-a18d-df6951385467]: (4, ('ok\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:59 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Flushing IO for device /dev/sdb {{(pid=72129) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 13:53:59 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:59 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:59 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3969368-cb7c-4199-ac2b-2b7ea8ac48af]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:59 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72129) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 13:53:59 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:59 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.064s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:59 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[9365ed72-ab99-486c-9082-491285b257d8]: (4, ('1', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:59 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 13:53:59 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] SCSI volumes sdb have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 13:53:59 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17')] {{(pid=72129) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 13:53:59 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:59 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:59 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c26a9e-d4b8-4584-8fd3-047c128c8963]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:59 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:53:59 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 -p 172.16.0.220:3260 --logout {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:59 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:59 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[69361f6d-6da6-481d-838d-fa8f09380036]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:59 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17, portal: 172.16.0.220,3260]
Aug 01 13:53:59 user nova-compute[72129]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17, portal: 172.16.0.220,3260] successful.
Aug 01 13:53:59 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:53:59 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 -p 172.16.0.220:3260 --op delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:59 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:59 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2cf815-8b95-4445-af66-77ff4410ebb5]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:53:59 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:53:59 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:53:59 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] <== disconnect_volume: return (311ms) None {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:53:59 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Disconnected iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 13:53:59 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efa87a6-1dd6-4441-a55e-8e86be7f0a35/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:59 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efa87a6-1dd6-4441-a55e-8e86be7f0a35/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:59 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efa87a6-1dd6-4441-a55e-8e86be7f0a35/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:59 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:59 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:59 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efa87a6-1dd6-4441-a55e-8e86be7f0a35/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:53:59 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 13:53:59 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/2efa87a6-1dd6-4441-a55e-8e86be7f0a35_resize/disk /opt/stack/data/nova/instances/2efa87a6-1dd6-4441-a55e-8e86be7f0a35/disk {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:53:59 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:53:59 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:54:00 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] CMD "cp -r /opt/stack/data/nova/instances/2efa87a6-1dd6-4441-a55e-8e86be7f0a35_resize/disk /opt/stack/data/nova/instances/2efa87a6-1dd6-4441-a55e-8e86be7f0a35/disk" returned: 0 in 0.560s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:54:00 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/2efa87a6-1dd6-4441-a55e-8e86be7f0a35_resize/disk.info /opt/stack/data/nova/instances/2efa87a6-1dd6-4441-a55e-8e86be7f0a35/disk.info {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:54:00 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] CMD "cp -r /opt/stack/data/nova/instances/2efa87a6-1dd6-4441-a55e-8e86be7f0a35_resize/disk.info /opt/stack/data/nova/instances/2efa87a6-1dd6-4441-a55e-8e86be7f0a35/disk.info" returned: 0 in 0.044s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:54:00 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:54:00 user nova-compute[72129]: DEBUG nova.compute.manager [req-b9928012-4cf2-4505-8a56-942344280ca7 req-a377839c-d612-4f2b-8a5a-347cb7bce0d6 service nova] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Received event network-vif-plugged-d59c6949-2748-4a57-b089-6219f9102815 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:54:00 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-b9928012-4cf2-4505-8a56-942344280ca7 req-a377839c-d612-4f2b-8a5a-347cb7bce0d6 service nova] Acquiring lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:54:00 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-b9928012-4cf2-4505-8a56-942344280ca7 req-a377839c-d612-4f2b-8a5a-347cb7bce0d6 service nova] Lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:54:00 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-b9928012-4cf2-4505-8a56-942344280ca7 req-a377839c-d612-4f2b-8a5a-347cb7bce0d6 service nova] Lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:54:00 user nova-compute[72129]: DEBUG nova.compute.manager [req-b9928012-4cf2-4505-8a56-942344280ca7 req-a377839c-d612-4f2b-8a5a-347cb7bce0d6 service nova] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] No waiting events found dispatching network-vif-plugged-d59c6949-2748-4a57-b089-6219f9102815 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:54:00 user nova-compute[72129]: WARNING nova.compute.manager [req-b9928012-4cf2-4505-8a56-942344280ca7 req-a377839c-d612-4f2b-8a5a-347cb7bce0d6 service nova] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Received unexpected event network-vif-plugged-d59c6949-2748-4a57-b089-6219f9102815 for instance with vm_state active and task_state resize_migrating.
Aug 01 13:54:00 user nova-compute[72129]: DEBUG nova.compute.manager [req-b9928012-4cf2-4505-8a56-942344280ca7 req-a377839c-d612-4f2b-8a5a-347cb7bce0d6 service nova] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Received event network-vif-plugged-d59c6949-2748-4a57-b089-6219f9102815 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:54:00 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-b9928012-4cf2-4505-8a56-942344280ca7 req-a377839c-d612-4f2b-8a5a-347cb7bce0d6 service nova] Acquiring lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:54:00 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-b9928012-4cf2-4505-8a56-942344280ca7 req-a377839c-d612-4f2b-8a5a-347cb7bce0d6 service nova] Lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:54:00 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-b9928012-4cf2-4505-8a56-942344280ca7 req-a377839c-d612-4f2b-8a5a-347cb7bce0d6 service nova] Lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:54:00 user nova-compute[72129]: DEBUG nova.compute.manager [req-b9928012-4cf2-4505-8a56-942344280ca7 req-a377839c-d612-4f2b-8a5a-347cb7bce0d6 service nova] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] No waiting events found dispatching network-vif-plugged-d59c6949-2748-4a57-b089-6219f9102815 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:54:00 user nova-compute[72129]: WARNING nova.compute.manager [req-b9928012-4cf2-4505-8a56-942344280ca7 req-a377839c-d612-4f2b-8a5a-347cb7bce0d6 service nova] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Received unexpected event network-vif-plugged-d59c6949-2748-4a57-b089-6219f9102815 for instance with vm_state active and task_state resize_migrating.
Aug 01 13:54:00 user nova-compute[72129]: DEBUG nova.compute.manager [req-b9928012-4cf2-4505-8a56-942344280ca7 req-a377839c-d612-4f2b-8a5a-347cb7bce0d6 service nova] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Received event network-vif-plugged-d59c6949-2748-4a57-b089-6219f9102815 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:54:00 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-b9928012-4cf2-4505-8a56-942344280ca7 req-a377839c-d612-4f2b-8a5a-347cb7bce0d6 service nova] Acquiring lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:54:00 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-b9928012-4cf2-4505-8a56-942344280ca7 req-a377839c-d612-4f2b-8a5a-347cb7bce0d6 service nova] Lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:54:00 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-b9928012-4cf2-4505-8a56-942344280ca7 req-a377839c-d612-4f2b-8a5a-347cb7bce0d6 service nova] Lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:54:00 user nova-compute[72129]: DEBUG nova.compute.manager [req-b9928012-4cf2-4505-8a56-942344280ca7 req-a377839c-d612-4f2b-8a5a-347cb7bce0d6 service nova] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] No waiting events found dispatching network-vif-plugged-d59c6949-2748-4a57-b089-6219f9102815 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:54:00 user nova-compute[72129]: WARNING nova.compute.manager [req-b9928012-4cf2-4505-8a56-942344280ca7 req-a377839c-d612-4f2b-8a5a-347cb7bce0d6 service nova] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Received unexpected event network-vif-plugged-d59c6949-2748-4a57-b089-6219f9102815 for instance with vm_state active and task_state resize_migrating.
Aug 01 13:54:00 user nova-compute[72129]: DEBUG nova.compute.manager [req-b9928012-4cf2-4505-8a56-942344280ca7 req-a377839c-d612-4f2b-8a5a-347cb7bce0d6 service nova] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Received event network-vif-unplugged-d59c6949-2748-4a57-b089-6219f9102815 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:54:00 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-b9928012-4cf2-4505-8a56-942344280ca7 req-a377839c-d612-4f2b-8a5a-347cb7bce0d6 service nova] Acquiring lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:54:00 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-b9928012-4cf2-4505-8a56-942344280ca7 req-a377839c-d612-4f2b-8a5a-347cb7bce0d6 service nova] Lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:54:00 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-b9928012-4cf2-4505-8a56-942344280ca7 req-a377839c-d612-4f2b-8a5a-347cb7bce0d6 service nova] Lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:54:00 user nova-compute[72129]: DEBUG nova.compute.manager [req-b9928012-4cf2-4505-8a56-942344280ca7 req-a377839c-d612-4f2b-8a5a-347cb7bce0d6 service nova] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] No waiting events found dispatching network-vif-unplugged-d59c6949-2748-4a57-b089-6219f9102815 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:54:00 user nova-compute[72129]: WARNING nova.compute.manager [req-b9928012-4cf2-4505-8a56-942344280ca7 req-a377839c-d612-4f2b-8a5a-347cb7bce0d6 service nova] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Received unexpected event network-vif-unplugged-d59c6949-2748-4a57-b089-6219f9102815 for instance with vm_state active and task_state resize_migrating.
Aug 01 13:54:00 user nova-compute[72129]: DEBUG nova.compute.manager [req-b9928012-4cf2-4505-8a56-942344280ca7 req-a377839c-d612-4f2b-8a5a-347cb7bce0d6 service nova] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Received event network-vif-plugged-d59c6949-2748-4a57-b089-6219f9102815 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:54:00 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-b9928012-4cf2-4505-8a56-942344280ca7 req-a377839c-d612-4f2b-8a5a-347cb7bce0d6 service nova] Acquiring lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:54:00 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-b9928012-4cf2-4505-8a56-942344280ca7 req-a377839c-d612-4f2b-8a5a-347cb7bce0d6 service nova] Lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:54:00 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-b9928012-4cf2-4505-8a56-942344280ca7 req-a377839c-d612-4f2b-8a5a-347cb7bce0d6 service nova] Lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:54:00 user nova-compute[72129]: DEBUG nova.compute.manager [req-b9928012-4cf2-4505-8a56-942344280ca7 req-a377839c-d612-4f2b-8a5a-347cb7bce0d6 service nova] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] No waiting events found dispatching network-vif-plugged-d59c6949-2748-4a57-b089-6219f9102815 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:54:00 user nova-compute[72129]: WARNING nova.compute.manager [req-b9928012-4cf2-4505-8a56-942344280ca7 req-a377839c-d612-4f2b-8a5a-347cb7bce0d6 service nova] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Received unexpected event network-vif-plugged-d59c6949-2748-4a57-b089-6219f9102815 for instance with vm_state active and task_state resize_migrating.
Aug 01 13:54:00 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Acquiring lock "0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:54:00 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:54:00 user nova-compute[72129]: DEBUG nova.compute.manager [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Starting instance... {{(pid=72129) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 13:54:00 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:54:00 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:54:00 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72129) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 13:54:00 user nova-compute[72129]: INFO nova.compute.claims [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Claim successful on node user
Aug 01 13:54:01 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 13:54:01 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 13:54:01 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.661s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:54:01 user nova-compute[72129]: DEBUG nova.compute.manager [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Start building networks asynchronously for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 13:54:01 user nova-compute[72129]: DEBUG nova.compute.manager [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Allocating IP information in the background. {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 13:54:01 user nova-compute[72129]: DEBUG nova.network.neutron [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] allocate_for_instance() {{(pid=72129) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 13:54:01 user nova-compute[72129]: DEBUG nova.network.neutron [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Port d59c6949-2748-4a57-b089-6219f9102815 binding to destination host user is already ACTIVE {{(pid=72129) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 01 13:54:01 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 13:54:01 user nova-compute[72129]: DEBUG nova.compute.manager [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Start building block device mappings for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 13:54:01 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Acquiring lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:54:01 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:54:01 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:54:02 user nova-compute[72129]: DEBUG nova.policy [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cdb6f66592fe4cdebea02e5f5c1f4a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0929886fa54d1c8023793806f10d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72129) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 13:54:02 user nova-compute[72129]: DEBUG nova.compute.manager [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Start spawning the instance on the hypervisor. {{(pid=72129) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 13:54:02 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Creating instance directory {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 13:54:02 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Creating image(s)
Aug 01 13:54:02 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Acquiring lock "/opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:54:02 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "/opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:54:02 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "/opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:54:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:54:02 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:54:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.163s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:54:02 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Acquiring lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:54:02 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.018s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:54:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:54:02 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Acquiring lock "refresh_cache-2efa87a6-1dd6-4441-a55e-8e86be7f0a35" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:54:02 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Acquired lock "refresh_cache-2efa87a6-1dd6-4441-a55e-8e86be7f0a35" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:54:02 user nova-compute[72129]: DEBUG nova.network.neutron [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 13:54:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.144s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:54:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk 1073741824 {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:54:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk 1073741824" returned: 0 in 0.062s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:54:02 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.213s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:54:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:54:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.157s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:54:02 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk. size=1073741824 {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 13:54:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:54:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:54:02 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Cannot resize image /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk to a smaller size. {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 13:54:02 user nova-compute[72129]: DEBUG nova.objects.instance [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lazy-loading 'migration_context' on Instance uuid 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:54:02 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Created local disks {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 13:54:02 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Ensure instance console log exists: /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/console.log {{(pid=72129) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 13:54:02 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:54:02 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:54:02 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:54:02 user nova-compute[72129]: DEBUG nova.network.neutron [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Successfully created port: d4f68f78-6df9-41b7-8d32-27f55f224683 {{(pid=72129) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 13:54:03 user nova-compute[72129]: DEBUG nova.network.neutron [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Updating instance_info_cache with network_info: [{"id": "d59c6949-2748-4a57-b089-6219f9102815", "address": "fa:16:3e:20:eb:cf", "network": {"id": "4de0d3ee-7981-427b-9013-99cf0bc22cf8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-289359635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d693a983e4a44434b64c7983239371a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd59c6949-27", "ovs_interfaceid": "d59c6949-2748-4a57-b089-6219f9102815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:54:03 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Releasing lock "refresh_cache-2efa87a6-1dd6-4441-a55e-8e86be7f0a35" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:54:03 user nova-compute[72129]: DEBUG os_brick.utils [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:54:03 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:54:03 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:54:03 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff9c9ec-134b-4cb9-ad80-05860660fb75]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f9b449c2cd3d\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:54:03 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:54:03 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:54:03 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[3429d442-1ef2-4a30-98cf-da615b905b9d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:54:03 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:54:03 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:54:03 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[79bbb311-383c-4b7a-b1b8-1f94295b9368]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:54:03 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce8c1e25-eb45-4499-b44f-ee23966ce2e9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:54:03 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Running cmd (subprocess): nvme version {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:54:03 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] 'nvme version' failed. Not Retrying. {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 13:54:03 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.nvmeof [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] nvme not present on system {{(pid=72129) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 13:54:03 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:54:03 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 13:54:03 user nova-compute[72129]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 13:54:03 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[e743d4cd-b663-4ac2-960a-ea413d0ea1a4]: (4, '') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:54:03 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72129) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 13:54:03 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 13:54:03 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] LIGHTOS: no hostnqn found. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 13:54:03 user nova-compute[72129]: DEBUG os_brick.utils [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f9b449c2cd3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:54:03 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:54:04 user nova-compute[72129]: DEBUG nova.network.neutron [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Successfully updated port: d4f68f78-6df9-41b7-8d32-27f55f224683 {{(pid=72129) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 13:54:04 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Acquiring lock "refresh_cache-0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:54:04 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Acquired lock "refresh_cache-0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:54:04 user nova-compute[72129]: DEBUG nova.network.neutron [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 13:54:04 user nova-compute[72129]: DEBUG nova.compute.manager [req-063deb1c-3519-4221-9981-fdc30659e62c req-2f4fe123-7ebc-4e95-a3f1-20a26ec21737 service nova] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Received event network-changed-d4f68f78-6df9-41b7-8d32-27f55f224683 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:54:04 user nova-compute[72129]: DEBUG nova.compute.manager [req-063deb1c-3519-4221-9981-fdc30659e62c req-2f4fe123-7ebc-4e95-a3f1-20a26ec21737 service nova] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Refreshing instance network info cache due to event network-changed-d4f68f78-6df9-41b7-8d32-27f55f224683. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 13:54:04 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-063deb1c-3519-4221-9981-fdc30659e62c req-2f4fe123-7ebc-4e95-a3f1-20a26ec21737 service nova] Acquiring lock "refresh_cache-0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:54:04 user nova-compute[72129]: DEBUG nova.network.neutron [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Instance cache missing network info. {{(pid=72129) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 13:54:04 user nova-compute[72129]: DEBUG nova.network.neutron [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Updating instance_info_cache with network_info: [{"id": "d4f68f78-6df9-41b7-8d32-27f55f224683", "address": "fa:16:3e:23:49:b3", "network": {"id": "59b1e538-8bfe-45ce-ab7b-c5838ab25582", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1129024349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0929886fa54d1c8023793806f10d31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f68f78-6d", "ovs_interfaceid": "d4f68f78-6df9-41b7-8d32-27f55f224683", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:54:04 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Releasing lock "refresh_cache-0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:54:04 user nova-compute[72129]: DEBUG nova.compute.manager [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Instance network_info: |[{"id": "d4f68f78-6df9-41b7-8d32-27f55f224683", "address": "fa:16:3e:23:49:b3", "network": {"id": "59b1e538-8bfe-45ce-ab7b-c5838ab25582", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1129024349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0929886fa54d1c8023793806f10d31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f68f78-6d", "ovs_interfaceid": "d4f68f78-6df9-41b7-8d32-27f55f224683", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 13:54:04 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-063deb1c-3519-4221-9981-fdc30659e62c req-2f4fe123-7ebc-4e95-a3f1-20a26ec21737 service nova] Acquired lock "refresh_cache-0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:54:04 user nova-compute[72129]: DEBUG nova.network.neutron [req-063deb1c-3519-4221-9981-fdc30659e62c req-2f4fe123-7ebc-4e95-a3f1-20a26ec21737 service nova] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Refreshing network info cache for port d4f68f78-6df9-41b7-8d32-27f55f224683 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 13:54:04 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Start _get_guest_xml network_info=[{"id": "d4f68f78-6df9-41b7-8d32-27f55f224683", "address": "fa:16:3e:23:49:b3", "network": {"id": "59b1e538-8bfe-45ce-ab7b-c5838ab25582", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1129024349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0929886fa54d1c8023793806f10d31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f68f78-6d", "ovs_interfaceid": "d4f68f78-6df9-41b7-8d32-27f55f224683", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'image_id': 'b6472c34-1b0f-4034-ba3a-7e8eb5103715'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 13:54:04 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:54:04 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:54:04 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 13:54:04 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] CPU controller missing on host. {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 13:54:04 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 13:54:04 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] CPU controller found on host. {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 13:54:04 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72129) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 13:54:04 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T13:45:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 13:54:04 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Flavor limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 13:54:04 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Image limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 13:54:04 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Flavor pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 13:54:04 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Image pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 13:54:04 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 13:54:04 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 13:54:04 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 13:54:04 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Got 1 possible topologies {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 13:54:04 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 13:54:04 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 13:54:04 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:53:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1536283622',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1536283622',id=16,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e0929886fa54d1c8023793806f10d31',ramdisk_id='',reservation_id='r-qtibntd8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1414609013',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:54:02Z,user_data=None,user_id='cdb6f66592fe4cdebea02e5f5c1f4a60',uuid=0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4f68f78-6df9-41b7-8d32-27f55f224683", "address": "fa:16:3e:23:49:b3", "network": {"id": "59b1e538-8bfe-45ce-ab7b-c5838ab25582", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1129024349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0929886fa54d1c8023793806f10d31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f68f78-6d", "ovs_interfaceid": "d4f68f78-6df9-41b7-8d32-27f55f224683", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 13:54:04 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Converting VIF {"id": "d4f68f78-6df9-41b7-8d32-27f55f224683", "address": "fa:16:3e:23:49:b3", "network": {"id": "59b1e538-8bfe-45ce-ab7b-c5838ab25582", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1129024349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0929886fa54d1c8023793806f10d31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f68f78-6d", "ovs_interfaceid": "d4f68f78-6df9-41b7-8d32-27f55f224683", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:54:04 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:49:b3,bridge_name='br-int',has_traffic_filtering=True,id=d4f68f78-6df9-41b7-8d32-27f55f224683,network=Network(59b1e538-8bfe-45ce-ab7b-c5838ab25582),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4f68f78-6d') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:54:04 user nova-compute[72129]: DEBUG nova.objects.instance [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lazy-loading 'pci_devices' on Instance uuid 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:54:04 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] End _get_guest_xml xml=<domain type="kvm">
Aug 01 13:54:04 user nova-compute[72129]:   <uuid>0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d</uuid>
Aug 01 13:54:04 user nova-compute[72129]:   <name>instance-00000010</name>
Aug 01 13:54:04 user nova-compute[72129]:   <memory>524288</memory>
Aug 01 13:54:04 user nova-compute[72129]:   <vcpu>1</vcpu>
Aug 01 13:54:04 user nova-compute[72129]:   <metadata>
Aug 01 13:54:04 user nova-compute[72129]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 13:54:04 user nova-compute[72129]:       <nova:package version="0.0.0"/>
Aug 01 13:54:04 user nova-compute[72129]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1536283622</nova:name>
Aug 01 13:54:04 user nova-compute[72129]:       <nova:creationTime>2023-08-01 13:54:04</nova:creationTime>
Aug 01 13:54:04 user nova-compute[72129]:       <nova:flavor name="m1.tiny">
Aug 01 13:54:04 user nova-compute[72129]:         <nova:memory>512</nova:memory>
Aug 01 13:54:04 user nova-compute[72129]:         <nova:disk>1</nova:disk>
Aug 01 13:54:04 user nova-compute[72129]:         <nova:swap>0</nova:swap>
Aug 01 13:54:04 user nova-compute[72129]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 13:54:04 user nova-compute[72129]:         <nova:vcpus>1</nova:vcpus>
Aug 01 13:54:04 user nova-compute[72129]:       </nova:flavor>
Aug 01 13:54:04 user nova-compute[72129]:       <nova:owner>
Aug 01 13:54:04 user nova-compute[72129]:         <nova:user uuid="cdb6f66592fe4cdebea02e5f5c1f4a60">tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member</nova:user>
Aug 01 13:54:04 user nova-compute[72129]:         <nova:project uuid="1e0929886fa54d1c8023793806f10d31">tempest-ServerBootFromVolumeStableRescueTest-1414609013</nova:project>
Aug 01 13:54:04 user nova-compute[72129]:       </nova:owner>
Aug 01 13:54:04 user nova-compute[72129]:       <nova:root type="image" uuid="b6472c34-1b0f-4034-ba3a-7e8eb5103715"/>
Aug 01 13:54:04 user nova-compute[72129]:       <nova:ports>
Aug 01 13:54:04 user nova-compute[72129]:         <nova:port uuid="d4f68f78-6df9-41b7-8d32-27f55f224683">
Aug 01 13:54:04 user nova-compute[72129]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 01 13:54:04 user nova-compute[72129]:         </nova:port>
Aug 01 13:54:04 user nova-compute[72129]:       </nova:ports>
Aug 01 13:54:04 user nova-compute[72129]:     </nova:instance>
Aug 01 13:54:04 user nova-compute[72129]:   </metadata>
Aug 01 13:54:04 user nova-compute[72129]:   <sysinfo type="smbios">
Aug 01 13:54:04 user nova-compute[72129]:     <system>
Aug 01 13:54:04 user nova-compute[72129]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 13:54:04 user nova-compute[72129]:       <entry name="product">OpenStack Nova</entry>
Aug 01 13:54:04 user nova-compute[72129]:       <entry name="version">0.0.0</entry>
Aug 01 13:54:04 user nova-compute[72129]:       <entry name="serial">0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d</entry>
Aug 01 13:54:04 user nova-compute[72129]:       <entry name="uuid">0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d</entry>
Aug 01 13:54:04 user nova-compute[72129]:       <entry name="family">Virtual Machine</entry>
Aug 01 13:54:04 user nova-compute[72129]:     </system>
Aug 01 13:54:04 user nova-compute[72129]:   </sysinfo>
Aug 01 13:54:04 user nova-compute[72129]:   <os>
Aug 01 13:54:04 user nova-compute[72129]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 13:54:04 user nova-compute[72129]:     <boot dev="hd"/>
Aug 01 13:54:04 user nova-compute[72129]:     <smbios mode="sysinfo"/>
Aug 01 13:54:04 user nova-compute[72129]:   </os>
Aug 01 13:54:04 user nova-compute[72129]:   <features>
Aug 01 13:54:04 user nova-compute[72129]:     <acpi/>
Aug 01 13:54:04 user nova-compute[72129]:     <apic/>
Aug 01 13:54:04 user nova-compute[72129]:     <vmcoreinfo/>
Aug 01 13:54:04 user nova-compute[72129]:   </features>
Aug 01 13:54:04 user nova-compute[72129]:   <clock offset="utc">
Aug 01 13:54:04 user nova-compute[72129]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 13:54:04 user nova-compute[72129]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 13:54:04 user nova-compute[72129]:     <timer name="hpet" present="no"/>
Aug 01 13:54:04 user nova-compute[72129]:   </clock>
Aug 01 13:54:04 user nova-compute[72129]:   <cpu mode="custom" match="exact">
Aug 01 13:54:04 user nova-compute[72129]:     <model>Nehalem</model>
Aug 01 13:54:04 user nova-compute[72129]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 13:54:04 user nova-compute[72129]:   </cpu>
Aug 01 13:54:04 user nova-compute[72129]:   <devices>
Aug 01 13:54:04 user nova-compute[72129]:     <disk type="file" device="disk">
Aug 01 13:54:04 user nova-compute[72129]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 13:54:04 user nova-compute[72129]:       <source file="/opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk"/>
Aug 01 13:54:04 user nova-compute[72129]:       <target dev="vda" bus="virtio"/>
Aug 01 13:54:04 user nova-compute[72129]:     </disk>
Aug 01 13:54:04 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 13:54:04 user nova-compute[72129]:       <mac address="fa:16:3e:23:49:b3"/>
Aug 01 13:54:04 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 13:54:04 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 13:54:04 user nova-compute[72129]:       <target dev="tapd4f68f78-6d"/>
Aug 01 13:54:04 user nova-compute[72129]:     </interface>
Aug 01 13:54:04 user nova-compute[72129]:     <serial type="pty">
Aug 01 13:54:04 user nova-compute[72129]:       <log file="/opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/console.log" append="off"/>
Aug 01 13:54:04 user nova-compute[72129]:     </serial>
Aug 01 13:54:04 user nova-compute[72129]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 13:54:04 user nova-compute[72129]:     <video>
Aug 01 13:54:04 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 13:54:04 user nova-compute[72129]:     </video>
Aug 01 13:54:04 user nova-compute[72129]:     <rng model="virtio">
Aug 01 13:54:04 user nova-compute[72129]:       <backend model="random">/dev/urandom</backend>
Aug 01 13:54:04 user nova-compute[72129]:     </rng>
Aug 01 13:54:04 user nova-compute[72129]:     <controller type="usb" index="0" model="none"/>
Aug 01 13:54:04 user nova-compute[72129]:     <memballoon model="virtio">
Aug 01 13:54:04 user nova-compute[72129]:       <stats period="10"/>
Aug 01 13:54:04 user nova-compute[72129]:     </memballoon>
Aug 01 13:54:04 user nova-compute[72129]:   </devices>
Aug 01 13:54:04 user nova-compute[72129]: </domain>
Aug 01 13:54:04 user nova-compute[72129]:  {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 13:54:04 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:53:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1536283622',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1536283622',id=16,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e0929886fa54d1c8023793806f10d31',ramdisk_id='',reservation_id='r-qtibntd8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1414609013',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:54:02Z,user_data=None,user_id='cdb6f66592fe4cdebea02e5f5c1f4a60',uuid=0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4f68f78-6df9-41b7-8d32-27f55f224683", "address": "fa:16:3e:23:49:b3", "network": {"id": "59b1e538-8bfe-45ce-ab7b-c5838ab25582", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1129024349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0929886fa54d1c8023793806f10d31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f68f78-6d", "ovs_interfaceid": "d4f68f78-6df9-41b7-8d32-27f55f224683", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 13:54:04 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Converting VIF {"id": "d4f68f78-6df9-41b7-8d32-27f55f224683", "address": "fa:16:3e:23:49:b3", "network": {"id": "59b1e538-8bfe-45ce-ab7b-c5838ab25582", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1129024349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0929886fa54d1c8023793806f10d31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f68f78-6d", "ovs_interfaceid": "d4f68f78-6df9-41b7-8d32-27f55f224683", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:54:04 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:49:b3,bridge_name='br-int',has_traffic_filtering=True,id=d4f68f78-6df9-41b7-8d32-27f55f224683,network=Network(59b1e538-8bfe-45ce-ab7b-c5838ab25582),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4f68f78-6d') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:54:04 user nova-compute[72129]: DEBUG os_vif [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:49:b3,bridge_name='br-int',has_traffic_filtering=True,id=d4f68f78-6df9-41b7-8d32-27f55f224683,network=Network(59b1e538-8bfe-45ce-ab7b-c5838ab25582),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4f68f78-6d') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 13:54:04 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:54:04 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:54:04 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 13:54:04 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:54:04 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd4f68f78-6d, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:54:04 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd4f68f78-6d, col_values=(('external_ids', {'iface-id': 'd4f68f78-6df9-41b7-8d32-27f55f224683', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:49:b3', 'vm-uuid': '0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:54:04 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:54:04 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 13:54:04 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:54:04 user nova-compute[72129]: INFO os_vif [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:49:b3,bridge_name='br-int',has_traffic_filtering=True,id=d4f68f78-6df9-41b7-8d32-27f55f224683,network=Network(59b1e538-8bfe-45ce-ab7b-c5838ab25582),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4f68f78-6d')
Aug 01 13:54:04 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:54:04 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 13:54:04 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] No VIF found with MAC fa:16:3e:23:49:b3, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 13:54:04 user nova-compute[72129]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690898029.9854112, a07aaeaa-322d-419e-86f5-65cd448c39e7 => Stopped> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:54:04 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] VM Stopped (Lifecycle Event)
Aug 01 13:54:05 user nova-compute[72129]: DEBUG nova.compute.manager [None req-16ffe4c6-9500-43fb-b8e0-73be51e2f377 None None] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:54:05 user nova-compute[72129]: DEBUG nova.network.neutron [req-063deb1c-3519-4221-9981-fdc30659e62c req-2f4fe123-7ebc-4e95-a3f1-20a26ec21737 service nova] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Updated VIF entry in instance network info cache for port d4f68f78-6df9-41b7-8d32-27f55f224683. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 13:54:05 user nova-compute[72129]: DEBUG nova.network.neutron [req-063deb1c-3519-4221-9981-fdc30659e62c req-2f4fe123-7ebc-4e95-a3f1-20a26ec21737 service nova] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Updating instance_info_cache with network_info: [{"id": "d4f68f78-6df9-41b7-8d32-27f55f224683", "address": "fa:16:3e:23:49:b3", "network": {"id": "59b1e538-8bfe-45ce-ab7b-c5838ab25582", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1129024349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0929886fa54d1c8023793806f10d31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f68f78-6d", "ovs_interfaceid": "d4f68f78-6df9-41b7-8d32-27f55f224683", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:54:05 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-063deb1c-3519-4221-9981-fdc30659e62c req-2f4fe123-7ebc-4e95-a3f1-20a26ec21737 service nova] Releasing lock "refresh_cache-0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:54:05 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:54:06 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:54:06 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:54:06 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:54:06 user nova-compute[72129]: DEBUG nova.compute.manager [req-d22e7944-c596-4a19-a479-76da2ba06e51 req-474dd203-999e-4613-a74e-6adcc8844494 service nova] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Received event network-vif-plugged-d4f68f78-6df9-41b7-8d32-27f55f224683 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:54:06 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-d22e7944-c596-4a19-a479-76da2ba06e51 req-474dd203-999e-4613-a74e-6adcc8844494 service nova] Acquiring lock "0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:54:06 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-d22e7944-c596-4a19-a479-76da2ba06e51 req-474dd203-999e-4613-a74e-6adcc8844494 service nova] Lock "0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:54:06 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-d22e7944-c596-4a19-a479-76da2ba06e51 req-474dd203-999e-4613-a74e-6adcc8844494 service nova] Lock "0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:54:06 user nova-compute[72129]: DEBUG nova.compute.manager [req-d22e7944-c596-4a19-a479-76da2ba06e51 req-474dd203-999e-4613-a74e-6adcc8844494 service nova] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] No waiting events found dispatching network-vif-plugged-d4f68f78-6df9-41b7-8d32-27f55f224683 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:54:06 user nova-compute[72129]: WARNING nova.compute.manager [req-d22e7944-c596-4a19-a479-76da2ba06e51 req-474dd203-999e-4613-a74e-6adcc8844494 service nova] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Received unexpected event network-vif-plugged-d4f68f78-6df9-41b7-8d32-27f55f224683 for instance with vm_state building and task_state spawning.
Aug 01 13:54:07 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:54:07 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:54:08 user nova-compute[72129]: DEBUG nova.compute.manager [req-99cce961-ec19-403f-9be8-d47f1daade9d req-78b922a1-fdb5-40b4-b0c9-2985d6daa3e2 service nova] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Received event network-vif-plugged-d4f68f78-6df9-41b7-8d32-27f55f224683 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:54:08 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-99cce961-ec19-403f-9be8-d47f1daade9d req-78b922a1-fdb5-40b4-b0c9-2985d6daa3e2 service nova] Acquiring lock "0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:54:08 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-99cce961-ec19-403f-9be8-d47f1daade9d req-78b922a1-fdb5-40b4-b0c9-2985d6daa3e2 service nova] Lock "0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:54:08 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-99cce961-ec19-403f-9be8-d47f1daade9d req-78b922a1-fdb5-40b4-b0c9-2985d6daa3e2 service nova] Lock "0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:54:08 user nova-compute[72129]: DEBUG nova.compute.manager [req-99cce961-ec19-403f-9be8-d47f1daade9d req-78b922a1-fdb5-40b4-b0c9-2985d6daa3e2 service nova] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] No waiting events found dispatching network-vif-plugged-d4f68f78-6df9-41b7-8d32-27f55f224683 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:54:08 user nova-compute[72129]: WARNING nova.compute.manager [req-99cce961-ec19-403f-9be8-d47f1daade9d req-78b922a1-fdb5-40b4-b0c9-2985d6daa3e2 service nova] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Received unexpected event network-vif-plugged-d4f68f78-6df9-41b7-8d32-27f55f224683 for instance with vm_state building and task_state spawning.
Aug 01 13:54:09 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898049.132512, 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:54:09 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] VM Resumed (Lifecycle Event)
Aug 01 13:54:09 user nova-compute[72129]: DEBUG nova.compute.manager [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Instance event wait completed in 0 seconds for  {{(pid=72129) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 13:54:09 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Guest created on hypervisor {{(pid=72129) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 13:54:09 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Instance spawned successfully.
Aug 01 13:54:09 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 13:54:09 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:54:09 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 13:54:09 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Found default for hw_cdrom_bus of ide {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:54:09 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Found default for hw_disk_bus of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:54:09 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Found default for hw_input_bus of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:54:09 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Found default for hw_pointer_model of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:54:09 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Found default for hw_video_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:54:09 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Found default for hw_vif_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:54:09 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 13:54:09 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898049.136623, 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:54:09 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] VM Started (Lifecycle Event)
Aug 01 13:54:09 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:54:09 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 13:54:09 user nova-compute[72129]: INFO nova.compute.manager [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Took 7.23 seconds to spawn the instance on the hypervisor.
Aug 01 13:54:09 user nova-compute[72129]: DEBUG nova.compute.manager [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:54:09 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 13:54:09 user nova-compute[72129]: INFO nova.compute.manager [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Took 8.47 seconds to build instance.
Aug 01 13:54:09 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-61a3718c-8099-4654-a394-62334c04955c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.669s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:54:09 user nova-compute[72129]: DEBUG nova.compute.manager [req-8f3e100b-57a0-4801-8341-0fde2b776c25 req-40983530-0cdb-446d-a06b-c95d4c185aea service nova] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Received event volume-reimaged-5b0dd53d-1f22-4c51-adec-a83e1193589b {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:54:09 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-8f3e100b-57a0-4801-8341-0fde2b776c25 req-40983530-0cdb-446d-a06b-c95d4c185aea service nova] Acquiring lock "a07aaeaa-322d-419e-86f5-65cd448c39e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:54:09 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-8f3e100b-57a0-4801-8341-0fde2b776c25 req-40983530-0cdb-446d-a06b-c95d4c185aea service nova] Lock "a07aaeaa-322d-419e-86f5-65cd448c39e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:54:09 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-8f3e100b-57a0-4801-8341-0fde2b776c25 req-40983530-0cdb-446d-a06b-c95d4c185aea service nova] Lock "a07aaeaa-322d-419e-86f5-65cd448c39e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:54:09 user nova-compute[72129]: DEBUG nova.compute.manager [req-8f3e100b-57a0-4801-8341-0fde2b776c25 req-40983530-0cdb-446d-a06b-c95d4c185aea service nova] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Processing event volume-reimaged-5b0dd53d-1f22-4c51-adec-a83e1193589b {{(pid=72129) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Aug 01 13:54:09 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:54:09 user nova-compute[72129]: DEBUG nova.compute.manager [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Instance event wait completed in 17 seconds for volume-reimaged {{(pid=72129) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 13:54:09 user nova-compute[72129]: INFO nova.virt.block_device [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Booting with volume 5b0dd53d-1f22-4c51-adec-a83e1193589b at /dev/vda
Aug 01 13:54:09 user nova-compute[72129]: DEBUG os_brick.utils [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:54:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:54:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:54:09 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7fda0dc-1261-4e08-b192-439656cd11d2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f9b449c2cd3d\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:54:09 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:54:10 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:54:10 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:54:10 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[47324fa3-d6ca-4408-8f47-24e406ee71b8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:54:10 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:54:10 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:54:10 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3cc12f-52a5-4daa-b30d-27a1b290bdb1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:54:10 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f303da-40b8-40af-884b-24d09370f2b8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:54:10 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Running cmd (subprocess): nvme version {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:54:10 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] 'nvme version' failed. Not Retrying. {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 13:54:10 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] nvme not present on system {{(pid=72129) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 13:54:10 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:54:10 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 13:54:10 user nova-compute[72129]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 13:54:10 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba8f285-5e13-4550-b3bc-8301aebcc446]: (4, '') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:54:10 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72129) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 13:54:10 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 13:54:10 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] LIGHTOS: no hostnqn found. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 13:54:10 user nova-compute[72129]: DEBUG os_brick.utils [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f9b449c2cd3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:54:10 user nova-compute[72129]: DEBUG nova.virt.block_device [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Updating existing volume attachment record: 26c654f3-5de8-473f-9f17-fbc389d31172 {{(pid=72129) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 13:54:10 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:54:12 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5938e5dc-9a1f-4f51-aadf-1a60fd0cbf38 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Acquiring lock "33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:54:12 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5938e5dc-9a1f-4f51-aadf-1a60fd0cbf38 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Lock "33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:54:12 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5938e5dc-9a1f-4f51-aadf-1a60fd0cbf38 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Acquiring lock "33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:54:12 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5938e5dc-9a1f-4f51-aadf-1a60fd0cbf38 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Lock "33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:54:12 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5938e5dc-9a1f-4f51-aadf-1a60fd0cbf38 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Lock "33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:54:12 user nova-compute[72129]: INFO nova.compute.manager [None req-5938e5dc-9a1f-4f51-aadf-1a60fd0cbf38 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Terminating instance
Aug 01 13:54:12 user nova-compute[72129]: DEBUG nova.compute.manager [None req-5938e5dc-9a1f-4f51-aadf-1a60fd0cbf38 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Start destroying the instance on the hypervisor. {{(pid=72129) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 13:54:12 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:54:12 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:54:12 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:54:12 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:54:12 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:54:12 user nova-compute[72129]: DEBUG nova.compute.manager [req-4787849a-fcd0-4f5d-ae15-f06403e146e9 req-28ade617-037a-4ebb-8c50-c62fa8004c3e service nova] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Received event network-vif-unplugged-027152b9-a97b-4756-8618-25d27e5c6e2f {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:54:12 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-4787849a-fcd0-4f5d-ae15-f06403e146e9 req-28ade617-037a-4ebb-8c50-c62fa8004c3e service nova] Acquiring lock "33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:54:12 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-4787849a-fcd0-4f5d-ae15-f06403e146e9 req-28ade617-037a-4ebb-8c50-c62fa8004c3e service nova] Lock "33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:54:12 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-4787849a-fcd0-4f5d-ae15-f06403e146e9 req-28ade617-037a-4ebb-8c50-c62fa8004c3e service nova] Lock "33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:54:12 user nova-compute[72129]: DEBUG nova.compute.manager [req-4787849a-fcd0-4f5d-ae15-f06403e146e9 req-28ade617-037a-4ebb-8c50-c62fa8004c3e service nova] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] No waiting events found dispatching network-vif-unplugged-027152b9-a97b-4756-8618-25d27e5c6e2f {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:54:12 user nova-compute[72129]: DEBUG nova.compute.manager [req-4787849a-fcd0-4f5d-ae15-f06403e146e9 req-28ade617-037a-4ebb-8c50-c62fa8004c3e service nova] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Received event network-vif-unplugged-027152b9-a97b-4756-8618-25d27e5c6e2f for instance with task_state deleting. {{(pid=72129) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 13:54:13 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:54:13 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:54:13 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Instance destroyed successfully.
Aug 01 13:54:13 user nova-compute[72129]: DEBUG nova.objects.instance [None req-5938e5dc-9a1f-4f51-aadf-1a60fd0cbf38 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Lazy-loading 'resources' on Instance uuid 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:54:13 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-5938e5dc-9a1f-4f51-aadf-1a60fd0cbf38 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:50:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1580756567',display_name='tempest-TestVolumeSwap-server-1580756567',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1580756567',id=9,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIX0PncPB4iHhAad3IYIQknouaB0tnAE5SYwdpjCFrRabL2BxexYvgcMxJlpUohCkK82O1NsIeovqvUiwGSBwUqE8DB3wfsyroWfo3gDa558EY1DaPOlnlmtnrlUE8+VIg==',key_name='tempest-keypair-851366275',keypairs=<?>,launch_index=0,launched_at=2023-08-01T13:50:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a0177e373be24a209f050b7fd6cd646a',ramdisk_id='',reservation_id='r-wc0z4roe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-2086711919',owner_user_name='tempest-TestVolumeSwap-2086711919-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T13:50:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f1347c68080c4de88a24ee9058a2ddc2',uuid=33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "027152b9-a97b-4756-8618-25d27e5c6e2f", "address": "fa:16:3e:a2:d0:6d", "network": {"id": "934b1a56-2f37-418b-bce9-a6cdc8a2083b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1371342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0177e373be24a209f050b7fd6cd646a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap027152b9-a9", "ovs_interfaceid": "027152b9-a97b-4756-8618-25d27e5c6e2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 13:54:13 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-5938e5dc-9a1f-4f51-aadf-1a60fd0cbf38 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Converting VIF {"id": "027152b9-a97b-4756-8618-25d27e5c6e2f", "address": "fa:16:3e:a2:d0:6d", "network": {"id": "934b1a56-2f37-418b-bce9-a6cdc8a2083b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1371342-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0177e373be24a209f050b7fd6cd646a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap027152b9-a9", "ovs_interfaceid": "027152b9-a97b-4756-8618-25d27e5c6e2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:54:13 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-5938e5dc-9a1f-4f51-aadf-1a60fd0cbf38 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a2:d0:6d,bridge_name='br-int',has_traffic_filtering=True,id=027152b9-a97b-4756-8618-25d27e5c6e2f,network=Network(934b1a56-2f37-418b-bce9-a6cdc8a2083b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap027152b9-a9') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:54:13 user nova-compute[72129]: DEBUG os_vif [None req-5938e5dc-9a1f-4f51-aadf-1a60fd0cbf38 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:d0:6d,bridge_name='br-int',has_traffic_filtering=True,id=027152b9-a97b-4756-8618-25d27e5c6e2f,network=Network(934b1a56-2f37-418b-bce9-a6cdc8a2083b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap027152b9-a9') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 13:54:13 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:54:13 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap027152b9-a9, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:54:13 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:54:13 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 13:54:13 user nova-compute[72129]: INFO os_vif [None req-5938e5dc-9a1f-4f51-aadf-1a60fd0cbf38 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:d0:6d,bridge_name='br-int',has_traffic_filtering=True,id=027152b9-a97b-4756-8618-25d27e5c6e2f,network=Network(934b1a56-2f37-418b-bce9-a6cdc8a2083b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap027152b9-a9')
Aug 01 13:54:13 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-5938e5dc-9a1f-4f51-aadf-1a60fd0cbf38 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Deleting instance files /opt/stack/data/nova/instances/33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0_del
Aug 01 13:54:13 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-5938e5dc-9a1f-4f51-aadf-1a60fd0cbf38 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Deletion of /opt/stack/data/nova/instances/33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0_del complete
Aug 01 13:54:13 user nova-compute[72129]: INFO nova.compute.manager [None req-5938e5dc-9a1f-4f51-aadf-1a60fd0cbf38 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Took 0.97 seconds to destroy the instance on the hypervisor.
Aug 01 13:54:13 user nova-compute[72129]: DEBUG oslo.service.loopingcall [None req-5938e5dc-9a1f-4f51-aadf-1a60fd0cbf38 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72129) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 13:54:13 user nova-compute[72129]: DEBUG nova.compute.manager [-] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Deallocating network for instance {{(pid=72129) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 13:54:13 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] deallocate_for_instance() {{(pid=72129) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 13:54:13 user nova-compute[72129]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690898038.8726795, 2efa87a6-1dd6-4441-a55e-8e86be7f0a35 => Stopped> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:54:13 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] VM Stopped (Lifecycle Event)
Aug 01 13:54:13 user nova-compute[72129]: DEBUG nova.compute.manager [None req-4ca816ec-7780-4813-8fd8-015e5c8573af None None] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:54:13 user nova-compute[72129]: DEBUG nova.compute.manager [None req-4ca816ec-7780-4813-8fd8-015e5c8573af None None] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 13:54:13 user nova-compute[72129]: INFO nova.compute.manager [None req-4ca816ec-7780-4813-8fd8-015e5c8573af None None] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 01 13:54:14 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:54:14 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Took 1.19 seconds to deallocate network for instance.
Aug 01 13:54:14 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Starting finish_migration {{(pid=72129) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 01 13:54:14 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Instance directory exists: not creating {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 01 13:54:14 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Creating image(s)
Aug 01 13:54:14 user nova-compute[72129]: DEBUG nova.objects.instance [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2efa87a6-1dd6-4441-a55e-8e86be7f0a35 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:54:14 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5938e5dc-9a1f-4f51-aadf-1a60fd0cbf38 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:54:14 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5938e5dc-9a1f-4f51-aadf-1a60fd0cbf38 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:54:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.142s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2efa87a6-1dd6-4441-a55e-8e86be7f0a35/disk. size=21474836480 {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efa87a6-1dd6-4441-a55e-8e86be7f0a35/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG nova.compute.manager [req-a6312b76-66b6-4f27-b753-47452723fa9b req-f8469989-15cb-44fa-a502-8ec61171b1aa service nova] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Received event network-vif-plugged-027152b9-a97b-4756-8618-25d27e5c6e2f {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-a6312b76-66b6-4f27-b753-47452723fa9b req-f8469989-15cb-44fa-a502-8ec61171b1aa service nova] Acquiring lock "33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-a6312b76-66b6-4f27-b753-47452723fa9b req-f8469989-15cb-44fa-a502-8ec61171b1aa service nova] Lock "33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-a6312b76-66b6-4f27-b753-47452723fa9b req-f8469989-15cb-44fa-a502-8ec61171b1aa service nova] Lock "33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG nova.compute.manager [req-a6312b76-66b6-4f27-b753-47452723fa9b req-f8469989-15cb-44fa-a502-8ec61171b1aa service nova] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] No waiting events found dispatching network-vif-plugged-027152b9-a97b-4756-8618-25d27e5c6e2f {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:54:15 user nova-compute[72129]: WARNING nova.compute.manager [req-a6312b76-66b6-4f27-b753-47452723fa9b req-f8469989-15cb-44fa-a502-8ec61171b1aa service nova] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Received unexpected event network-vif-plugged-027152b9-a97b-4756-8618-25d27e5c6e2f for instance with vm_state deleted and task_state None.
Aug 01 13:54:15 user nova-compute[72129]: DEBUG nova.compute.manager [req-a6312b76-66b6-4f27-b753-47452723fa9b req-f8469989-15cb-44fa-a502-8ec61171b1aa service nova] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Received event network-vif-deleted-027152b9-a97b-4756-8618-25d27e5c6e2f {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efa87a6-1dd6-4441-a55e-8e86be7f0a35/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/2efa87a6-1dd6-4441-a55e-8e86be7f0a35/disk 21474836480 {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/2efa87a6-1dd6-4441-a55e-8e86be7f0a35/disk 21474836480" returned: 0 in 0.047s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Did not create local disks {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Ensure instance console log exists: /opt/stack/data/nova/instances/2efa87a6-1dd6-4441-a55e-8e86be7f0a35/console.log {{(pid=72129) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Start _get_guest_xml network_info=[{"id": "d59c6949-2748-4a57-b089-6219f9102815", "address": "fa:16:3e:20:eb:cf", "network": {"id": "4de0d3ee-7981-427b-9013-99cf0bc22cf8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-289359635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-289359635-network", "vif_mac": "fa:16:3e:20:eb:cf"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d693a983e4a44434b64c7983239371a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd59c6949-27", "ovs_interfaceid": "d59c6949-2748-4a57-b089-6219f9102815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'image_id': 'b6472c34-1b0f-4034-ba3a-7e8eb5103715'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'attachment_id': '631c4115-a469-4dae-a9d7-d31a5c10d0c6', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gmPMFjbA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '2efa87a6-1dd6-4441-a55e-8e86be7f0a35', 'attached_at': '2023-08-01T13:54:15.000000', 'detached_at': '', 'volume_id': '4abb01c8-017a-4ccc-a2dd-024a94775c17', 'serial': '4abb01c8-017a-4ccc-a2dd-024a94775c17'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 13:54:15 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:54:15 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:54:15 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] CPU controller missing on host. {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] CPU controller found on host. {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72129) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T13:45:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Flavor limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Image limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Flavor pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Image pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Got 1 possible topologies {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG nova.objects.instance [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2efa87a6-1dd6-4441-a55e-8e86be7f0a35 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-5938e5dc-9a1f-4f51-aadf-1a60fd0cbf38 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Calling os-brick to attach iSCSI Volume {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gmPMFjbA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:54:15 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 13:54:15 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:54:15 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 13:54:15 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:54:15 user nova-compute[72129]: INFO os_brick.initiator.connectors.iscsi [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 13:54:15 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-5938e5dc-9a1f-4f51-aadf-1a60fd0cbf38 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 -p 172.16.0.220:3260 {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac44edb8-3244-4f69-bf7e-a848a509b224]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 13:54:15 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 -p 172.16.0.220:3260 --interface default --op new {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5938e5dc-9a1f-4f51-aadf-1a60fd0cbf38 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.601s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[65cfe184-c0f6-40cc-9e40-2b0e4250e7f9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17] added\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17] added
Aug 01 13:54:15 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[28859be8-adb3-4ace-9c94-bdf0417777fd]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:54:15 user nova-compute[72129]: INFO nova.scheduler.client.report [None req-5938e5dc-9a1f-4f51-aadf-1a60fd0cbf38 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Deleted allocations for instance 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0
Aug 01 13:54:15 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57f7fef-60dd-47f7-aea7-b7e3bd1a687b]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gmPMFjbA {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gmPMFjbA" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c0be0d-1105-4a65-948e-25fb2866d222]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gmPMFjbA'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf3024f-a5e4-4a4e-8e68-1621930cbf27]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.025s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab5a34c9-957f-47fe-98c9-d5bebddc62d4]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 13:54:15 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 13:54:15 user nova-compute[72129]:  {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:54:15 user nova-compute[72129]: WARNING os_brick.initiator.connectors.iscsi [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 13:54:15 user nova-compute[72129]: 
Aug 01 13:54:15 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 -p 172.16.0.220:3260 --login {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5938e5dc-9a1f-4f51-aadf-1a60fd0cbf38 tempest-TestVolumeSwap-2086711919 tempest-TestVolumeSwap-2086711919-project-member] Lock "33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.986s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b58eb3e-f465-4729-9739-2a53ce099c6e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17, portal: 172.16.0.220,3260]
Aug 01 13:54:15 user nova-compute[72129]: Login to [iface: default, target: iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17, portal: 172.16.0.220,3260] successful.
Aug 01 13:54:15 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed676e92-c75a-4050-a420-1ee6fca6641f]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d8765d9-5ac7-4358-ab7d-81b8bf241367]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)
Aug 01 13:54:15 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)
Aug 01 13:54:15 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Connected to 172.16.0.220:3260 {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] HCTL ('33', '-', '-', 0) found on session 18 with lun 0 {{(pid=72129) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72129) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8b7a1a-fd3d-40a0-a0f6-7c30a153a042]: (4, ('- - 0', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:54:15 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: None {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 13:54:16 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 13:54:16 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gmPMFjbA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 13:54:16 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:54:16 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '23463373065393332', 'path': '/dev/sdb'} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:54:16 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23463373065393332', 'path': '/dev/sdb'} {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 13:54:16 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:49:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1892996256',display_name='tempest-ServerActionsTestOtherB-server-1892996256',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1892996256',id=3,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEv1XQzBjYoYpbhYYzAkxCcHUbemRkkK9uL3KJrV3p8Too9wSnun/4eb7cYSvdSK/lx7EWwYazfwFvI3n8xQWjsYEP2mWFNbGfwKAUlfbILCQIuiMev2z7hB1YDNH/wWXQ==',key_name='tempest-keypair-539050345',keypairs=<?>,launch_index=0,launched_at=2023-08-01T13:50:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d693a983e4a44434b64c7983239371a4',ramdisk_id='',reservation_id='r-ghzodbos',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-398231514',owner_user_name='tempest-ServerActionsTestOtherB-398231514-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:54:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1936f560fd794910af1fa6e9c4fffa90',uuid=2efa87a6-1dd6-4441-a55e-8e86be7f0a35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d59c6949-2748-4a57-b089-6219f9102815", "address": "fa:16:3e:20:eb:cf", "network": {"id": "4de0d3ee-7981-427b-9013-99cf0bc22cf8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-289359635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-289359635-network", "vif_mac": "fa:16:3e:20:eb:cf"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d693a983e4a44434b64c7983239371a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd59c6949-27", "ovs_interfaceid": "d59c6949-2748-4a57-b089-6219f9102815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 13:54:16 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Converting VIF {"id": "d59c6949-2748-4a57-b089-6219f9102815", "address": "fa:16:3e:20:eb:cf", "network": {"id": "4de0d3ee-7981-427b-9013-99cf0bc22cf8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-289359635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-289359635-network", "vif_mac": "fa:16:3e:20:eb:cf"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d693a983e4a44434b64c7983239371a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd59c6949-27", "ovs_interfaceid": "d59c6949-2748-4a57-b089-6219f9102815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:54:16 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:eb:cf,bridge_name='br-int',has_traffic_filtering=True,id=d59c6949-2748-4a57-b089-6219f9102815,network=Network(4de0d3ee-7981-427b-9013-99cf0bc22cf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd59c6949-27') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:54:16 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] End _get_guest_xml xml=<domain type="kvm">
Aug 01 13:54:16 user nova-compute[72129]:   <uuid>2efa87a6-1dd6-4441-a55e-8e86be7f0a35</uuid>
Aug 01 13:54:16 user nova-compute[72129]:   <name>instance-00000003</name>
Aug 01 13:54:16 user nova-compute[72129]:   <memory>2097152</memory>
Aug 01 13:54:16 user nova-compute[72129]:   <vcpu>1</vcpu>
Aug 01 13:54:16 user nova-compute[72129]:   <metadata>
Aug 01 13:54:16 user nova-compute[72129]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 13:54:16 user nova-compute[72129]:       <nova:package version="0.0.0"/>
Aug 01 13:54:16 user nova-compute[72129]:       <nova:name>tempest-ServerActionsTestOtherB-server-1892996256</nova:name>
Aug 01 13:54:16 user nova-compute[72129]:       <nova:creationTime>2023-08-01 13:54:15</nova:creationTime>
Aug 01 13:54:16 user nova-compute[72129]:       <nova:flavor name="m1.small">
Aug 01 13:54:16 user nova-compute[72129]:         <nova:memory>2048</nova:memory>
Aug 01 13:54:16 user nova-compute[72129]:         <nova:disk>20</nova:disk>
Aug 01 13:54:16 user nova-compute[72129]:         <nova:swap>0</nova:swap>
Aug 01 13:54:16 user nova-compute[72129]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 13:54:16 user nova-compute[72129]:         <nova:vcpus>1</nova:vcpus>
Aug 01 13:54:16 user nova-compute[72129]:       </nova:flavor>
Aug 01 13:54:16 user nova-compute[72129]:       <nova:owner>
Aug 01 13:54:16 user nova-compute[72129]:         <nova:user uuid="1936f560fd794910af1fa6e9c4fffa90">tempest-ServerActionsTestOtherB-398231514-project-member</nova:user>
Aug 01 13:54:16 user nova-compute[72129]:         <nova:project uuid="d693a983e4a44434b64c7983239371a4">tempest-ServerActionsTestOtherB-398231514</nova:project>
Aug 01 13:54:16 user nova-compute[72129]:       </nova:owner>
Aug 01 13:54:16 user nova-compute[72129]:       <nova:root type="image" uuid="b6472c34-1b0f-4034-ba3a-7e8eb5103715"/>
Aug 01 13:54:16 user nova-compute[72129]:       <nova:ports>
Aug 01 13:54:16 user nova-compute[72129]:         <nova:port uuid="d59c6949-2748-4a57-b089-6219f9102815">
Aug 01 13:54:16 user nova-compute[72129]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 01 13:54:16 user nova-compute[72129]:         </nova:port>
Aug 01 13:54:16 user nova-compute[72129]:       </nova:ports>
Aug 01 13:54:16 user nova-compute[72129]:     </nova:instance>
Aug 01 13:54:16 user nova-compute[72129]:   </metadata>
Aug 01 13:54:16 user nova-compute[72129]:   <sysinfo type="smbios">
Aug 01 13:54:16 user nova-compute[72129]:     <system>
Aug 01 13:54:16 user nova-compute[72129]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 13:54:16 user nova-compute[72129]:       <entry name="product">OpenStack Nova</entry>
Aug 01 13:54:16 user nova-compute[72129]:       <entry name="version">0.0.0</entry>
Aug 01 13:54:16 user nova-compute[72129]:       <entry name="serial">2efa87a6-1dd6-4441-a55e-8e86be7f0a35</entry>
Aug 01 13:54:16 user nova-compute[72129]:       <entry name="uuid">2efa87a6-1dd6-4441-a55e-8e86be7f0a35</entry>
Aug 01 13:54:16 user nova-compute[72129]:       <entry name="family">Virtual Machine</entry>
Aug 01 13:54:16 user nova-compute[72129]:     </system>
Aug 01 13:54:16 user nova-compute[72129]:   </sysinfo>
Aug 01 13:54:16 user nova-compute[72129]:   <os>
Aug 01 13:54:16 user nova-compute[72129]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 13:54:16 user nova-compute[72129]:     <boot dev="hd"/>
Aug 01 13:54:16 user nova-compute[72129]:     <smbios mode="sysinfo"/>
Aug 01 13:54:16 user nova-compute[72129]:   </os>
Aug 01 13:54:16 user nova-compute[72129]:   <features>
Aug 01 13:54:16 user nova-compute[72129]:     <acpi/>
Aug 01 13:54:16 user nova-compute[72129]:     <apic/>
Aug 01 13:54:16 user nova-compute[72129]:     <vmcoreinfo/>
Aug 01 13:54:16 user nova-compute[72129]:   </features>
Aug 01 13:54:16 user nova-compute[72129]:   <clock offset="utc">
Aug 01 13:54:16 user nova-compute[72129]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 13:54:16 user nova-compute[72129]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 13:54:16 user nova-compute[72129]:     <timer name="hpet" present="no"/>
Aug 01 13:54:16 user nova-compute[72129]:   </clock>
Aug 01 13:54:16 user nova-compute[72129]:   <cpu mode="custom" match="exact">
Aug 01 13:54:16 user nova-compute[72129]:     <model>Nehalem</model>
Aug 01 13:54:16 user nova-compute[72129]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 13:54:16 user nova-compute[72129]:   </cpu>
Aug 01 13:54:16 user nova-compute[72129]:   <devices>
Aug 01 13:54:16 user nova-compute[72129]:     <disk type="file" device="disk">
Aug 01 13:54:16 user nova-compute[72129]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 13:54:16 user nova-compute[72129]:       <source file="/opt/stack/data/nova/instances/2efa87a6-1dd6-4441-a55e-8e86be7f0a35/disk"/>
Aug 01 13:54:16 user nova-compute[72129]:       <target dev="vda" bus="virtio"/>
Aug 01 13:54:16 user nova-compute[72129]:     </disk>
Aug 01 13:54:16 user nova-compute[72129]:     <disk type="block" device="disk">
Aug 01 13:54:16 user nova-compute[72129]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 13:54:16 user nova-compute[72129]:       <source dev="/dev/sdb"/>
Aug 01 13:54:16 user nova-compute[72129]:       <target dev="vdb" bus="virtio"/>
Aug 01 13:54:16 user nova-compute[72129]:       <serial>4abb01c8-017a-4ccc-a2dd-024a94775c17</serial>
Aug 01 13:54:16 user nova-compute[72129]:     </disk>
Aug 01 13:54:16 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 13:54:16 user nova-compute[72129]:       <mac address="fa:16:3e:20:eb:cf"/>
Aug 01 13:54:16 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 13:54:16 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 13:54:16 user nova-compute[72129]:       <target dev="tapd59c6949-27"/>
Aug 01 13:54:16 user nova-compute[72129]:     </interface>
Aug 01 13:54:16 user nova-compute[72129]:     <serial type="pty">
Aug 01 13:54:16 user nova-compute[72129]:       <log file="/opt/stack/data/nova/instances/2efa87a6-1dd6-4441-a55e-8e86be7f0a35/console.log" append="off"/>
Aug 01 13:54:16 user nova-compute[72129]:     </serial>
Aug 01 13:54:16 user nova-compute[72129]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 13:54:16 user nova-compute[72129]:     <video>
Aug 01 13:54:16 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 13:54:16 user nova-compute[72129]:     </video>
Aug 01 13:54:16 user nova-compute[72129]:     <rng model="virtio">
Aug 01 13:54:16 user nova-compute[72129]:       <backend model="random">/dev/urandom</backend>
Aug 01 13:54:16 user nova-compute[72129]:     </rng>
Aug 01 13:54:16 user nova-compute[72129]:     <controller type="usb" index="0" model="none"/>
Aug 01 13:54:16 user nova-compute[72129]:     <memballoon model="virtio">
Aug 01 13:54:16 user nova-compute[72129]:       <stats period="10"/>
Aug 01 13:54:16 user nova-compute[72129]:     </memballoon>
Aug 01 13:54:16 user nova-compute[72129]:   </devices>
Aug 01 13:54:16 user nova-compute[72129]: </domain>
Aug 01 13:54:16 user nova-compute[72129]:  {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 13:54:16 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:49:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1892996256',display_name='tempest-ServerActionsTestOtherB-server-1892996256',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1892996256',id=3,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEv1XQzBjYoYpbhYYzAkxCcHUbemRkkK9uL3KJrV3p8Too9wSnun/4eb7cYSvdSK/lx7EWwYazfwFvI3n8xQWjsYEP2mWFNbGfwKAUlfbILCQIuiMev2z7hB1YDNH/wWXQ==',key_name='tempest-keypair-539050345',keypairs=<?>,launch_index=0,launched_at=2023-08-01T13:50:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d693a983e4a44434b64c7983239371a4',ramdisk_id='',reservation_id='r-ghzodbos',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-398231514',owner_user_name='tempest-ServerActionsTestOtherB-398231514-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:54:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1936f560fd794910af1fa6e9c4fffa90',uuid=2efa87a6-1dd6-4441-a55e-8e86be7f0a35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d59c6949-2748-4a57-b089-6219f9102815", "address": "fa:16:3e:20:eb:cf", "network": {"id": "4de0d3ee-7981-427b-9013-99cf0bc22cf8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-289359635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-289359635-network", "vif_mac": "fa:16:3e:20:eb:cf"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d693a983e4a44434b64c7983239371a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd59c6949-27", "ovs_interfaceid": "d59c6949-2748-4a57-b089-6219f9102815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 13:54:16 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Converting VIF {"id": "d59c6949-2748-4a57-b089-6219f9102815", "address": "fa:16:3e:20:eb:cf", "network": {"id": "4de0d3ee-7981-427b-9013-99cf0bc22cf8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-289359635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-289359635-network", "vif_mac": "fa:16:3e:20:eb:cf"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d693a983e4a44434b64c7983239371a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd59c6949-27", "ovs_interfaceid": "d59c6949-2748-4a57-b089-6219f9102815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:54:16 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:eb:cf,bridge_name='br-int',has_traffic_filtering=True,id=d59c6949-2748-4a57-b089-6219f9102815,network=Network(4de0d3ee-7981-427b-9013-99cf0bc22cf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd59c6949-27') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:54:16 user nova-compute[72129]: DEBUG os_vif [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:eb:cf,bridge_name='br-int',has_traffic_filtering=True,id=d59c6949-2748-4a57-b089-6219f9102815,network=Network(4de0d3ee-7981-427b-9013-99cf0bc22cf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd59c6949-27') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 13:54:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:54:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:54:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 13:54:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:54:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd59c6949-27, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:54:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd59c6949-27, col_values=(('external_ids', {'iface-id': 'd59c6949-2748-4a57-b089-6219f9102815', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:eb:cf', 'vm-uuid': '2efa87a6-1dd6-4441-a55e-8e86be7f0a35'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:54:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:54:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 13:54:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:54:16 user nova-compute[72129]: INFO os_vif [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:eb:cf,bridge_name='br-int',has_traffic_filtering=True,id=d59c6949-2748-4a57-b089-6219f9102815,network=Network(4de0d3ee-7981-427b-9013-99cf0bc22cf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd59c6949-27')
Aug 01 13:54:16 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 13:54:16 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 13:54:16 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] No VIF found with MAC fa:16:3e:20:eb:cf, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 13:54:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:54:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:54:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:54:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:54:18 user nova-compute[72129]: DEBUG nova.compute.manager [req-7e4c5308-91c1-4ac3-b45c-0b1409775bcc req-b82bf137-314b-4695-a254-0a9c087d5c23 service nova] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Received event network-vif-plugged-d59c6949-2748-4a57-b089-6219f9102815 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:54:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-7e4c5308-91c1-4ac3-b45c-0b1409775bcc req-b82bf137-314b-4695-a254-0a9c087d5c23 service nova] Acquiring lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:54:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-7e4c5308-91c1-4ac3-b45c-0b1409775bcc req-b82bf137-314b-4695-a254-0a9c087d5c23 service nova] Lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:54:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-7e4c5308-91c1-4ac3-b45c-0b1409775bcc req-b82bf137-314b-4695-a254-0a9c087d5c23 service nova] Lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:54:18 user nova-compute[72129]: DEBUG nova.compute.manager [req-7e4c5308-91c1-4ac3-b45c-0b1409775bcc req-b82bf137-314b-4695-a254-0a9c087d5c23 service nova] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] No waiting events found dispatching network-vif-plugged-d59c6949-2748-4a57-b089-6219f9102815 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:54:18 user nova-compute[72129]: WARNING nova.compute.manager [req-7e4c5308-91c1-4ac3-b45c-0b1409775bcc req-b82bf137-314b-4695-a254-0a9c087d5c23 service nova] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Received unexpected event network-vif-plugged-d59c6949-2748-4a57-b089-6219f9102815 for instance with vm_state active and task_state resize_finish.
Aug 01 13:54:19 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Creating instance directory {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 13:54:19 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Creating image(s)
Aug 01 13:54:19 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Did not create local disks {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Ensure instance console log exists: /opt/stack/data/nova/instances/a07aaeaa-322d-419e-86f5-65cd448c39e7/console.log {{(pid=72129) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Start _get_guest_xml network_info=[{"id": "f3403639-00ba-4c7c-983a-7995f60f2519", "address": "fa:16:3e:4b:01:bd", "network": {"id": "2338fb81-87b6-4976-a6ab-b4ea0218fa9b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-606840206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebef26e9d3654bf99ecf391ccb263330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3403639-00", "ovs_interfaceid": "f3403639-00ba-4c7c-983a-7995f60f2519", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '26c654f3-5de8-473f-9f17-fbc389d31172', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gilTSBJb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a07aaeaa-322d-419e-86f5-65cd448c39e7', 'attached_at': '', 'detached_at': '', 'volume_id': '5b0dd53d-1f22-4c51-adec-a83e1193589b', 'serial': '5b0dd53d-1f22-4c51-adec-a83e1193589b'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 13:54:19 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 01 13:54:19 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 01 13:54:19 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] CPU controller missing on host. {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] CPU controller found on host. {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72129) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T13:45:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Flavor limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Image limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Flavor pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Image pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Got 1 possible topologies {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG nova.objects.instance [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Lazy-loading 'vcpu_model' on Instance uuid a07aaeaa-322d-419e-86f5-65cd448c39e7 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Calling os-brick to attach iSCSI Volume {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gilTSBJb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:54:19 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 01 13:54:19 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:54:19 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 01 13:54:19 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:54:19 user nova-compute[72129]: INFO os_brick.initiator.connectors.iscsi [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 13:54:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b -p 172.16.0.220:3260 {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b1f00d-72dd-4abd-adbe-67ddd155848d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 13:54:19 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b -p 172.16.0.220:3260 --interface default --op new {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eedacd1-05fc-490c-8865-71f4865b13af]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b] added\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b] added
Aug 01 13:54:19 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[6921c743-7993-4b2c-9b1b-10e76218ea48]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1078be9-02ed-4c0a-82a4-fa30b1f85972]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gilTSBJb {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gilTSBJb" returned: 0 in 0.026s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[550c0ebd-595c-4144-ac57-80319f8982c3]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gilTSBJb'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede10c47-75e8-483f-95b3-db4aedf02059]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa97b6e-cd3a-44d8-a863-19ec5f02a9c6]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)
Aug 01 13:54:19 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)
Aug 01 13:54:19 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b -p 172.16.0.220:3260 --login {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[46283e55-e187-42dd-90de-68d164ff3b43]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b, portal: 172.16.0.220,3260]
Aug 01 13:54:19 user nova-compute[72129]: Login to [iface: default, target: iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b, portal: 172.16.0.220,3260] successful.
Aug 01 13:54:19 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77a431c-3636-40b6-8e1b-4cd132f88d38]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[bade89a3-ebd8-4ea8-98cb-f12e37819884]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)
Aug 01 13:54:19 user nova-compute[72129]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)
Aug 01 13:54:19 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)
Aug 01 13:54:19 user nova-compute[72129]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)
Aug 01 13:54:19 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Connected to 172.16.0.220:3260 {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] HCTL ('34', '-', '-', 0) found on session 19 with lun 0 {{(pid=72129) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72129) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eee6e6d-2d75-4056-8cb1-070707131f2c]: (4, ('- - 0', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Searching for a device in session 19 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 13:54:19 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gilTSBJb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 13:54:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:54:20 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:54:20 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '26164333761333862', 'path': '/dev/sdc'} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:54:20 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26164333761333862', 'path': '/dev/sdc'} {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 13:54:20 user nova-compute[72129]: DEBUG nova.compute.manager [req-f4449030-4901-4eff-ad2b-022602482b75 req-bfdc0ede-76f8-4f86-b23a-d60e1d843d5d service nova] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Received event network-vif-plugged-d59c6949-2748-4a57-b089-6219f9102815 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:54:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f4449030-4901-4eff-ad2b-022602482b75 req-bfdc0ede-76f8-4f86-b23a-d60e1d843d5d service nova] Acquiring lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:54:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f4449030-4901-4eff-ad2b-022602482b75 req-bfdc0ede-76f8-4f86-b23a-d60e1d843d5d service nova] Lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:54:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f4449030-4901-4eff-ad2b-022602482b75 req-bfdc0ede-76f8-4f86-b23a-d60e1d843d5d service nova] Lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:54:20 user nova-compute[72129]: DEBUG nova.compute.manager [req-f4449030-4901-4eff-ad2b-022602482b75 req-bfdc0ede-76f8-4f86-b23a-d60e1d843d5d service nova] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] No waiting events found dispatching network-vif-plugged-d59c6949-2748-4a57-b089-6219f9102815 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:54:20 user nova-compute[72129]: WARNING nova.compute.manager [req-f4449030-4901-4eff-ad2b-022602482b75 req-bfdc0ede-76f8-4f86-b23a-d60e1d843d5d service nova] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Received unexpected event network-vif-plugged-d59c6949-2748-4a57-b089-6219f9102815 for instance with vm_state active and task_state resize_finish.
Aug 01 13:54:20 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T13:51:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2145562199',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-582848887',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHP4lq6QUMPS3pezcVQZPAh44QK9Cjc2FafAnYqVVnXmR/G2I0IR/iHbmL/nrBBWAYHzkIVIbYY+6AfkD3E0LtsteDcaYMG5TC80GmI1zAMDyri/eMn3gWGPdMZtuTTfcw==',key_name='tempest-keypair-1869868466',keypairs=<?>,launch_index=0,launched_at=2023-08-01T13:52:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ebef26e9d3654bf99ecf391ccb263330',ramdisk_id='',reservation_id='r-mcwbm2vy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1852542004',owner_user_name='tempest-ServerActionsV293TestJSON-1852542004-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:54:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37e6bf606d3041d9928c5e5d6f4a9063',uuid=a07aaeaa-322d-419e-86f5-65cd448c39e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f3403639-00ba-4c7c-983a-7995f60f2519", "address": "fa:16:3e:4b:01:bd", "network": {"id": "2338fb81-87b6-4976-a6ab-b4ea0218fa9b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-606840206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebef26e9d3654bf99ecf391ccb263330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3403639-00", "ovs_interfaceid": "f3403639-00ba-4c7c-983a-7995f60f2519", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 13:54:20 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Converting VIF {"id": "f3403639-00ba-4c7c-983a-7995f60f2519", "address": "fa:16:3e:4b:01:bd", "network": {"id": "2338fb81-87b6-4976-a6ab-b4ea0218fa9b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-606840206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebef26e9d3654bf99ecf391ccb263330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3403639-00", "ovs_interfaceid": "f3403639-00ba-4c7c-983a-7995f60f2519", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:54:20 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4b:01:bd,bridge_name='br-int',has_traffic_filtering=True,id=f3403639-00ba-4c7c-983a-7995f60f2519,network=Network(2338fb81-87b6-4976-a6ab-b4ea0218fa9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3403639-00') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:54:20 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] End _get_guest_xml xml=<domain type="kvm">
Aug 01 13:54:20 user nova-compute[72129]:   <uuid>a07aaeaa-322d-419e-86f5-65cd448c39e7</uuid>
Aug 01 13:54:20 user nova-compute[72129]:   <name>instance-0000000d</name>
Aug 01 13:54:20 user nova-compute[72129]:   <memory>524288</memory>
Aug 01 13:54:20 user nova-compute[72129]:   <vcpu>1</vcpu>
Aug 01 13:54:20 user nova-compute[72129]:   <metadata>
Aug 01 13:54:20 user nova-compute[72129]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 13:54:20 user nova-compute[72129]:       <nova:package version="0.0.0"/>
Aug 01 13:54:20 user nova-compute[72129]:       <nova:name>tempest-ServerActionsV293TestJSON-server-2145562199</nova:name>
Aug 01 13:54:20 user nova-compute[72129]:       <nova:creationTime>2023-08-01 13:54:19</nova:creationTime>
Aug 01 13:54:20 user nova-compute[72129]:       <nova:flavor name="m1.tiny">
Aug 01 13:54:20 user nova-compute[72129]:         <nova:memory>512</nova:memory>
Aug 01 13:54:20 user nova-compute[72129]:         <nova:disk>1</nova:disk>
Aug 01 13:54:20 user nova-compute[72129]:         <nova:swap>0</nova:swap>
Aug 01 13:54:20 user nova-compute[72129]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 13:54:20 user nova-compute[72129]:         <nova:vcpus>1</nova:vcpus>
Aug 01 13:54:20 user nova-compute[72129]:       </nova:flavor>
Aug 01 13:54:20 user nova-compute[72129]:       <nova:owner>
Aug 01 13:54:20 user nova-compute[72129]:         <nova:user uuid="37e6bf606d3041d9928c5e5d6f4a9063">tempest-ServerActionsV293TestJSON-1852542004-project-member</nova:user>
Aug 01 13:54:20 user nova-compute[72129]:         <nova:project uuid="ebef26e9d3654bf99ecf391ccb263330">tempest-ServerActionsV293TestJSON-1852542004</nova:project>
Aug 01 13:54:20 user nova-compute[72129]:       </nova:owner>
Aug 01 13:54:20 user nova-compute[72129]:       <nova:ports>
Aug 01 13:54:20 user nova-compute[72129]:         <nova:port uuid="f3403639-00ba-4c7c-983a-7995f60f2519">
Aug 01 13:54:20 user nova-compute[72129]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 01 13:54:20 user nova-compute[72129]:         </nova:port>
Aug 01 13:54:20 user nova-compute[72129]:       </nova:ports>
Aug 01 13:54:20 user nova-compute[72129]:     </nova:instance>
Aug 01 13:54:20 user nova-compute[72129]:   </metadata>
Aug 01 13:54:20 user nova-compute[72129]:   <sysinfo type="smbios">
Aug 01 13:54:20 user nova-compute[72129]:     <system>
Aug 01 13:54:20 user nova-compute[72129]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 13:54:20 user nova-compute[72129]:       <entry name="product">OpenStack Nova</entry>
Aug 01 13:54:20 user nova-compute[72129]:       <entry name="version">0.0.0</entry>
Aug 01 13:54:20 user nova-compute[72129]:       <entry name="serial">a07aaeaa-322d-419e-86f5-65cd448c39e7</entry>
Aug 01 13:54:20 user nova-compute[72129]:       <entry name="uuid">a07aaeaa-322d-419e-86f5-65cd448c39e7</entry>
Aug 01 13:54:20 user nova-compute[72129]:       <entry name="family">Virtual Machine</entry>
Aug 01 13:54:20 user nova-compute[72129]:     </system>
Aug 01 13:54:20 user nova-compute[72129]:   </sysinfo>
Aug 01 13:54:20 user nova-compute[72129]:   <os>
Aug 01 13:54:20 user nova-compute[72129]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 13:54:20 user nova-compute[72129]:     <boot dev="hd"/>
Aug 01 13:54:20 user nova-compute[72129]:     <smbios mode="sysinfo"/>
Aug 01 13:54:20 user nova-compute[72129]:   </os>
Aug 01 13:54:20 user nova-compute[72129]:   <features>
Aug 01 13:54:20 user nova-compute[72129]:     <acpi/>
Aug 01 13:54:20 user nova-compute[72129]:     <apic/>
Aug 01 13:54:20 user nova-compute[72129]:     <vmcoreinfo/>
Aug 01 13:54:20 user nova-compute[72129]:   </features>
Aug 01 13:54:20 user nova-compute[72129]:   <clock offset="utc">
Aug 01 13:54:20 user nova-compute[72129]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 13:54:20 user nova-compute[72129]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 13:54:20 user nova-compute[72129]:     <timer name="hpet" present="no"/>
Aug 01 13:54:20 user nova-compute[72129]:   </clock>
Aug 01 13:54:20 user nova-compute[72129]:   <cpu mode="custom" match="exact">
Aug 01 13:54:20 user nova-compute[72129]:     <model>Nehalem</model>
Aug 01 13:54:20 user nova-compute[72129]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 13:54:20 user nova-compute[72129]:   </cpu>
Aug 01 13:54:20 user nova-compute[72129]:   <devices>
Aug 01 13:54:20 user nova-compute[72129]:     <disk type="block" device="disk">
Aug 01 13:54:20 user nova-compute[72129]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 13:54:20 user nova-compute[72129]:       <source dev="/dev/sdc"/>
Aug 01 13:54:20 user nova-compute[72129]:       <target dev="vda" bus="virtio"/>
Aug 01 13:54:20 user nova-compute[72129]:       <serial>5b0dd53d-1f22-4c51-adec-a83e1193589b</serial>
Aug 01 13:54:20 user nova-compute[72129]:     </disk>
Aug 01 13:54:20 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 13:54:20 user nova-compute[72129]:       <mac address="fa:16:3e:4b:01:bd"/>
Aug 01 13:54:20 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 13:54:20 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 13:54:20 user nova-compute[72129]:       <target dev="tapf3403639-00"/>
Aug 01 13:54:20 user nova-compute[72129]:     </interface>
Aug 01 13:54:20 user nova-compute[72129]:     <serial type="pty">
Aug 01 13:54:20 user nova-compute[72129]:       <log file="/opt/stack/data/nova/instances/a07aaeaa-322d-419e-86f5-65cd448c39e7/console.log" append="off"/>
Aug 01 13:54:20 user nova-compute[72129]:     </serial>
Aug 01 13:54:20 user nova-compute[72129]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 13:54:20 user nova-compute[72129]:     <video>
Aug 01 13:54:20 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 13:54:20 user nova-compute[72129]:     </video>
Aug 01 13:54:20 user nova-compute[72129]:     <rng model="virtio">
Aug 01 13:54:20 user nova-compute[72129]:       <backend model="random">/dev/urandom</backend>
Aug 01 13:54:20 user nova-compute[72129]:     </rng>
Aug 01 13:54:20 user nova-compute[72129]:     <controller type="usb" index="0" model="none"/>
Aug 01 13:54:20 user nova-compute[72129]:     <memballoon model="virtio">
Aug 01 13:54:20 user nova-compute[72129]:       <stats period="10"/>
Aug 01 13:54:20 user nova-compute[72129]:     </memballoon>
Aug 01 13:54:20 user nova-compute[72129]:   </devices>
Aug 01 13:54:20 user nova-compute[72129]: </domain>
Aug 01 13:54:20 user nova-compute[72129]:  {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 13:54:20 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T13:51:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2145562199',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-582848887',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHP4lq6QUMPS3pezcVQZPAh44QK9Cjc2FafAnYqVVnXmR/G2I0IR/iHbmL/nrBBWAYHzkIVIbYY+6AfkD3E0LtsteDcaYMG5TC80GmI1zAMDyri/eMn3gWGPdMZtuTTfcw==',key_name='tempest-keypair-1869868466',keypairs=<?>,launch_index=0,launched_at=2023-08-01T13:52:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ebef26e9d3654bf99ecf391ccb263330',ramdisk_id='',reservation_id='r-mcwbm2vy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1852542004',owner_user_name='tempest-ServerActionsV293TestJSON-1852542004-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:54:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37e6bf606d3041d9928c5e5d6f4a9063',uuid=a07aaeaa-322d-419e-86f5-65cd448c39e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f3403639-00ba-4c7c-983a-7995f60f2519", "address": "fa:16:3e:4b:01:bd", "network": {"id": "2338fb81-87b6-4976-a6ab-b4ea0218fa9b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-606840206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebef26e9d3654bf99ecf391ccb263330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3403639-00", "ovs_interfaceid": "f3403639-00ba-4c7c-983a-7995f60f2519", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 13:54:20 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Converting VIF {"id": "f3403639-00ba-4c7c-983a-7995f60f2519", "address": "fa:16:3e:4b:01:bd", "network": {"id": "2338fb81-87b6-4976-a6ab-b4ea0218fa9b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-606840206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebef26e9d3654bf99ecf391ccb263330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3403639-00", "ovs_interfaceid": "f3403639-00ba-4c7c-983a-7995f60f2519", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:54:20 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4b:01:bd,bridge_name='br-int',has_traffic_filtering=True,id=f3403639-00ba-4c7c-983a-7995f60f2519,network=Network(2338fb81-87b6-4976-a6ab-b4ea0218fa9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3403639-00') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:54:20 user nova-compute[72129]: DEBUG os_vif [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:01:bd,bridge_name='br-int',has_traffic_filtering=True,id=f3403639-00ba-4c7c-983a-7995f60f2519,network=Network(2338fb81-87b6-4976-a6ab-b4ea0218fa9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3403639-00') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 13:54:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:54:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:54:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 13:54:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:54:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf3403639-00, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:54:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf3403639-00, col_values=(('external_ids', {'iface-id': 'f3403639-00ba-4c7c-983a-7995f60f2519', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:01:bd', 'vm-uuid': 'a07aaeaa-322d-419e-86f5-65cd448c39e7'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:54:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:54:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 13:54:20 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898060.7549138, 2efa87a6-1dd6-4441-a55e-8e86be7f0a35 => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:54:20 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] VM Resumed (Lifecycle Event)
Aug 01 13:54:20 user nova-compute[72129]: DEBUG nova.compute.manager [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Instance event wait completed in 0 seconds for  {{(pid=72129) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 13:54:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:54:20 user nova-compute[72129]: INFO os_vif [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:01:bd,bridge_name='br-int',has_traffic_filtering=True,id=f3403639-00ba-4c7c-983a-7995f60f2519,network=Network(2338fb81-87b6-4976-a6ab-b4ea0218fa9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3403639-00')
Aug 01 13:54:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:54:20 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Instance running successfully.
Aug 01 13:54:20 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Failed to set time: agent not configured {{(pid=72129) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 01 13:54:20 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-54da1c54-1b6a-4831-a269-c40817988229 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] finish_migration finished successfully. {{(pid=72129) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 01 13:54:20 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:54:20 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 13:54:20 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 01 13:54:20 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898060.7560956, 2efa87a6-1dd6-4441-a55e-8e86be7f0a35 => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:54:20 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] VM Started (Lifecycle Event)
Aug 01 13:54:20 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:54:20 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 13:54:20 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] No VIF found with MAC fa:16:3e:4b:01:bd, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 13:54:20 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 13:54:20 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 01 13:54:22 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:54:22 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:54:22 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:54:22 user nova-compute[72129]: DEBUG nova.compute.manager [req-b93f29a9-dca0-499d-863f-83264d825e4f req-a545335e-de43-4951-b5d4-201c930d07bf service nova] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Received event network-vif-plugged-f3403639-00ba-4c7c-983a-7995f60f2519 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:54:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-b93f29a9-dca0-499d-863f-83264d825e4f req-a545335e-de43-4951-b5d4-201c930d07bf service nova] Acquiring lock "a07aaeaa-322d-419e-86f5-65cd448c39e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:54:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-b93f29a9-dca0-499d-863f-83264d825e4f req-a545335e-de43-4951-b5d4-201c930d07bf service nova] Lock "a07aaeaa-322d-419e-86f5-65cd448c39e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:54:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-b93f29a9-dca0-499d-863f-83264d825e4f req-a545335e-de43-4951-b5d4-201c930d07bf service nova] Lock "a07aaeaa-322d-419e-86f5-65cd448c39e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:54:22 user nova-compute[72129]: DEBUG nova.compute.manager [req-b93f29a9-dca0-499d-863f-83264d825e4f req-a545335e-de43-4951-b5d4-201c930d07bf service nova] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] No waiting events found dispatching network-vif-plugged-f3403639-00ba-4c7c-983a-7995f60f2519 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:54:22 user nova-compute[72129]: WARNING nova.compute.manager [req-b93f29a9-dca0-499d-863f-83264d825e4f req-a545335e-de43-4951-b5d4-201c930d07bf service nova] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Received unexpected event network-vif-plugged-f3403639-00ba-4c7c-983a-7995f60f2519 for instance with vm_state active and task_state rebuild_spawning.
Aug 01 13:54:22 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:54:22 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:54:24 user nova-compute[72129]: DEBUG nova.compute.manager [req-d4ee07ee-4c21-4a43-b331-c949e32ac6e2 req-9d7dd901-b609-45b2-84f2-59cf9f8264bd service nova] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Received event network-vif-plugged-f3403639-00ba-4c7c-983a-7995f60f2519 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:54:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-d4ee07ee-4c21-4a43-b331-c949e32ac6e2 req-9d7dd901-b609-45b2-84f2-59cf9f8264bd service nova] Acquiring lock "a07aaeaa-322d-419e-86f5-65cd448c39e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:54:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-d4ee07ee-4c21-4a43-b331-c949e32ac6e2 req-9d7dd901-b609-45b2-84f2-59cf9f8264bd service nova] Lock "a07aaeaa-322d-419e-86f5-65cd448c39e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:54:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-d4ee07ee-4c21-4a43-b331-c949e32ac6e2 req-9d7dd901-b609-45b2-84f2-59cf9f8264bd service nova] Lock "a07aaeaa-322d-419e-86f5-65cd448c39e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:54:24 user nova-compute[72129]: DEBUG nova.compute.manager [req-d4ee07ee-4c21-4a43-b331-c949e32ac6e2 req-9d7dd901-b609-45b2-84f2-59cf9f8264bd service nova] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] No waiting events found dispatching network-vif-plugged-f3403639-00ba-4c7c-983a-7995f60f2519 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:54:24 user nova-compute[72129]: WARNING nova.compute.manager [req-d4ee07ee-4c21-4a43-b331-c949e32ac6e2 req-9d7dd901-b609-45b2-84f2-59cf9f8264bd service nova] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Received unexpected event network-vif-plugged-f3403639-00ba-4c7c-983a-7995f60f2519 for instance with vm_state active and task_state rebuild_spawning.
Aug 01 13:54:25 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898065.0549488, a07aaeaa-322d-419e-86f5-65cd448c39e7 => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:54:25 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] VM Resumed (Lifecycle Event)
Aug 01 13:54:25 user nova-compute[72129]: DEBUG nova.compute.manager [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Instance event wait completed in 0 seconds for  {{(pid=72129) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 13:54:25 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Guest created on hypervisor {{(pid=72129) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 13:54:25 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Instance spawned successfully.
Aug 01 13:54:25 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 13:54:25 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:54:25 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 13:54:25 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Found default for hw_cdrom_bus of ide {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:54:25 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Found default for hw_disk_bus of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:54:25 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Found default for hw_input_bus of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:54:25 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Found default for hw_pointer_model of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:54:25 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Found default for hw_video_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:54:25 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Found default for hw_vif_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:54:25 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 01 13:54:25 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898065.056603, a07aaeaa-322d-419e-86f5-65cd448c39e7 => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:54:25 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] VM Started (Lifecycle Event)
Aug 01 13:54:25 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:54:25 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 13:54:25 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 01 13:54:25 user nova-compute[72129]: DEBUG nova.compute.manager [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:54:25 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:54:25 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:54:25 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:54:25 user nova-compute[72129]: DEBUG nova.objects.instance [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72129) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Aug 01 13:54:25 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-8f3e100b-57a0-4801-8341-0fde2b776c25 tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.076s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:54:25 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:54:25 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:54:28 user nova-compute[72129]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690898053.4752436, 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0 => Stopped> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:54:28 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] VM Stopped (Lifecycle Event)
Aug 01 13:54:28 user nova-compute[72129]: DEBUG nova.compute.manager [None req-59009931-b562-4d92-8c62-1696250e750a None None] [instance: 33bd1349-1ea1-44a0-8dce-b8ed7b9a85b0] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:54:30 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:54:30 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:54:35 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:54:35 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:54:35 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:54:36 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:54:39 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:54:39 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Starting heal instance info cache {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 13:54:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "refresh_cache-31105963-52fa-4aff-9270-075cd98f08a5" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:54:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquired lock "refresh_cache-31105963-52fa-4aff-9270-075cd98f08a5" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:54:39 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] Forcefully refreshing network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 13:54:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:54:39 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] Updating instance_info_cache with network_info: [{"id": "a56b8b52-26f1-4e64-b02e-0e46462dfb13", "address": "fa:16:3e:a8:fe:6c", "network": {"id": "8c424a77-2cdc-4519-bad7-e5c4498aa600", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1161619305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8fd0bc919dc4f39a702173f8be6a847", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa56b8b52-26", "ovs_interfaceid": "a56b8b52-26f1-4e64-b02e-0e46462dfb13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:54:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Releasing lock "refresh_cache-31105963-52fa-4aff-9270-075cd98f08a5" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:54:39 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] Updated the network info_cache for instance {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 13:54:39 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:54:39 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:54:40 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:54:40 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:54:40 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:54:40 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:54:41 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:54:41 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72129) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 13:54:41 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:54:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:54:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:54:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:54:41 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Auditing locally available compute resources for user (node: user) {{(pid=72129) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 13:54:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:54:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:54:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:54:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:54:41 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 13:54:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28115c7d-544a-4504-98da-2398e0e354d8/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:54:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28115c7d-544a-4504-98da-2398e0e354d8/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:54:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28115c7d-544a-4504-98da-2398e0e354d8/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:54:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28115c7d-544a-4504-98da-2398e0e354d8/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:54:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:54:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:54:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:54:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:54:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a915d04-faf8-4987-9233-130524dfe655/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:54:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a915d04-faf8-4987-9233-130524dfe655/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:54:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a915d04-faf8-4987-9233-130524dfe655/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:54:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a915d04-faf8-4987-9233-130524dfe655/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:54:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31105963-52fa-4aff-9270-075cd98f08a5/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:54:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31105963-52fa-4aff-9270-075cd98f08a5/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:54:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31105963-52fa-4aff-9270-075cd98f08a5/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:54:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31105963-52fa-4aff-9270-075cd98f08a5/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:54:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63c0c1fe-7e4d-4763-8ede-a7662747a4c0/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:54:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63c0c1fe-7e4d-4763-8ede-a7662747a4c0/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:54:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63c0c1fe-7e4d-4763-8ede-a7662747a4c0/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:54:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63c0c1fe-7e4d-4763-8ede-a7662747a4c0/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:54:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efa87a6-1dd6-4441-a55e-8e86be7f0a35/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:54:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efa87a6-1dd6-4441-a55e-8e86be7f0a35/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:54:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efa87a6-1dd6-4441-a55e-8e86be7f0a35/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:54:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efa87a6-1dd6-4441-a55e-8e86be7f0a35/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:54:43 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 13:54:43 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:54:43 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:54:43 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Hypervisor/Node resource view: name=user free_ram=7458MB free_disk=25.570369720458984GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72129) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 13:54:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:54:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:54:43 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Applying migration context for instance 2efa87a6-1dd6-4441-a55e-8e86be7f0a35 as it has an incoming, in-progress migration 4d3294df-2b0a-4f01-b65f-59aefa59e918. Migration status is finished {{(pid=72129) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 01 13:54:43 user nova-compute[72129]: INFO nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Updating resource usage from migration 4d3294df-2b0a-4f01-b65f-59aefa59e918
Aug 01 13:54:43 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 63c0c1fe-7e4d-4763-8ede-a7662747a4c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:54:43 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 28115c7d-544a-4504-98da-2398e0e354d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:54:43 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 31105963-52fa-4aff-9270-075cd98f08a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:54:43 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance a07aaeaa-322d-419e-86f5-65cd448c39e7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:54:43 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 97a5dccf-b499-443a-b332-cfa293a16047 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:54:43 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 3a915d04-faf8-4987-9233-130524dfe655 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:54:43 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Migration 4d3294df-2b0a-4f01-b65f-59aefa59e918 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 01 13:54:43 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 2efa87a6-1dd6-4441-a55e-8e86be7f0a35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:54:43 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:54:43 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 13:54:43 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=27GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 13:54:44 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 13:54:44 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 13:54:44 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Compute_service record updated for user:user {{(pid=72129) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 13:54:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.591s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:54:45 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:54:45 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:54:45 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:54:49 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:54:50 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:54:50 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:54:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:54:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:54:58 user nova-compute[72129]: DEBUG nova.compute.manager [req-ac2f2404-1026-4dc6-8dc6-e388c4f80aaa req-1cb9dfdb-8ce0-4b14-860c-0496d46a14b4 service nova] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Received event network-changed-4871bc74-6594-49e6-a6ef-343bc3800742 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:54:58 user nova-compute[72129]: DEBUG nova.compute.manager [req-ac2f2404-1026-4dc6-8dc6-e388c4f80aaa req-1cb9dfdb-8ce0-4b14-860c-0496d46a14b4 service nova] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Refreshing instance network info cache due to event network-changed-4871bc74-6594-49e6-a6ef-343bc3800742. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 13:54:58 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ac2f2404-1026-4dc6-8dc6-e388c4f80aaa req-1cb9dfdb-8ce0-4b14-860c-0496d46a14b4 service nova] Acquiring lock "refresh_cache-97a5dccf-b499-443a-b332-cfa293a16047" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:54:58 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ac2f2404-1026-4dc6-8dc6-e388c4f80aaa req-1cb9dfdb-8ce0-4b14-860c-0496d46a14b4 service nova] Acquired lock "refresh_cache-97a5dccf-b499-443a-b332-cfa293a16047" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:54:58 user nova-compute[72129]: DEBUG nova.network.neutron [req-ac2f2404-1026-4dc6-8dc6-e388c4f80aaa req-1cb9dfdb-8ce0-4b14-860c-0496d46a14b4 service nova] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Refreshing network info cache for port 4871bc74-6594-49e6-a6ef-343bc3800742 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 13:54:59 user nova-compute[72129]: DEBUG nova.network.neutron [req-ac2f2404-1026-4dc6-8dc6-e388c4f80aaa req-1cb9dfdb-8ce0-4b14-860c-0496d46a14b4 service nova] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Updated VIF entry in instance network info cache for port 4871bc74-6594-49e6-a6ef-343bc3800742. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 13:54:59 user nova-compute[72129]: DEBUG nova.network.neutron [req-ac2f2404-1026-4dc6-8dc6-e388c4f80aaa req-1cb9dfdb-8ce0-4b14-860c-0496d46a14b4 service nova] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Updating instance_info_cache with network_info: [{"id": "4871bc74-6594-49e6-a6ef-343bc3800742", "address": "fa:16:3e:a3:52:a2", "network": {"id": "4b93ad92-9a3a-4472-ba6c-d215329da98b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-734108983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0e85d9b73a546dc95e0ace26233f2a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4871bc74-65", "ovs_interfaceid": "4871bc74-6594-49e6-a6ef-343bc3800742", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:54:59 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ac2f2404-1026-4dc6-8dc6-e388c4f80aaa req-1cb9dfdb-8ce0-4b14-860c-0496d46a14b4 service nova] Releasing lock "refresh_cache-97a5dccf-b499-443a-b332-cfa293a16047" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:55:00 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:55:00 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:55:05 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:55:05 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:55:10 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:55:10 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:55:13 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:55:14 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b2c1aaae-8c32-4b67-b6b9-7954d79467b8 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Acquiring lock "3a915d04-faf8-4987-9233-130524dfe655" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:55:14 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b2c1aaae-8c32-4b67-b6b9-7954d79467b8 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Lock "3a915d04-faf8-4987-9233-130524dfe655" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:55:14 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b2c1aaae-8c32-4b67-b6b9-7954d79467b8 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Acquiring lock "3a915d04-faf8-4987-9233-130524dfe655-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:55:14 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b2c1aaae-8c32-4b67-b6b9-7954d79467b8 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Lock "3a915d04-faf8-4987-9233-130524dfe655-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:55:14 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b2c1aaae-8c32-4b67-b6b9-7954d79467b8 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Lock "3a915d04-faf8-4987-9233-130524dfe655-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:55:14 user nova-compute[72129]: INFO nova.compute.manager [None req-b2c1aaae-8c32-4b67-b6b9-7954d79467b8 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 3a915d04-faf8-4987-9233-130524dfe655] Terminating instance
Aug 01 13:55:14 user nova-compute[72129]: DEBUG nova.compute.manager [None req-b2c1aaae-8c32-4b67-b6b9-7954d79467b8 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 3a915d04-faf8-4987-9233-130524dfe655] Start destroying the instance on the hypervisor. {{(pid=72129) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 13:55:15 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:55:15 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:55:15 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:55:15 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:55:15 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:55:15 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:55:15 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:55:15 user nova-compute[72129]: DEBUG nova.compute.manager [req-26135f24-0da2-48b7-99ae-6d121058eb2a req-4e8abc7f-cebf-4d91-a002-5d6cbceecf69 service nova] [instance: 3a915d04-faf8-4987-9233-130524dfe655] Received event network-vif-unplugged-163ebe07-e21c-4208-b902-29c309adcef1 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:55:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-26135f24-0da2-48b7-99ae-6d121058eb2a req-4e8abc7f-cebf-4d91-a002-5d6cbceecf69 service nova] Acquiring lock "3a915d04-faf8-4987-9233-130524dfe655-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:55:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-26135f24-0da2-48b7-99ae-6d121058eb2a req-4e8abc7f-cebf-4d91-a002-5d6cbceecf69 service nova] Lock "3a915d04-faf8-4987-9233-130524dfe655-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:55:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-26135f24-0da2-48b7-99ae-6d121058eb2a req-4e8abc7f-cebf-4d91-a002-5d6cbceecf69 service nova] Lock "3a915d04-faf8-4987-9233-130524dfe655-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:55:15 user nova-compute[72129]: DEBUG nova.compute.manager [req-26135f24-0da2-48b7-99ae-6d121058eb2a req-4e8abc7f-cebf-4d91-a002-5d6cbceecf69 service nova] [instance: 3a915d04-faf8-4987-9233-130524dfe655] No waiting events found dispatching network-vif-unplugged-163ebe07-e21c-4208-b902-29c309adcef1 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:55:15 user nova-compute[72129]: DEBUG nova.compute.manager [req-26135f24-0da2-48b7-99ae-6d121058eb2a req-4e8abc7f-cebf-4d91-a002-5d6cbceecf69 service nova] [instance: 3a915d04-faf8-4987-9233-130524dfe655] Received event network-vif-unplugged-163ebe07-e21c-4208-b902-29c309adcef1 for instance with task_state deleting. {{(pid=72129) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 13:55:15 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 3a915d04-faf8-4987-9233-130524dfe655] Instance destroyed successfully.
Aug 01 13:55:15 user nova-compute[72129]: DEBUG nova.objects.instance [None req-b2c1aaae-8c32-4b67-b6b9-7954d79467b8 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Lazy-loading 'resources' on Instance uuid 3a915d04-faf8-4987-9233-130524dfe655 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:55:15 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-b2c1aaae-8c32-4b67-b6b9-7954d79467b8 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:53:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-715351820',display_name='tempest-VolumesAdminNegativeTest-server-715351820',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-715351820',id=15,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T13:53:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e8fd0bc919dc4f39a702173f8be6a847',ramdisk_id='',reservation_id='r-6ay87fb7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1822759437',owner_user_name='tempest-VolumesAdminNegativeTest-1822759437-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T13:53:23Z,user_data=None,user_id='42662c28ee804a399b2ba6467e3c3926',uuid=3a915d04-faf8-4987-9233-130524dfe655,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "163ebe07-e21c-4208-b902-29c309adcef1", "address": "fa:16:3e:fc:4f:6f", "network": {"id": "8c424a77-2cdc-4519-bad7-e5c4498aa600", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1161619305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8fd0bc919dc4f39a702173f8be6a847", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap163ebe07-e2", "ovs_interfaceid": "163ebe07-e21c-4208-b902-29c309adcef1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 13:55:15 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-b2c1aaae-8c32-4b67-b6b9-7954d79467b8 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Converting VIF {"id": "163ebe07-e21c-4208-b902-29c309adcef1", "address": "fa:16:3e:fc:4f:6f", "network": {"id": "8c424a77-2cdc-4519-bad7-e5c4498aa600", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1161619305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8fd0bc919dc4f39a702173f8be6a847", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap163ebe07-e2", "ovs_interfaceid": "163ebe07-e21c-4208-b902-29c309adcef1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:55:15 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-b2c1aaae-8c32-4b67-b6b9-7954d79467b8 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:4f:6f,bridge_name='br-int',has_traffic_filtering=True,id=163ebe07-e21c-4208-b902-29c309adcef1,network=Network(8c424a77-2cdc-4519-bad7-e5c4498aa600),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap163ebe07-e2') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:55:15 user nova-compute[72129]: DEBUG os_vif [None req-b2c1aaae-8c32-4b67-b6b9-7954d79467b8 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:4f:6f,bridge_name='br-int',has_traffic_filtering=True,id=163ebe07-e21c-4208-b902-29c309adcef1,network=Network(8c424a77-2cdc-4519-bad7-e5c4498aa600),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap163ebe07-e2') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 13:55:15 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:55:15 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap163ebe07-e2, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:55:15 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:55:15 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 13:55:15 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:55:15 user nova-compute[72129]: INFO os_vif [None req-b2c1aaae-8c32-4b67-b6b9-7954d79467b8 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:4f:6f,bridge_name='br-int',has_traffic_filtering=True,id=163ebe07-e21c-4208-b902-29c309adcef1,network=Network(8c424a77-2cdc-4519-bad7-e5c4498aa600),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap163ebe07-e2')
Aug 01 13:55:15 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-b2c1aaae-8c32-4b67-b6b9-7954d79467b8 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 3a915d04-faf8-4987-9233-130524dfe655] Deleting instance files /opt/stack/data/nova/instances/3a915d04-faf8-4987-9233-130524dfe655_del
Aug 01 13:55:15 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-b2c1aaae-8c32-4b67-b6b9-7954d79467b8 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 3a915d04-faf8-4987-9233-130524dfe655] Deletion of /opt/stack/data/nova/instances/3a915d04-faf8-4987-9233-130524dfe655_del complete
Aug 01 13:55:15 user nova-compute[72129]: INFO nova.compute.manager [None req-b2c1aaae-8c32-4b67-b6b9-7954d79467b8 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 3a915d04-faf8-4987-9233-130524dfe655] Took 0.82 seconds to destroy the instance on the hypervisor.
Aug 01 13:55:15 user nova-compute[72129]: DEBUG oslo.service.loopingcall [None req-b2c1aaae-8c32-4b67-b6b9-7954d79467b8 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72129) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 13:55:15 user nova-compute[72129]: DEBUG nova.compute.manager [-] [instance: 3a915d04-faf8-4987-9233-130524dfe655] Deallocating network for instance {{(pid=72129) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 13:55:15 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 3a915d04-faf8-4987-9233-130524dfe655] deallocate_for_instance() {{(pid=72129) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 13:55:16 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 3a915d04-faf8-4987-9233-130524dfe655] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:55:16 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 3a915d04-faf8-4987-9233-130524dfe655] Took 1.16 seconds to deallocate network for instance.
Aug 01 13:55:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b2c1aaae-8c32-4b67-b6b9-7954d79467b8 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:55:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b2c1aaae-8c32-4b67-b6b9-7954d79467b8 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:55:17 user nova-compute[72129]: DEBUG nova.compute.manager [req-2744f27b-f842-4f08-baaf-7e25dfd52b4e req-575b7ad8-234e-4eea-b4a3-0c6c422d63c2 service nova] [instance: 3a915d04-faf8-4987-9233-130524dfe655] Received event network-vif-deleted-163ebe07-e21c-4208-b902-29c309adcef1 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:55:17 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-b2c1aaae-8c32-4b67-b6b9-7954d79467b8 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 13:55:17 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-b2c1aaae-8c32-4b67-b6b9-7954d79467b8 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 13:55:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b2c1aaae-8c32-4b67-b6b9-7954d79467b8 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.436s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:55:17 user nova-compute[72129]: INFO nova.scheduler.client.report [None req-b2c1aaae-8c32-4b67-b6b9-7954d79467b8 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Deleted allocations for instance 3a915d04-faf8-4987-9233-130524dfe655
Aug 01 13:55:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b2c1aaae-8c32-4b67-b6b9-7954d79467b8 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Lock "3a915d04-faf8-4987-9233-130524dfe655" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.693s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:55:17 user nova-compute[72129]: DEBUG nova.compute.manager [req-13bd74bf-8cf6-42d4-b265-681b1d91f07b req-af79da51-a3b3-4ef2-916e-61c40bf90d59 service nova] [instance: 3a915d04-faf8-4987-9233-130524dfe655] Received event network-vif-plugged-163ebe07-e21c-4208-b902-29c309adcef1 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:55:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-13bd74bf-8cf6-42d4-b265-681b1d91f07b req-af79da51-a3b3-4ef2-916e-61c40bf90d59 service nova] Acquiring lock "3a915d04-faf8-4987-9233-130524dfe655-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:55:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-13bd74bf-8cf6-42d4-b265-681b1d91f07b req-af79da51-a3b3-4ef2-916e-61c40bf90d59 service nova] Lock "3a915d04-faf8-4987-9233-130524dfe655-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:55:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-13bd74bf-8cf6-42d4-b265-681b1d91f07b req-af79da51-a3b3-4ef2-916e-61c40bf90d59 service nova] Lock "3a915d04-faf8-4987-9233-130524dfe655-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:55:17 user nova-compute[72129]: DEBUG nova.compute.manager [req-13bd74bf-8cf6-42d4-b265-681b1d91f07b req-af79da51-a3b3-4ef2-916e-61c40bf90d59 service nova] [instance: 3a915d04-faf8-4987-9233-130524dfe655] No waiting events found dispatching network-vif-plugged-163ebe07-e21c-4208-b902-29c309adcef1 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:55:17 user nova-compute[72129]: WARNING nova.compute.manager [req-13bd74bf-8cf6-42d4-b265-681b1d91f07b req-af79da51-a3b3-4ef2-916e-61c40bf90d59 service nova] [instance: 3a915d04-faf8-4987-9233-130524dfe655] Received unexpected event network-vif-plugged-163ebe07-e21c-4208-b902-29c309adcef1 for instance with vm_state deleted and task_state None.
Aug 01 13:55:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:55:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:55:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:55:22 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:55:22 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:55:25 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:55:25 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:55:25 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:55:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Acquiring lock "133076de-14b5-4ceb-aa41-d9acef8506c5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:55:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lock "133076de-14b5-4ceb-aa41-d9acef8506c5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:55:27 user nova-compute[72129]: DEBUG nova.compute.manager [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Starting instance... {{(pid=72129) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 13:55:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:55:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:55:27 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72129) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 13:55:27 user nova-compute[72129]: INFO nova.compute.claims [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Claim successful on node user
Aug 01 13:55:28 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 13:55:28 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 13:55:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.430s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:55:28 user nova-compute[72129]: DEBUG nova.compute.manager [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Start building networks asynchronously for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 13:55:28 user nova-compute[72129]: DEBUG nova.compute.manager [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Allocating IP information in the background. {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 13:55:28 user nova-compute[72129]: DEBUG nova.network.neutron [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] allocate_for_instance() {{(pid=72129) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 13:55:28 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 13:55:28 user nova-compute[72129]: DEBUG nova.compute.manager [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Start building block device mappings for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 13:55:28 user nova-compute[72129]: DEBUG nova.policy [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8acae20eb69f40c08bbe0799513b95e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43253b37caa747b090b14c707abf96cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72129) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 13:55:28 user nova-compute[72129]: DEBUG nova.compute.manager [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Start spawning the instance on the hypervisor. {{(pid=72129) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 13:55:28 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Creating instance directory {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 13:55:28 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Creating image(s)
Aug 01 13:55:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Acquiring lock "/opt/stack/data/nova/instances/133076de-14b5-4ceb-aa41-d9acef8506c5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:55:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lock "/opt/stack/data/nova/instances/133076de-14b5-4ceb-aa41-d9acef8506c5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:55:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lock "/opt/stack/data/nova/instances/133076de-14b5-4ceb-aa41-d9acef8506c5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:55:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Acquiring lock "734c552304c5993ab26a647b4af83e454a57c1ec" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:55:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lock "734c552304c5993ab26a647b4af83e454a57c1ec" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:55:28 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/734c552304c5993ab26a647b4af83e454a57c1ec.part --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:55:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/734c552304c5993ab26a647b4af83e454a57c1ec.part --force-share --output=json" returned: 0 in 0.163s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:55:29 user nova-compute[72129]: DEBUG nova.virt.images [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] edea0658-dd0d-4712-83e7-608cd2089ee4 was qcow2, converting to raw {{(pid=72129) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 13:55:29 user nova-compute[72129]: DEBUG nova.privsep.utils [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72129) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 13:55:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/734c552304c5993ab26a647b4af83e454a57c1ec.part /opt/stack/data/nova/instances/_base/734c552304c5993ab26a647b4af83e454a57c1ec.converted {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:55:29 user nova-compute[72129]: DEBUG nova.network.neutron [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Successfully created port: 09dc6abd-1d55-4e2d-8568-1f793ca45413 {{(pid=72129) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 13:55:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/734c552304c5993ab26a647b4af83e454a57c1ec.part /opt/stack/data/nova/instances/_base/734c552304c5993ab26a647b4af83e454a57c1ec.converted" returned: 0 in 0.156s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:55:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/734c552304c5993ab26a647b4af83e454a57c1ec.converted --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:55:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/734c552304c5993ab26a647b4af83e454a57c1ec.converted --force-share --output=json" returned: 0 in 0.170s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:55:29 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lock "734c552304c5993ab26a647b4af83e454a57c1ec" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.913s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:55:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/734c552304c5993ab26a647b4af83e454a57c1ec --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:55:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/734c552304c5993ab26a647b4af83e454a57c1ec --force-share --output=json" returned: 0 in 0.157s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:55:29 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Acquiring lock "734c552304c5993ab26a647b4af83e454a57c1ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:55:29 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lock "734c552304c5993ab26a647b4af83e454a57c1ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:55:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/734c552304c5993ab26a647b4af83e454a57c1ec --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:55:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/734c552304c5993ab26a647b4af83e454a57c1ec --force-share --output=json" returned: 0 in 0.157s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:55:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/734c552304c5993ab26a647b4af83e454a57c1ec,backing_fmt=raw /opt/stack/data/nova/instances/133076de-14b5-4ceb-aa41-d9acef8506c5/disk 1073741824 {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:55:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/734c552304c5993ab26a647b4af83e454a57c1ec,backing_fmt=raw /opt/stack/data/nova/instances/133076de-14b5-4ceb-aa41-d9acef8506c5/disk 1073741824" returned: 0 in 0.051s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:55:29 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lock "734c552304c5993ab26a647b4af83e454a57c1ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.218s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:55:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/734c552304c5993ab26a647b4af83e454a57c1ec --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:55:29 user nova-compute[72129]: DEBUG nova.network.neutron [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Successfully updated port: 09dc6abd-1d55-4e2d-8568-1f793ca45413 {{(pid=72129) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 13:55:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/734c552304c5993ab26a647b4af83e454a57c1ec --force-share --output=json" returned: 0 in 0.140s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:55:29 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Checking if we can resize image /opt/stack/data/nova/instances/133076de-14b5-4ceb-aa41-d9acef8506c5/disk. size=1073741824 {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 13:55:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133076de-14b5-4ceb-aa41-d9acef8506c5/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:55:29 user nova-compute[72129]: DEBUG nova.compute.manager [req-9bcbb3a6-c5a3-4ef1-acd5-87227ee296b3 req-1b92519e-7cd5-47ab-9925-3cf01e0f804e service nova] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Received event network-changed-09dc6abd-1d55-4e2d-8568-1f793ca45413 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:55:29 user nova-compute[72129]: DEBUG nova.compute.manager [req-9bcbb3a6-c5a3-4ef1-acd5-87227ee296b3 req-1b92519e-7cd5-47ab-9925-3cf01e0f804e service nova] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Refreshing instance network info cache due to event network-changed-09dc6abd-1d55-4e2d-8568-1f793ca45413. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 13:55:29 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-9bcbb3a6-c5a3-4ef1-acd5-87227ee296b3 req-1b92519e-7cd5-47ab-9925-3cf01e0f804e service nova] Acquiring lock "refresh_cache-133076de-14b5-4ceb-aa41-d9acef8506c5" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:55:29 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-9bcbb3a6-c5a3-4ef1-acd5-87227ee296b3 req-1b92519e-7cd5-47ab-9925-3cf01e0f804e service nova] Acquired lock "refresh_cache-133076de-14b5-4ceb-aa41-d9acef8506c5" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:55:29 user nova-compute[72129]: DEBUG nova.network.neutron [req-9bcbb3a6-c5a3-4ef1-acd5-87227ee296b3 req-1b92519e-7cd5-47ab-9925-3cf01e0f804e service nova] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Refreshing network info cache for port 09dc6abd-1d55-4e2d-8568-1f793ca45413 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 13:55:29 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Acquiring lock "refresh_cache-133076de-14b5-4ceb-aa41-d9acef8506c5" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:55:30 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133076de-14b5-4ceb-aa41-d9acef8506c5/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:55:30 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Cannot resize image /opt/stack/data/nova/instances/133076de-14b5-4ceb-aa41-d9acef8506c5/disk to a smaller size. {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 13:55:30 user nova-compute[72129]: DEBUG nova.objects.instance [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lazy-loading 'migration_context' on Instance uuid 133076de-14b5-4ceb-aa41-d9acef8506c5 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:55:30 user nova-compute[72129]: DEBUG nova.network.neutron [req-9bcbb3a6-c5a3-4ef1-acd5-87227ee296b3 req-1b92519e-7cd5-47ab-9925-3cf01e0f804e service nova] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Instance cache missing network info. {{(pid=72129) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 13:55:30 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Created local disks {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 13:55:30 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Ensure instance console log exists: /opt/stack/data/nova/instances/133076de-14b5-4ceb-aa41-d9acef8506c5/console.log {{(pid=72129) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 13:55:30 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:55:30 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:55:30 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:55:30 user nova-compute[72129]: DEBUG nova.network.neutron [req-9bcbb3a6-c5a3-4ef1-acd5-87227ee296b3 req-1b92519e-7cd5-47ab-9925-3cf01e0f804e service nova] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:55:30 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-9bcbb3a6-c5a3-4ef1-acd5-87227ee296b3 req-1b92519e-7cd5-47ab-9925-3cf01e0f804e service nova] Releasing lock "refresh_cache-133076de-14b5-4ceb-aa41-d9acef8506c5" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:55:30 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Acquired lock "refresh_cache-133076de-14b5-4ceb-aa41-d9acef8506c5" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:55:30 user nova-compute[72129]: DEBUG nova.network.neutron [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 13:55:30 user nova-compute[72129]: DEBUG nova.network.neutron [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Instance cache missing network info. {{(pid=72129) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 13:55:30 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:55:30 user nova-compute[72129]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690898115.6402686, 3a915d04-faf8-4987-9233-130524dfe655 => Stopped> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:55:30 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 3a915d04-faf8-4987-9233-130524dfe655] VM Stopped (Lifecycle Event)
Aug 01 13:55:30 user nova-compute[72129]: DEBUG nova.compute.manager [None req-7ed3731b-ff4a-4124-8d25-1ec6a4f63884 None None] [instance: 3a915d04-faf8-4987-9233-130524dfe655] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:55:30 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:55:30 user nova-compute[72129]: DEBUG nova.network.neutron [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Updating instance_info_cache with network_info: [{"id": "09dc6abd-1d55-4e2d-8568-1f793ca45413", "address": "fa:16:3e:d3:ee:e0", "network": {"id": "a7ec6cc0-140b-446b-ae97-d4aafbc42693", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-397303278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43253b37caa747b090b14c707abf96cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09dc6abd-1d", "ovs_interfaceid": "09dc6abd-1d55-4e2d-8568-1f793ca45413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:55:30 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Releasing lock "refresh_cache-133076de-14b5-4ceb-aa41-d9acef8506c5" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:55:30 user nova-compute[72129]: DEBUG nova.compute.manager [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Instance network_info: |[{"id": "09dc6abd-1d55-4e2d-8568-1f793ca45413", "address": "fa:16:3e:d3:ee:e0", "network": {"id": "a7ec6cc0-140b-446b-ae97-d4aafbc42693", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-397303278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43253b37caa747b090b14c707abf96cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09dc6abd-1d", "ovs_interfaceid": "09dc6abd-1d55-4e2d-8568-1f793ca45413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 13:55:30 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Start _get_guest_xml network_info=[{"id": "09dc6abd-1d55-4e2d-8568-1f793ca45413", "address": "fa:16:3e:d3:ee:e0", "network": {"id": "a7ec6cc0-140b-446b-ae97-d4aafbc42693", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-397303278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43253b37caa747b090b14c707abf96cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09dc6abd-1d", "ovs_interfaceid": "09dc6abd-1d55-4e2d-8568-1f793ca45413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:55:23Z,direct_url=<?>,disk_format='qcow2',id=edea0658-dd0d-4712-83e7-608cd2089ee4,min_disk=0,min_ram=0,name='tempest-scenario-img--1426152661',owner='43253b37caa747b090b14c707abf96cf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:55:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'image_id': 'edea0658-dd0d-4712-83e7-608cd2089ee4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 13:55:30 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:55:30 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:55:30 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 13:55:30 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] CPU controller missing on host. {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 13:55:30 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 13:55:30 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] CPU controller found on host. {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 13:55:30 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72129) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 13:55:30 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T13:45:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:55:23Z,direct_url=<?>,disk_format='qcow2',id=edea0658-dd0d-4712-83e7-608cd2089ee4,min_disk=0,min_ram=0,name='tempest-scenario-img--1426152661',owner='43253b37caa747b090b14c707abf96cf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:55:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 13:55:30 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Flavor limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 13:55:30 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Image limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 13:55:30 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Flavor pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 13:55:30 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Image pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 13:55:30 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 13:55:30 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 13:55:30 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 13:55:30 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Got 1 possible topologies {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 13:55:30 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 13:55:30 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 13:55:30 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:55:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-337029066',display_name='tempest-TestMinimumBasicScenario-server-337029066',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-337029066',id=17,image_ref='edea0658-dd0d-4712-83e7-608cd2089ee4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIF8pK0CTkVNfFPcWoAjeaWcCqpSHidxLzrNXnGzXid58N/NMzig5Fh+PrM0HmEtqXEVuFeC6ojSBtRRykq6gLAiPaZuHwOjhWv6j6ZSIDENuHN2kr+7tsEOeWGDThWqHw==',key_name='tempest-TestMinimumBasicScenario-1218723859',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='43253b37caa747b090b14c707abf96cf',ramdisk_id='',reservation_id='r-3dv71pgh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='edea0658-dd0d-4712-83e7-608cd2089ee4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-833844079',owner_user_name='tempest-TestMinimumBasicScenario-833844079-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:55:28Z,user_data=None,user_id='8acae20eb69f40c08bbe0799513b95e1',uuid=133076de-14b5-4ceb-aa41-d9acef8506c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09dc6abd-1d55-4e2d-8568-1f793ca45413", "address": "fa:16:3e:d3:ee:e0", "network": {"id": "a7ec6cc0-140b-446b-ae97-d4aafbc42693", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-397303278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43253b37caa747b090b14c707abf96cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09dc6abd-1d", "ovs_interfaceid": "09dc6abd-1d55-4e2d-8568-1f793ca45413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 13:55:30 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Converting VIF {"id": "09dc6abd-1d55-4e2d-8568-1f793ca45413", "address": "fa:16:3e:d3:ee:e0", "network": {"id": "a7ec6cc0-140b-446b-ae97-d4aafbc42693", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-397303278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43253b37caa747b090b14c707abf96cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09dc6abd-1d", "ovs_interfaceid": "09dc6abd-1d55-4e2d-8568-1f793ca45413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:55:30 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:ee:e0,bridge_name='br-int',has_traffic_filtering=True,id=09dc6abd-1d55-4e2d-8568-1f793ca45413,network=Network(a7ec6cc0-140b-446b-ae97-d4aafbc42693),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09dc6abd-1d') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:55:30 user nova-compute[72129]: DEBUG nova.objects.instance [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lazy-loading 'pci_devices' on Instance uuid 133076de-14b5-4ceb-aa41-d9acef8506c5 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:55:30 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] End _get_guest_xml xml=<domain type="kvm">
Aug 01 13:55:30 user nova-compute[72129]:   <uuid>133076de-14b5-4ceb-aa41-d9acef8506c5</uuid>
Aug 01 13:55:30 user nova-compute[72129]:   <name>instance-00000011</name>
Aug 01 13:55:30 user nova-compute[72129]:   <memory>524288</memory>
Aug 01 13:55:30 user nova-compute[72129]:   <vcpu>1</vcpu>
Aug 01 13:55:30 user nova-compute[72129]:   <metadata>
Aug 01 13:55:30 user nova-compute[72129]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 13:55:30 user nova-compute[72129]:       <nova:package version="0.0.0"/>
Aug 01 13:55:30 user nova-compute[72129]:       <nova:name>tempest-TestMinimumBasicScenario-server-337029066</nova:name>
Aug 01 13:55:30 user nova-compute[72129]:       <nova:creationTime>2023-08-01 13:55:30</nova:creationTime>
Aug 01 13:55:30 user nova-compute[72129]:       <nova:flavor name="m1.tiny">
Aug 01 13:55:30 user nova-compute[72129]:         <nova:memory>512</nova:memory>
Aug 01 13:55:30 user nova-compute[72129]:         <nova:disk>1</nova:disk>
Aug 01 13:55:30 user nova-compute[72129]:         <nova:swap>0</nova:swap>
Aug 01 13:55:30 user nova-compute[72129]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 13:55:30 user nova-compute[72129]:         <nova:vcpus>1</nova:vcpus>
Aug 01 13:55:30 user nova-compute[72129]:       </nova:flavor>
Aug 01 13:55:30 user nova-compute[72129]:       <nova:owner>
Aug 01 13:55:30 user nova-compute[72129]:         <nova:user uuid="8acae20eb69f40c08bbe0799513b95e1">tempest-TestMinimumBasicScenario-833844079-project-member</nova:user>
Aug 01 13:55:30 user nova-compute[72129]:         <nova:project uuid="43253b37caa747b090b14c707abf96cf">tempest-TestMinimumBasicScenario-833844079</nova:project>
Aug 01 13:55:30 user nova-compute[72129]:       </nova:owner>
Aug 01 13:55:30 user nova-compute[72129]:       <nova:root type="image" uuid="edea0658-dd0d-4712-83e7-608cd2089ee4"/>
Aug 01 13:55:30 user nova-compute[72129]:       <nova:ports>
Aug 01 13:55:30 user nova-compute[72129]:         <nova:port uuid="09dc6abd-1d55-4e2d-8568-1f793ca45413">
Aug 01 13:55:30 user nova-compute[72129]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 01 13:55:30 user nova-compute[72129]:         </nova:port>
Aug 01 13:55:30 user nova-compute[72129]:       </nova:ports>
Aug 01 13:55:30 user nova-compute[72129]:     </nova:instance>
Aug 01 13:55:30 user nova-compute[72129]:   </metadata>
Aug 01 13:55:30 user nova-compute[72129]:   <sysinfo type="smbios">
Aug 01 13:55:30 user nova-compute[72129]:     <system>
Aug 01 13:55:30 user nova-compute[72129]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 13:55:30 user nova-compute[72129]:       <entry name="product">OpenStack Nova</entry>
Aug 01 13:55:30 user nova-compute[72129]:       <entry name="version">0.0.0</entry>
Aug 01 13:55:30 user nova-compute[72129]:       <entry name="serial">133076de-14b5-4ceb-aa41-d9acef8506c5</entry>
Aug 01 13:55:30 user nova-compute[72129]:       <entry name="uuid">133076de-14b5-4ceb-aa41-d9acef8506c5</entry>
Aug 01 13:55:30 user nova-compute[72129]:       <entry name="family">Virtual Machine</entry>
Aug 01 13:55:30 user nova-compute[72129]:     </system>
Aug 01 13:55:30 user nova-compute[72129]:   </sysinfo>
Aug 01 13:55:30 user nova-compute[72129]:   <os>
Aug 01 13:55:30 user nova-compute[72129]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 13:55:30 user nova-compute[72129]:     <boot dev="hd"/>
Aug 01 13:55:30 user nova-compute[72129]:     <smbios mode="sysinfo"/>
Aug 01 13:55:30 user nova-compute[72129]:   </os>
Aug 01 13:55:30 user nova-compute[72129]:   <features>
Aug 01 13:55:30 user nova-compute[72129]:     <acpi/>
Aug 01 13:55:30 user nova-compute[72129]:     <apic/>
Aug 01 13:55:30 user nova-compute[72129]:     <vmcoreinfo/>
Aug 01 13:55:30 user nova-compute[72129]:   </features>
Aug 01 13:55:30 user nova-compute[72129]:   <clock offset="utc">
Aug 01 13:55:30 user nova-compute[72129]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 13:55:30 user nova-compute[72129]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 13:55:30 user nova-compute[72129]:     <timer name="hpet" present="no"/>
Aug 01 13:55:30 user nova-compute[72129]:   </clock>
Aug 01 13:55:30 user nova-compute[72129]:   <cpu mode="custom" match="exact">
Aug 01 13:55:30 user nova-compute[72129]:     <model>Nehalem</model>
Aug 01 13:55:30 user nova-compute[72129]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 13:55:30 user nova-compute[72129]:   </cpu>
Aug 01 13:55:30 user nova-compute[72129]:   <devices>
Aug 01 13:55:30 user nova-compute[72129]:     <disk type="file" device="disk">
Aug 01 13:55:30 user nova-compute[72129]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 13:55:30 user nova-compute[72129]:       <source file="/opt/stack/data/nova/instances/133076de-14b5-4ceb-aa41-d9acef8506c5/disk"/>
Aug 01 13:55:30 user nova-compute[72129]:       <target dev="vda" bus="virtio"/>
Aug 01 13:55:30 user nova-compute[72129]:     </disk>
Aug 01 13:55:30 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 13:55:30 user nova-compute[72129]:       <mac address="fa:16:3e:d3:ee:e0"/>
Aug 01 13:55:30 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 13:55:30 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 13:55:30 user nova-compute[72129]:       <target dev="tap09dc6abd-1d"/>
Aug 01 13:55:30 user nova-compute[72129]:     </interface>
Aug 01 13:55:30 user nova-compute[72129]:     <serial type="pty">
Aug 01 13:55:30 user nova-compute[72129]:       <log file="/opt/stack/data/nova/instances/133076de-14b5-4ceb-aa41-d9acef8506c5/console.log" append="off"/>
Aug 01 13:55:30 user nova-compute[72129]:     </serial>
Aug 01 13:55:30 user nova-compute[72129]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 13:55:30 user nova-compute[72129]:     <video>
Aug 01 13:55:30 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 13:55:30 user nova-compute[72129]:     </video>
Aug 01 13:55:30 user nova-compute[72129]:     <rng model="virtio">
Aug 01 13:55:30 user nova-compute[72129]:       <backend model="random">/dev/urandom</backend>
Aug 01 13:55:30 user nova-compute[72129]:     </rng>
Aug 01 13:55:30 user nova-compute[72129]:     <controller type="usb" index="0" model="none"/>
Aug 01 13:55:30 user nova-compute[72129]:     <memballoon model="virtio">
Aug 01 13:55:30 user nova-compute[72129]:       <stats period="10"/>
Aug 01 13:55:30 user nova-compute[72129]:     </memballoon>
Aug 01 13:55:30 user nova-compute[72129]:   </devices>
Aug 01 13:55:30 user nova-compute[72129]: </domain>
Aug 01 13:55:30 user nova-compute[72129]:  {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 13:55:30 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:55:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-337029066',display_name='tempest-TestMinimumBasicScenario-server-337029066',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-337029066',id=17,image_ref='edea0658-dd0d-4712-83e7-608cd2089ee4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIF8pK0CTkVNfFPcWoAjeaWcCqpSHidxLzrNXnGzXid58N/NMzig5Fh+PrM0HmEtqXEVuFeC6ojSBtRRykq6gLAiPaZuHwOjhWv6j6ZSIDENuHN2kr+7tsEOeWGDThWqHw==',key_name='tempest-TestMinimumBasicScenario-1218723859',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='43253b37caa747b090b14c707abf96cf',ramdisk_id='',reservation_id='r-3dv71pgh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='edea0658-dd0d-4712-83e7-608cd2089ee4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-833844079',owner_user_name='tempest-TestMinimumBasicScenario-833844079-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:55:28Z,user_data=None,user_id='8acae20eb69f40c08bbe0799513b95e1',uuid=133076de-14b5-4ceb-aa41-d9acef8506c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09dc6abd-1d55-4e2d-8568-1f793ca45413", "address": "fa:16:3e:d3:ee:e0", "network": {"id": "a7ec6cc0-140b-446b-ae97-d4aafbc42693", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-397303278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43253b37caa747b090b14c707abf96cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09dc6abd-1d", "ovs_interfaceid": "09dc6abd-1d55-4e2d-8568-1f793ca45413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 13:55:30 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Converting VIF {"id": "09dc6abd-1d55-4e2d-8568-1f793ca45413", "address": "fa:16:3e:d3:ee:e0", "network": {"id": "a7ec6cc0-140b-446b-ae97-d4aafbc42693", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-397303278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43253b37caa747b090b14c707abf96cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09dc6abd-1d", "ovs_interfaceid": "09dc6abd-1d55-4e2d-8568-1f793ca45413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:55:30 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:ee:e0,bridge_name='br-int',has_traffic_filtering=True,id=09dc6abd-1d55-4e2d-8568-1f793ca45413,network=Network(a7ec6cc0-140b-446b-ae97-d4aafbc42693),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09dc6abd-1d') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:55:30 user nova-compute[72129]: DEBUG os_vif [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:ee:e0,bridge_name='br-int',has_traffic_filtering=True,id=09dc6abd-1d55-4e2d-8568-1f793ca45413,network=Network(a7ec6cc0-140b-446b-ae97-d4aafbc42693),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09dc6abd-1d') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 13:55:30 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:55:30 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:55:30 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 13:55:30 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:55:30 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap09dc6abd-1d, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:55:30 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap09dc6abd-1d, col_values=(('external_ids', {'iface-id': '09dc6abd-1d55-4e2d-8568-1f793ca45413', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:ee:e0', 'vm-uuid': '133076de-14b5-4ceb-aa41-d9acef8506c5'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:55:30 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:55:30 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 13:55:30 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:55:30 user nova-compute[72129]: INFO os_vif [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:ee:e0,bridge_name='br-int',has_traffic_filtering=True,id=09dc6abd-1d55-4e2d-8568-1f793ca45413,network=Network(a7ec6cc0-140b-446b-ae97-d4aafbc42693),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09dc6abd-1d')
Aug 01 13:55:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 13:55:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] No VIF found with MAC fa:16:3e:d3:ee:e0, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 13:55:32 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:55:32 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:55:32 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:55:32 user nova-compute[72129]: DEBUG nova.compute.manager [req-36efa9d3-af09-4817-9643-ef9d84b97529 req-af0842aa-9776-4762-8967-d7f2cf55585e service nova] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Received event network-vif-plugged-09dc6abd-1d55-4e2d-8568-1f793ca45413 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:55:32 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-36efa9d3-af09-4817-9643-ef9d84b97529 req-af0842aa-9776-4762-8967-d7f2cf55585e service nova] Acquiring lock "133076de-14b5-4ceb-aa41-d9acef8506c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:55:32 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-36efa9d3-af09-4817-9643-ef9d84b97529 req-af0842aa-9776-4762-8967-d7f2cf55585e service nova] Lock "133076de-14b5-4ceb-aa41-d9acef8506c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:55:32 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-36efa9d3-af09-4817-9643-ef9d84b97529 req-af0842aa-9776-4762-8967-d7f2cf55585e service nova] Lock "133076de-14b5-4ceb-aa41-d9acef8506c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:55:32 user nova-compute[72129]: DEBUG nova.compute.manager [req-36efa9d3-af09-4817-9643-ef9d84b97529 req-af0842aa-9776-4762-8967-d7f2cf55585e service nova] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] No waiting events found dispatching network-vif-plugged-09dc6abd-1d55-4e2d-8568-1f793ca45413 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:55:32 user nova-compute[72129]: WARNING nova.compute.manager [req-36efa9d3-af09-4817-9643-ef9d84b97529 req-af0842aa-9776-4762-8967-d7f2cf55585e service nova] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Received unexpected event network-vif-plugged-09dc6abd-1d55-4e2d-8568-1f793ca45413 for instance with vm_state building and task_state spawning.
Aug 01 13:55:33 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:55:33 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:55:33 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:55:33 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:55:34 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898134.6586936, 133076de-14b5-4ceb-aa41-d9acef8506c5 => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:55:34 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] VM Resumed (Lifecycle Event)
Aug 01 13:55:34 user nova-compute[72129]: DEBUG nova.compute.manager [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Instance event wait completed in 0 seconds for  {{(pid=72129) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 13:55:34 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Guest created on hypervisor {{(pid=72129) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 13:55:34 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Instance spawned successfully.
Aug 01 13:55:34 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 13:55:34 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:55:34 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 13:55:34 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Found default for hw_cdrom_bus of ide {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:55:34 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Found default for hw_disk_bus of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:55:34 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Found default for hw_input_bus of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:55:34 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Found default for hw_pointer_model of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:55:34 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Found default for hw_video_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:55:34 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Found default for hw_vif_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:55:34 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 13:55:34 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898134.659922, 133076de-14b5-4ceb-aa41-d9acef8506c5 => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:55:34 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] VM Started (Lifecycle Event)
Aug 01 13:55:34 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:55:34 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 13:55:34 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 13:55:34 user nova-compute[72129]: INFO nova.compute.manager [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Took 6.31 seconds to spawn the instance on the hypervisor.
Aug 01 13:55:34 user nova-compute[72129]: DEBUG nova.compute.manager [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:55:34 user nova-compute[72129]: DEBUG nova.compute.manager [req-edc995c3-8d67-4bb2-816f-1e5fa8d1cec0 req-76958765-5a1f-4135-98b8-25657d2f6cf7 service nova] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Received event network-vif-plugged-09dc6abd-1d55-4e2d-8568-1f793ca45413 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:55:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-edc995c3-8d67-4bb2-816f-1e5fa8d1cec0 req-76958765-5a1f-4135-98b8-25657d2f6cf7 service nova] Acquiring lock "133076de-14b5-4ceb-aa41-d9acef8506c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:55:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-edc995c3-8d67-4bb2-816f-1e5fa8d1cec0 req-76958765-5a1f-4135-98b8-25657d2f6cf7 service nova] Lock "133076de-14b5-4ceb-aa41-d9acef8506c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:55:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-edc995c3-8d67-4bb2-816f-1e5fa8d1cec0 req-76958765-5a1f-4135-98b8-25657d2f6cf7 service nova] Lock "133076de-14b5-4ceb-aa41-d9acef8506c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:55:34 user nova-compute[72129]: DEBUG nova.compute.manager [req-edc995c3-8d67-4bb2-816f-1e5fa8d1cec0 req-76958765-5a1f-4135-98b8-25657d2f6cf7 service nova] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] No waiting events found dispatching network-vif-plugged-09dc6abd-1d55-4e2d-8568-1f793ca45413 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:55:34 user nova-compute[72129]: WARNING nova.compute.manager [req-edc995c3-8d67-4bb2-816f-1e5fa8d1cec0 req-76958765-5a1f-4135-98b8-25657d2f6cf7 service nova] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Received unexpected event network-vif-plugged-09dc6abd-1d55-4e2d-8568-1f793ca45413 for instance with vm_state building and task_state spawning.
Aug 01 13:55:34 user nova-compute[72129]: INFO nova.compute.manager [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Took 7.12 seconds to build instance.
Aug 01 13:55:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-0e578402-c69e-4a3b-b9ac-dcecb8b6dfe8 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lock "133076de-14b5-4ceb-aa41-d9acef8506c5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.246s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:55:35 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:55:35 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:55:36 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:55:39 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:55:39 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Starting heal instance info cache {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 13:55:39 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Didn't find any instances for network info cache update. {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 13:55:39 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:55:39 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:55:40 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:55:40 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:55:40 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:55:41 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:55:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-acbaf701-6c75-4f90-b391-fd62c367ba8b tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Acquiring lock "a07aaeaa-322d-419e-86f5-65cd448c39e7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:55:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-acbaf701-6c75-4f90-b391-fd62c367ba8b tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Lock "a07aaeaa-322d-419e-86f5-65cd448c39e7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:55:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-acbaf701-6c75-4f90-b391-fd62c367ba8b tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Acquiring lock "a07aaeaa-322d-419e-86f5-65cd448c39e7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:55:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-acbaf701-6c75-4f90-b391-fd62c367ba8b tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Lock "a07aaeaa-322d-419e-86f5-65cd448c39e7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:55:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-acbaf701-6c75-4f90-b391-fd62c367ba8b tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Lock "a07aaeaa-322d-419e-86f5-65cd448c39e7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:55:41 user nova-compute[72129]: INFO nova.compute.manager [None req-acbaf701-6c75-4f90-b391-fd62c367ba8b tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Terminating instance
Aug 01 13:55:41 user nova-compute[72129]: DEBUG nova.compute.manager [None req-acbaf701-6c75-4f90-b391-fd62c367ba8b tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Start destroying the instance on the hypervisor. {{(pid=72129) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 13:55:41 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:55:41 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:55:41 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:55:41 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:55:41 user nova-compute[72129]: DEBUG nova.compute.manager [req-d1cceeb6-94d5-4d45-b634-aba7fdae6e2a req-f78c782d-901e-4fd6-9dbf-c7db8e8e8d9c service nova] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Received event network-vif-unplugged-f3403639-00ba-4c7c-983a-7995f60f2519 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:55:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-d1cceeb6-94d5-4d45-b634-aba7fdae6e2a req-f78c782d-901e-4fd6-9dbf-c7db8e8e8d9c service nova] Acquiring lock "a07aaeaa-322d-419e-86f5-65cd448c39e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:55:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-d1cceeb6-94d5-4d45-b634-aba7fdae6e2a req-f78c782d-901e-4fd6-9dbf-c7db8e8e8d9c service nova] Lock "a07aaeaa-322d-419e-86f5-65cd448c39e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:55:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-d1cceeb6-94d5-4d45-b634-aba7fdae6e2a req-f78c782d-901e-4fd6-9dbf-c7db8e8e8d9c service nova] Lock "a07aaeaa-322d-419e-86f5-65cd448c39e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:55:41 user nova-compute[72129]: DEBUG nova.compute.manager [req-d1cceeb6-94d5-4d45-b634-aba7fdae6e2a req-f78c782d-901e-4fd6-9dbf-c7db8e8e8d9c service nova] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] No waiting events found dispatching network-vif-unplugged-f3403639-00ba-4c7c-983a-7995f60f2519 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:55:41 user nova-compute[72129]: DEBUG nova.compute.manager [req-d1cceeb6-94d5-4d45-b634-aba7fdae6e2a req-f78c782d-901e-4fd6-9dbf-c7db8e8e8d9c service nova] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Received event network-vif-unplugged-f3403639-00ba-4c7c-983a-7995f60f2519 for instance with task_state deleting. {{(pid=72129) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 13:55:41 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Instance destroyed successfully.
Aug 01 13:55:41 user nova-compute[72129]: DEBUG nova.objects.instance [None req-acbaf701-6c75-4f90-b391-fd62c367ba8b tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Lazy-loading 'resources' on Instance uuid a07aaeaa-322d-419e-86f5-65cd448c39e7 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:55:41 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-acbaf701-6c75-4f90-b391-fd62c367ba8b tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T13:51:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2145562199',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-582848887',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHP4lq6QUMPS3pezcVQZPAh44QK9Cjc2FafAnYqVVnXmR/G2I0IR/iHbmL/nrBBWAYHzkIVIbYY+6AfkD3E0LtsteDcaYMG5TC80GmI1zAMDyri/eMn3gWGPdMZtuTTfcw==',key_name='tempest-keypair-1869868466',keypairs=<?>,launch_index=0,launched_at=2023-08-01T13:54:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ebef26e9d3654bf99ecf391ccb263330',ramdisk_id='',reservation_id='r-mcwbm2vy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1852542004',owner_user_name='tempest-ServerActionsV293TestJSON-1852542004-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T13:54:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37e6bf606d3041d9928c5e5d6f4a9063',uuid=a07aaeaa-322d-419e-86f5-65cd448c39e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f3403639-00ba-4c7c-983a-7995f60f2519", "address": "fa:16:3e:4b:01:bd", "network": {"id": "2338fb81-87b6-4976-a6ab-b4ea0218fa9b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-606840206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebef26e9d3654bf99ecf391ccb263330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3403639-00", "ovs_interfaceid": "f3403639-00ba-4c7c-983a-7995f60f2519", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 13:55:41 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-acbaf701-6c75-4f90-b391-fd62c367ba8b tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Converting VIF {"id": "f3403639-00ba-4c7c-983a-7995f60f2519", "address": "fa:16:3e:4b:01:bd", "network": {"id": "2338fb81-87b6-4976-a6ab-b4ea0218fa9b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-606840206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebef26e9d3654bf99ecf391ccb263330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3403639-00", "ovs_interfaceid": "f3403639-00ba-4c7c-983a-7995f60f2519", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:55:41 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-acbaf701-6c75-4f90-b391-fd62c367ba8b tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4b:01:bd,bridge_name='br-int',has_traffic_filtering=True,id=f3403639-00ba-4c7c-983a-7995f60f2519,network=Network(2338fb81-87b6-4976-a6ab-b4ea0218fa9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3403639-00') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:55:41 user nova-compute[72129]: DEBUG os_vif [None req-acbaf701-6c75-4f90-b391-fd62c367ba8b tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:01:bd,bridge_name='br-int',has_traffic_filtering=True,id=f3403639-00ba-4c7c-983a-7995f60f2519,network=Network(2338fb81-87b6-4976-a6ab-b4ea0218fa9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3403639-00') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 13:55:41 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:55:41 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf3403639-00, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:55:41 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:55:41 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 13:55:41 user nova-compute[72129]: INFO os_vif [None req-acbaf701-6c75-4f90-b391-fd62c367ba8b tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:01:bd,bridge_name='br-int',has_traffic_filtering=True,id=f3403639-00ba-4c7c-983a-7995f60f2519,network=Network(2338fb81-87b6-4976-a6ab-b4ea0218fa9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3403639-00')
Aug 01 13:55:41 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acbaf701-6c75-4f90-b391-fd62c367ba8b tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] calling os-brick to detach iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 13:55:41 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-acbaf701-6c75-4f90-b391-fd62c367ba8b tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, {'target_iqns': ['iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gilTSBJb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:55:41 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-acbaf701-6c75-4f90-b391-fd62c367ba8b tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 13:55:41 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-acbaf701-6c75-4f90-b391-fd62c367ba8b tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:55:41 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-acbaf701-6c75-4f90-b391-fd62c367ba8b tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:55:41 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-acbaf701-6c75-4f90-b391-fd62c367ba8b tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b', 0)] {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 13:55:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:55:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:55:41 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda72aaa-275a-4e17-84eb-41795aed5cf3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:55:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:55:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.051s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:55:41 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd0f475f-c36a-476f-aef1-5dc5f869b609]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:55:41 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-acbaf701-6c75-4f90-b391-fd62c367ba8b tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)
Aug 01 13:55:41 user nova-compute[72129]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)
Aug 01 13:55:41 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:55:41 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-acbaf701-6c75-4f90-b391-fd62c367ba8b tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)
Aug 01 13:55:41 user nova-compute[72129]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b (non-flash)
Aug 01 13:55:41 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:55:41 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-acbaf701-6c75-4f90-b391-fd62c367ba8b tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2810423be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b'): ({'sdc'}, set())}) {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 13:55:41 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-acbaf701-6c75-4f90-b391-fd62c367ba8b tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Removing single pathed devices sdc {{(pid=72129) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 13:55:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:55:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:55:41 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc466b0-59ae-4c90-86b7-3678254715d4]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:55:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:55:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:55:42 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ec13ac-daec-4ae6-8d8a-a05ffb291f57]: (4, ('ok\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:55:42 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-acbaf701-6c75-4f90-b391-fd62c367ba8b tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Flushing IO for device /dev/sdc {{(pid=72129) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 13:55:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:55:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:55:42 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59f85a2-582b-431d-9d33-9219a8795f91]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:55:42 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-acbaf701-6c75-4f90-b391-fd62c367ba8b tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72129) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 13:55:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:55:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:55:42 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a935d0d-fd56-487c-8a38-7138eb4317d5]: (4, ('1', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:55:42 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-acbaf701-6c75-4f90-b391-fd62c367ba8b tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 13:55:42 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-acbaf701-6c75-4f90-b391-fd62c367ba8b tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] SCSI volumes sdc have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 13:55:42 user nova-compute[72129]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26164333761333862', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_ca461b8d', '/dev/disk/by-id/scsi-1SCST_BIOca461b8d-ad37a38b188da541') {{(pid=82887) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 01 13:55:42 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e03d9ce-912e-4659-b9fc-eb3e2574f47d]: (4, None) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:55:42 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-acbaf701-6c75-4f90-b391-fd62c367ba8b tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b')] {{(pid=72129) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 13:55:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:55:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:55:42 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36c8dbb-4b5c-46f0-8066-2a24ade7b5dc]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:55:42 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-acbaf701-6c75-4f90-b391-fd62c367ba8b tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:55:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b -p 172.16.0.220:3260 --logout {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:55:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:55:42 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56aba46-4e2a-4f17-86c6-df6cebb9cfd3]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:55:42 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-acbaf701-6c75-4f90-b391-fd62c367ba8b tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b, portal: 172.16.0.220,3260]
Aug 01 13:55:42 user nova-compute[72129]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b, portal: 172.16.0.220,3260] successful.
Aug 01 13:55:42 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:55:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b -p 172.16.0.220:3260 --op delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:55:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b0dd53d-1f22-4c51-adec-a83e1193589b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:55:42 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[614354a6-8814-45f4-9501-29b9f307fcb9]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:55:42 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-acbaf701-6c75-4f90-b391-fd62c367ba8b tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:55:42 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-acbaf701-6c75-4f90-b391-fd62c367ba8b tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:55:42 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-acbaf701-6c75-4f90-b391-fd62c367ba8b tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] <== disconnect_volume: return (352ms) None {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:55:42 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acbaf701-6c75-4f90-b391-fd62c367ba8b tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Disconnected iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 13:55:42 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-acbaf701-6c75-4f90-b391-fd62c367ba8b tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Deleting instance files /opt/stack/data/nova/instances/a07aaeaa-322d-419e-86f5-65cd448c39e7_del
Aug 01 13:55:42 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-acbaf701-6c75-4f90-b391-fd62c367ba8b tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Deletion of /opt/stack/data/nova/instances/a07aaeaa-322d-419e-86f5-65cd448c39e7_del complete
Aug 01 13:55:42 user nova-compute[72129]: INFO nova.compute.manager [None req-acbaf701-6c75-4f90-b391-fd62c367ba8b tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Took 1.25 seconds to destroy the instance on the hypervisor.
Aug 01 13:55:42 user nova-compute[72129]: DEBUG oslo.service.loopingcall [None req-acbaf701-6c75-4f90-b391-fd62c367ba8b tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72129) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 13:55:42 user nova-compute[72129]: DEBUG nova.compute.manager [-] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Deallocating network for instance {{(pid=72129) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 13:55:42 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] deallocate_for_instance() {{(pid=72129) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 13:55:43 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:55:43 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72129) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 13:55:43 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:55:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:55:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:55:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:55:43 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Auditing locally available compute resources for user (node: user) {{(pid=72129) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 13:55:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:55:43 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:55:43 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Took 0.98 seconds to deallocate network for instance.
Aug 01 13:55:43 user nova-compute[72129]: DEBUG nova.compute.manager [req-5e369a4f-2e82-4b3e-a146-c70c1795bd2a req-9215f8cd-2566-4619-a88e-72b6b1567ee9 service nova] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Received event network-vif-deleted-f3403639-00ba-4c7c-983a-7995f60f2519 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:55:43 user nova-compute[72129]: INFO nova.compute.manager [req-5e369a4f-2e82-4b3e-a146-c70c1795bd2a req-9215f8cd-2566-4619-a88e-72b6b1567ee9 service nova] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Neutron deleted interface f3403639-00ba-4c7c-983a-7995f60f2519; detaching it from the instance and deleting it from the info cache
Aug 01 13:55:43 user nova-compute[72129]: DEBUG nova.network.neutron [req-5e369a4f-2e82-4b3e-a146-c70c1795bd2a req-9215f8cd-2566-4619-a88e-72b6b1567ee9 service nova] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:55:43 user nova-compute[72129]: DEBUG nova.compute.manager [req-5e369a4f-2e82-4b3e-a146-c70c1795bd2a req-9215f8cd-2566-4619-a88e-72b6b1567ee9 service nova] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Detach interface failed, port_id=f3403639-00ba-4c7c-983a-7995f60f2519, reason: Instance a07aaeaa-322d-419e-86f5-65cd448c39e7 could not be found. {{(pid=72129) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 13:55:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:55:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:55:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:55:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133076de-14b5-4ceb-aa41-d9acef8506c5/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:55:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133076de-14b5-4ceb-aa41-d9acef8506c5/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:55:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133076de-14b5-4ceb-aa41-d9acef8506c5/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:55:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133076de-14b5-4ceb-aa41-d9acef8506c5/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:55:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28115c7d-544a-4504-98da-2398e0e354d8/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:55:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28115c7d-544a-4504-98da-2398e0e354d8/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:55:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28115c7d-544a-4504-98da-2398e0e354d8/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:55:44 user nova-compute[72129]: INFO nova.compute.manager [None req-acbaf701-6c75-4f90-b391-fd62c367ba8b tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Took 0.80 seconds to detach 1 volumes for instance.
Aug 01 13:55:44 user nova-compute[72129]: DEBUG nova.compute.manager [req-2a76434c-b5df-49c6-a377-c6e091795354 req-2eac3056-a0c7-47b9-8295-50c775862ced service nova] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Received event network-vif-plugged-f3403639-00ba-4c7c-983a-7995f60f2519 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:55:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-2a76434c-b5df-49c6-a377-c6e091795354 req-2eac3056-a0c7-47b9-8295-50c775862ced service nova] Acquiring lock "a07aaeaa-322d-419e-86f5-65cd448c39e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:55:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-2a76434c-b5df-49c6-a377-c6e091795354 req-2eac3056-a0c7-47b9-8295-50c775862ced service nova] Lock "a07aaeaa-322d-419e-86f5-65cd448c39e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:55:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-2a76434c-b5df-49c6-a377-c6e091795354 req-2eac3056-a0c7-47b9-8295-50c775862ced service nova] Lock "a07aaeaa-322d-419e-86f5-65cd448c39e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:55:44 user nova-compute[72129]: DEBUG nova.compute.manager [req-2a76434c-b5df-49c6-a377-c6e091795354 req-2eac3056-a0c7-47b9-8295-50c775862ced service nova] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] No waiting events found dispatching network-vif-plugged-f3403639-00ba-4c7c-983a-7995f60f2519 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:55:44 user nova-compute[72129]: WARNING nova.compute.manager [req-2a76434c-b5df-49c6-a377-c6e091795354 req-2eac3056-a0c7-47b9-8295-50c775862ced service nova] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Received unexpected event network-vif-plugged-f3403639-00ba-4c7c-983a-7995f60f2519 for instance with vm_state active and task_state deleting.
Aug 01 13:55:44 user nova-compute[72129]: DEBUG nova.compute.manager [None req-acbaf701-6c75-4f90-b391-fd62c367ba8b tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Deleting volume: 5b0dd53d-1f22-4c51-adec-a83e1193589b {{(pid=72129) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 01 13:55:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28115c7d-544a-4504-98da-2398e0e354d8/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:55:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:55:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-acbaf701-6c75-4f90-b391-fd62c367ba8b tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:55:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-acbaf701-6c75-4f90-b391-fd62c367ba8b tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:55:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:55:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:55:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:55:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31105963-52fa-4aff-9270-075cd98f08a5/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:55:44 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-acbaf701-6c75-4f90-b391-fd62c367ba8b tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Refreshing inventories for resource provider c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 13:55:44 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-acbaf701-6c75-4f90-b391-fd62c367ba8b tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Updating ProviderTree inventory for provider c2f345c3-9b82-4164-b21d-1eef8e661842 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 13:55:44 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-acbaf701-6c75-4f90-b391-fd62c367ba8b tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Updating inventory in ProviderTree for provider c2f345c3-9b82-4164-b21d-1eef8e661842 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 13:55:44 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-acbaf701-6c75-4f90-b391-fd62c367ba8b tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Refreshing aggregate associations for resource provider c2f345c3-9b82-4164-b21d-1eef8e661842, aggregates: None {{(pid=72129) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 13:55:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31105963-52fa-4aff-9270-075cd98f08a5/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:55:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31105963-52fa-4aff-9270-075cd98f08a5/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:55:44 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-acbaf701-6c75-4f90-b391-fd62c367ba8b tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Refreshing trait associations for resource provider c2f345c3-9b82-4164-b21d-1eef8e661842, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE {{(pid=72129) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 13:55:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31105963-52fa-4aff-9270-075cd98f08a5/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:55:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63c0c1fe-7e4d-4763-8ede-a7662747a4c0/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:55:45 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63c0c1fe-7e4d-4763-8ede-a7662747a4c0/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:55:45 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63c0c1fe-7e4d-4763-8ede-a7662747a4c0/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:55:45 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-acbaf701-6c75-4f90-b391-fd62c367ba8b tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 13:55:45 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-acbaf701-6c75-4f90-b391-fd62c367ba8b tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 13:55:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-acbaf701-6c75-4f90-b391-fd62c367ba8b tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.865s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:55:45 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63c0c1fe-7e4d-4763-8ede-a7662747a4c0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:55:45 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efa87a6-1dd6-4441-a55e-8e86be7f0a35/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:55:45 user nova-compute[72129]: INFO nova.scheduler.client.report [None req-acbaf701-6c75-4f90-b391-fd62c367ba8b tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Deleted allocations for instance a07aaeaa-322d-419e-86f5-65cd448c39e7
Aug 01 13:55:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-acbaf701-6c75-4f90-b391-fd62c367ba8b tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Lock "a07aaeaa-322d-419e-86f5-65cd448c39e7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.308s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:55:45 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efa87a6-1dd6-4441-a55e-8e86be7f0a35/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:55:45 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efa87a6-1dd6-4441-a55e-8e86be7f0a35/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:55:45 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efa87a6-1dd6-4441-a55e-8e86be7f0a35/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:55:45 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 13:55:45 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:55:46 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:55:46 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:55:46 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Hypervisor/Node resource view: name=user free_ram=7774MB free_disk=25.512290954589844GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72129) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 13:55:46 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:55:46 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:55:46 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Applying migration context for instance 2efa87a6-1dd6-4441-a55e-8e86be7f0a35 as it has an incoming, in-progress migration 4d3294df-2b0a-4f01-b65f-59aefa59e918. Migration status is reverting {{(pid=72129) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 01 13:55:46 user nova-compute[72129]: INFO nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Updating resource usage from migration 4d3294df-2b0a-4f01-b65f-59aefa59e918
Aug 01 13:55:46 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 63c0c1fe-7e4d-4763-8ede-a7662747a4c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:55:46 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 28115c7d-544a-4504-98da-2398e0e354d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:55:46 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 31105963-52fa-4aff-9270-075cd98f08a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:55:46 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 97a5dccf-b499-443a-b332-cfa293a16047 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:55:46 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Migration 4d3294df-2b0a-4f01-b65f-59aefa59e918 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 01 13:55:46 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 2efa87a6-1dd6-4441-a55e-8e86be7f0a35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:55:46 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:55:46 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 133076de-14b5-4ceb-aa41-d9acef8506c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:55:46 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 13:55:46 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=27GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 13:55:46 user nova-compute[72129]: DEBUG nova.network.neutron [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Port d59c6949-2748-4a57-b089-6219f9102815 binding to destination host user is already ACTIVE {{(pid=72129) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 01 13:55:46 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Acquiring lock "refresh_cache-2efa87a6-1dd6-4441-a55e-8e86be7f0a35" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:55:46 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Acquired lock "refresh_cache-2efa87a6-1dd6-4441-a55e-8e86be7f0a35" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:55:46 user nova-compute[72129]: DEBUG nova.network.neutron [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 13:55:46 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 13:55:46 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 13:55:46 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Compute_service record updated for user:user {{(pid=72129) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 13:55:46 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.471s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:55:46 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:55:46 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Cleaning up deleted instances {{(pid=72129) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 13:55:46 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] There are 0 instances to clean {{(pid=72129) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 13:55:46 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:55:46 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72129) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 13:55:46 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:55:46 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:55:47 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:55:47 user nova-compute[72129]: DEBUG nova.network.neutron [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Updating instance_info_cache with network_info: [{"id": "d59c6949-2748-4a57-b089-6219f9102815", "address": "fa:16:3e:20:eb:cf", "network": {"id": "4de0d3ee-7981-427b-9013-99cf0bc22cf8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-289359635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d693a983e4a44434b64c7983239371a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd59c6949-27", "ovs_interfaceid": "d59c6949-2748-4a57-b089-6219f9102815", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:55:47 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Releasing lock "refresh_cache-2efa87a6-1dd6-4441-a55e-8e86be7f0a35" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:55:47 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Creating tmpfile /opt/stack/data/nova/instances/2efa87a6-1dd6-4441-a55e-8e86be7f0a35/tmp1xxpi71k to verify with other compute node that the instance is on the same shared storage. {{(pid=72129) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Aug 01 13:55:47 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:55:47 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:55:47 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:55:47 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:55:47 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:55:47 user nova-compute[72129]: DEBUG nova.compute.manager [req-818dd9b2-8318-4b5d-9cf4-82ee04c5228c req-08323499-2fa0-40eb-858e-3435ef54d1cb service nova] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Received event network-vif-unplugged-d59c6949-2748-4a57-b089-6219f9102815 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:55:47 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-818dd9b2-8318-4b5d-9cf4-82ee04c5228c req-08323499-2fa0-40eb-858e-3435ef54d1cb service nova] Acquiring lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:55:47 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-818dd9b2-8318-4b5d-9cf4-82ee04c5228c req-08323499-2fa0-40eb-858e-3435ef54d1cb service nova] Lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:55:47 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-818dd9b2-8318-4b5d-9cf4-82ee04c5228c req-08323499-2fa0-40eb-858e-3435ef54d1cb service nova] Lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:55:47 user nova-compute[72129]: DEBUG nova.compute.manager [req-818dd9b2-8318-4b5d-9cf4-82ee04c5228c req-08323499-2fa0-40eb-858e-3435ef54d1cb service nova] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] No waiting events found dispatching network-vif-unplugged-d59c6949-2748-4a57-b089-6219f9102815 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:55:47 user nova-compute[72129]: WARNING nova.compute.manager [req-818dd9b2-8318-4b5d-9cf4-82ee04c5228c req-08323499-2fa0-40eb-858e-3435ef54d1cb service nova] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Received unexpected event network-vif-unplugged-d59c6949-2748-4a57-b089-6219f9102815 for instance with vm_state resized and task_state resize_reverting.
Aug 01 13:55:47 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:55:47 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Instance destroyed successfully.
Aug 01 13:55:47 user nova-compute[72129]: DEBUG nova.objects.instance [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Lazy-loading 'resources' on Instance uuid 2efa87a6-1dd6-4441-a55e-8e86be7f0a35 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:55:47 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:49:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1892996256',display_name='tempest-ServerActionsTestOtherB-server-1892996256',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1892996256',id=3,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEv1XQzBjYoYpbhYYzAkxCcHUbemRkkK9uL3KJrV3p8Too9wSnun/4eb7cYSvdSK/lx7EWwYazfwFvI3n8xQWjsYEP2mWFNbGfwKAUlfbILCQIuiMev2z7hB1YDNH/wWXQ==',key_name='tempest-keypair-539050345',keypairs=<?>,launch_index=0,launched_at=2023-08-01T13:54:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d693a983e4a44434b64c7983239371a4',ramdisk_id='',reservation_id='r-ghzodbos',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-398231514',owner_user_name='tempest-ServerActionsTestOtherB-398231514-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T13:54:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1936f560fd794910af1fa6e9c4fffa90',uuid=2efa87a6-1dd6-4441-a55e-8e86be7f0a35,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "d59c6949-2748-4a57-b089-6219f9102815", "address": "fa:16:3e:20:eb:cf", "network": {"id": "4de0d3ee-7981-427b-9013-99cf0bc22cf8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-289359635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d693a983e4a44434b64c7983239371a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd59c6949-27", "ovs_interfaceid": "d59c6949-2748-4a57-b089-6219f9102815", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 13:55:47 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Converting VIF {"id": "d59c6949-2748-4a57-b089-6219f9102815", "address": "fa:16:3e:20:eb:cf", "network": {"id": "4de0d3ee-7981-427b-9013-99cf0bc22cf8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-289359635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d693a983e4a44434b64c7983239371a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd59c6949-27", "ovs_interfaceid": "d59c6949-2748-4a57-b089-6219f9102815", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:55:47 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:20:eb:cf,bridge_name='br-int',has_traffic_filtering=True,id=d59c6949-2748-4a57-b089-6219f9102815,network=Network(4de0d3ee-7981-427b-9013-99cf0bc22cf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd59c6949-27') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:55:47 user nova-compute[72129]: DEBUG os_vif [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:eb:cf,bridge_name='br-int',has_traffic_filtering=True,id=d59c6949-2748-4a57-b089-6219f9102815,network=Network(4de0d3ee-7981-427b-9013-99cf0bc22cf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd59c6949-27') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 13:55:47 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:55:47 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd59c6949-27, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:55:47 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:55:47 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:55:47 user nova-compute[72129]: INFO os_vif [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:eb:cf,bridge_name='br-int',has_traffic_filtering=True,id=d59c6949-2748-4a57-b089-6219f9102815,network=Network(4de0d3ee-7981-427b-9013-99cf0bc22cf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd59c6949-27')
Aug 01 13:55:47 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] calling os-brick to detach iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 13:55:47 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, {'target_iqns': ['iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gmPMFjbA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:55:47 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 13:55:47 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:55:47 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:55:47 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17', 0)] {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 13:55:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:55:48 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:55:48 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3c78cd-2ee1-46cf-bcfe-fa5039ee6822]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:55:48 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:55:48 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:55:48 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cac1bba-d4f5-4cee-bdff-e176f0d17c74]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:55:48 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)
Aug 01 13:55:48 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:55:48 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)
Aug 01 13:55:48 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:55:48 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f282e02a440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17'): ({'sdb'}, set())}) {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 13:55:48 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Removing single pathed devices sdb {{(pid=72129) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 13:55:48 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:55:48 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:55:48 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb010c4-096a-4e6e-b15f-3940579f520a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:55:48 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:55:48 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.034s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:55:48 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d35a72d-3205-48b8-ad5a-60c6093e9eac]: (4, ('ok\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:55:48 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Flushing IO for device /dev/sdb {{(pid=72129) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 13:55:48 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:55:48 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:55:48 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[8718aec3-0224-4bab-90b2-185e099c066d]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:55:48 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72129) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 13:55:48 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:55:48 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:55:48 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[71253f0c-3f5d-4883-b709-83d07e7b5c51]: (4, ('1', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:55:48 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 13:55:48 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] SCSI volumes sdb have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 13:55:48 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17')] {{(pid=72129) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 13:55:48 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:55:48 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:55:48 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab468c34-df1c-41aa-8afa-09923067082e]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:55:48 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:55:48 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 -p 172.16.0.220:3260 --logout {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:55:48 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:55:48 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22a8ecc-c619-4d68-a80e-222147ffa1d6]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:55:48 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17, portal: 172.16.0.220,3260]
Aug 01 13:55:48 user nova-compute[72129]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17, portal: 172.16.0.220,3260] successful.
Aug 01 13:55:48 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:55:48 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 -p 172.16.0.220:3260 --op delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:55:48 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:55:48 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ea568a-3626-4ee8-b17f-c5b47602efb8]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:55:48 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:55:48 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:55:48 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] <== disconnect_volume: return (328ms) None {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:55:48 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Disconnected iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 13:55:49 user nova-compute[72129]: DEBUG nova.compute.manager [req-3b09bc01-9630-4a6f-a149-41117a53b3a6 req-f3875a10-7f48-4bee-9055-f2f38c682723 service nova] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Received event network-vif-plugged-d59c6949-2748-4a57-b089-6219f9102815 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:55:49 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-3b09bc01-9630-4a6f-a149-41117a53b3a6 req-f3875a10-7f48-4bee-9055-f2f38c682723 service nova] Acquiring lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:55:49 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-3b09bc01-9630-4a6f-a149-41117a53b3a6 req-f3875a10-7f48-4bee-9055-f2f38c682723 service nova] Lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:55:49 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-3b09bc01-9630-4a6f-a149-41117a53b3a6 req-f3875a10-7f48-4bee-9055-f2f38c682723 service nova] Lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:55:49 user nova-compute[72129]: DEBUG nova.compute.manager [req-3b09bc01-9630-4a6f-a149-41117a53b3a6 req-f3875a10-7f48-4bee-9055-f2f38c682723 service nova] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] No waiting events found dispatching network-vif-plugged-d59c6949-2748-4a57-b089-6219f9102815 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:55:49 user nova-compute[72129]: WARNING nova.compute.manager [req-3b09bc01-9630-4a6f-a149-41117a53b3a6 req-f3875a10-7f48-4bee-9055-f2f38c682723 service nova] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Received unexpected event network-vif-plugged-d59c6949-2748-4a57-b089-6219f9102815 for instance with vm_state resized and task_state resize_reverting.
Aug 01 13:55:49 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:55:49 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:55:49 user nova-compute[72129]: DEBUG nova.objects.instance [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Lazy-loading 'migration_context' on Instance uuid 2efa87a6-1dd6-4441-a55e-8e86be7f0a35 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:55:50 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 13:55:50 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 13:55:50 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.409s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:55:50 user nova-compute[72129]: INFO nova.compute.manager [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Swapping old allocation on dict_keys(['c2f345c3-9b82-4164-b21d-1eef8e661842']) held by migration 4d3294df-2b0a-4f01-b65f-59aefa59e918 for instance
Aug 01 13:55:50 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:55:50 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Overwriting current allocation {'allocations': {'c2f345c3-9b82-4164-b21d-1eef8e661842': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 21}}, 'project_id': 'd693a983e4a44434b64c7983239371a4', 'user_id': '1936f560fd794910af1fa6e9c4fffa90', 'consumer_generation': 1} on consumer 2efa87a6-1dd6-4441-a55e-8e86be7f0a35 {{(pid=72129) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Aug 01 13:55:50 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:55:50 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Acquiring lock "refresh_cache-2efa87a6-1dd6-4441-a55e-8e86be7f0a35" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:55:50 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Acquired lock "refresh_cache-2efa87a6-1dd6-4441-a55e-8e86be7f0a35" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:55:50 user nova-compute[72129]: DEBUG nova.network.neutron [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 13:55:51 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:55:51 user nova-compute[72129]: DEBUG nova.compute.manager [None req-5171f51f-b03b-4b23-8120-22761fc7320b tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:55:51 user nova-compute[72129]: INFO nova.compute.manager [None req-5171f51f-b03b-4b23-8120-22761fc7320b tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] instance snapshotting
Aug 01 13:55:51 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-5171f51f-b03b-4b23-8120-22761fc7320b tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Beginning live snapshot process
Aug 01 13:55:51 user nova-compute[72129]: DEBUG nova.network.neutron [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Updating instance_info_cache with network_info: [{"id": "d59c6949-2748-4a57-b089-6219f9102815", "address": "fa:16:3e:20:eb:cf", "network": {"id": "4de0d3ee-7981-427b-9013-99cf0bc22cf8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-289359635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d693a983e4a44434b64c7983239371a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd59c6949-27", "ovs_interfaceid": "d59c6949-2748-4a57-b089-6219f9102815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:55:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Releasing lock "refresh_cache-2efa87a6-1dd6-4441-a55e-8e86be7f0a35" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:55:51 user nova-compute[72129]: DEBUG os_brick.utils [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:55:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:55:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:55:51 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e5cc95-19ea-4680-b7f9-8ca09e7ba265]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f9b449c2cd3d\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:55:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:55:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.025s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:55:51 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bfa0c77-cf09-4a81-ae4a-d94df3204d66]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:55:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:55:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-5171f51f-b03b-4b23-8120-22761fc7320b tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json -f qcow2 {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:55:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:55:51 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8dfb4a4-8c68-456b-ac26-2e8a11f377a4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:55:51 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[e920e7f7-ed88-433f-a142-01a8e9a5f52c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:55:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Running cmd (subprocess): nvme version {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:55:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] 'nvme version' failed. Not Retrying. {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 13:55:51 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] nvme not present on system {{(pid=72129) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 13:55:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:55:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 13:55:51 user nova-compute[72129]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 13:55:51 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[728a92be-9bdd-48e7-a349-6a31de483054]: (4, '') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:55:51 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72129) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 13:55:51 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 13:55:51 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] LIGHTOS: no hostnqn found. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 13:55:51 user nova-compute[72129]: DEBUG os_brick.utils [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] <== get_connector_properties: return (177ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f9b449c2cd3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:55:52 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-5171f51f-b03b-4b23-8120-22761fc7320b tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json -f qcow2" returned: 0 in 0.184s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:55:52 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-5171f51f-b03b-4b23-8120-22761fc7320b tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json -f qcow2 {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:55:52 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-5171f51f-b03b-4b23-8120-22761fc7320b tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json -f qcow2" returned: 0 in 0.163s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:55:52 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-5171f51f-b03b-4b23-8120-22761fc7320b tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:55:52 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-5171f51f-b03b-4b23-8120-22761fc7320b tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.150s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:55:52 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-5171f51f-b03b-4b23-8120-22761fc7320b tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp8q08l3vl/492ba96a19a34f2caad04c6aa81e0eab.delta 1073741824 {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:55:52 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-5171f51f-b03b-4b23-8120-22761fc7320b tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp8q08l3vl/492ba96a19a34f2caad04c6aa81e0eab.delta 1073741824" returned: 0 in 0.058s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:55:52 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-5171f51f-b03b-4b23-8120-22761fc7320b tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 01 13:55:52 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:55:53 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-5171f51f-b03b-4b23-8120-22761fc7320b tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72129) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 13:55:53 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-5171f51f-b03b-4b23-8120-22761fc7320b tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72129) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 13:55:53 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-5171f51f-b03b-4b23-8120-22761fc7320b tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 01 13:55:53 user nova-compute[72129]: DEBUG nova.privsep.utils [None req-5171f51f-b03b-4b23-8120-22761fc7320b tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72129) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 13:55:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-5171f51f-b03b-4b23-8120-22761fc7320b tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp8q08l3vl/492ba96a19a34f2caad04c6aa81e0eab.delta /opt/stack/data/nova/instances/snapshots/tmp8q08l3vl/492ba96a19a34f2caad04c6aa81e0eab {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:55:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-5171f51f-b03b-4b23-8120-22761fc7320b tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp8q08l3vl/492ba96a19a34f2caad04c6aa81e0eab.delta /opt/stack/data/nova/instances/snapshots/tmp8q08l3vl/492ba96a19a34f2caad04c6aa81e0eab" returned: 0 in 0.503s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:55:54 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-5171f51f-b03b-4b23-8120-22761fc7320b tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Snapshot extracted, beginning image upload
Aug 01 13:55:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:55:56 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:55:56 user nova-compute[72129]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690898141.8222606, a07aaeaa-322d-419e-86f5-65cd448c39e7 => Stopped> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:55:56 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] VM Stopped (Lifecycle Event)
Aug 01 13:55:56 user nova-compute[72129]: DEBUG nova.compute.manager [None req-1c2119ea-fee6-4d84-bfee-3e18bd9dc7f3 None None] [instance: a07aaeaa-322d-419e-86f5-65cd448c39e7] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:55:57 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-5171f51f-b03b-4b23-8120-22761fc7320b tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Snapshot image upload complete
Aug 01 13:55:57 user nova-compute[72129]: INFO nova.compute.manager [None req-5171f51f-b03b-4b23-8120-22761fc7320b tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Took 5.84 seconds to snapshot the instance on the hypervisor.
Aug 01 13:55:57 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:55:58 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:56:00 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:56:01 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Starting finish_revert_migration {{(pid=72129) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Aug 01 13:56:01 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Start _get_guest_xml network_info=[{"id": "d59c6949-2748-4a57-b089-6219f9102815", "address": "fa:16:3e:20:eb:cf", "network": {"id": "4de0d3ee-7981-427b-9013-99cf0bc22cf8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-289359635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d693a983e4a44434b64c7983239371a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd59c6949-27", "ovs_interfaceid": "d59c6949-2748-4a57-b089-6219f9102815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'image_id': 'b6472c34-1b0f-4034-ba3a-7e8eb5103715'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'attachment_id': 'caca2da3-4b14-4044-9c67-eea3f7be012d', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gmPMFjbA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '2efa87a6-1dd6-4441-a55e-8e86be7f0a35', 'attached_at': '2023-08-01T13:56:01.000000', 'detached_at': '', 'volume_id': '4abb01c8-017a-4ccc-a2dd-024a94775c17', 'serial': '4abb01c8-017a-4ccc-a2dd-024a94775c17'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 13:56:01 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:56:01 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:56:01 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 13:56:01 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] CPU controller missing on host. {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 13:56:01 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 13:56:01 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] CPU controller found on host. {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 13:56:01 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72129) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 13:56:01 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T13:45:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 13:56:01 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Flavor limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 13:56:01 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Image limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 13:56:01 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Flavor pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 13:56:01 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Image pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 13:56:01 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 13:56:01 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 13:56:01 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 13:56:01 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Got 1 possible topologies {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 13:56:01 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 13:56:01 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 13:56:01 user nova-compute[72129]: DEBUG nova.objects.instance [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2efa87a6-1dd6-4441-a55e-8e86be7f0a35 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:56:01 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Calling os-brick to attach iSCSI Volume {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 13:56:01 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gmPMFjbA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:56:01 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 13:56:01 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:56:01 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:56:01 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 13:56:01 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:56:01 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:56:01 user nova-compute[72129]: INFO os_brick.initiator.connectors.iscsi [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 13:56:01 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 -p 172.16.0.220:3260 {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:56:01 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 -p 172.16.0.220:3260" returned: 21 in 0.067s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:56:01 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d002ca8-c42e-4254-9f79-6fc9439f4592]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:56:01 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 13:56:01 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:56:01 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 -p 172.16.0.220:3260 --interface default --op new {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:56:01 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:56:01 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[739f3a11-7756-4bfc-9d3c-2e77b6ecc983]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17] added\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:56:01 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17] added
Aug 01 13:56:01 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:56:01 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:56:01 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:56:01 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e1b1fd-e486-487f-be97-7920173a5381]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:56:01 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:56:01 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:56:01 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:56:01 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[034bf63a-00ad-4e1e-b1fe-1cbb16b6a1d2]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:56:01 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:56:01 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gmPMFjbA {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:56:01 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gmPMFjbA" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:56:01 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbadc5d7-eddf-4872-bed5-17ae08524ecc]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:56:01 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gmPMFjbA'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:56:01 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:56:01 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:56:01 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe319d3e-e1ec-4248-af5f-51d4cef9fac2]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:56:01 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:56:01 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:56:01 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:56:01 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e9038a-ce9d-4353-b18b-99e62f7bf120]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:56:01 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 13:56:01 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:56:01 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 13:56:01 user nova-compute[72129]:  {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:56:01 user nova-compute[72129]: WARNING os_brick.initiator.connectors.iscsi [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 13:56:01 user nova-compute[72129]: 
Aug 01 13:56:01 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 -p 172.16.0.220:3260 --login {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:56:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:56:02 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b4261d-6970-406a-8722-cb77e09befdc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:56:02 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17, portal: 172.16.0.220,3260]
Aug 01 13:56:02 user nova-compute[72129]: Login to [iface: default, target: iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17, portal: 172.16.0.220,3260] successful.
Aug 01 13:56:02 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:56:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:56:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:56:02 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96e6469-1616-497b-86d4-fe0dac2d14cc]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:56:02 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:56:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:56:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:56:02 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c5bcbd-f432-40d0-8e33-c0adf598eae0]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:56:02 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)
Aug 01 13:56:02 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:56:02 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)
Aug 01 13:56:02 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:56:02 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.353s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:56:02 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Connected to 172.16.0.220:3260 {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 13:56:02 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] HCTL ('33', '-', '-', 0) found on session 20 with lun 0 {{(pid=72129) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 13:56:02 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72129) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 13:56:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:56:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:56:02 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae0f1e7-5241-4b6f-b856-c073626d74fc]: (4, ('- - 0', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:56:02 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 13:56:02 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gmPMFjbA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 13:56:02 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:56:02 user nova-compute[72129]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690898147.9269085, 2efa87a6-1dd6-4441-a55e-8e86be7f0a35 => Stopped> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:56:02 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] VM Stopped (Lifecycle Event)
Aug 01 13:56:02 user nova-compute[72129]: DEBUG nova.compute.manager [None req-35bb4406-8130-4a72-8a6b-1cc3767da8e3 None None] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:56:02 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:56:03 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.396s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:56:03 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] <== connect_volume: return (1397ms) {'type': 'block', 'scsi_wwn': '23463373065393332', 'path': '/dev/sdb'} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:56:03 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23463373065393332', 'path': '/dev/sdb'} {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 13:56:03 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:49:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1892996256',display_name='tempest-ServerActionsTestOtherB-server-1892996256',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1892996256',id=3,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEv1XQzBjYoYpbhYYzAkxCcHUbemRkkK9uL3KJrV3p8Too9wSnun/4eb7cYSvdSK/lx7EWwYazfwFvI3n8xQWjsYEP2mWFNbGfwKAUlfbILCQIuiMev2z7hB1YDNH/wWXQ==',key_name='tempest-keypair-539050345',keypairs=<?>,launch_index=0,launched_at=2023-08-01T13:54:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d693a983e4a44434b64c7983239371a4',ramdisk_id='',reservation_id='r-ghzodbos',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-398231514',owner_user_name='tempest-ServerActionsTestOtherB-398231514-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T13:55:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1936f560fd794910af1fa6e9c4fffa90',uuid=2efa87a6-1dd6-4441-a55e-8e86be7f0a35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "d59c6949-2748-4a57-b089-6219f9102815", "address": "fa:16:3e:20:eb:cf", "network": {"id": "4de0d3ee-7981-427b-9013-99cf0bc22cf8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-289359635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d693a983e4a44434b64c7983239371a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd59c6949-27", "ovs_interfaceid": "d59c6949-2748-4a57-b089-6219f9102815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 13:56:03 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Converting VIF {"id": "d59c6949-2748-4a57-b089-6219f9102815", "address": "fa:16:3e:20:eb:cf", "network": {"id": "4de0d3ee-7981-427b-9013-99cf0bc22cf8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-289359635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d693a983e4a44434b64c7983239371a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd59c6949-27", "ovs_interfaceid": "d59c6949-2748-4a57-b089-6219f9102815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:56:03 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:eb:cf,bridge_name='br-int',has_traffic_filtering=True,id=d59c6949-2748-4a57-b089-6219f9102815,network=Network(4de0d3ee-7981-427b-9013-99cf0bc22cf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd59c6949-27') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:56:03 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] End _get_guest_xml xml=<domain type="kvm">
Aug 01 13:56:03 user nova-compute[72129]:   <uuid>2efa87a6-1dd6-4441-a55e-8e86be7f0a35</uuid>
Aug 01 13:56:03 user nova-compute[72129]:   <name>instance-00000003</name>
Aug 01 13:56:03 user nova-compute[72129]:   <memory>524288</memory>
Aug 01 13:56:03 user nova-compute[72129]:   <vcpu>1</vcpu>
Aug 01 13:56:03 user nova-compute[72129]:   <metadata>
Aug 01 13:56:03 user nova-compute[72129]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 13:56:03 user nova-compute[72129]:       <nova:package version="0.0.0"/>
Aug 01 13:56:03 user nova-compute[72129]:       <nova:name>tempest-ServerActionsTestOtherB-server-1892996256</nova:name>
Aug 01 13:56:03 user nova-compute[72129]:       <nova:creationTime>2023-08-01 13:56:01</nova:creationTime>
Aug 01 13:56:03 user nova-compute[72129]:       <nova:flavor name="m1.tiny">
Aug 01 13:56:03 user nova-compute[72129]:         <nova:memory>512</nova:memory>
Aug 01 13:56:03 user nova-compute[72129]:         <nova:disk>1</nova:disk>
Aug 01 13:56:03 user nova-compute[72129]:         <nova:swap>0</nova:swap>
Aug 01 13:56:03 user nova-compute[72129]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 13:56:03 user nova-compute[72129]:         <nova:vcpus>1</nova:vcpus>
Aug 01 13:56:03 user nova-compute[72129]:       </nova:flavor>
Aug 01 13:56:03 user nova-compute[72129]:       <nova:owner>
Aug 01 13:56:03 user nova-compute[72129]:         <nova:user uuid="1936f560fd794910af1fa6e9c4fffa90">tempest-ServerActionsTestOtherB-398231514-project-member</nova:user>
Aug 01 13:56:03 user nova-compute[72129]:         <nova:project uuid="d693a983e4a44434b64c7983239371a4">tempest-ServerActionsTestOtherB-398231514</nova:project>
Aug 01 13:56:03 user nova-compute[72129]:       </nova:owner>
Aug 01 13:56:03 user nova-compute[72129]:       <nova:root type="image" uuid="b6472c34-1b0f-4034-ba3a-7e8eb5103715"/>
Aug 01 13:56:03 user nova-compute[72129]:       <nova:ports>
Aug 01 13:56:03 user nova-compute[72129]:         <nova:port uuid="d59c6949-2748-4a57-b089-6219f9102815">
Aug 01 13:56:03 user nova-compute[72129]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 01 13:56:03 user nova-compute[72129]:         </nova:port>
Aug 01 13:56:03 user nova-compute[72129]:       </nova:ports>
Aug 01 13:56:03 user nova-compute[72129]:     </nova:instance>
Aug 01 13:56:03 user nova-compute[72129]:   </metadata>
Aug 01 13:56:03 user nova-compute[72129]:   <sysinfo type="smbios">
Aug 01 13:56:03 user nova-compute[72129]:     <system>
Aug 01 13:56:03 user nova-compute[72129]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 13:56:03 user nova-compute[72129]:       <entry name="product">OpenStack Nova</entry>
Aug 01 13:56:03 user nova-compute[72129]:       <entry name="version">0.0.0</entry>
Aug 01 13:56:03 user nova-compute[72129]:       <entry name="serial">2efa87a6-1dd6-4441-a55e-8e86be7f0a35</entry>
Aug 01 13:56:03 user nova-compute[72129]:       <entry name="uuid">2efa87a6-1dd6-4441-a55e-8e86be7f0a35</entry>
Aug 01 13:56:03 user nova-compute[72129]:       <entry name="family">Virtual Machine</entry>
Aug 01 13:56:03 user nova-compute[72129]:     </system>
Aug 01 13:56:03 user nova-compute[72129]:   </sysinfo>
Aug 01 13:56:03 user nova-compute[72129]:   <os>
Aug 01 13:56:03 user nova-compute[72129]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 13:56:03 user nova-compute[72129]:     <boot dev="hd"/>
Aug 01 13:56:03 user nova-compute[72129]:     <smbios mode="sysinfo"/>
Aug 01 13:56:03 user nova-compute[72129]:   </os>
Aug 01 13:56:03 user nova-compute[72129]:   <features>
Aug 01 13:56:03 user nova-compute[72129]:     <acpi/>
Aug 01 13:56:03 user nova-compute[72129]:     <apic/>
Aug 01 13:56:03 user nova-compute[72129]:     <vmcoreinfo/>
Aug 01 13:56:03 user nova-compute[72129]:   </features>
Aug 01 13:56:03 user nova-compute[72129]:   <clock offset="utc">
Aug 01 13:56:03 user nova-compute[72129]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 13:56:03 user nova-compute[72129]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 13:56:03 user nova-compute[72129]:     <timer name="hpet" present="no"/>
Aug 01 13:56:03 user nova-compute[72129]:   </clock>
Aug 01 13:56:03 user nova-compute[72129]:   <cpu mode="custom" match="exact">
Aug 01 13:56:03 user nova-compute[72129]:     <model>Nehalem</model>
Aug 01 13:56:03 user nova-compute[72129]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 13:56:03 user nova-compute[72129]:   </cpu>
Aug 01 13:56:03 user nova-compute[72129]:   <devices>
Aug 01 13:56:03 user nova-compute[72129]:     <disk type="file" device="disk">
Aug 01 13:56:03 user nova-compute[72129]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 13:56:03 user nova-compute[72129]:       <source file="/opt/stack/data/nova/instances/2efa87a6-1dd6-4441-a55e-8e86be7f0a35/disk"/>
Aug 01 13:56:03 user nova-compute[72129]:       <target dev="vda" bus="virtio"/>
Aug 01 13:56:03 user nova-compute[72129]:     </disk>
Aug 01 13:56:03 user nova-compute[72129]:     <disk type="block" device="disk">
Aug 01 13:56:03 user nova-compute[72129]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 13:56:03 user nova-compute[72129]:       <source dev="/dev/sdb"/>
Aug 01 13:56:03 user nova-compute[72129]:       <target dev="vdb" bus="virtio"/>
Aug 01 13:56:03 user nova-compute[72129]:       <serial>4abb01c8-017a-4ccc-a2dd-024a94775c17</serial>
Aug 01 13:56:03 user nova-compute[72129]:     </disk>
Aug 01 13:56:03 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 13:56:03 user nova-compute[72129]:       <mac address="fa:16:3e:20:eb:cf"/>
Aug 01 13:56:03 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 13:56:03 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 13:56:03 user nova-compute[72129]:       <target dev="tapd59c6949-27"/>
Aug 01 13:56:03 user nova-compute[72129]:     </interface>
Aug 01 13:56:03 user nova-compute[72129]:     <serial type="pty">
Aug 01 13:56:03 user nova-compute[72129]:       <log file="/opt/stack/data/nova/instances/2efa87a6-1dd6-4441-a55e-8e86be7f0a35/console.log" append="off"/>
Aug 01 13:56:03 user nova-compute[72129]:     </serial>
Aug 01 13:56:03 user nova-compute[72129]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 13:56:03 user nova-compute[72129]:     <video>
Aug 01 13:56:03 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 13:56:03 user nova-compute[72129]:     </video>
Aug 01 13:56:03 user nova-compute[72129]:     <rng model="virtio">
Aug 01 13:56:03 user nova-compute[72129]:       <backend model="random">/dev/urandom</backend>
Aug 01 13:56:03 user nova-compute[72129]:     </rng>
Aug 01 13:56:03 user nova-compute[72129]:     <controller type="usb" index="0" model="none"/>
Aug 01 13:56:03 user nova-compute[72129]:     <memballoon model="virtio">
Aug 01 13:56:03 user nova-compute[72129]:       <stats period="10"/>
Aug 01 13:56:03 user nova-compute[72129]:     </memballoon>
Aug 01 13:56:03 user nova-compute[72129]:   </devices>
Aug 01 13:56:03 user nova-compute[72129]: </domain>
Aug 01 13:56:03 user nova-compute[72129]:  {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 13:56:03 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:49:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1892996256',display_name='tempest-ServerActionsTestOtherB-server-1892996256',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1892996256',id=3,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEv1XQzBjYoYpbhYYzAkxCcHUbemRkkK9uL3KJrV3p8Too9wSnun/4eb7cYSvdSK/lx7EWwYazfwFvI3n8xQWjsYEP2mWFNbGfwKAUlfbILCQIuiMev2z7hB1YDNH/wWXQ==',key_name='tempest-keypair-539050345',keypairs=<?>,launch_index=0,launched_at=2023-08-01T13:54:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d693a983e4a44434b64c7983239371a4',ramdisk_id='',reservation_id='r-ghzodbos',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-398231514',owner_user_name='tempest-ServerActionsTestOtherB-398231514-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T13:55:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1936f560fd794910af1fa6e9c4fffa90',uuid=2efa87a6-1dd6-4441-a55e-8e86be7f0a35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "d59c6949-2748-4a57-b089-6219f9102815", "address": "fa:16:3e:20:eb:cf", "network": {"id": "4de0d3ee-7981-427b-9013-99cf0bc22cf8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-289359635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d693a983e4a44434b64c7983239371a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd59c6949-27", "ovs_interfaceid": "d59c6949-2748-4a57-b089-6219f9102815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 13:56:03 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Converting VIF {"id": "d59c6949-2748-4a57-b089-6219f9102815", "address": "fa:16:3e:20:eb:cf", "network": {"id": "4de0d3ee-7981-427b-9013-99cf0bc22cf8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-289359635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d693a983e4a44434b64c7983239371a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd59c6949-27", "ovs_interfaceid": "d59c6949-2748-4a57-b089-6219f9102815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:56:03 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:eb:cf,bridge_name='br-int',has_traffic_filtering=True,id=d59c6949-2748-4a57-b089-6219f9102815,network=Network(4de0d3ee-7981-427b-9013-99cf0bc22cf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd59c6949-27') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:56:03 user nova-compute[72129]: DEBUG os_vif [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:eb:cf,bridge_name='br-int',has_traffic_filtering=True,id=d59c6949-2748-4a57-b089-6219f9102815,network=Network(4de0d3ee-7981-427b-9013-99cf0bc22cf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd59c6949-27') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 13:56:03 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:56:03 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:56:03 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 13:56:03 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:56:03 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd59c6949-27, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:56:03 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd59c6949-27, col_values=(('external_ids', {'iface-id': 'd59c6949-2748-4a57-b089-6219f9102815', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:eb:cf', 'vm-uuid': '2efa87a6-1dd6-4441-a55e-8e86be7f0a35'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:56:03 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:56:03 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 13:56:03 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:56:03 user nova-compute[72129]: INFO os_vif [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:eb:cf,bridge_name='br-int',has_traffic_filtering=True,id=d59c6949-2748-4a57-b089-6219f9102815,network=Network(4de0d3ee-7981-427b-9013-99cf0bc22cf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd59c6949-27')
Aug 01 13:56:04 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:56:04 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:56:04 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:56:04 user nova-compute[72129]: DEBUG nova.compute.manager [req-7095df6a-436e-45f3-a49c-6ac1c411d677 req-4e5351d2-af87-4de8-b961-9a16847db16a service nova] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Received event network-vif-plugged-d59c6949-2748-4a57-b089-6219f9102815 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:56:04 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-7095df6a-436e-45f3-a49c-6ac1c411d677 req-4e5351d2-af87-4de8-b961-9a16847db16a service nova] Acquiring lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:56:04 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-7095df6a-436e-45f3-a49c-6ac1c411d677 req-4e5351d2-af87-4de8-b961-9a16847db16a service nova] Lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:56:04 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-7095df6a-436e-45f3-a49c-6ac1c411d677 req-4e5351d2-af87-4de8-b961-9a16847db16a service nova] Lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:56:04 user nova-compute[72129]: DEBUG nova.compute.manager [req-7095df6a-436e-45f3-a49c-6ac1c411d677 req-4e5351d2-af87-4de8-b961-9a16847db16a service nova] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] No waiting events found dispatching network-vif-plugged-d59c6949-2748-4a57-b089-6219f9102815 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:56:04 user nova-compute[72129]: WARNING nova.compute.manager [req-7095df6a-436e-45f3-a49c-6ac1c411d677 req-4e5351d2-af87-4de8-b961-9a16847db16a service nova] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Received unexpected event network-vif-plugged-d59c6949-2748-4a57-b089-6219f9102815 for instance with vm_state resized and task_state resize_reverting.
Aug 01 13:56:05 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:56:05 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:56:05 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:56:06 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:56:06 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898166.8247588, 2efa87a6-1dd6-4441-a55e-8e86be7f0a35 => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:56:06 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] VM Resumed (Lifecycle Event)
Aug 01 13:56:06 user nova-compute[72129]: DEBUG nova.compute.manager [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Instance event wait completed in 0 seconds for  {{(pid=72129) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 13:56:06 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Instance running successfully.
Aug 01 13:56:06 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] finish_revert_migration finished successfully. {{(pid=72129) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Aug 01 13:56:06 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:56:06 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 13:56:06 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 01 13:56:06 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898166.8292847, 2efa87a6-1dd6-4441-a55e-8e86be7f0a35 => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:56:06 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] VM Started (Lifecycle Event)
Aug 01 13:56:06 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:56:06 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 13:56:06 user nova-compute[72129]: DEBUG nova.compute.manager [req-e3f36f2e-47f4-4b17-a0f4-f8dfc1ef69a7 req-1217deec-f1ae-4bf2-9e2b-311a66cfbe18 service nova] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Received event network-vif-plugged-d59c6949-2748-4a57-b089-6219f9102815 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:56:06 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-e3f36f2e-47f4-4b17-a0f4-f8dfc1ef69a7 req-1217deec-f1ae-4bf2-9e2b-311a66cfbe18 service nova] Acquiring lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:56:06 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-e3f36f2e-47f4-4b17-a0f4-f8dfc1ef69a7 req-1217deec-f1ae-4bf2-9e2b-311a66cfbe18 service nova] Lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:56:06 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-e3f36f2e-47f4-4b17-a0f4-f8dfc1ef69a7 req-1217deec-f1ae-4bf2-9e2b-311a66cfbe18 service nova] Lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:56:06 user nova-compute[72129]: DEBUG nova.compute.manager [req-e3f36f2e-47f4-4b17-a0f4-f8dfc1ef69a7 req-1217deec-f1ae-4bf2-9e2b-311a66cfbe18 service nova] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] No waiting events found dispatching network-vif-plugged-d59c6949-2748-4a57-b089-6219f9102815 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:56:06 user nova-compute[72129]: WARNING nova.compute.manager [req-e3f36f2e-47f4-4b17-a0f4-f8dfc1ef69a7 req-1217deec-f1ae-4bf2-9e2b-311a66cfbe18 service nova] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Received unexpected event network-vif-plugged-d59c6949-2748-4a57-b089-6219f9102815 for instance with vm_state resized and task_state resize_reverting.
Aug 01 13:56:06 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 01 13:56:07 user nova-compute[72129]: INFO nova.compute.manager [None req-d7d0562b-8705-46e5-bad6-2296374d16fe tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Updating instance to original state: 'active'
Aug 01 13:56:08 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:56:10 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:56:10 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d7950955-7498-4665-b633-e1b8aa022e05 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Acquiring lock "31105963-52fa-4aff-9270-075cd98f08a5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:56:10 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d7950955-7498-4665-b633-e1b8aa022e05 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Lock "31105963-52fa-4aff-9270-075cd98f08a5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:56:10 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d7950955-7498-4665-b633-e1b8aa022e05 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Acquiring lock "31105963-52fa-4aff-9270-075cd98f08a5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:56:10 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d7950955-7498-4665-b633-e1b8aa022e05 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Lock "31105963-52fa-4aff-9270-075cd98f08a5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:56:10 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d7950955-7498-4665-b633-e1b8aa022e05 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Lock "31105963-52fa-4aff-9270-075cd98f08a5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:56:10 user nova-compute[72129]: INFO nova.compute.manager [None req-d7950955-7498-4665-b633-e1b8aa022e05 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] Terminating instance
Aug 01 13:56:10 user nova-compute[72129]: DEBUG nova.compute.manager [None req-d7950955-7498-4665-b633-e1b8aa022e05 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] Start destroying the instance on the hypervisor. {{(pid=72129) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 13:56:11 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:56:11 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:56:11 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:56:11 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:56:11 user nova-compute[72129]: DEBUG nova.compute.manager [req-2f1bd9de-20e5-49fd-9f90-989dd9ae223f req-3f8a7664-efe5-4f65-8a78-96d814448eeb service nova] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] Received event network-vif-unplugged-a56b8b52-26f1-4e64-b02e-0e46462dfb13 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:56:11 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-2f1bd9de-20e5-49fd-9f90-989dd9ae223f req-3f8a7664-efe5-4f65-8a78-96d814448eeb service nova] Acquiring lock "31105963-52fa-4aff-9270-075cd98f08a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:56:11 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-2f1bd9de-20e5-49fd-9f90-989dd9ae223f req-3f8a7664-efe5-4f65-8a78-96d814448eeb service nova] Lock "31105963-52fa-4aff-9270-075cd98f08a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:56:11 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-2f1bd9de-20e5-49fd-9f90-989dd9ae223f req-3f8a7664-efe5-4f65-8a78-96d814448eeb service nova] Lock "31105963-52fa-4aff-9270-075cd98f08a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:56:11 user nova-compute[72129]: DEBUG nova.compute.manager [req-2f1bd9de-20e5-49fd-9f90-989dd9ae223f req-3f8a7664-efe5-4f65-8a78-96d814448eeb service nova] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] No waiting events found dispatching network-vif-unplugged-a56b8b52-26f1-4e64-b02e-0e46462dfb13 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:56:11 user nova-compute[72129]: DEBUG nova.compute.manager [req-2f1bd9de-20e5-49fd-9f90-989dd9ae223f req-3f8a7664-efe5-4f65-8a78-96d814448eeb service nova] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] Received event network-vif-unplugged-a56b8b52-26f1-4e64-b02e-0e46462dfb13 for instance with task_state deleting. {{(pid=72129) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 13:56:11 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] Instance destroyed successfully.
Aug 01 13:56:11 user nova-compute[72129]: DEBUG nova.objects.instance [None req-d7950955-7498-4665-b633-e1b8aa022e05 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Lazy-loading 'resources' on Instance uuid 31105963-52fa-4aff-9270-075cd98f08a5 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:56:11 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-d7950955-7498-4665-b633-e1b8aa022e05 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:50:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-948526765',display_name='tempest-VolumesAdminNegativeTest-server-948526765',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-948526765',id=5,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDvTmdR3quxrqaiFn45V0Zn2r/L9WMPB0u32Ivu6QbOlnFhjdHNWzSebHlCs67MJfiIDDtM1t045ql0JSTR8D3izyDKWjb3GzGFOTJphl4HPbjAxOzT8ciKpPTL0RGrgng==',key_name='tempest-keypair-1982435248',keypairs=<?>,launch_index=0,launched_at=2023-08-01T13:50:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e8fd0bc919dc4f39a702173f8be6a847',ramdisk_id='',reservation_id='r-lc6aobxb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1822759437',owner_user_name='tempest-VolumesAdminNegativeTest-1822759437-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T13:50:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='42662c28ee804a399b2ba6467e3c3926',uuid=31105963-52fa-4aff-9270-075cd98f08a5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a56b8b52-26f1-4e64-b02e-0e46462dfb13", "address": "fa:16:3e:a8:fe:6c", "network": {"id": "8c424a77-2cdc-4519-bad7-e5c4498aa600", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1161619305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8fd0bc919dc4f39a702173f8be6a847", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa56b8b52-26", "ovs_interfaceid": "a56b8b52-26f1-4e64-b02e-0e46462dfb13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 13:56:11 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-d7950955-7498-4665-b633-e1b8aa022e05 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Converting VIF {"id": "a56b8b52-26f1-4e64-b02e-0e46462dfb13", "address": "fa:16:3e:a8:fe:6c", "network": {"id": "8c424a77-2cdc-4519-bad7-e5c4498aa600", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1161619305-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8fd0bc919dc4f39a702173f8be6a847", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa56b8b52-26", "ovs_interfaceid": "a56b8b52-26f1-4e64-b02e-0e46462dfb13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:56:11 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-d7950955-7498-4665-b633-e1b8aa022e05 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:fe:6c,bridge_name='br-int',has_traffic_filtering=True,id=a56b8b52-26f1-4e64-b02e-0e46462dfb13,network=Network(8c424a77-2cdc-4519-bad7-e5c4498aa600),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa56b8b52-26') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:56:11 user nova-compute[72129]: DEBUG os_vif [None req-d7950955-7498-4665-b633-e1b8aa022e05 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:fe:6c,bridge_name='br-int',has_traffic_filtering=True,id=a56b8b52-26f1-4e64-b02e-0e46462dfb13,network=Network(8c424a77-2cdc-4519-bad7-e5c4498aa600),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa56b8b52-26') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 13:56:11 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:56:11 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa56b8b52-26, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:56:11 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:56:11 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 13:56:11 user nova-compute[72129]: INFO os_vif [None req-d7950955-7498-4665-b633-e1b8aa022e05 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:fe:6c,bridge_name='br-int',has_traffic_filtering=True,id=a56b8b52-26f1-4e64-b02e-0e46462dfb13,network=Network(8c424a77-2cdc-4519-bad7-e5c4498aa600),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa56b8b52-26')
Aug 01 13:56:11 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-d7950955-7498-4665-b633-e1b8aa022e05 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] Deleting instance files /opt/stack/data/nova/instances/31105963-52fa-4aff-9270-075cd98f08a5_del
Aug 01 13:56:11 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-d7950955-7498-4665-b633-e1b8aa022e05 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] Deletion of /opt/stack/data/nova/instances/31105963-52fa-4aff-9270-075cd98f08a5_del complete
Aug 01 13:56:11 user nova-compute[72129]: INFO nova.compute.manager [None req-d7950955-7498-4665-b633-e1b8aa022e05 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] Took 1.02 seconds to destroy the instance on the hypervisor.
Aug 01 13:56:11 user nova-compute[72129]: DEBUG oslo.service.loopingcall [None req-d7950955-7498-4665-b633-e1b8aa022e05 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72129) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 13:56:11 user nova-compute[72129]: DEBUG nova.compute.manager [-] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] Deallocating network for instance {{(pid=72129) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 13:56:11 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] deallocate_for_instance() {{(pid=72129) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 13:56:12 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:56:12 user nova-compute[72129]: WARNING nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] While synchronizing instance power states, found 7 instances in the database and 6 instances on the hypervisor.
Aug 01 13:56:12 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Triggering sync for uuid 63c0c1fe-7e4d-4763-8ede-a7662747a4c0 {{(pid=72129) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 13:56:12 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Triggering sync for uuid 2efa87a6-1dd6-4441-a55e-8e86be7f0a35 {{(pid=72129) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 13:56:12 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Triggering sync for uuid 28115c7d-544a-4504-98da-2398e0e354d8 {{(pid=72129) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 13:56:12 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Triggering sync for uuid 31105963-52fa-4aff-9270-075cd98f08a5 {{(pid=72129) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 13:56:12 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Triggering sync for uuid 97a5dccf-b499-443a-b332-cfa293a16047 {{(pid=72129) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 13:56:12 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Triggering sync for uuid 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d {{(pid=72129) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 13:56:12 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Triggering sync for uuid 133076de-14b5-4ceb-aa41-d9acef8506c5 {{(pid=72129) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 13:56:12 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "63c0c1fe-7e4d-4763-8ede-a7662747a4c0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:56:12 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "63c0c1fe-7e4d-4763-8ede-a7662747a4c0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:56:12 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:56:12 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:56:12 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "28115c7d-544a-4504-98da-2398e0e354d8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:56:12 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "28115c7d-544a-4504-98da-2398e0e354d8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:56:12 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "31105963-52fa-4aff-9270-075cd98f08a5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:56:12 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "97a5dccf-b499-443a-b332-cfa293a16047" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:56:12 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "97a5dccf-b499-443a-b332-cfa293a16047" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:56:12 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:56:12 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:56:12 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "133076de-14b5-4ceb-aa41-d9acef8506c5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:56:12 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "133076de-14b5-4ceb-aa41-d9acef8506c5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:56:13 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.098s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:56:13 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "63c0c1fe-7e4d-4763-8ede-a7662747a4c0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.104s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:56:13 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.105s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:56:13 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "97a5dccf-b499-443a-b332-cfa293a16047" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.113s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:56:13 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "28115c7d-544a-4504-98da-2398e0e354d8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.127s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:56:13 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "133076de-14b5-4ceb-aa41-d9acef8506c5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.137s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:56:13 user nova-compute[72129]: DEBUG nova.compute.manager [req-9902272a-e861-48f3-b39e-5d204b1b8705 req-b744131e-827b-4908-b513-89af8b01acaf service nova] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] Received event network-vif-plugged-a56b8b52-26f1-4e64-b02e-0e46462dfb13 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:56:13 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-9902272a-e861-48f3-b39e-5d204b1b8705 req-b744131e-827b-4908-b513-89af8b01acaf service nova] Acquiring lock "31105963-52fa-4aff-9270-075cd98f08a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:56:13 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-9902272a-e861-48f3-b39e-5d204b1b8705 req-b744131e-827b-4908-b513-89af8b01acaf service nova] Lock "31105963-52fa-4aff-9270-075cd98f08a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:56:13 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-9902272a-e861-48f3-b39e-5d204b1b8705 req-b744131e-827b-4908-b513-89af8b01acaf service nova] Lock "31105963-52fa-4aff-9270-075cd98f08a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:56:13 user nova-compute[72129]: DEBUG nova.compute.manager [req-9902272a-e861-48f3-b39e-5d204b1b8705 req-b744131e-827b-4908-b513-89af8b01acaf service nova] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] No waiting events found dispatching network-vif-plugged-a56b8b52-26f1-4e64-b02e-0e46462dfb13 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:56:13 user nova-compute[72129]: WARNING nova.compute.manager [req-9902272a-e861-48f3-b39e-5d204b1b8705 req-b744131e-827b-4908-b513-89af8b01acaf service nova] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] Received unexpected event network-vif-plugged-a56b8b52-26f1-4e64-b02e-0e46462dfb13 for instance with vm_state active and task_state deleting.
Aug 01 13:56:13 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:56:13 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] Took 1.39 seconds to deallocate network for instance.
Aug 01 13:56:13 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d7950955-7498-4665-b633-e1b8aa022e05 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:56:13 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d7950955-7498-4665-b633-e1b8aa022e05 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:56:13 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-d7950955-7498-4665-b633-e1b8aa022e05 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 13:56:13 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-d7950955-7498-4665-b633-e1b8aa022e05 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 13:56:13 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d7950955-7498-4665-b633-e1b8aa022e05 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.312s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:56:13 user nova-compute[72129]: INFO nova.scheduler.client.report [None req-d7950955-7498-4665-b633-e1b8aa022e05 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Deleted allocations for instance 31105963-52fa-4aff-9270-075cd98f08a5
Aug 01 13:56:13 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d7950955-7498-4665-b633-e1b8aa022e05 tempest-VolumesAdminNegativeTest-1822759437 tempest-VolumesAdminNegativeTest-1822759437-project-member] Lock "31105963-52fa-4aff-9270-075cd98f08a5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.915s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:56:13 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "31105963-52fa-4aff-9270-075cd98f08a5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.887s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:56:13 user nova-compute[72129]: INFO nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] During sync_power_state the instance has a pending task (deleting). Skip.
Aug 01 13:56:13 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "31105963-52fa-4aff-9270-075cd98f08a5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:56:15 user nova-compute[72129]: DEBUG nova.compute.manager [req-033827b2-23d7-469f-9045-3ef9afe66be7 req-078284c8-ccf2-44bc-8a6f-82238d1f3e86 service nova] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] Received event network-vif-deleted-a56b8b52-26f1-4e64-b02e-0e46462dfb13 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:56:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:56:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:56:23 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] Acquiring lock "28164e90-f7ad-4f7e-9dcf-2fc750201342" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:56:23 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] Lock "28164e90-f7ad-4f7e-9dcf-2fc750201342" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:56:23 user nova-compute[72129]: DEBUG nova.compute.manager [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] [instance: 28164e90-f7ad-4f7e-9dcf-2fc750201342] Starting instance... {{(pid=72129) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 13:56:23 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:56:23 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:56:23 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72129) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 13:56:23 user nova-compute[72129]: INFO nova.compute.claims [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] [instance: 28164e90-f7ad-4f7e-9dcf-2fc750201342] Claim successful on node user
Aug 01 13:56:24 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 13:56:24 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 13:56:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.367s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:56:24 user nova-compute[72129]: DEBUG nova.compute.manager [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] [instance: 28164e90-f7ad-4f7e-9dcf-2fc750201342] Start building networks asynchronously for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 13:56:24 user nova-compute[72129]: DEBUG nova.compute.manager [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] [instance: 28164e90-f7ad-4f7e-9dcf-2fc750201342] Allocating IP information in the background. {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 13:56:24 user nova-compute[72129]: DEBUG nova.network.neutron [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] [instance: 28164e90-f7ad-4f7e-9dcf-2fc750201342] allocate_for_instance() {{(pid=72129) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 13:56:24 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] [instance: 28164e90-f7ad-4f7e-9dcf-2fc750201342] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 13:56:24 user nova-compute[72129]: DEBUG nova.compute.manager [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] [instance: 28164e90-f7ad-4f7e-9dcf-2fc750201342] Start building block device mappings for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 13:56:24 user nova-compute[72129]: DEBUG nova.compute.manager [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] [instance: 28164e90-f7ad-4f7e-9dcf-2fc750201342] Start spawning the instance on the hypervisor. {{(pid=72129) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 13:56:24 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] [instance: 28164e90-f7ad-4f7e-9dcf-2fc750201342] Creating instance directory {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 13:56:24 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] [instance: 28164e90-f7ad-4f7e-9dcf-2fc750201342] Creating image(s)
Aug 01 13:56:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] Acquiring lock "/opt/stack/data/nova/instances/28164e90-f7ad-4f7e-9dcf-2fc750201342/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:56:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] Lock "/opt/stack/data/nova/instances/28164e90-f7ad-4f7e-9dcf-2fc750201342/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:56:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] Lock "/opt/stack/data/nova/instances/28164e90-f7ad-4f7e-9dcf-2fc750201342/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:56:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:56:24 user nova-compute[72129]: DEBUG nova.policy [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b3277c75916d4781aff0a0f99951380e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149eac1fb49640de8b72140d879aea84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72129) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 13:56:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.148s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:56:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] Acquiring lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:56:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:56:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:56:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.139s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:56:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/28164e90-f7ad-4f7e-9dcf-2fc750201342/disk 1073741824 {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:56:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/28164e90-f7ad-4f7e-9dcf-2fc750201342/disk 1073741824" returned: 0 in 0.051s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:56:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:56:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:56:25 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.145s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:56:25 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] Checking if we can resize image /opt/stack/data/nova/instances/28164e90-f7ad-4f7e-9dcf-2fc750201342/disk. size=1073741824 {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 13:56:25 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28164e90-f7ad-4f7e-9dcf-2fc750201342/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:56:25 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28164e90-f7ad-4f7e-9dcf-2fc750201342/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:56:25 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] Cannot resize image /opt/stack/data/nova/instances/28164e90-f7ad-4f7e-9dcf-2fc750201342/disk to a smaller size. {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 13:56:25 user nova-compute[72129]: DEBUG nova.objects.instance [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] Lazy-loading 'migration_context' on Instance uuid 28164e90-f7ad-4f7e-9dcf-2fc750201342 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:56:25 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] [instance: 28164e90-f7ad-4f7e-9dcf-2fc750201342] Created local disks {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 13:56:25 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] [instance: 28164e90-f7ad-4f7e-9dcf-2fc750201342] Ensure instance console log exists: /opt/stack/data/nova/instances/28164e90-f7ad-4f7e-9dcf-2fc750201342/console.log {{(pid=72129) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 13:56:25 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:56:25 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:56:25 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:56:25 user nova-compute[72129]: DEBUG nova.network.neutron [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] [instance: 28164e90-f7ad-4f7e-9dcf-2fc750201342] Successfully created port: a5c1a737-6ce0-4826-b20b-8d288bdd4283 {{(pid=72129) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 13:56:25 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:56:26 user nova-compute[72129]: DEBUG nova.network.neutron [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] [instance: 28164e90-f7ad-4f7e-9dcf-2fc750201342] Successfully updated port: a5c1a737-6ce0-4826-b20b-8d288bdd4283 {{(pid=72129) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 13:56:26 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] Acquiring lock "refresh_cache-28164e90-f7ad-4f7e-9dcf-2fc750201342" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:56:26 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] Acquired lock "refresh_cache-28164e90-f7ad-4f7e-9dcf-2fc750201342" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:56:26 user nova-compute[72129]: DEBUG nova.network.neutron [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] [instance: 28164e90-f7ad-4f7e-9dcf-2fc750201342] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 13:56:26 user nova-compute[72129]: DEBUG nova.compute.manager [req-5da1b6dd-6434-41b1-9897-cc97fa4bd113 req-87813097-611f-4813-9f98-ac4a2abd2558 service nova] [instance: 28164e90-f7ad-4f7e-9dcf-2fc750201342] Received event network-changed-a5c1a737-6ce0-4826-b20b-8d288bdd4283 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:56:26 user nova-compute[72129]: DEBUG nova.compute.manager [req-5da1b6dd-6434-41b1-9897-cc97fa4bd113 req-87813097-611f-4813-9f98-ac4a2abd2558 service nova] [instance: 28164e90-f7ad-4f7e-9dcf-2fc750201342] Refreshing instance network info cache due to event network-changed-a5c1a737-6ce0-4826-b20b-8d288bdd4283. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 13:56:26 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-5da1b6dd-6434-41b1-9897-cc97fa4bd113 req-87813097-611f-4813-9f98-ac4a2abd2558 service nova] Acquiring lock "refresh_cache-28164e90-f7ad-4f7e-9dcf-2fc750201342" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:56:26 user nova-compute[72129]: DEBUG nova.network.neutron [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] [instance: 28164e90-f7ad-4f7e-9dcf-2fc750201342] Instance cache missing network info. {{(pid=72129) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 13:56:26 user nova-compute[72129]: DEBUG nova.network.neutron [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] [instance: 28164e90-f7ad-4f7e-9dcf-2fc750201342] Updating instance_info_cache with network_info: [{"id": "a5c1a737-6ce0-4826-b20b-8d288bdd4283", "address": "fa:16:3e:9a:fa:ec", "network": {"id": "d1324d81-9cdd-4788-b5a6-319e831b3723", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c51a048b091340dab769abbab323121d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c1a737-6c", "ovs_interfaceid": "a5c1a737-6ce0-4826-b20b-8d288bdd4283", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:56:26 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] Releasing lock "refresh_cache-28164e90-f7ad-4f7e-9dcf-2fc750201342" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:56:26 user nova-compute[72129]: DEBUG nova.compute.manager [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] [instance: 28164e90-f7ad-4f7e-9dcf-2fc750201342] Instance network_info: |[{"id": "a5c1a737-6ce0-4826-b20b-8d288bdd4283", "address": "fa:16:3e:9a:fa:ec", "network": {"id": "d1324d81-9cdd-4788-b5a6-319e831b3723", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c51a048b091340dab769abbab323121d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c1a737-6c", "ovs_interfaceid": "a5c1a737-6ce0-4826-b20b-8d288bdd4283", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 13:56:26 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-5da1b6dd-6434-41b1-9897-cc97fa4bd113 req-87813097-611f-4813-9f98-ac4a2abd2558 service nova] Acquired lock "refresh_cache-28164e90-f7ad-4f7e-9dcf-2fc750201342" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:56:26 user nova-compute[72129]: DEBUG nova.network.neutron [req-5da1b6dd-6434-41b1-9897-cc97fa4bd113 req-87813097-611f-4813-9f98-ac4a2abd2558 service nova] [instance: 28164e90-f7ad-4f7e-9dcf-2fc750201342] Refreshing network info cache for port a5c1a737-6ce0-4826-b20b-8d288bdd4283 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 13:56:26 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] [instance: 28164e90-f7ad-4f7e-9dcf-2fc750201342] Start _get_guest_xml network_info=[{"id": "a5c1a737-6ce0-4826-b20b-8d288bdd4283", "address": "fa:16:3e:9a:fa:ec", "network": {"id": "d1324d81-9cdd-4788-b5a6-319e831b3723", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c51a048b091340dab769abbab323121d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c1a737-6c", "ovs_interfaceid": "a5c1a737-6ce0-4826-b20b-8d288bdd4283", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'image_id': 'b6472c34-1b0f-4034-ba3a-7e8eb5103715'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 13:56:26 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:56:26 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:56:26 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 13:56:26 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] CPU controller missing on host. {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 13:56:26 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 13:56:26 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] CPU controller found on host. {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 13:56:26 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72129) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 13:56:26 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T13:45:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 13:56:26 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] Flavor limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 13:56:26 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] Image limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 13:56:26 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] Flavor pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 13:56:26 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] Image pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 13:56:26 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 13:56:26 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 13:56:26 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 13:56:26 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] Got 1 possible topologies {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 13:56:26 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 13:56:26 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 13:56:26 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:56:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-886630369',display_name='tempest-VolumesNegativeTest-instance-886630369',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-886630369',id=18,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='149eac1fb49640de8b72140d879aea84',ramdisk_id='',reservation_id='r-onkmwbi9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1214026803',owner_user_name='tempest-VolumesNegativeTest-1214026803-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:56:24Z,user_data=None,user_id='b3277c75916d4781aff0a0f99951380e',uuid=28164e90-f7ad-4f7e-9dcf-2fc750201342,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a5c1a737-6ce0-4826-b20b-8d288bdd4283", "address": "fa:16:3e:9a:fa:ec", "network": {"id": "d1324d81-9cdd-4788-b5a6-319e831b3723", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c51a048b091340dab769abbab323121d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c1a737-6c", "ovs_interfaceid": "a5c1a737-6ce0-4826-b20b-8d288bdd4283", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 13:56:26 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] Converting VIF {"id": "a5c1a737-6ce0-4826-b20b-8d288bdd4283", "address": "fa:16:3e:9a:fa:ec", "network": {"id": "d1324d81-9cdd-4788-b5a6-319e831b3723", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c51a048b091340dab769abbab323121d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c1a737-6c", "ovs_interfaceid": "a5c1a737-6ce0-4826-b20b-8d288bdd4283", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:56:26 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:fa:ec,bridge_name='br-int',has_traffic_filtering=True,id=a5c1a737-6ce0-4826-b20b-8d288bdd4283,network=Network(d1324d81-9cdd-4788-b5a6-319e831b3723),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5c1a737-6c') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:56:26 user nova-compute[72129]: DEBUG nova.objects.instance [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] Lazy-loading 'pci_devices' on Instance uuid 28164e90-f7ad-4f7e-9dcf-2fc750201342 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:56:26 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] [instance: 28164e90-f7ad-4f7e-9dcf-2fc750201342] End _get_guest_xml xml=<domain type="kvm">
Aug 01 13:56:26 user nova-compute[72129]:   <uuid>28164e90-f7ad-4f7e-9dcf-2fc750201342</uuid>
Aug 01 13:56:26 user nova-compute[72129]:   <name>instance-00000012</name>
Aug 01 13:56:26 user nova-compute[72129]:   <memory>524288</memory>
Aug 01 13:56:26 user nova-compute[72129]:   <vcpu>1</vcpu>
Aug 01 13:56:26 user nova-compute[72129]:   <metadata>
Aug 01 13:56:26 user nova-compute[72129]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 13:56:26 user nova-compute[72129]:       <nova:package version="0.0.0"/>
Aug 01 13:56:26 user nova-compute[72129]:       <nova:name>tempest-VolumesNegativeTest-instance-886630369</nova:name>
Aug 01 13:56:26 user nova-compute[72129]:       <nova:creationTime>2023-08-01 13:56:26</nova:creationTime>
Aug 01 13:56:26 user nova-compute[72129]:       <nova:flavor name="m1.tiny">
Aug 01 13:56:26 user nova-compute[72129]:         <nova:memory>512</nova:memory>
Aug 01 13:56:26 user nova-compute[72129]:         <nova:disk>1</nova:disk>
Aug 01 13:56:26 user nova-compute[72129]:         <nova:swap>0</nova:swap>
Aug 01 13:56:26 user nova-compute[72129]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 13:56:26 user nova-compute[72129]:         <nova:vcpus>1</nova:vcpus>
Aug 01 13:56:26 user nova-compute[72129]:       </nova:flavor>
Aug 01 13:56:26 user nova-compute[72129]:       <nova:owner>
Aug 01 13:56:26 user nova-compute[72129]:         <nova:user uuid="b3277c75916d4781aff0a0f99951380e">tempest-VolumesNegativeTest-1214026803-project-member</nova:user>
Aug 01 13:56:26 user nova-compute[72129]:         <nova:project uuid="149eac1fb49640de8b72140d879aea84">tempest-VolumesNegativeTest-1214026803</nova:project>
Aug 01 13:56:26 user nova-compute[72129]:       </nova:owner>
Aug 01 13:56:26 user nova-compute[72129]:       <nova:root type="image" uuid="b6472c34-1b0f-4034-ba3a-7e8eb5103715"/>
Aug 01 13:56:26 user nova-compute[72129]:       <nova:ports>
Aug 01 13:56:26 user nova-compute[72129]:         <nova:port uuid="a5c1a737-6ce0-4826-b20b-8d288bdd4283">
Aug 01 13:56:26 user nova-compute[72129]:           <nova:ip type="fixed" address="192.168.233.219" ipVersion="4"/>
Aug 01 13:56:26 user nova-compute[72129]:         </nova:port>
Aug 01 13:56:26 user nova-compute[72129]:       </nova:ports>
Aug 01 13:56:26 user nova-compute[72129]:     </nova:instance>
Aug 01 13:56:26 user nova-compute[72129]:   </metadata>
Aug 01 13:56:26 user nova-compute[72129]:   <sysinfo type="smbios">
Aug 01 13:56:26 user nova-compute[72129]:     <system>
Aug 01 13:56:26 user nova-compute[72129]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 13:56:26 user nova-compute[72129]:       <entry name="product">OpenStack Nova</entry>
Aug 01 13:56:26 user nova-compute[72129]:       <entry name="version">0.0.0</entry>
Aug 01 13:56:26 user nova-compute[72129]:       <entry name="serial">28164e90-f7ad-4f7e-9dcf-2fc750201342</entry>
Aug 01 13:56:26 user nova-compute[72129]:       <entry name="uuid">28164e90-f7ad-4f7e-9dcf-2fc750201342</entry>
Aug 01 13:56:26 user nova-compute[72129]:       <entry name="family">Virtual Machine</entry>
Aug 01 13:56:26 user nova-compute[72129]:     </system>
Aug 01 13:56:26 user nova-compute[72129]:   </sysinfo>
Aug 01 13:56:26 user nova-compute[72129]:   <os>
Aug 01 13:56:26 user nova-compute[72129]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 13:56:26 user nova-compute[72129]:     <boot dev="hd"/>
Aug 01 13:56:26 user nova-compute[72129]:     <smbios mode="sysinfo"/>
Aug 01 13:56:26 user nova-compute[72129]:   </os>
Aug 01 13:56:26 user nova-compute[72129]:   <features>
Aug 01 13:56:26 user nova-compute[72129]:     <acpi/>
Aug 01 13:56:26 user nova-compute[72129]:     <apic/>
Aug 01 13:56:26 user nova-compute[72129]:     <vmcoreinfo/>
Aug 01 13:56:26 user nova-compute[72129]:   </features>
Aug 01 13:56:26 user nova-compute[72129]:   <clock offset="utc">
Aug 01 13:56:26 user nova-compute[72129]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 13:56:26 user nova-compute[72129]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 13:56:26 user nova-compute[72129]:     <timer name="hpet" present="no"/>
Aug 01 13:56:26 user nova-compute[72129]:   </clock>
Aug 01 13:56:26 user nova-compute[72129]:   <cpu mode="custom" match="exact">
Aug 01 13:56:26 user nova-compute[72129]:     <model>Nehalem</model>
Aug 01 13:56:26 user nova-compute[72129]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 13:56:26 user nova-compute[72129]:   </cpu>
Aug 01 13:56:26 user nova-compute[72129]:   <devices>
Aug 01 13:56:26 user nova-compute[72129]:     <disk type="file" device="disk">
Aug 01 13:56:26 user nova-compute[72129]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 13:56:26 user nova-compute[72129]:       <source file="/opt/stack/data/nova/instances/28164e90-f7ad-4f7e-9dcf-2fc750201342/disk"/>
Aug 01 13:56:26 user nova-compute[72129]:       <target dev="vda" bus="virtio"/>
Aug 01 13:56:26 user nova-compute[72129]:     </disk>
Aug 01 13:56:26 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 13:56:26 user nova-compute[72129]:       <mac address="fa:16:3e:9a:fa:ec"/>
Aug 01 13:56:26 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 13:56:26 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 13:56:26 user nova-compute[72129]:       <target dev="tapa5c1a737-6c"/>
Aug 01 13:56:26 user nova-compute[72129]:     </interface>
Aug 01 13:56:26 user nova-compute[72129]:     <serial type="pty">
Aug 01 13:56:26 user nova-compute[72129]:       <log file="/opt/stack/data/nova/instances/28164e90-f7ad-4f7e-9dcf-2fc750201342/console.log" append="off"/>
Aug 01 13:56:26 user nova-compute[72129]:     </serial>
Aug 01 13:56:26 user nova-compute[72129]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 13:56:26 user nova-compute[72129]:     <video>
Aug 01 13:56:26 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 13:56:26 user nova-compute[72129]:     </video>
Aug 01 13:56:26 user nova-compute[72129]:     <rng model="virtio">
Aug 01 13:56:26 user nova-compute[72129]:       <backend model="random">/dev/urandom</backend>
Aug 01 13:56:26 user nova-compute[72129]:     </rng>
Aug 01 13:56:26 user nova-compute[72129]:     <controller type="usb" index="0" model="none"/>
Aug 01 13:56:26 user nova-compute[72129]:     <memballoon model="virtio">
Aug 01 13:56:26 user nova-compute[72129]:       <stats period="10"/>
Aug 01 13:56:26 user nova-compute[72129]:     </memballoon>
Aug 01 13:56:26 user nova-compute[72129]:   </devices>
Aug 01 13:56:26 user nova-compute[72129]: </domain>
Aug 01 13:56:26 user nova-compute[72129]:  {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 13:56:26 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:56:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-886630369',display_name='tempest-VolumesNegativeTest-instance-886630369',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-886630369',id=18,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='149eac1fb49640de8b72140d879aea84',ramdisk_id='',reservation_id='r-onkmwbi9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1214026803',owner_user_name='tempest-VolumesNegativeTest-1214026803-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:56:24Z,user_data=None,user_id='b3277c75916d4781aff0a0f99951380e',uuid=28164e90-f7ad-4f7e-9dcf-2fc750201342,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a5c1a737-6ce0-4826-b20b-8d288bdd4283", "address": "fa:16:3e:9a:fa:ec", "network": {"id": "d1324d81-9cdd-4788-b5a6-319e831b3723", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c51a048b091340dab769abbab323121d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c1a737-6c", "ovs_interfaceid": "a5c1a737-6ce0-4826-b20b-8d288bdd4283", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 13:56:26 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] Converting VIF {"id": "a5c1a737-6ce0-4826-b20b-8d288bdd4283", "address": "fa:16:3e:9a:fa:ec", "network": {"id": "d1324d81-9cdd-4788-b5a6-319e831b3723", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c51a048b091340dab769abbab323121d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c1a737-6c", "ovs_interfaceid": "a5c1a737-6ce0-4826-b20b-8d288bdd4283", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:56:26 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:fa:ec,bridge_name='br-int',has_traffic_filtering=True,id=a5c1a737-6ce0-4826-b20b-8d288bdd4283,network=Network(d1324d81-9cdd-4788-b5a6-319e831b3723),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5c1a737-6c') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:56:26 user nova-compute[72129]: DEBUG os_vif [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:fa:ec,bridge_name='br-int',has_traffic_filtering=True,id=a5c1a737-6ce0-4826-b20b-8d288bdd4283,network=Network(d1324d81-9cdd-4788-b5a6-319e831b3723),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5c1a737-6c') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 13:56:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:56:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:56:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 13:56:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:56:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa5c1a737-6c, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:56:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa5c1a737-6c, col_values=(('external_ids', {'iface-id': 'a5c1a737-6ce0-4826-b20b-8d288bdd4283', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:fa:ec', 'vm-uuid': '28164e90-f7ad-4f7e-9dcf-2fc750201342'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:56:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:56:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 13:56:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:56:26 user nova-compute[72129]: INFO os_vif [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:fa:ec,bridge_name='br-int',has_traffic_filtering=True,id=a5c1a737-6ce0-4826-b20b-8d288bdd4283,network=Network(d1324d81-9cdd-4788-b5a6-319e831b3723),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5c1a737-6c')
Aug 01 13:56:26 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 13:56:26 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] No VIF found with MAC fa:16:3e:9a:fa:ec, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 13:56:26 user nova-compute[72129]: DEBUG nova.network.neutron [req-5da1b6dd-6434-41b1-9897-cc97fa4bd113 req-87813097-611f-4813-9f98-ac4a2abd2558 service nova] [instance: 28164e90-f7ad-4f7e-9dcf-2fc750201342] Updated VIF entry in instance network info cache for port a5c1a737-6ce0-4826-b20b-8d288bdd4283. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 13:56:26 user nova-compute[72129]: DEBUG nova.network.neutron [req-5da1b6dd-6434-41b1-9897-cc97fa4bd113 req-87813097-611f-4813-9f98-ac4a2abd2558 service nova] [instance: 28164e90-f7ad-4f7e-9dcf-2fc750201342] Updating instance_info_cache with network_info: [{"id": "a5c1a737-6ce0-4826-b20b-8d288bdd4283", "address": "fa:16:3e:9a:fa:ec", "network": {"id": "d1324d81-9cdd-4788-b5a6-319e831b3723", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c51a048b091340dab769abbab323121d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c1a737-6c", "ovs_interfaceid": "a5c1a737-6ce0-4826-b20b-8d288bdd4283", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:56:26 user nova-compute[72129]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690898171.8271248, 31105963-52fa-4aff-9270-075cd98f08a5 => Stopped> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:56:26 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] VM Stopped (Lifecycle Event)
Aug 01 13:56:26 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-5da1b6dd-6434-41b1-9897-cc97fa4bd113 req-87813097-611f-4813-9f98-ac4a2abd2558 service nova] Releasing lock "refresh_cache-28164e90-f7ad-4f7e-9dcf-2fc750201342" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:56:26 user nova-compute[72129]: DEBUG nova.compute.manager [None req-5358419c-edd3-4430-80ab-71ed681135d3 None None] [instance: 31105963-52fa-4aff-9270-075cd98f08a5] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:56:27 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:56:27 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:56:27 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:56:28 user nova-compute[72129]: DEBUG nova.compute.manager [req-054b4acc-7363-4a48-b13b-a7b7813c29df req-0bb0216e-118c-47f0-b3f9-f8f73cc3c6cb service nova] [instance: 28164e90-f7ad-4f7e-9dcf-2fc750201342] Received event network-vif-plugged-a5c1a737-6ce0-4826-b20b-8d288bdd4283 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:56:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-054b4acc-7363-4a48-b13b-a7b7813c29df req-0bb0216e-118c-47f0-b3f9-f8f73cc3c6cb service nova] Acquiring lock "28164e90-f7ad-4f7e-9dcf-2fc750201342-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:56:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-054b4acc-7363-4a48-b13b-a7b7813c29df req-0bb0216e-118c-47f0-b3f9-f8f73cc3c6cb service nova] Lock "28164e90-f7ad-4f7e-9dcf-2fc750201342-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:56:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-054b4acc-7363-4a48-b13b-a7b7813c29df req-0bb0216e-118c-47f0-b3f9-f8f73cc3c6cb service nova] Lock "28164e90-f7ad-4f7e-9dcf-2fc750201342-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:56:28 user nova-compute[72129]: DEBUG nova.compute.manager [req-054b4acc-7363-4a48-b13b-a7b7813c29df req-0bb0216e-118c-47f0-b3f9-f8f73cc3c6cb service nova] [instance: 28164e90-f7ad-4f7e-9dcf-2fc750201342] No waiting events found dispatching network-vif-plugged-a5c1a737-6ce0-4826-b20b-8d288bdd4283 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:56:28 user nova-compute[72129]: WARNING nova.compute.manager [req-054b4acc-7363-4a48-b13b-a7b7813c29df req-0bb0216e-118c-47f0-b3f9-f8f73cc3c6cb service nova] [instance: 28164e90-f7ad-4f7e-9dcf-2fc750201342] Received unexpected event network-vif-plugged-a5c1a737-6ce0-4826-b20b-8d288bdd4283 for instance with vm_state building and task_state spawning.
Aug 01 13:56:28 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:56:28 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:56:28 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:56:28 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:56:30 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898190.2085238, 28164e90-f7ad-4f7e-9dcf-2fc750201342 => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:56:30 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 28164e90-f7ad-4f7e-9dcf-2fc750201342] VM Resumed (Lifecycle Event)
Aug 01 13:56:30 user nova-compute[72129]: DEBUG nova.compute.manager [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] [instance: 28164e90-f7ad-4f7e-9dcf-2fc750201342] Instance event wait completed in 0 seconds for  {{(pid=72129) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 13:56:30 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] [instance: 28164e90-f7ad-4f7e-9dcf-2fc750201342] Guest created on hypervisor {{(pid=72129) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 13:56:30 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 28164e90-f7ad-4f7e-9dcf-2fc750201342] Instance spawned successfully.
Aug 01 13:56:30 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] [instance: 28164e90-f7ad-4f7e-9dcf-2fc750201342] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 13:56:30 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 28164e90-f7ad-4f7e-9dcf-2fc750201342] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:56:30 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 28164e90-f7ad-4f7e-9dcf-2fc750201342] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 13:56:30 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] [instance: 28164e90-f7ad-4f7e-9dcf-2fc750201342] Found default for hw_cdrom_bus of ide {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:56:30 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] [instance: 28164e90-f7ad-4f7e-9dcf-2fc750201342] Found default for hw_disk_bus of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:56:30 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] [instance: 28164e90-f7ad-4f7e-9dcf-2fc750201342] Found default for hw_input_bus of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:56:30 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] [instance: 28164e90-f7ad-4f7e-9dcf-2fc750201342] Found default for hw_pointer_model of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:56:30 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] [instance: 28164e90-f7ad-4f7e-9dcf-2fc750201342] Found default for hw_video_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:56:30 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] [instance: 28164e90-f7ad-4f7e-9dcf-2fc750201342] Found default for hw_vif_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:56:30 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:56:30 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 28164e90-f7ad-4f7e-9dcf-2fc750201342] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 13:56:30 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898190.210507, 28164e90-f7ad-4f7e-9dcf-2fc750201342 => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:56:30 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 28164e90-f7ad-4f7e-9dcf-2fc750201342] VM Started (Lifecycle Event)
Aug 01 13:56:30 user nova-compute[72129]: DEBUG nova.compute.manager [req-d6d6630d-c189-4f09-ae99-f1173dba804d req-9529d8f6-e228-4705-8221-7c4d20d0521f service nova] [instance: 28164e90-f7ad-4f7e-9dcf-2fc750201342] Received event network-vif-plugged-a5c1a737-6ce0-4826-b20b-8d288bdd4283 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:56:30 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-d6d6630d-c189-4f09-ae99-f1173dba804d req-9529d8f6-e228-4705-8221-7c4d20d0521f service nova] Acquiring lock "28164e90-f7ad-4f7e-9dcf-2fc750201342-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:56:30 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-d6d6630d-c189-4f09-ae99-f1173dba804d req-9529d8f6-e228-4705-8221-7c4d20d0521f service nova] Lock "28164e90-f7ad-4f7e-9dcf-2fc750201342-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:56:30 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-d6d6630d-c189-4f09-ae99-f1173dba804d req-9529d8f6-e228-4705-8221-7c4d20d0521f service nova] Lock "28164e90-f7ad-4f7e-9dcf-2fc750201342-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:56:30 user nova-compute[72129]: DEBUG nova.compute.manager [req-d6d6630d-c189-4f09-ae99-f1173dba804d req-9529d8f6-e228-4705-8221-7c4d20d0521f service nova] [instance: 28164e90-f7ad-4f7e-9dcf-2fc750201342] No waiting events found dispatching network-vif-plugged-a5c1a737-6ce0-4826-b20b-8d288bdd4283 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:56:30 user nova-compute[72129]: WARNING nova.compute.manager [req-d6d6630d-c189-4f09-ae99-f1173dba804d req-9529d8f6-e228-4705-8221-7c4d20d0521f service nova] [instance: 28164e90-f7ad-4f7e-9dcf-2fc750201342] Received unexpected event network-vif-plugged-a5c1a737-6ce0-4826-b20b-8d288bdd4283 for instance with vm_state building and task_state spawning.
Aug 01 13:56:30 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 28164e90-f7ad-4f7e-9dcf-2fc750201342] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:56:30 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 28164e90-f7ad-4f7e-9dcf-2fc750201342] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 13:56:30 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 28164e90-f7ad-4f7e-9dcf-2fc750201342] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 13:56:30 user nova-compute[72129]: INFO nova.compute.manager [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] [instance: 28164e90-f7ad-4f7e-9dcf-2fc750201342] Took 6.41 seconds to spawn the instance on the hypervisor.
Aug 01 13:56:30 user nova-compute[72129]: DEBUG nova.compute.manager [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] [instance: 28164e90-f7ad-4f7e-9dcf-2fc750201342] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:56:31 user nova-compute[72129]: INFO nova.compute.manager [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] [instance: 28164e90-f7ad-4f7e-9dcf-2fc750201342] Took 7.12 seconds to build instance.
Aug 01 13:56:31 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-1d8e5bab-2f5f-42fe-9339-e337e60a1ed4 tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] Lock "28164e90-f7ad-4f7e-9dcf-2fc750201342" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.216s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:56:31 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:56:32 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-28ae10fa-9a8d-4b01-adb8-1eb5a42f3c0d tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Acquiring lock "28115c7d-544a-4504-98da-2398e0e354d8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:56:32 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-28ae10fa-9a8d-4b01-adb8-1eb5a42f3c0d tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Lock "28115c7d-544a-4504-98da-2398e0e354d8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:56:32 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-28ae10fa-9a8d-4b01-adb8-1eb5a42f3c0d tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Acquiring lock "28115c7d-544a-4504-98da-2398e0e354d8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:56:32 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-28ae10fa-9a8d-4b01-adb8-1eb5a42f3c0d tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Lock "28115c7d-544a-4504-98da-2398e0e354d8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:56:32 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-28ae10fa-9a8d-4b01-adb8-1eb5a42f3c0d tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Lock "28115c7d-544a-4504-98da-2398e0e354d8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:56:32 user nova-compute[72129]: INFO nova.compute.manager [None req-28ae10fa-9a8d-4b01-adb8-1eb5a42f3c0d tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] Terminating instance
Aug 01 13:56:32 user nova-compute[72129]: DEBUG nova.compute.manager [None req-28ae10fa-9a8d-4b01-adb8-1eb5a42f3c0d tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] Start destroying the instance on the hypervisor. {{(pid=72129) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 13:56:32 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:56:32 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:56:32 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:56:32 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:56:33 user nova-compute[72129]: DEBUG nova.compute.manager [req-8465e9e2-e9e7-4555-b50b-db0cf4d399e2 req-0fc47601-a7ae-4e17-976b-2e38e43f5abd service nova] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] Received event network-vif-unplugged-85708040-d7bf-4951-a29c-68cd6d3c4c42 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:56:33 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-8465e9e2-e9e7-4555-b50b-db0cf4d399e2 req-0fc47601-a7ae-4e17-976b-2e38e43f5abd service nova] Acquiring lock "28115c7d-544a-4504-98da-2398e0e354d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:56:33 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-8465e9e2-e9e7-4555-b50b-db0cf4d399e2 req-0fc47601-a7ae-4e17-976b-2e38e43f5abd service nova] Lock "28115c7d-544a-4504-98da-2398e0e354d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:56:33 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-8465e9e2-e9e7-4555-b50b-db0cf4d399e2 req-0fc47601-a7ae-4e17-976b-2e38e43f5abd service nova] Lock "28115c7d-544a-4504-98da-2398e0e354d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:56:33 user nova-compute[72129]: DEBUG nova.compute.manager [req-8465e9e2-e9e7-4555-b50b-db0cf4d399e2 req-0fc47601-a7ae-4e17-976b-2e38e43f5abd service nova] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] No waiting events found dispatching network-vif-unplugged-85708040-d7bf-4951-a29c-68cd6d3c4c42 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:56:33 user nova-compute[72129]: DEBUG nova.compute.manager [req-8465e9e2-e9e7-4555-b50b-db0cf4d399e2 req-0fc47601-a7ae-4e17-976b-2e38e43f5abd service nova] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] Received event network-vif-unplugged-85708040-d7bf-4951-a29c-68cd6d3c4c42 for instance with task_state deleting. {{(pid=72129) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 13:56:33 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] Instance destroyed successfully.
Aug 01 13:56:33 user nova-compute[72129]: DEBUG nova.objects.instance [None req-28ae10fa-9a8d-4b01-adb8-1eb5a42f3c0d tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Lazy-loading 'resources' on Instance uuid 28115c7d-544a-4504-98da-2398e0e354d8 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:56:33 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-28ae10fa-9a8d-4b01-adb8-1eb5a42f3c0d tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:49:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-778819907',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-778819907',id=4,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKvGwo0zjXCNUbYrIi4YEs4rtiDx/9NdwV/Sx7cEd1WUmQMQL0Cvr4BJf7rFX6wTjuFT3Iox4h/+fvNDp2cLdA3kaS9jPaIqGnKwrwaSc0khjL6fklV+VntF7pSPCiAV+A==',key_name='tempest-keypair-1718331991',keypairs=<?>,launch_index=0,launched_at=2023-08-01T13:50:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ebef26e9d3654bf99ecf391ccb263330',ramdisk_id='',reservation_id='r-yt02zl40',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1852542004',owner_user_name='tempest-ServerActionsV293TestJSON-1852542004-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T13:50:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37e6bf606d3041d9928c5e5d6f4a9063',uuid=28115c7d-544a-4504-98da-2398e0e354d8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85708040-d7bf-4951-a29c-68cd6d3c4c42", "address": "fa:16:3e:ed:f5:6f", "network": {"id": "2338fb81-87b6-4976-a6ab-b4ea0218fa9b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-606840206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebef26e9d3654bf99ecf391ccb263330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85708040-d7", "ovs_interfaceid": "85708040-d7bf-4951-a29c-68cd6d3c4c42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 13:56:33 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-28ae10fa-9a8d-4b01-adb8-1eb5a42f3c0d tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Converting VIF {"id": "85708040-d7bf-4951-a29c-68cd6d3c4c42", "address": "fa:16:3e:ed:f5:6f", "network": {"id": "2338fb81-87b6-4976-a6ab-b4ea0218fa9b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-606840206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ebef26e9d3654bf99ecf391ccb263330", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85708040-d7", "ovs_interfaceid": "85708040-d7bf-4951-a29c-68cd6d3c4c42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:56:33 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-28ae10fa-9a8d-4b01-adb8-1eb5a42f3c0d tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ed:f5:6f,bridge_name='br-int',has_traffic_filtering=True,id=85708040-d7bf-4951-a29c-68cd6d3c4c42,network=Network(2338fb81-87b6-4976-a6ab-b4ea0218fa9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85708040-d7') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:56:33 user nova-compute[72129]: DEBUG os_vif [None req-28ae10fa-9a8d-4b01-adb8-1eb5a42f3c0d tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:f5:6f,bridge_name='br-int',has_traffic_filtering=True,id=85708040-d7bf-4951-a29c-68cd6d3c4c42,network=Network(2338fb81-87b6-4976-a6ab-b4ea0218fa9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85708040-d7') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 13:56:33 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:56:33 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap85708040-d7, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:56:33 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:56:33 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:56:33 user nova-compute[72129]: INFO os_vif [None req-28ae10fa-9a8d-4b01-adb8-1eb5a42f3c0d tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:f5:6f,bridge_name='br-int',has_traffic_filtering=True,id=85708040-d7bf-4951-a29c-68cd6d3c4c42,network=Network(2338fb81-87b6-4976-a6ab-b4ea0218fa9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85708040-d7')
Aug 01 13:56:33 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-28ae10fa-9a8d-4b01-adb8-1eb5a42f3c0d tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] Deleting instance files /opt/stack/data/nova/instances/28115c7d-544a-4504-98da-2398e0e354d8_del
Aug 01 13:56:33 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-28ae10fa-9a8d-4b01-adb8-1eb5a42f3c0d tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] Deletion of /opt/stack/data/nova/instances/28115c7d-544a-4504-98da-2398e0e354d8_del complete
Aug 01 13:56:33 user nova-compute[72129]: INFO nova.compute.manager [None req-28ae10fa-9a8d-4b01-adb8-1eb5a42f3c0d tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 01 13:56:33 user nova-compute[72129]: DEBUG oslo.service.loopingcall [None req-28ae10fa-9a8d-4b01-adb8-1eb5a42f3c0d tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72129) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 13:56:33 user nova-compute[72129]: DEBUG nova.compute.manager [-] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] Deallocating network for instance {{(pid=72129) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 13:56:33 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] deallocate_for_instance() {{(pid=72129) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 13:56:34 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:56:34 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] Took 0.84 seconds to deallocate network for instance.
Aug 01 13:56:34 user nova-compute[72129]: DEBUG nova.compute.manager [req-733bfd08-0d0a-4369-8c72-1b222f156603 req-fd4ca9b5-b365-4ac2-90f2-35904255fffb service nova] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] Received event network-vif-deleted-85708040-d7bf-4951-a29c-68cd6d3c4c42 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:56:34 user nova-compute[72129]: INFO nova.compute.manager [req-733bfd08-0d0a-4369-8c72-1b222f156603 req-fd4ca9b5-b365-4ac2-90f2-35904255fffb service nova] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] Neutron deleted interface 85708040-d7bf-4951-a29c-68cd6d3c4c42; detaching it from the instance and deleting it from the info cache
Aug 01 13:56:34 user nova-compute[72129]: DEBUG nova.network.neutron [req-733bfd08-0d0a-4369-8c72-1b222f156603 req-fd4ca9b5-b365-4ac2-90f2-35904255fffb service nova] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:56:34 user nova-compute[72129]: DEBUG nova.compute.manager [req-733bfd08-0d0a-4369-8c72-1b222f156603 req-fd4ca9b5-b365-4ac2-90f2-35904255fffb service nova] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] Detach interface failed, port_id=85708040-d7bf-4951-a29c-68cd6d3c4c42, reason: Instance 28115c7d-544a-4504-98da-2398e0e354d8 could not be found. {{(pid=72129) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 13:56:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-28ae10fa-9a8d-4b01-adb8-1eb5a42f3c0d tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:56:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-28ae10fa-9a8d-4b01-adb8-1eb5a42f3c0d tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:56:34 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-28ae10fa-9a8d-4b01-adb8-1eb5a42f3c0d tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 13:56:34 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-28ae10fa-9a8d-4b01-adb8-1eb5a42f3c0d tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 13:56:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-28ae10fa-9a8d-4b01-adb8-1eb5a42f3c0d tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.303s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:56:34 user nova-compute[72129]: INFO nova.scheduler.client.report [None req-28ae10fa-9a8d-4b01-adb8-1eb5a42f3c0d tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Deleted allocations for instance 28115c7d-544a-4504-98da-2398e0e354d8
Aug 01 13:56:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-28ae10fa-9a8d-4b01-adb8-1eb5a42f3c0d tempest-ServerActionsV293TestJSON-1852542004 tempest-ServerActionsV293TestJSON-1852542004-project-member] Lock "28115c7d-544a-4504-98da-2398e0e354d8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.228s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:56:35 user nova-compute[72129]: DEBUG nova.compute.manager [req-ec128e6c-7211-4909-b66f-5b26c7b7973f req-45eee179-05fa-41ce-9439-1995d36065db service nova] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] Received event network-vif-plugged-85708040-d7bf-4951-a29c-68cd6d3c4c42 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:56:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ec128e6c-7211-4909-b66f-5b26c7b7973f req-45eee179-05fa-41ce-9439-1995d36065db service nova] Acquiring lock "28115c7d-544a-4504-98da-2398e0e354d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:56:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ec128e6c-7211-4909-b66f-5b26c7b7973f req-45eee179-05fa-41ce-9439-1995d36065db service nova] Lock "28115c7d-544a-4504-98da-2398e0e354d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:56:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ec128e6c-7211-4909-b66f-5b26c7b7973f req-45eee179-05fa-41ce-9439-1995d36065db service nova] Lock "28115c7d-544a-4504-98da-2398e0e354d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:56:35 user nova-compute[72129]: DEBUG nova.compute.manager [req-ec128e6c-7211-4909-b66f-5b26c7b7973f req-45eee179-05fa-41ce-9439-1995d36065db service nova] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] No waiting events found dispatching network-vif-plugged-85708040-d7bf-4951-a29c-68cd6d3c4c42 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:56:35 user nova-compute[72129]: WARNING nova.compute.manager [req-ec128e6c-7211-4909-b66f-5b26c7b7973f req-45eee179-05fa-41ce-9439-1995d36065db service nova] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] Received unexpected event network-vif-plugged-85708040-d7bf-4951-a29c-68cd6d3c4c42 for instance with vm_state deleted and task_state None.
Aug 01 13:56:35 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:56:37 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:56:38 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:56:39 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:56:39 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Starting heal instance info cache {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 13:56:39 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Rebuilding the list of instances to heal {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 13:56:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "refresh_cache-63c0c1fe-7e4d-4763-8ede-a7662747a4c0" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:56:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquired lock "refresh_cache-63c0c1fe-7e4d-4763-8ede-a7662747a4c0" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:56:39 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] Forcefully refreshing network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 13:56:39 user nova-compute[72129]: DEBUG nova.objects.instance [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lazy-loading 'info_cache' on Instance uuid 63c0c1fe-7e4d-4763-8ede-a7662747a4c0 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:56:39 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] Updating instance_info_cache with network_info: [{"id": "33a9acea-27a3-4a66-a5f9-4be39dc61ae7", "address": "fa:16:3e:65:63:71", "network": {"id": "90839969-290c-4555-ab2f-2215c33e89e9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1983064867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f34719c31d18460fa308e1f40130ed24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33a9acea-27", "ovs_interfaceid": "33a9acea-27a3-4a66-a5f9-4be39dc61ae7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:56:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Releasing lock "refresh_cache-63c0c1fe-7e4d-4763-8ede-a7662747a4c0" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:56:39 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] Updated the network info_cache for instance {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 13:56:40 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:56:41 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:56:42 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:56:42 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:56:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 13:56:44 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:56:44 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:56:44 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72129) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 13:56:44 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:56:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:56:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:56:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:56:44 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Auditing locally available compute resources for user (node: user) {{(pid=72129) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 13:56:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:56:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:56:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:56:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:56:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133076de-14b5-4ceb-aa41-d9acef8506c5/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:56:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133076de-14b5-4ceb-aa41-d9acef8506c5/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:56:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133076de-14b5-4ceb-aa41-d9acef8506c5/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:56:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133076de-14b5-4ceb-aa41-d9acef8506c5/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:56:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:56:45 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:56:45 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:56:45 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:56:45 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28164e90-f7ad-4f7e-9dcf-2fc750201342/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:56:45 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28164e90-f7ad-4f7e-9dcf-2fc750201342/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:56:45 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28164e90-f7ad-4f7e-9dcf-2fc750201342/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:56:45 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28164e90-f7ad-4f7e-9dcf-2fc750201342/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:56:45 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efa87a6-1dd6-4441-a55e-8e86be7f0a35/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:56:45 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:56:45 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efa87a6-1dd6-4441-a55e-8e86be7f0a35/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:56:45 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efa87a6-1dd6-4441-a55e-8e86be7f0a35/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:56:45 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efa87a6-1dd6-4441-a55e-8e86be7f0a35/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:56:45 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 13:56:45 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63c0c1fe-7e4d-4763-8ede-a7662747a4c0/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:56:45 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63c0c1fe-7e4d-4763-8ede-a7662747a4c0/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:56:45 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63c0c1fe-7e4d-4763-8ede-a7662747a4c0/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:56:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63c0c1fe-7e4d-4763-8ede-a7662747a4c0/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:56:46 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:56:46 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:56:46 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Hypervisor/Node resource view: name=user free_ram=7856MB free_disk=25.469898223876953GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72129) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 13:56:46 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:56:46 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:56:46 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 63c0c1fe-7e4d-4763-8ede-a7662747a4c0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:56:46 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 97a5dccf-b499-443a-b332-cfa293a16047 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:56:46 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 2efa87a6-1dd6-4441-a55e-8e86be7f0a35 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:56:46 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:56:46 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 133076de-14b5-4ceb-aa41-d9acef8506c5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:56:46 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 28164e90-f7ad-4f7e-9dcf-2fc750201342 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:56:46 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 13:56:46 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 13:56:46 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 13:56:47 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 13:56:47 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Compute_service record updated for user:user {{(pid=72129) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 13:56:47 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.410s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:56:48 user nova-compute[72129]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690898193.45011, 28115c7d-544a-4504-98da-2398e0e354d8 => Stopped> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:56:48 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] VM Stopped (Lifecycle Event)
Aug 01 13:56:48 user nova-compute[72129]: DEBUG nova.compute.manager [None req-a202b387-4475-4e07-bb41-37a4328dc213 None None] [instance: 28115c7d-544a-4504-98da-2398e0e354d8] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:56:48 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:56:50 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:56:53 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:56:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-ea6190f0-97d7-4cdd-9ebe-dc3a56668e9f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Acquiring lock "97a5dccf-b499-443a-b332-cfa293a16047" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:56:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-ea6190f0-97d7-4cdd-9ebe-dc3a56668e9f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "97a5dccf-b499-443a-b332-cfa293a16047" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:56:54 user nova-compute[72129]: DEBUG nova.objects.instance [None req-ea6190f0-97d7-4cdd-9ebe-dc3a56668e9f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lazy-loading 'flavor' on Instance uuid 97a5dccf-b499-443a-b332-cfa293a16047 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:56:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-ea6190f0-97d7-4cdd-9ebe-dc3a56668e9f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "97a5dccf-b499-443a-b332-cfa293a16047" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:56:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-ea6190f0-97d7-4cdd-9ebe-dc3a56668e9f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Acquiring lock "97a5dccf-b499-443a-b332-cfa293a16047" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:56:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-ea6190f0-97d7-4cdd-9ebe-dc3a56668e9f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "97a5dccf-b499-443a-b332-cfa293a16047" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:56:54 user nova-compute[72129]: INFO nova.compute.manager [None req-ea6190f0-97d7-4cdd-9ebe-dc3a56668e9f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Attaching volume de3acab7-803c-4154-926b-fa47bdeb988f to /dev/vdb
Aug 01 13:56:54 user nova-compute[72129]: DEBUG os_brick.utils [None req-ea6190f0-97d7-4cdd-9ebe-dc3a56668e9f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:56:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:56:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:56:54 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[52787ffa-2259-4b12-87ab-cee3e6c3038a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f9b449c2cd3d\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:56:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:56:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:56:54 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b998b8a2-6ca8-4e08-bb67-e8ee94a2fddc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:56:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:56:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:56:54 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed1d8ad6-0e03-4a05-8a2f-e8d43cb4b066]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:56:54 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[56137c0d-552c-4252-a55c-c34e9b0aac38]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:56:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-ea6190f0-97d7-4cdd-9ebe-dc3a56668e9f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Running cmd (subprocess): nvme version {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:56:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-ea6190f0-97d7-4cdd-9ebe-dc3a56668e9f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] 'nvme version' failed. Not Retrying. {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 13:56:54 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ea6190f0-97d7-4cdd-9ebe-dc3a56668e9f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] nvme not present on system {{(pid=72129) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 13:56:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:56:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 13:56:54 user nova-compute[72129]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 13:56:54 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[2687c738-3ad9-408a-96e3-dad449812a7e]: (4, '') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:56:54 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-ea6190f0-97d7-4cdd-9ebe-dc3a56668e9f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72129) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 13:56:54 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-ea6190f0-97d7-4cdd-9ebe-dc3a56668e9f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 13:56:54 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-ea6190f0-97d7-4cdd-9ebe-dc3a56668e9f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] LIGHTOS: no hostnqn found. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 13:56:54 user nova-compute[72129]: DEBUG os_brick.utils [None req-ea6190f0-97d7-4cdd-9ebe-dc3a56668e9f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f9b449c2cd3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:56:54 user nova-compute[72129]: DEBUG nova.virt.block_device [None req-ea6190f0-97d7-4cdd-9ebe-dc3a56668e9f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Updating existing volume attachment record: f0c61eae-8d1e-4bb7-8645-6c7e2e718fc6 {{(pid=72129) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 13:56:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:56:57 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:56:58 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:56:59 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Acquiring lock "d031973f-8f48-43b3-a338-040950103e4c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:56:59 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "d031973f-8f48-43b3-a338-040950103e4c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:57:00 user nova-compute[72129]: DEBUG nova.compute.manager [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: d031973f-8f48-43b3-a338-040950103e4c] Starting instance... {{(pid=72129) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 13:57:00 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:57:00 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:57:00 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72129) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 13:57:00 user nova-compute[72129]: INFO nova.compute.claims [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: d031973f-8f48-43b3-a338-040950103e4c] Claim successful on node user
Aug 01 13:57:00 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 13:57:00 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 13:57:00 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:00 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.449s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:57:00 user nova-compute[72129]: DEBUG nova.compute.manager [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: d031973f-8f48-43b3-a338-040950103e4c] Start building networks asynchronously for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 13:57:00 user nova-compute[72129]: DEBUG nova.compute.manager [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: d031973f-8f48-43b3-a338-040950103e4c] Allocating IP information in the background. {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 13:57:00 user nova-compute[72129]: DEBUG nova.network.neutron [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: d031973f-8f48-43b3-a338-040950103e4c] allocate_for_instance() {{(pid=72129) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 13:57:00 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: d031973f-8f48-43b3-a338-040950103e4c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 13:57:00 user nova-compute[72129]: DEBUG nova.compute.manager [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: d031973f-8f48-43b3-a338-040950103e4c] Start building block device mappings for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 13:57:00 user nova-compute[72129]: INFO nova.virt.block_device [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: d031973f-8f48-43b3-a338-040950103e4c] Booting with blank volume at /dev/vda
Aug 01 13:57:00 user nova-compute[72129]: DEBUG nova.policy [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cdb6f66592fe4cdebea02e5f5c1f4a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0929886fa54d1c8023793806f10d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72129) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 13:57:02 user nova-compute[72129]: DEBUG nova.network.neutron [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: d031973f-8f48-43b3-a338-040950103e4c] Successfully created port: a978f40a-6406-423f-81f7-1e8077b43fd5 {{(pid=72129) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 13:57:02 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea6190f0-97d7-4cdd-9ebe-dc3a56668e9f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Calling os-brick to attach iSCSI Volume {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 13:57:02 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6190f0-97d7-4cdd-9ebe-dc3a56668e9f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DMmEigrw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:57:02 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-ea6190f0-97d7-4cdd-9ebe-dc3a56668e9f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 13:57:02 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-ea6190f0-97d7-4cdd-9ebe-dc3a56668e9f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:57:02 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-ea6190f0-97d7-4cdd-9ebe-dc3a56668e9f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:57:02 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-ea6190f0-97d7-4cdd-9ebe-dc3a56668e9f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 13:57:02 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-ea6190f0-97d7-4cdd-9ebe-dc3a56668e9f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:57:02 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-ea6190f0-97d7-4cdd-9ebe-dc3a56668e9f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:57:02 user nova-compute[72129]: INFO os_brick.initiator.connectors.iscsi [None req-ea6190f0-97d7-4cdd-9ebe-dc3a56668e9f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 13:57:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f -p 172.16.0.220:3260 {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:02 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c3b0a4-3af0-4f4d-9332-f388cc845ebe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:02 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6190f0-97d7-4cdd-9ebe-dc3a56668e9f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 13:57:02 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:57:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f -p 172.16.0.220:3260 --interface default --op new {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:02 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f59969d-080e-46af-b0ca-c7d9db902419]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f] added\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:02 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6190f0-97d7-4cdd-9ebe-dc3a56668e9f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f] added
Aug 01 13:57:02 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:57:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:02 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[2953ce0f-6709-4ebd-ba39-9fa19ed586f9]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:02 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6190f0-97d7-4cdd-9ebe-dc3a56668e9f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:57:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:02 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8fcf915-d7b2-4309-81ef-31151618fa8c]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:02 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6190f0-97d7-4cdd-9ebe-dc3a56668e9f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:57:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DMmEigrw {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DMmEigrw" returned: 0 in 0.025s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:02 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[6027021f-0a3e-4a0d-a061-3a3129cc681c]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:02 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6190f0-97d7-4cdd-9ebe-dc3a56668e9f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DMmEigrw'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:57:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:02 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98fc4f6-ec2b-4b7a-91e0-4ac86c7afd4a]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:02 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6190f0-97d7-4cdd-9ebe-dc3a56668e9f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:57:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:02 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ac070d-761e-421e-a59f-987fc780fc8b]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:02 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6190f0-97d7-4cdd-9ebe-dc3a56668e9f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)
Aug 01 13:57:02 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:57:02 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6190f0-97d7-4cdd-9ebe-dc3a56668e9f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)
Aug 01 13:57:02 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:57:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f -p 172.16.0.220:3260 --login {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:02 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bbd5a88-660d-4bdb-91d9-7da5d058d803]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:02 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6190f0-97d7-4cdd-9ebe-dc3a56668e9f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f, portal: 172.16.0.220,3260]
Aug 01 13:57:02 user nova-compute[72129]: Login to [iface: default, target: iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f, portal: 172.16.0.220,3260] successful.
Aug 01 13:57:02 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:57:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:02 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[483e3c5f-9830-4901-ba67-5f730f7c745e]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:02 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6190f0-97d7-4cdd-9ebe-dc3a56668e9f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:57:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:02 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[626f573b-a8df-4634-b3ad-c4060b93f8a8]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:02 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6190f0-97d7-4cdd-9ebe-dc3a56668e9f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)
Aug 01 13:57:02 user nova-compute[72129]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f (non-flash)
Aug 01 13:57:02 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:57:02 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6190f0-97d7-4cdd-9ebe-dc3a56668e9f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)
Aug 01 13:57:02 user nova-compute[72129]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f (non-flash)
Aug 01 13:57:02 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:57:02 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-ea6190f0-97d7-4cdd-9ebe-dc3a56668e9f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:57:02 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6190f0-97d7-4cdd-9ebe-dc3a56668e9f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Connected to 172.16.0.220:3260 {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 13:57:02 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-ea6190f0-97d7-4cdd-9ebe-dc3a56668e9f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] HCTL ('34', '-', '-', 0) found on session 21 with lun 0 {{(pid=72129) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 13:57:02 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-ea6190f0-97d7-4cdd-9ebe-dc3a56668e9f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72129) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 13:57:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:03 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:03 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba3c43b-5126-45f1-838a-8c40c552e69d]: (4, ('- - 0', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:03 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-ea6190f0-97d7-4cdd-9ebe-dc3a56668e9f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Searching for a device in session 21 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 13:57:03 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6190f0-97d7-4cdd-9ebe-dc3a56668e9f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DMmEigrw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 13:57:03 user nova-compute[72129]: DEBUG nova.network.neutron [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: d031973f-8f48-43b3-a338-040950103e4c] Successfully updated port: a978f40a-6406-423f-81f7-1e8077b43fd5 {{(pid=72129) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 13:57:03 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Acquiring lock "refresh_cache-d031973f-8f48-43b3-a338-040950103e4c" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:57:03 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Acquired lock "refresh_cache-d031973f-8f48-43b3-a338-040950103e4c" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:57:03 user nova-compute[72129]: DEBUG nova.network.neutron [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: d031973f-8f48-43b3-a338-040950103e4c] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 13:57:03 user nova-compute[72129]: DEBUG nova.compute.manager [req-b9889a82-ba7c-4db9-81aa-0df7540f5bf4 req-e1f81d42-3884-498b-a621-2efe5927e771 service nova] [instance: d031973f-8f48-43b3-a338-040950103e4c] Received event network-changed-a978f40a-6406-423f-81f7-1e8077b43fd5 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:57:03 user nova-compute[72129]: DEBUG nova.compute.manager [req-b9889a82-ba7c-4db9-81aa-0df7540f5bf4 req-e1f81d42-3884-498b-a621-2efe5927e771 service nova] [instance: d031973f-8f48-43b3-a338-040950103e4c] Refreshing instance network info cache due to event network-changed-a978f40a-6406-423f-81f7-1e8077b43fd5. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 13:57:03 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-b9889a82-ba7c-4db9-81aa-0df7540f5bf4 req-e1f81d42-3884-498b-a621-2efe5927e771 service nova] Acquiring lock "refresh_cache-d031973f-8f48-43b3-a338-040950103e4c" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:57:03 user nova-compute[72129]: DEBUG nova.network.neutron [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: d031973f-8f48-43b3-a338-040950103e4c] Instance cache missing network info. {{(pid=72129) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 13:57:03 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:03 user nova-compute[72129]: DEBUG nova.network.neutron [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: d031973f-8f48-43b3-a338-040950103e4c] Updating instance_info_cache with network_info: [{"id": "a978f40a-6406-423f-81f7-1e8077b43fd5", "address": "fa:16:3e:09:fd:e5", "network": {"id": "59b1e538-8bfe-45ce-ab7b-c5838ab25582", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1129024349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0929886fa54d1c8023793806f10d31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa978f40a-64", "ovs_interfaceid": "a978f40a-6406-423f-81f7-1e8077b43fd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:57:03 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Releasing lock "refresh_cache-d031973f-8f48-43b3-a338-040950103e4c" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:57:03 user nova-compute[72129]: DEBUG nova.compute.manager [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: d031973f-8f48-43b3-a338-040950103e4c] Instance network_info: |[{"id": "a978f40a-6406-423f-81f7-1e8077b43fd5", "address": "fa:16:3e:09:fd:e5", "network": {"id": "59b1e538-8bfe-45ce-ab7b-c5838ab25582", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1129024349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0929886fa54d1c8023793806f10d31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa978f40a-64", "ovs_interfaceid": "a978f40a-6406-423f-81f7-1e8077b43fd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 13:57:03 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-b9889a82-ba7c-4db9-81aa-0df7540f5bf4 req-e1f81d42-3884-498b-a621-2efe5927e771 service nova] Acquired lock "refresh_cache-d031973f-8f48-43b3-a338-040950103e4c" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:57:03 user nova-compute[72129]: DEBUG nova.network.neutron [req-b9889a82-ba7c-4db9-81aa-0df7540f5bf4 req-e1f81d42-3884-498b-a621-2efe5927e771 service nova] [instance: d031973f-8f48-43b3-a338-040950103e4c] Refreshing network info cache for port a978f40a-6406-423f-81f7-1e8077b43fd5 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 13:57:04 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-ea6190f0-97d7-4cdd-9ebe-dc3a56668e9f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:57:04 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea6190f0-97d7-4cdd-9ebe-dc3a56668e9f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] <== connect_volume: return (1371ms) {'type': 'block', 'scsi_wwn': '23565333230636531', 'path': '/dev/sdc'} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:57:04 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea6190f0-97d7-4cdd-9ebe-dc3a56668e9f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23565333230636531', 'path': '/dev/sdc'} {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 13:57:04 user nova-compute[72129]: DEBUG nova.objects.instance [None req-ea6190f0-97d7-4cdd-9ebe-dc3a56668e9f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lazy-loading 'flavor' on Instance uuid 97a5dccf-b499-443a-b332-cfa293a16047 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:57:04 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-ea6190f0-97d7-4cdd-9ebe-dc3a56668e9f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 13:57:04 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 13:57:04 user nova-compute[72129]:   <source dev="/dev/sdc"/>
Aug 01 13:57:04 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 13:57:04 user nova-compute[72129]:   <serial>de3acab7-803c-4154-926b-fa47bdeb988f</serial>
Aug 01 13:57:04 user nova-compute[72129]: </disk>
Aug 01 13:57:04 user nova-compute[72129]:  {{(pid=72129) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 13:57:04 user nova-compute[72129]: DEBUG nova.network.neutron [req-b9889a82-ba7c-4db9-81aa-0df7540f5bf4 req-e1f81d42-3884-498b-a621-2efe5927e771 service nova] [instance: d031973f-8f48-43b3-a338-040950103e4c] Updated VIF entry in instance network info cache for port a978f40a-6406-423f-81f7-1e8077b43fd5. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 13:57:04 user nova-compute[72129]: DEBUG nova.network.neutron [req-b9889a82-ba7c-4db9-81aa-0df7540f5bf4 req-e1f81d42-3884-498b-a621-2efe5927e771 service nova] [instance: d031973f-8f48-43b3-a338-040950103e4c] Updating instance_info_cache with network_info: [{"id": "a978f40a-6406-423f-81f7-1e8077b43fd5", "address": "fa:16:3e:09:fd:e5", "network": {"id": "59b1e538-8bfe-45ce-ab7b-c5838ab25582", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1129024349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0929886fa54d1c8023793806f10d31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa978f40a-64", "ovs_interfaceid": "a978f40a-6406-423f-81f7-1e8077b43fd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:57:04 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-b9889a82-ba7c-4db9-81aa-0df7540f5bf4 req-e1f81d42-3884-498b-a621-2efe5927e771 service nova] Releasing lock "refresh_cache-d031973f-8f48-43b3-a338-040950103e4c" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:57:04 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-ea6190f0-97d7-4cdd-9ebe-dc3a56668e9f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 13:57:04 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-ea6190f0-97d7-4cdd-9ebe-dc3a56668e9f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 13:57:04 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-ea6190f0-97d7-4cdd-9ebe-dc3a56668e9f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] No VIF found with MAC fa:16:3e:a3:52:a2, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 13:57:04 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-ea6190f0-97d7-4cdd-9ebe-dc3a56668e9f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "97a5dccf-b499-443a-b332-cfa293a16047" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.327s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:57:05 user nova-compute[72129]: INFO nova.compute.manager [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Rebuilding instance
Aug 01 13:57:05 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:05 user nova-compute[72129]: DEBUG nova.objects.instance [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lazy-loading 'trusted_certs' on Instance uuid 97a5dccf-b499-443a-b332-cfa293a16047 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:57:06 user nova-compute[72129]: DEBUG nova.compute.manager [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:57:06 user nova-compute[72129]: DEBUG nova.objects.instance [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lazy-loading 'pci_requests' on Instance uuid 97a5dccf-b499-443a-b332-cfa293a16047 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:57:06 user nova-compute[72129]: DEBUG nova.objects.instance [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lazy-loading 'pci_devices' on Instance uuid 97a5dccf-b499-443a-b332-cfa293a16047 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:57:06 user nova-compute[72129]: DEBUG nova.objects.instance [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lazy-loading 'resources' on Instance uuid 97a5dccf-b499-443a-b332-cfa293a16047 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:57:06 user nova-compute[72129]: DEBUG nova.objects.instance [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lazy-loading 'migration_context' on Instance uuid 97a5dccf-b499-443a-b332-cfa293a16047 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:57:06 user nova-compute[72129]: DEBUG nova.objects.instance [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72129) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Aug 01 13:57:06 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:06 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:06 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:06 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:06 user nova-compute[72129]: DEBUG nova.compute.manager [req-5daaa5ce-ccf6-45fe-9979-a4ac0663d224 req-57c72eac-9055-415d-b473-b67c5d52587f service nova] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Received event network-vif-unplugged-4871bc74-6594-49e6-a6ef-343bc3800742 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:57:06 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-5daaa5ce-ccf6-45fe-9979-a4ac0663d224 req-57c72eac-9055-415d-b473-b67c5d52587f service nova] Acquiring lock "97a5dccf-b499-443a-b332-cfa293a16047-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:57:06 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-5daaa5ce-ccf6-45fe-9979-a4ac0663d224 req-57c72eac-9055-415d-b473-b67c5d52587f service nova] Lock "97a5dccf-b499-443a-b332-cfa293a16047-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:57:06 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-5daaa5ce-ccf6-45fe-9979-a4ac0663d224 req-57c72eac-9055-415d-b473-b67c5d52587f service nova] Lock "97a5dccf-b499-443a-b332-cfa293a16047-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:57:06 user nova-compute[72129]: DEBUG nova.compute.manager [req-5daaa5ce-ccf6-45fe-9979-a4ac0663d224 req-57c72eac-9055-415d-b473-b67c5d52587f service nova] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] No waiting events found dispatching network-vif-unplugged-4871bc74-6594-49e6-a6ef-343bc3800742 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:57:06 user nova-compute[72129]: WARNING nova.compute.manager [req-5daaa5ce-ccf6-45fe-9979-a4ac0663d224 req-57c72eac-9055-415d-b473-b67c5d52587f service nova] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Received unexpected event network-vif-unplugged-4871bc74-6594-49e6-a6ef-343bc3800742 for instance with vm_state active and task_state rebuilding.
Aug 01 13:57:06 user nova-compute[72129]: DEBUG os_brick.utils [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:57:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:06 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[443d2e81-e7ee-472a-abfd-1745bb20e47d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f9b449c2cd3d\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:06 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[103ddf41-0637-465a-9551-daac514e1bcc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:06 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b850d05f-9c06-42d7-b699-b8e62323f89c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:06 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb7527ba-3665-4426-8dd4-227645c74db0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Running cmd (subprocess): nvme version {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] 'nvme version' failed. Not Retrying. {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 13:57:06 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] nvme not present on system {{(pid=72129) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 13:57:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 13:57:06 user nova-compute[72129]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 13:57:06 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[0451badb-73ce-419e-84a0-9c8c36aed191]: (4, '') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:06 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72129) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 13:57:06 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 13:57:06 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] LIGHTOS: no hostnqn found. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 13:57:06 user nova-compute[72129]: DEBUG os_brick.utils [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f9b449c2cd3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:57:06 user nova-compute[72129]: DEBUG nova.virt.block_device [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: d031973f-8f48-43b3-a338-040950103e4c] Updating existing volume attachment record: 84b52685-fab2-4ada-83ad-002206870b22 {{(pid=72129) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 13:57:06 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Instance destroyed successfully.
Aug 01 13:57:07 user nova-compute[72129]: INFO nova.compute.manager [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Detaching volume de3acab7-803c-4154-926b-fa47bdeb988f
Aug 01 13:57:07 user nova-compute[72129]: INFO nova.virt.block_device [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Attempting to driver detach volume de3acab7-803c-4154-926b-fa47bdeb988f from mountpoint /dev/vdb
Aug 01 13:57:07 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Attempting to detach device vdb from instance 97a5dccf-b499-443a-b332-cfa293a16047 from the persistent domain config. {{(pid=72129) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 13:57:07 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 13:57:07 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 13:57:07 user nova-compute[72129]:   <source dev="/dev/sdc"/>
Aug 01 13:57:07 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 13:57:07 user nova-compute[72129]:   <serial>de3acab7-803c-4154-926b-fa47bdeb988f</serial>
Aug 01 13:57:07 user nova-compute[72129]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 13:57:07 user nova-compute[72129]: </disk>
Aug 01 13:57:07 user nova-compute[72129]:  {{(pid=72129) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 13:57:07 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Successfully detached device vdb from instance 97a5dccf-b499-443a-b332-cfa293a16047 from the persistent domain config.
Aug 01 13:57:07 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] calling os-brick to detach iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 13:57:07 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, {'target_iqns': ['iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DMmEigrw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:57:07 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 01 13:57:07 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:57:07 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:57:07 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f', 0)] {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 13:57:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:07 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[83896159-2b69-4827-a7e5-c9bf70a29bb8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:07 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[06456a65-ea97-44b6-af32-6e54f0325a7e]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:07 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)
Aug 01 13:57:07 user nova-compute[72129]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f (non-flash)
Aug 01 13:57:07 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:57:07 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)
Aug 01 13:57:07 user nova-compute[72129]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f (non-flash)
Aug 01 13:57:07 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:57:07 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f28282813f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f'): ({'sdc'}, set())}) {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 13:57:07 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Removing single pathed devices sdc {{(pid=72129) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 13:57:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:07 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[59dc3632-4f22-4d7d-b895-bada6308bb11]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:07 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[818b28ec-2a0d-45b1-903d-4ac0a8d58c0e]: (4, ('ok\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:07 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Flushing IO for device /dev/sdc {{(pid=72129) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 13:57:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:07 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d143337d-7f6f-4ead-badd-2095653387f9]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:07 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72129) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 13:57:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:07 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d440ce6-f1eb-4dd8-a867-78363643ec1c]: (4, ('1', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:07 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 13:57:07 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] SCSI volumes sdc have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 13:57:07 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f')] {{(pid=72129) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 13:57:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:07 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f233d4-d80a-43e4-99dd-6108c78955d3]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:07 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:57:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f -p 172.16.0.220:3260 --logout {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:07 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[4148954b-6789-4daf-a50f-610335689621]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:07 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f, portal: 172.16.0.220,3260]
Aug 01 13:57:07 user nova-compute[72129]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f, portal: 172.16.0.220,3260] successful.
Aug 01 13:57:07 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:57:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f -p 172.16.0.220:3260 --op delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:07 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[557503ee-6d8a-40e7-9c11-878245236cee]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:07 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:57:07 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:57:07 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] <== disconnect_volume: return (321ms) None {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:57:07 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Disconnected iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 13:57:08 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Instance destroyed successfully.
Aug 01 13:57:08 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:53:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1047779358',display_name='tempest-ServerActionsTestOtherA-server-1597969023',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1047779358',id=14,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMKxgVYWQdVKRLV+QIEDxsF4RC9I5wENeCwXhryJ2sr+8oNRgK2W8XmwhDYsUxLBCXzQXdaopDtUa2pfT9PfB2oRmI83WPjT6V3uSmwDrvE9fHgGK0Xxc5yPsVieUvlqoA==',key_name='tempest-keypair-1687158208',keypairs=<?>,launch_index=0,launched_at=2023-08-01T13:53:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b0e85d9b73a546dc95e0ace26233f2a7',ramdisk_id='',reservation_id='r-hn67ks7n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1440097443',owner_user_name='tempest-ServerActionsTestOtherA-1440097443-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:57:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f35620862694e7295f782ab15e290a8',uuid=97a5dccf-b499-443a-b332-cfa293a16047,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4871bc74-6594-49e6-a6ef-343bc3800742", "address": "fa:16:3e:a3:52:a2", "network": {"id": "4b93ad92-9a3a-4472-ba6c-d215329da98b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-734108983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0e85d9b73a546dc95e0ace26233f2a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4871bc74-65", "ovs_interfaceid": "4871bc74-6594-49e6-a6ef-343bc3800742", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 13:57:08 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Converting VIF {"id": "4871bc74-6594-49e6-a6ef-343bc3800742", "address": "fa:16:3e:a3:52:a2", "network": {"id": "4b93ad92-9a3a-4472-ba6c-d215329da98b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-734108983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0e85d9b73a546dc95e0ace26233f2a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4871bc74-65", "ovs_interfaceid": "4871bc74-6594-49e6-a6ef-343bc3800742", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:57:08 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a3:52:a2,bridge_name='br-int',has_traffic_filtering=True,id=4871bc74-6594-49e6-a6ef-343bc3800742,network=Network(4b93ad92-9a3a-4472-ba6c-d215329da98b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4871bc74-65') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:57:08 user nova-compute[72129]: DEBUG os_vif [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:52:a2,bridge_name='br-int',has_traffic_filtering=True,id=4871bc74-6594-49e6-a6ef-343bc3800742,network=Network(4b93ad92-9a3a-4472-ba6c-d215329da98b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4871bc74-65') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 13:57:08 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:08 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4871bc74-65, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:57:08 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:08 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 13:57:08 user nova-compute[72129]: INFO os_vif [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:52:a2,bridge_name='br-int',has_traffic_filtering=True,id=4871bc74-6594-49e6-a6ef-343bc3800742,network=Network(4b93ad92-9a3a-4472-ba6c-d215329da98b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4871bc74-65')
Aug 01 13:57:08 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] calling os-brick to detach iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 13:57:08 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, {'target_iqns': ['iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DMmEigrw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:57:08 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 01 13:57:08 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:57:08 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.006s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:57:08 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f', 0)] {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 13:57:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:08 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff740c0-fbb4-46f9-997d-c0d2bdfc67a0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:08 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ceef532-68d8-4dfd-82d8-80ff63effabf]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:08 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)
Aug 01 13:57:08 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:57:08 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)
Aug 01 13:57:08 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:57:08 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f28201f5630>, {}) {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 13:57:08 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Disconnecting from: [] {{(pid=72129) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 13:57:08 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.053s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:57:08 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] <== disconnect_volume: return (59ms) None {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:57:08 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Disconnected iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 13:57:08 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Deleting instance files /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047_del
Aug 01 13:57:08 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Deletion of /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047_del complete
Aug 01 13:57:08 user nova-compute[72129]: DEBUG nova.compute.manager [req-d2e96d0a-fcb5-4d04-b72c-b30ca07ab47f req-abc67d54-fd05-4e8e-8be3-9ce4703c9dac service nova] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Received event network-vif-plugged-4871bc74-6594-49e6-a6ef-343bc3800742 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:57:08 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-d2e96d0a-fcb5-4d04-b72c-b30ca07ab47f req-abc67d54-fd05-4e8e-8be3-9ce4703c9dac service nova] Acquiring lock "97a5dccf-b499-443a-b332-cfa293a16047-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:57:08 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-d2e96d0a-fcb5-4d04-b72c-b30ca07ab47f req-abc67d54-fd05-4e8e-8be3-9ce4703c9dac service nova] Lock "97a5dccf-b499-443a-b332-cfa293a16047-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:57:08 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-d2e96d0a-fcb5-4d04-b72c-b30ca07ab47f req-abc67d54-fd05-4e8e-8be3-9ce4703c9dac service nova] Lock "97a5dccf-b499-443a-b332-cfa293a16047-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:57:08 user nova-compute[72129]: DEBUG nova.compute.manager [req-d2e96d0a-fcb5-4d04-b72c-b30ca07ab47f req-abc67d54-fd05-4e8e-8be3-9ce4703c9dac service nova] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] No waiting events found dispatching network-vif-plugged-4871bc74-6594-49e6-a6ef-343bc3800742 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:57:08 user nova-compute[72129]: WARNING nova.compute.manager [req-d2e96d0a-fcb5-4d04-b72c-b30ca07ab47f req-abc67d54-fd05-4e8e-8be3-9ce4703c9dac service nova] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Received unexpected event network-vif-plugged-4871bc74-6594-49e6-a6ef-343bc3800742 for instance with vm_state active and task_state rebuilding.
Aug 01 13:57:08 user nova-compute[72129]: INFO nova.virt.block_device [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Booting with volume de3acab7-803c-4154-926b-fa47bdeb988f at /dev/vdb
Aug 01 13:57:08 user nova-compute[72129]: DEBUG os_brick.utils [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:57:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:08 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f3bfe6-a0aa-41dc-8b4a-f7dedf769638]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f9b449c2cd3d\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:08 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd2e671-a4c9-4d68-b515-5f6fd1dbb2b3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:08 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[30676623-36b4-4e3d-a430-f211d4af499e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:08 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae65202-011d-4576-a407-4cdca2144a4c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Running cmd (subprocess): nvme version {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] 'nvme version' failed. Not Retrying. {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 13:57:08 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.nvmeof [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] nvme not present on system {{(pid=72129) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 13:57:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 13:57:08 user nova-compute[72129]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 13:57:08 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef1c45a-98bd-4808-97fd-eeba1ccf86ea]: (4, '') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:08 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72129) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 13:57:08 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 13:57:08 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] LIGHTOS: no hostnqn found. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 13:57:08 user nova-compute[72129]: DEBUG os_brick.utils [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f9b449c2cd3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:57:08 user nova-compute[72129]: DEBUG nova.virt.block_device [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Updating existing volume attachment record: 8ff41080-8290-4dcf-aad4-43b8127d4ca5 {{(pid=72129) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 13:57:10 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:11 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:13 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:13 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:14 user nova-compute[72129]: DEBUG nova.compute.manager [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: d031973f-8f48-43b3-a338-040950103e4c] Start spawning the instance on the hypervisor. {{(pid=72129) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 13:57:14 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: d031973f-8f48-43b3-a338-040950103e4c] Creating instance directory {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 13:57:14 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: d031973f-8f48-43b3-a338-040950103e4c] Creating image(s)
Aug 01 13:57:14 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: d031973f-8f48-43b3-a338-040950103e4c] Did not create local disks {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 13:57:14 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: d031973f-8f48-43b3-a338-040950103e4c] Ensure instance console log exists: /opt/stack/data/nova/instances/d031973f-8f48-43b3-a338-040950103e4c/console.log {{(pid=72129) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 13:57:14 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:57:14 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:57:14 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:57:14 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: d031973f-8f48-43b3-a338-040950103e4c] Start _get_guest_xml network_info=[{"id": "a978f40a-6406-423f-81f7-1e8077b43fd5", "address": "fa:16:3e:09:fd:e5", "network": {"id": "59b1e538-8bfe-45ce-ab7b-c5838ab25582", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1129024349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0929886fa54d1c8023793806f10d31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa978f40a-64", "ovs_interfaceid": "a978f40a-6406-423f-81f7-1e8077b43fd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '84b52685-fab2-4ada-83ad-002206870b22', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YbOIcMLV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd031973f-8f48-43b3-a338-040950103e4c', 'attached_at': '', 'detached_at': '', 'volume_id': '11ec6e25-74a1-4f6b-a96c-634c55581fa6', 'serial': '11ec6e25-74a1-4f6b-a96c-634c55581fa6'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 13:57:14 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:57:14 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:57:14 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 13:57:14 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] CPU controller missing on host. {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 13:57:14 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 13:57:14 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] CPU controller found on host. {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 13:57:14 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72129) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 13:57:14 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T13:45:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 13:57:14 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Flavor limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 13:57:14 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Image limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 13:57:14 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Flavor pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 13:57:14 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Image pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 13:57:14 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 13:57:14 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 13:57:14 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 13:57:14 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Got 1 possible topologies {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 13:57:14 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 13:57:14 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 13:57:14 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: d031973f-8f48-43b3-a338-040950103e4c] Calling os-brick to attach iSCSI Volume {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 13:57:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YbOIcMLV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:57:14 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 13:57:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:57:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:57:14 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 13:57:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:57:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:57:14 user nova-compute[72129]: INFO os_brick.initiator.connectors.iscsi [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 13:57:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 -p 172.16.0.220:3260 {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:14 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[174403a0-3eea-4d4d-84f0-fa08e12640f7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 13:57:14 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:57:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 -p 172.16.0.220:3260 --interface default --op new {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:14 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98a349c-b7a2-401c-941f-d328ae68415c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6] added\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6] added
Aug 01 13:57:14 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:57:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:14 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80ecd6e-c394-4b47-bc74-796d8eb300bb]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:57:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:14 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8383c9-9966-4ebf-b94f-26fda0547e65]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:57:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YbOIcMLV {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:15 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YbOIcMLV" returned: 0 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:15 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a03fb3-3771-4e2a-a793-664db6295e2f]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:15 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YbOIcMLV'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:57:15 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:15 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:15 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[828c7fda-e5d4-44fd-ab37-da2044652991]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:15 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:57:15 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:15 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:15 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[9341c248-302d-4a91-acce-204bcf3041bf]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:15 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)
Aug 01 13:57:15 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:57:15 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)
Aug 01 13:57:15 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:57:15 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 -p 172.16.0.220:3260 --login {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:15 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:15 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[424bcd12-d53c-4cc1-a7c4-941aed8c3df9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:15 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6, portal: 172.16.0.220,3260]
Aug 01 13:57:15 user nova-compute[72129]: Login to [iface: default, target: iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6, portal: 172.16.0.220,3260] successful.
Aug 01 13:57:15 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:57:15 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:15 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:15 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[6670100e-f1ff-42ab-9ef4-bcaea3ff634b]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:15 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:57:15 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:15 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:15 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:15 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[65155a80-11c4-4297-ace6-0eed68e2c329]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:15 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)
Aug 01 13:57:15 user nova-compute[72129]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 13:57:15 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:57:15 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)
Aug 01 13:57:15 user nova-compute[72129]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 13:57:15 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:57:15 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:57:15 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Connected to 172.16.0.220:3260 {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 13:57:15 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] HCTL ('34', '-', '-', 0) found on session 22 with lun 0 {{(pid=72129) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 13:57:15 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72129) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 13:57:15 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:15 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:15 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b8bdfd-fd25-4225-9b45-e890d6d250db]: (4, ('- - 0', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:15 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Searching for a device in session 22 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 13:57:15 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YbOIcMLV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 13:57:15 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:16 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:57:16 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '23966376365666436', 'path': '/dev/sdc'} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:57:16 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: d031973f-8f48-43b3-a338-040950103e4c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23966376365666436', 'path': '/dev/sdc'} {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 13:57:16 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:56:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-750731877',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-750731877',id=19,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e0929886fa54d1c8023793806f10d31',ramdisk_id='',reservation_id='r-n3dae9u5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1414609013',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:57:01Z,user_data=None,user_id='cdb6f66592fe4cdebea02e5f5c1f4a60',uuid=d031973f-8f48-43b3-a338-040950103e4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a978f40a-6406-423f-81f7-1e8077b43fd5", "address": "fa:16:3e:09:fd:e5", "network": {"id": "59b1e538-8bfe-45ce-ab7b-c5838ab25582", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1129024349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0929886fa54d1c8023793806f10d31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa978f40a-64", "ovs_interfaceid": "a978f40a-6406-423f-81f7-1e8077b43fd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 13:57:16 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Converting VIF {"id": "a978f40a-6406-423f-81f7-1e8077b43fd5", "address": "fa:16:3e:09:fd:e5", "network": {"id": "59b1e538-8bfe-45ce-ab7b-c5838ab25582", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1129024349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0929886fa54d1c8023793806f10d31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa978f40a-64", "ovs_interfaceid": "a978f40a-6406-423f-81f7-1e8077b43fd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:57:16 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:fd:e5,bridge_name='br-int',has_traffic_filtering=True,id=a978f40a-6406-423f-81f7-1e8077b43fd5,network=Network(59b1e538-8bfe-45ce-ab7b-c5838ab25582),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa978f40a-64') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:57:16 user nova-compute[72129]: DEBUG nova.objects.instance [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lazy-loading 'pci_devices' on Instance uuid d031973f-8f48-43b3-a338-040950103e4c {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:57:16 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: d031973f-8f48-43b3-a338-040950103e4c] End _get_guest_xml xml=<domain type="kvm">
Aug 01 13:57:16 user nova-compute[72129]:   <uuid>d031973f-8f48-43b3-a338-040950103e4c</uuid>
Aug 01 13:57:16 user nova-compute[72129]:   <name>instance-00000013</name>
Aug 01 13:57:16 user nova-compute[72129]:   <memory>524288</memory>
Aug 01 13:57:16 user nova-compute[72129]:   <vcpu>1</vcpu>
Aug 01 13:57:16 user nova-compute[72129]:   <metadata>
Aug 01 13:57:16 user nova-compute[72129]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 13:57:16 user nova-compute[72129]:       <nova:package version="0.0.0"/>
Aug 01 13:57:16 user nova-compute[72129]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-750731877</nova:name>
Aug 01 13:57:16 user nova-compute[72129]:       <nova:creationTime>2023-08-01 13:57:14</nova:creationTime>
Aug 01 13:57:16 user nova-compute[72129]:       <nova:flavor name="m1.tiny">
Aug 01 13:57:16 user nova-compute[72129]:         <nova:memory>512</nova:memory>
Aug 01 13:57:16 user nova-compute[72129]:         <nova:disk>1</nova:disk>
Aug 01 13:57:16 user nova-compute[72129]:         <nova:swap>0</nova:swap>
Aug 01 13:57:16 user nova-compute[72129]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 13:57:16 user nova-compute[72129]:         <nova:vcpus>1</nova:vcpus>
Aug 01 13:57:16 user nova-compute[72129]:       </nova:flavor>
Aug 01 13:57:16 user nova-compute[72129]:       <nova:owner>
Aug 01 13:57:16 user nova-compute[72129]:         <nova:user uuid="cdb6f66592fe4cdebea02e5f5c1f4a60">tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member</nova:user>
Aug 01 13:57:16 user nova-compute[72129]:         <nova:project uuid="1e0929886fa54d1c8023793806f10d31">tempest-ServerBootFromVolumeStableRescueTest-1414609013</nova:project>
Aug 01 13:57:16 user nova-compute[72129]:       </nova:owner>
Aug 01 13:57:16 user nova-compute[72129]:       <nova:root type="image" uuid="b6472c34-1b0f-4034-ba3a-7e8eb5103715"/>
Aug 01 13:57:16 user nova-compute[72129]:       <nova:ports>
Aug 01 13:57:16 user nova-compute[72129]:         <nova:port uuid="a978f40a-6406-423f-81f7-1e8077b43fd5">
Aug 01 13:57:16 user nova-compute[72129]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 01 13:57:16 user nova-compute[72129]:         </nova:port>
Aug 01 13:57:16 user nova-compute[72129]:       </nova:ports>
Aug 01 13:57:16 user nova-compute[72129]:     </nova:instance>
Aug 01 13:57:16 user nova-compute[72129]:   </metadata>
Aug 01 13:57:16 user nova-compute[72129]:   <sysinfo type="smbios">
Aug 01 13:57:16 user nova-compute[72129]:     <system>
Aug 01 13:57:16 user nova-compute[72129]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 13:57:16 user nova-compute[72129]:       <entry name="product">OpenStack Nova</entry>
Aug 01 13:57:16 user nova-compute[72129]:       <entry name="version">0.0.0</entry>
Aug 01 13:57:16 user nova-compute[72129]:       <entry name="serial">d031973f-8f48-43b3-a338-040950103e4c</entry>
Aug 01 13:57:16 user nova-compute[72129]:       <entry name="uuid">d031973f-8f48-43b3-a338-040950103e4c</entry>
Aug 01 13:57:16 user nova-compute[72129]:       <entry name="family">Virtual Machine</entry>
Aug 01 13:57:16 user nova-compute[72129]:     </system>
Aug 01 13:57:16 user nova-compute[72129]:   </sysinfo>
Aug 01 13:57:16 user nova-compute[72129]:   <os>
Aug 01 13:57:16 user nova-compute[72129]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 13:57:16 user nova-compute[72129]:     <boot dev="hd"/>
Aug 01 13:57:16 user nova-compute[72129]:     <smbios mode="sysinfo"/>
Aug 01 13:57:16 user nova-compute[72129]:   </os>
Aug 01 13:57:16 user nova-compute[72129]:   <features>
Aug 01 13:57:16 user nova-compute[72129]:     <acpi/>
Aug 01 13:57:16 user nova-compute[72129]:     <apic/>
Aug 01 13:57:16 user nova-compute[72129]:     <vmcoreinfo/>
Aug 01 13:57:16 user nova-compute[72129]:   </features>
Aug 01 13:57:16 user nova-compute[72129]:   <clock offset="utc">
Aug 01 13:57:16 user nova-compute[72129]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 13:57:16 user nova-compute[72129]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 13:57:16 user nova-compute[72129]:     <timer name="hpet" present="no"/>
Aug 01 13:57:16 user nova-compute[72129]:   </clock>
Aug 01 13:57:16 user nova-compute[72129]:   <cpu mode="custom" match="exact">
Aug 01 13:57:16 user nova-compute[72129]:     <model>Nehalem</model>
Aug 01 13:57:16 user nova-compute[72129]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 13:57:16 user nova-compute[72129]:   </cpu>
Aug 01 13:57:16 user nova-compute[72129]:   <devices>
Aug 01 13:57:16 user nova-compute[72129]:     <disk type="block" device="disk">
Aug 01 13:57:16 user nova-compute[72129]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 13:57:16 user nova-compute[72129]:       <source dev="/dev/sdc"/>
Aug 01 13:57:16 user nova-compute[72129]:       <target dev="vda" bus="virtio"/>
Aug 01 13:57:16 user nova-compute[72129]:       <serial>11ec6e25-74a1-4f6b-a96c-634c55581fa6</serial>
Aug 01 13:57:16 user nova-compute[72129]:     </disk>
Aug 01 13:57:16 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 13:57:16 user nova-compute[72129]:       <mac address="fa:16:3e:09:fd:e5"/>
Aug 01 13:57:16 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 13:57:16 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 13:57:16 user nova-compute[72129]:       <target dev="tapa978f40a-64"/>
Aug 01 13:57:16 user nova-compute[72129]:     </interface>
Aug 01 13:57:16 user nova-compute[72129]:     <serial type="pty">
Aug 01 13:57:16 user nova-compute[72129]:       <log file="/opt/stack/data/nova/instances/d031973f-8f48-43b3-a338-040950103e4c/console.log" append="off"/>
Aug 01 13:57:16 user nova-compute[72129]:     </serial>
Aug 01 13:57:16 user nova-compute[72129]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 13:57:16 user nova-compute[72129]:     <video>
Aug 01 13:57:16 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 13:57:16 user nova-compute[72129]:     </video>
Aug 01 13:57:16 user nova-compute[72129]:     <rng model="virtio">
Aug 01 13:57:16 user nova-compute[72129]:       <backend model="random">/dev/urandom</backend>
Aug 01 13:57:16 user nova-compute[72129]:     </rng>
Aug 01 13:57:16 user nova-compute[72129]:     <controller type="usb" index="0" model="none"/>
Aug 01 13:57:16 user nova-compute[72129]:     <memballoon model="virtio">
Aug 01 13:57:16 user nova-compute[72129]:       <stats period="10"/>
Aug 01 13:57:16 user nova-compute[72129]:     </memballoon>
Aug 01 13:57:16 user nova-compute[72129]:   </devices>
Aug 01 13:57:16 user nova-compute[72129]: </domain>
Aug 01 13:57:16 user nova-compute[72129]:  {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 13:57:16 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:56:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-750731877',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-750731877',id=19,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e0929886fa54d1c8023793806f10d31',ramdisk_id='',reservation_id='r-n3dae9u5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1414609013',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:57:01Z,user_data=None,user_id='cdb6f66592fe4cdebea02e5f5c1f4a60',uuid=d031973f-8f48-43b3-a338-040950103e4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a978f40a-6406-423f-81f7-1e8077b43fd5", "address": "fa:16:3e:09:fd:e5", "network": {"id": "59b1e538-8bfe-45ce-ab7b-c5838ab25582", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1129024349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0929886fa54d1c8023793806f10d31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa978f40a-64", "ovs_interfaceid": "a978f40a-6406-423f-81f7-1e8077b43fd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 13:57:16 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Converting VIF {"id": "a978f40a-6406-423f-81f7-1e8077b43fd5", "address": "fa:16:3e:09:fd:e5", "network": {"id": "59b1e538-8bfe-45ce-ab7b-c5838ab25582", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1129024349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0929886fa54d1c8023793806f10d31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa978f40a-64", "ovs_interfaceid": "a978f40a-6406-423f-81f7-1e8077b43fd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:57:16 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:fd:e5,bridge_name='br-int',has_traffic_filtering=True,id=a978f40a-6406-423f-81f7-1e8077b43fd5,network=Network(59b1e538-8bfe-45ce-ab7b-c5838ab25582),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa978f40a-64') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:57:16 user nova-compute[72129]: DEBUG os_vif [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:fd:e5,bridge_name='br-int',has_traffic_filtering=True,id=a978f40a-6406-423f-81f7-1e8077b43fd5,network=Network(59b1e538-8bfe-45ce-ab7b-c5838ab25582),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa978f40a-64') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 13:57:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:57:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 13:57:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa978f40a-64, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:57:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa978f40a-64, col_values=(('external_ids', {'iface-id': 'a978f40a-6406-423f-81f7-1e8077b43fd5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:fd:e5', 'vm-uuid': 'd031973f-8f48-43b3-a338-040950103e4c'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:57:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 13:57:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:16 user nova-compute[72129]: INFO os_vif [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:fd:e5,bridge_name='br-int',has_traffic_filtering=True,id=a978f40a-6406-423f-81f7-1e8077b43fd5,network=Network(59b1e538-8bfe-45ce-ab7b-c5838ab25582),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa978f40a-64')
Aug 01 13:57:16 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 13:57:16 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] No VIF found with MAC fa:16:3e:09:fd:e5, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 13:57:16 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Creating instance directory {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 13:57:16 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Creating image(s)
Aug 01 13:57:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Acquiring lock "/opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:57:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "/opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:57:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "/opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:57:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.151s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Acquiring lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:57:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:57:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.164s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk 1073741824 {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk 1073741824" returned: 0 in 0.051s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:57:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.139s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:17 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Checking if we can resize image /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk. size=1073741824 {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 13:57:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:17 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Cannot resize image /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk to a smaller size. {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 13:57:17 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Created local disks {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 13:57:17 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Ensure instance console log exists: /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/console.log {{(pid=72129) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 13:57:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:57:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:57:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:57:17 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Start _get_guest_xml network_info=[{"id": "4871bc74-6594-49e6-a6ef-343bc3800742", "address": "fa:16:3e:a3:52:a2", "network": {"id": "4b93ad92-9a3a-4472-ba6c-d215329da98b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-734108983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0e85d9b73a546dc95e0ace26233f2a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4871bc74-65", "ovs_interfaceid": "4871bc74-6594-49e6-a6ef-343bc3800742", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'image_id': 'b6472c34-1b0f-4034-ba3a-7e8eb5103715'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'attachment_id': '8ff41080-8290-4dcf-aad4-43b8127d4ca5', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DMmEigrw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '97a5dccf-b499-443a-b332-cfa293a16047', 'attached_at': '', 'detached_at': '', 'volume_id': 'de3acab7-803c-4154-926b-fa47bdeb988f', 'serial': 'de3acab7-803c-4154-926b-fa47bdeb988f'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 13:57:17 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 01 13:57:17 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 01 13:57:17 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 13:57:17 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] CPU controller missing on host. {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 13:57:17 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:17 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 13:57:17 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] CPU controller found on host. {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 13:57:17 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72129) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 13:57:17 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T13:45:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 13:57:17 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Flavor limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 13:57:17 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Image limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 13:57:17 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Flavor pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 13:57:17 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Image pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 13:57:17 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 13:57:17 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 13:57:17 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 13:57:17 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Got 1 possible topologies {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 13:57:17 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 13:57:17 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 13:57:17 user nova-compute[72129]: DEBUG nova.objects.instance [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lazy-loading 'vcpu_model' on Instance uuid 97a5dccf-b499-443a-b332-cfa293a16047 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:57:17 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:17 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:17 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Calling os-brick to attach iSCSI Volume {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 13:57:17 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DMmEigrw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:57:17 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 01 13:57:17 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:57:17 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:57:17 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 01 13:57:17 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:57:17 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:57:17 user nova-compute[72129]: INFO os_brick.initiator.connectors.iscsi [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 13:57:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f -p 172.16.0.220:3260 {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:17 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb5552b-6062-4ddb-9adc-c01d32fe0f9e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:17 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 13:57:17 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:57:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f -p 172.16.0.220:3260 --interface default --op new {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:17 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b8a1b98-8c64-4430-8342-07dbb8fda95a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f] added\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:17 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f] added
Aug 01 13:57:17 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:57:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:17 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb816c1-c5ef-44dc-b553-110c6e43fe18]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:17 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:57:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:17 user nova-compute[72129]: DEBUG nova.compute.manager [req-149f4510-220b-46f0-899c-dd23ea8b2301 req-a8397211-ec90-4f15-a795-1388f2b659ea service nova] [instance: d031973f-8f48-43b3-a338-040950103e4c] Received event network-vif-plugged-a978f40a-6406-423f-81f7-1e8077b43fd5 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:57:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-149f4510-220b-46f0-899c-dd23ea8b2301 req-a8397211-ec90-4f15-a795-1388f2b659ea service nova] Acquiring lock "d031973f-8f48-43b3-a338-040950103e4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:57:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-149f4510-220b-46f0-899c-dd23ea8b2301 req-a8397211-ec90-4f15-a795-1388f2b659ea service nova] Lock "d031973f-8f48-43b3-a338-040950103e4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:57:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-149f4510-220b-46f0-899c-dd23ea8b2301 req-a8397211-ec90-4f15-a795-1388f2b659ea service nova] Lock "d031973f-8f48-43b3-a338-040950103e4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:57:17 user nova-compute[72129]: DEBUG nova.compute.manager [req-149f4510-220b-46f0-899c-dd23ea8b2301 req-a8397211-ec90-4f15-a795-1388f2b659ea service nova] [instance: d031973f-8f48-43b3-a338-040950103e4c] No waiting events found dispatching network-vif-plugged-a978f40a-6406-423f-81f7-1e8077b43fd5 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:57:17 user nova-compute[72129]: WARNING nova.compute.manager [req-149f4510-220b-46f0-899c-dd23ea8b2301 req-a8397211-ec90-4f15-a795-1388f2b659ea service nova] [instance: d031973f-8f48-43b3-a338-040950103e4c] Received unexpected event network-vif-plugged-a978f40a-6406-423f-81f7-1e8077b43fd5 for instance with vm_state building and task_state spawning.
Aug 01 13:57:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:17 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[8266b8f2-799b-4b09-b32d-61216a63bf0f]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:17 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:57:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DMmEigrw {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DMmEigrw" returned: 0 in 0.024s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:17 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92c4003-f495-4f1d-9aa1-89cee0cfbe7d]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:17 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DMmEigrw'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:57:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:17 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:17 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b250bdbb-1596-465c-97f5-74ebb88567ba]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:17 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:17 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:57:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:18 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:18 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[098d5b34-0e84-4868-b9f3-9b15883248a9]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:18 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)
Aug 01 13:57:18 user nova-compute[72129]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 13:57:18 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:57:18 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)
Aug 01 13:57:18 user nova-compute[72129]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 13:57:18 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:57:18 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f -p 172.16.0.220:3260 --login {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:18 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:18 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[288d9046-75b0-425f-8e6b-aaae7b2d5caa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:18 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f, portal: 172.16.0.220,3260]
Aug 01 13:57:18 user nova-compute[72129]: Login to [iface: default, target: iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f, portal: 172.16.0.220,3260] successful.
Aug 01 13:57:18 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:57:18 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:18 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:18 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf95abcb-7073-47b2-95c7-91306a08d473]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:18 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:57:18 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:18 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:18 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8f1b24-bdbb-4bff-9992-0d2af7ef42a1]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:18 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)
Aug 01 13:57:18 user nova-compute[72129]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 13:57:18 user nova-compute[72129]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f (non-flash)
Aug 01 13:57:18 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:57:18 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)
Aug 01 13:57:18 user nova-compute[72129]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 13:57:18 user nova-compute[72129]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f (non-flash)
Aug 01 13:57:18 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:57:18 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:57:18 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Connected to 172.16.0.220:3260 {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 13:57:18 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] HCTL ('35', '-', '-', 0) found on session 23 with lun 0 {{(pid=72129) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 13:57:18 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72129) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 13:57:18 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:18 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.025s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:18 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c84e39-2952-4b2a-a22c-e5d2dc58676b]: (4, ('- - 0', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:18 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Searching for a device in session 23 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 13:57:18 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DMmEigrw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 13:57:19 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:57:19 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '23565333230636531', 'path': '/dev/sdd'} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:57:19 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23565333230636531', 'path': '/dev/sdd'} {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 13:57:19 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T13:53:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1047779358',display_name='tempest-ServerActionsTestOtherA-server-1597969023',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1047779358',id=14,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMKxgVYWQdVKRLV+QIEDxsF4RC9I5wENeCwXhryJ2sr+8oNRgK2W8XmwhDYsUxLBCXzQXdaopDtUa2pfT9PfB2oRmI83WPjT6V3uSmwDrvE9fHgGK0Xxc5yPsVieUvlqoA==',key_name='tempest-keypair-1687158208',keypairs=<?>,launch_index=0,launched_at=2023-08-01T13:53:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b0e85d9b73a546dc95e0ace26233f2a7',ramdisk_id='',reservation_id='r-hn67ks7n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1440097443',owner_user_name='tempest-ServerActionsTestOtherA-1440097443-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:57:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f35620862694e7295f782ab15e290a8',uuid=97a5dccf-b499-443a-b332-cfa293a16047,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4871bc74-6594-49e6-a6ef-343bc3800742", "address": "fa:16:3e:a3:52:a2", "network": {"id": "4b93ad92-9a3a-4472-ba6c-d215329da98b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-734108983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0e85d9b73a546dc95e0ace26233f2a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4871bc74-65", "ovs_interfaceid": "4871bc74-6594-49e6-a6ef-343bc3800742", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 13:57:19 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Converting VIF {"id": "4871bc74-6594-49e6-a6ef-343bc3800742", "address": "fa:16:3e:a3:52:a2", "network": {"id": "4b93ad92-9a3a-4472-ba6c-d215329da98b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-734108983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0e85d9b73a546dc95e0ace26233f2a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4871bc74-65", "ovs_interfaceid": "4871bc74-6594-49e6-a6ef-343bc3800742", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:57:19 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a3:52:a2,bridge_name='br-int',has_traffic_filtering=True,id=4871bc74-6594-49e6-a6ef-343bc3800742,network=Network(4b93ad92-9a3a-4472-ba6c-d215329da98b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4871bc74-65') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:57:19 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] End _get_guest_xml xml=<domain type="kvm">
Aug 01 13:57:19 user nova-compute[72129]:   <uuid>97a5dccf-b499-443a-b332-cfa293a16047</uuid>
Aug 01 13:57:19 user nova-compute[72129]:   <name>instance-0000000e</name>
Aug 01 13:57:19 user nova-compute[72129]:   <memory>524288</memory>
Aug 01 13:57:19 user nova-compute[72129]:   <vcpu>1</vcpu>
Aug 01 13:57:19 user nova-compute[72129]:   <metadata>
Aug 01 13:57:19 user nova-compute[72129]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 13:57:19 user nova-compute[72129]:       <nova:package version="0.0.0"/>
Aug 01 13:57:19 user nova-compute[72129]:       <nova:name>tempest-ServerActionsTestOtherA-server-1597969023</nova:name>
Aug 01 13:57:19 user nova-compute[72129]:       <nova:creationTime>2023-08-01 13:57:17</nova:creationTime>
Aug 01 13:57:19 user nova-compute[72129]:       <nova:flavor name="m1.tiny">
Aug 01 13:57:19 user nova-compute[72129]:         <nova:memory>512</nova:memory>
Aug 01 13:57:19 user nova-compute[72129]:         <nova:disk>1</nova:disk>
Aug 01 13:57:19 user nova-compute[72129]:         <nova:swap>0</nova:swap>
Aug 01 13:57:19 user nova-compute[72129]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 13:57:19 user nova-compute[72129]:         <nova:vcpus>1</nova:vcpus>
Aug 01 13:57:19 user nova-compute[72129]:       </nova:flavor>
Aug 01 13:57:19 user nova-compute[72129]:       <nova:owner>
Aug 01 13:57:19 user nova-compute[72129]:         <nova:user uuid="1f35620862694e7295f782ab15e290a8">tempest-ServerActionsTestOtherA-1440097443-project-member</nova:user>
Aug 01 13:57:19 user nova-compute[72129]:         <nova:project uuid="b0e85d9b73a546dc95e0ace26233f2a7">tempest-ServerActionsTestOtherA-1440097443</nova:project>
Aug 01 13:57:19 user nova-compute[72129]:       </nova:owner>
Aug 01 13:57:19 user nova-compute[72129]:       <nova:root type="image" uuid="b6472c34-1b0f-4034-ba3a-7e8eb5103715"/>
Aug 01 13:57:19 user nova-compute[72129]:       <nova:ports>
Aug 01 13:57:19 user nova-compute[72129]:         <nova:port uuid="4871bc74-6594-49e6-a6ef-343bc3800742">
Aug 01 13:57:19 user nova-compute[72129]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 01 13:57:19 user nova-compute[72129]:         </nova:port>
Aug 01 13:57:19 user nova-compute[72129]:       </nova:ports>
Aug 01 13:57:19 user nova-compute[72129]:     </nova:instance>
Aug 01 13:57:19 user nova-compute[72129]:   </metadata>
Aug 01 13:57:19 user nova-compute[72129]:   <sysinfo type="smbios">
Aug 01 13:57:19 user nova-compute[72129]:     <system>
Aug 01 13:57:19 user nova-compute[72129]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 13:57:19 user nova-compute[72129]:       <entry name="product">OpenStack Nova</entry>
Aug 01 13:57:19 user nova-compute[72129]:       <entry name="version">0.0.0</entry>
Aug 01 13:57:19 user nova-compute[72129]:       <entry name="serial">97a5dccf-b499-443a-b332-cfa293a16047</entry>
Aug 01 13:57:19 user nova-compute[72129]:       <entry name="uuid">97a5dccf-b499-443a-b332-cfa293a16047</entry>
Aug 01 13:57:19 user nova-compute[72129]:       <entry name="family">Virtual Machine</entry>
Aug 01 13:57:19 user nova-compute[72129]:     </system>
Aug 01 13:57:19 user nova-compute[72129]:   </sysinfo>
Aug 01 13:57:19 user nova-compute[72129]:   <os>
Aug 01 13:57:19 user nova-compute[72129]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 13:57:19 user nova-compute[72129]:     <boot dev="hd"/>
Aug 01 13:57:19 user nova-compute[72129]:     <smbios mode="sysinfo"/>
Aug 01 13:57:19 user nova-compute[72129]:   </os>
Aug 01 13:57:19 user nova-compute[72129]:   <features>
Aug 01 13:57:19 user nova-compute[72129]:     <acpi/>
Aug 01 13:57:19 user nova-compute[72129]:     <apic/>
Aug 01 13:57:19 user nova-compute[72129]:     <vmcoreinfo/>
Aug 01 13:57:19 user nova-compute[72129]:   </features>
Aug 01 13:57:19 user nova-compute[72129]:   <clock offset="utc">
Aug 01 13:57:19 user nova-compute[72129]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 13:57:19 user nova-compute[72129]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 13:57:19 user nova-compute[72129]:     <timer name="hpet" present="no"/>
Aug 01 13:57:19 user nova-compute[72129]:   </clock>
Aug 01 13:57:19 user nova-compute[72129]:   <cpu mode="custom" match="exact">
Aug 01 13:57:19 user nova-compute[72129]:     <model>Nehalem</model>
Aug 01 13:57:19 user nova-compute[72129]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 13:57:19 user nova-compute[72129]:   </cpu>
Aug 01 13:57:19 user nova-compute[72129]:   <devices>
Aug 01 13:57:19 user nova-compute[72129]:     <disk type="file" device="disk">
Aug 01 13:57:19 user nova-compute[72129]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 13:57:19 user nova-compute[72129]:       <source file="/opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk"/>
Aug 01 13:57:19 user nova-compute[72129]:       <target dev="vda" bus="virtio"/>
Aug 01 13:57:19 user nova-compute[72129]:     </disk>
Aug 01 13:57:19 user nova-compute[72129]:     <disk type="block" device="disk">
Aug 01 13:57:19 user nova-compute[72129]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 13:57:19 user nova-compute[72129]:       <source dev="/dev/sdd"/>
Aug 01 13:57:19 user nova-compute[72129]:       <target dev="vdb" bus="virtio"/>
Aug 01 13:57:19 user nova-compute[72129]:       <serial>de3acab7-803c-4154-926b-fa47bdeb988f</serial>
Aug 01 13:57:19 user nova-compute[72129]:     </disk>
Aug 01 13:57:19 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 13:57:19 user nova-compute[72129]:       <mac address="fa:16:3e:a3:52:a2"/>
Aug 01 13:57:19 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 13:57:19 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 13:57:19 user nova-compute[72129]:       <target dev="tap4871bc74-65"/>
Aug 01 13:57:19 user nova-compute[72129]:     </interface>
Aug 01 13:57:19 user nova-compute[72129]:     <serial type="pty">
Aug 01 13:57:19 user nova-compute[72129]:       <log file="/opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/console.log" append="off"/>
Aug 01 13:57:19 user nova-compute[72129]:     </serial>
Aug 01 13:57:19 user nova-compute[72129]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 13:57:19 user nova-compute[72129]:     <video>
Aug 01 13:57:19 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 13:57:19 user nova-compute[72129]:     </video>
Aug 01 13:57:19 user nova-compute[72129]:     <rng model="virtio">
Aug 01 13:57:19 user nova-compute[72129]:       <backend model="random">/dev/urandom</backend>
Aug 01 13:57:19 user nova-compute[72129]:     </rng>
Aug 01 13:57:19 user nova-compute[72129]:     <controller type="usb" index="0" model="none"/>
Aug 01 13:57:19 user nova-compute[72129]:     <memballoon model="virtio">
Aug 01 13:57:19 user nova-compute[72129]:       <stats period="10"/>
Aug 01 13:57:19 user nova-compute[72129]:     </memballoon>
Aug 01 13:57:19 user nova-compute[72129]:   </devices>
Aug 01 13:57:19 user nova-compute[72129]: </domain>
Aug 01 13:57:19 user nova-compute[72129]:  {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 13:57:19 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T13:53:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1047779358',display_name='tempest-ServerActionsTestOtherA-server-1597969023',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1047779358',id=14,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMKxgVYWQdVKRLV+QIEDxsF4RC9I5wENeCwXhryJ2sr+8oNRgK2W8XmwhDYsUxLBCXzQXdaopDtUa2pfT9PfB2oRmI83WPjT6V3uSmwDrvE9fHgGK0Xxc5yPsVieUvlqoA==',key_name='tempest-keypair-1687158208',keypairs=<?>,launch_index=0,launched_at=2023-08-01T13:53:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b0e85d9b73a546dc95e0ace26233f2a7',ramdisk_id='',reservation_id='r-hn67ks7n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1440097443',owner_user_name='tempest-ServerActionsTestOtherA-1440097443-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:57:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f35620862694e7295f782ab15e290a8',uuid=97a5dccf-b499-443a-b332-cfa293a16047,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4871bc74-6594-49e6-a6ef-343bc3800742", "address": "fa:16:3e:a3:52:a2", "network": {"id": "4b93ad92-9a3a-4472-ba6c-d215329da98b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-734108983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0e85d9b73a546dc95e0ace26233f2a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4871bc74-65", "ovs_interfaceid": "4871bc74-6594-49e6-a6ef-343bc3800742", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 13:57:19 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Converting VIF {"id": "4871bc74-6594-49e6-a6ef-343bc3800742", "address": "fa:16:3e:a3:52:a2", "network": {"id": "4b93ad92-9a3a-4472-ba6c-d215329da98b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-734108983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0e85d9b73a546dc95e0ace26233f2a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4871bc74-65", "ovs_interfaceid": "4871bc74-6594-49e6-a6ef-343bc3800742", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:57:19 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a3:52:a2,bridge_name='br-int',has_traffic_filtering=True,id=4871bc74-6594-49e6-a6ef-343bc3800742,network=Network(4b93ad92-9a3a-4472-ba6c-d215329da98b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4871bc74-65') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:57:19 user nova-compute[72129]: DEBUG os_vif [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:52:a2,bridge_name='br-int',has_traffic_filtering=True,id=4871bc74-6594-49e6-a6ef-343bc3800742,network=Network(4b93ad92-9a3a-4472-ba6c-d215329da98b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4871bc74-65') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 13:57:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:57:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 13:57:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4871bc74-65, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:57:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4871bc74-65, col_values=(('external_ids', {'iface-id': '4871bc74-6594-49e6-a6ef-343bc3800742', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:52:a2', 'vm-uuid': '97a5dccf-b499-443a-b332-cfa293a16047'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:57:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 13:57:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:19 user nova-compute[72129]: INFO os_vif [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:52:a2,bridge_name='br-int',has_traffic_filtering=True,id=4871bc74-6594-49e6-a6ef-343bc3800742,network=Network(4b93ad92-9a3a-4472-ba6c-d215329da98b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4871bc74-65')
Aug 01 13:57:19 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 13:57:19 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 13:57:19 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] No VIF found with MAC fa:16:3e:a3:52:a2, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 13:57:19 user nova-compute[72129]: DEBUG nova.compute.manager [req-9e0b12c9-813d-4c1b-8ce0-f5dda5077557 req-f5a10fd8-0453-4e96-a8e1-5e9990265014 service nova] [instance: d031973f-8f48-43b3-a338-040950103e4c] Received event network-vif-plugged-a978f40a-6406-423f-81f7-1e8077b43fd5 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:57:19 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-9e0b12c9-813d-4c1b-8ce0-f5dda5077557 req-f5a10fd8-0453-4e96-a8e1-5e9990265014 service nova] Acquiring lock "d031973f-8f48-43b3-a338-040950103e4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:57:19 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-9e0b12c9-813d-4c1b-8ce0-f5dda5077557 req-f5a10fd8-0453-4e96-a8e1-5e9990265014 service nova] Lock "d031973f-8f48-43b3-a338-040950103e4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:57:19 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-9e0b12c9-813d-4c1b-8ce0-f5dda5077557 req-f5a10fd8-0453-4e96-a8e1-5e9990265014 service nova] Lock "d031973f-8f48-43b3-a338-040950103e4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:57:19 user nova-compute[72129]: DEBUG nova.compute.manager [req-9e0b12c9-813d-4c1b-8ce0-f5dda5077557 req-f5a10fd8-0453-4e96-a8e1-5e9990265014 service nova] [instance: d031973f-8f48-43b3-a338-040950103e4c] No waiting events found dispatching network-vif-plugged-a978f40a-6406-423f-81f7-1e8077b43fd5 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:57:19 user nova-compute[72129]: WARNING nova.compute.manager [req-9e0b12c9-813d-4c1b-8ce0-f5dda5077557 req-f5a10fd8-0453-4e96-a8e1-5e9990265014 service nova] [instance: d031973f-8f48-43b3-a338-040950103e4c] Received unexpected event network-vif-plugged-a978f40a-6406-423f-81f7-1e8077b43fd5 for instance with vm_state building and task_state spawning.
Aug 01 13:57:20 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898240.2265666, d031973f-8f48-43b3-a338-040950103e4c => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:57:20 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: d031973f-8f48-43b3-a338-040950103e4c] VM Resumed (Lifecycle Event)
Aug 01 13:57:20 user nova-compute[72129]: DEBUG nova.compute.manager [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: d031973f-8f48-43b3-a338-040950103e4c] Instance event wait completed in 0 seconds for  {{(pid=72129) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 13:57:20 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: d031973f-8f48-43b3-a338-040950103e4c] Guest created on hypervisor {{(pid=72129) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 13:57:20 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: d031973f-8f48-43b3-a338-040950103e4c] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:57:20 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: d031973f-8f48-43b3-a338-040950103e4c] Instance spawned successfully.
Aug 01 13:57:20 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: d031973f-8f48-43b3-a338-040950103e4c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 13:57:20 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: d031973f-8f48-43b3-a338-040950103e4c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 13:57:20 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: d031973f-8f48-43b3-a338-040950103e4c] Found default for hw_cdrom_bus of ide {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:57:20 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: d031973f-8f48-43b3-a338-040950103e4c] Found default for hw_disk_bus of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:57:20 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: d031973f-8f48-43b3-a338-040950103e4c] Found default for hw_input_bus of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:57:20 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: d031973f-8f48-43b3-a338-040950103e4c] Found default for hw_pointer_model of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:57:20 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: d031973f-8f48-43b3-a338-040950103e4c] Found default for hw_video_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:57:20 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: d031973f-8f48-43b3-a338-040950103e4c] Found default for hw_vif_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:57:20 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: d031973f-8f48-43b3-a338-040950103e4c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 13:57:20 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898240.2315109, d031973f-8f48-43b3-a338-040950103e4c => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:57:20 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: d031973f-8f48-43b3-a338-040950103e4c] VM Started (Lifecycle Event)
Aug 01 13:57:20 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: d031973f-8f48-43b3-a338-040950103e4c] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:57:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:20 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: d031973f-8f48-43b3-a338-040950103e4c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 13:57:20 user nova-compute[72129]: INFO nova.compute.manager [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: d031973f-8f48-43b3-a338-040950103e4c] Took 5.55 seconds to spawn the instance on the hypervisor.
Aug 01 13:57:20 user nova-compute[72129]: DEBUG nova.compute.manager [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: d031973f-8f48-43b3-a338-040950103e4c] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:57:20 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: d031973f-8f48-43b3-a338-040950103e4c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 13:57:20 user nova-compute[72129]: INFO nova.compute.manager [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: d031973f-8f48-43b3-a338-040950103e4c] Took 20.42 seconds to build instance.
Aug 01 13:57:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5d6d0fe7-9d63-469f-aa62-a46aeb741f17 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "d031973f-8f48-43b3-a338-040950103e4c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.660s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:57:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:21 user nova-compute[72129]: DEBUG nova.compute.manager [req-249f00bb-8316-4271-8561-ee19e620361c req-4e35f510-2d35-4b6a-b41d-a89fbc313b3c service nova] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Received event network-vif-plugged-4871bc74-6594-49e6-a6ef-343bc3800742 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:57:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-249f00bb-8316-4271-8561-ee19e620361c req-4e35f510-2d35-4b6a-b41d-a89fbc313b3c service nova] Acquiring lock "97a5dccf-b499-443a-b332-cfa293a16047-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:57:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-249f00bb-8316-4271-8561-ee19e620361c req-4e35f510-2d35-4b6a-b41d-a89fbc313b3c service nova] Lock "97a5dccf-b499-443a-b332-cfa293a16047-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:57:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-249f00bb-8316-4271-8561-ee19e620361c req-4e35f510-2d35-4b6a-b41d-a89fbc313b3c service nova] Lock "97a5dccf-b499-443a-b332-cfa293a16047-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:57:21 user nova-compute[72129]: DEBUG nova.compute.manager [req-249f00bb-8316-4271-8561-ee19e620361c req-4e35f510-2d35-4b6a-b41d-a89fbc313b3c service nova] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] No waiting events found dispatching network-vif-plugged-4871bc74-6594-49e6-a6ef-343bc3800742 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:57:21 user nova-compute[72129]: WARNING nova.compute.manager [req-249f00bb-8316-4271-8561-ee19e620361c req-4e35f510-2d35-4b6a-b41d-a89fbc313b3c service nova] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Received unexpected event network-vif-plugged-4871bc74-6594-49e6-a6ef-343bc3800742 for instance with vm_state active and task_state rebuild_spawning.
Aug 01 13:57:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:21 user nova-compute[72129]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690898226.890452, 97a5dccf-b499-443a-b332-cfa293a16047 => Stopped> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:57:21 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] VM Stopped (Lifecycle Event)
Aug 01 13:57:21 user nova-compute[72129]: DEBUG nova.compute.manager [None req-7c4dd6c9-5f9c-4489-92e7-8c9b089a8c22 None None] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:57:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-18565379-8727-4be7-90af-e7f9f375f070 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Acquiring lock "133076de-14b5-4ceb-aa41-d9acef8506c5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:57:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-18565379-8727-4be7-90af-e7f9f375f070 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lock "133076de-14b5-4ceb-aa41-d9acef8506c5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:57:22 user nova-compute[72129]: DEBUG nova.objects.instance [None req-18565379-8727-4be7-90af-e7f9f375f070 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lazy-loading 'flavor' on Instance uuid 133076de-14b5-4ceb-aa41-d9acef8506c5 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:57:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-18565379-8727-4be7-90af-e7f9f375f070 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lock "133076de-14b5-4ceb-aa41-d9acef8506c5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:57:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-18565379-8727-4be7-90af-e7f9f375f070 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Acquiring lock "133076de-14b5-4ceb-aa41-d9acef8506c5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:57:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-18565379-8727-4be7-90af-e7f9f375f070 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lock "133076de-14b5-4ceb-aa41-d9acef8506c5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:57:22 user nova-compute[72129]: INFO nova.compute.manager [None req-18565379-8727-4be7-90af-e7f9f375f070 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Attaching volume a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 to /dev/vdb
Aug 01 13:57:22 user nova-compute[72129]: DEBUG os_brick.utils [None req-18565379-8727-4be7-90af-e7f9f375f070 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:57:22 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:22 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:22 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c326352-9e19-46d8-848a-d85847d9b183]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f9b449c2cd3d\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:22 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:22 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:22 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb7c142-79c5-447e-8546-f81aaa75bb22]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:22 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:22 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:22 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdebdc1d-0043-4b29-87ad-31266829a59b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:22 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[9473c4e5-1178-46a4-a4d4-ecb53ea483e3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:22 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-18565379-8727-4be7-90af-e7f9f375f070 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Running cmd (subprocess): nvme version {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:22 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-18565379-8727-4be7-90af-e7f9f375f070 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] 'nvme version' failed. Not Retrying. {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 13:57:22 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.nvmeof [None req-18565379-8727-4be7-90af-e7f9f375f070 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] nvme not present on system {{(pid=72129) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 13:57:22 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 13:57:23 user nova-compute[72129]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 13:57:23 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8418f6-b743-4464-bf75-e160b2262467]: (4, '') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:23 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-18565379-8727-4be7-90af-e7f9f375f070 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72129) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 13:57:23 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-18565379-8727-4be7-90af-e7f9f375f070 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 13:57:23 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-18565379-8727-4be7-90af-e7f9f375f070 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] LIGHTOS: no hostnqn found. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 13:57:23 user nova-compute[72129]: DEBUG os_brick.utils [None req-18565379-8727-4be7-90af-e7f9f375f070 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f9b449c2cd3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:57:23 user nova-compute[72129]: DEBUG nova.virt.block_device [None req-18565379-8727-4be7-90af-e7f9f375f070 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Updating existing volume attachment record: 949dd8bd-aff0-4753-b916-6e6afede0bd9 {{(pid=72129) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 13:57:23 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898243.4418705, 97a5dccf-b499-443a-b332-cfa293a16047 => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:57:23 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] VM Resumed (Lifecycle Event)
Aug 01 13:57:23 user nova-compute[72129]: DEBUG nova.compute.manager [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Instance event wait completed in 0 seconds for  {{(pid=72129) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 13:57:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Guest created on hypervisor {{(pid=72129) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 13:57:23 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Instance spawned successfully.
Aug 01 13:57:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 13:57:23 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:57:23 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 13:57:23 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 01 13:57:23 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898243.4435563, 97a5dccf-b499-443a-b332-cfa293a16047 => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:57:23 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] VM Started (Lifecycle Event)
Aug 01 13:57:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Found default for hw_cdrom_bus of ide {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:57:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Found default for hw_disk_bus of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:57:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Found default for hw_input_bus of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:57:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Found default for hw_pointer_model of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:57:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Found default for hw_video_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:57:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Found default for hw_vif_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:57:23 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:57:23 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 13:57:23 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 01 13:57:23 user nova-compute[72129]: DEBUG nova.compute.manager [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:57:23 user nova-compute[72129]: DEBUG nova.compute.manager [req-99ebbd16-181d-41dc-a2f7-92eeedaa94a5 req-4cc43970-05b8-40e0-a490-d620e3ad3deb service nova] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Received event network-vif-plugged-4871bc74-6594-49e6-a6ef-343bc3800742 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:57:23 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-99ebbd16-181d-41dc-a2f7-92eeedaa94a5 req-4cc43970-05b8-40e0-a490-d620e3ad3deb service nova] Acquiring lock "97a5dccf-b499-443a-b332-cfa293a16047-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:57:23 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-99ebbd16-181d-41dc-a2f7-92eeedaa94a5 req-4cc43970-05b8-40e0-a490-d620e3ad3deb service nova] Lock "97a5dccf-b499-443a-b332-cfa293a16047-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:57:23 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-99ebbd16-181d-41dc-a2f7-92eeedaa94a5 req-4cc43970-05b8-40e0-a490-d620e3ad3deb service nova] Lock "97a5dccf-b499-443a-b332-cfa293a16047-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:57:23 user nova-compute[72129]: DEBUG nova.compute.manager [req-99ebbd16-181d-41dc-a2f7-92eeedaa94a5 req-4cc43970-05b8-40e0-a490-d620e3ad3deb service nova] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] No waiting events found dispatching network-vif-plugged-4871bc74-6594-49e6-a6ef-343bc3800742 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:57:23 user nova-compute[72129]: WARNING nova.compute.manager [req-99ebbd16-181d-41dc-a2f7-92eeedaa94a5 req-4cc43970-05b8-40e0-a490-d620e3ad3deb service nova] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Received unexpected event network-vif-plugged-4871bc74-6594-49e6-a6ef-343bc3800742 for instance with vm_state active and task_state rebuild_spawning.
Aug 01 13:57:23 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:57:23 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:57:23 user nova-compute[72129]: DEBUG nova.objects.instance [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72129) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Aug 01 13:57:23 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-60f13311-c63d-425c-872d-b3dc4138073b tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.079s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:57:24 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:24 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:25 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Acquiring lock "53b76ca4-30f0-4fd4-9928-714c7073a490" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:57:25 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "53b76ca4-30f0-4fd4-9928-714c7073a490" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:57:25 user nova-compute[72129]: DEBUG nova.compute.manager [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Starting instance... {{(pid=72129) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 13:57:25 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:57:25 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:57:25 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72129) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 13:57:25 user nova-compute[72129]: INFO nova.compute.claims [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Claim successful on node user
Aug 01 13:57:25 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:25 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 13:57:25 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 13:57:25 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.600s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:57:25 user nova-compute[72129]: DEBUG nova.compute.manager [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Start building networks asynchronously for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 13:57:25 user nova-compute[72129]: DEBUG nova.compute.manager [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Allocating IP information in the background. {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 13:57:25 user nova-compute[72129]: DEBUG nova.network.neutron [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] allocate_for_instance() {{(pid=72129) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 13:57:25 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 13:57:25 user nova-compute[72129]: DEBUG nova.compute.manager [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Start building block device mappings for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 13:57:26 user nova-compute[72129]: DEBUG nova.compute.manager [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Start spawning the instance on the hypervisor. {{(pid=72129) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 13:57:26 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Creating instance directory {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 13:57:26 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Creating image(s)
Aug 01 13:57:26 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Acquiring lock "/opt/stack/data/nova/instances/53b76ca4-30f0-4fd4-9928-714c7073a490/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:57:26 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "/opt/stack/data/nova/instances/53b76ca4-30f0-4fd4-9928-714c7073a490/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:57:26 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "/opt/stack/data/nova/instances/53b76ca4-30f0-4fd4-9928-714c7073a490/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:57:26 user nova-compute[72129]: DEBUG nova.policy [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '13a3c19bbcbb4833abbb2997944a6564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6120989bad342a4a6fa2a8975f5932f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72129) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 13:57:26 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:26 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.203s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:26 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Acquiring lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:57:26 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:57:26 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:26 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.157s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:26 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/53b76ca4-30f0-4fd4-9928-714c7073a490/disk 1073741824 {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:26 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/53b76ca4-30f0-4fd4-9928-714c7073a490/disk 1073741824" returned: 0 in 0.066s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:26 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:57:26 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:26 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.188s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:26 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Checking if we can resize image /opt/stack/data/nova/instances/53b76ca4-30f0-4fd4-9928-714c7073a490/disk. size=1073741824 {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 13:57:26 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53b76ca4-30f0-4fd4-9928-714c7073a490/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:26 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53b76ca4-30f0-4fd4-9928-714c7073a490/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:26 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Cannot resize image /opt/stack/data/nova/instances/53b76ca4-30f0-4fd4-9928-714c7073a490/disk to a smaller size. {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 13:57:26 user nova-compute[72129]: DEBUG nova.objects.instance [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lazy-loading 'migration_context' on Instance uuid 53b76ca4-30f0-4fd4-9928-714c7073a490 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:57:26 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Created local disks {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 13:57:26 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Ensure instance console log exists: /opt/stack/data/nova/instances/53b76ca4-30f0-4fd4-9928-714c7073a490/console.log {{(pid=72129) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 13:57:26 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:57:26 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:57:26 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:57:27 user nova-compute[72129]: DEBUG nova.network.neutron [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Successfully created port: b7271bae-a440-4d06-87d0-cece38122deb {{(pid=72129) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 13:57:27 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:27 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:29 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:30 user nova-compute[72129]: DEBUG nova.network.neutron [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Successfully updated port: b7271bae-a440-4d06-87d0-cece38122deb {{(pid=72129) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 13:57:30 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Acquiring lock "refresh_cache-53b76ca4-30f0-4fd4-9928-714c7073a490" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:57:30 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Acquired lock "refresh_cache-53b76ca4-30f0-4fd4-9928-714c7073a490" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:57:30 user nova-compute[72129]: DEBUG nova.network.neutron [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 13:57:30 user nova-compute[72129]: DEBUG nova.compute.manager [req-81576997-d1f5-4d68-90f1-a32032c58ec0 req-47e0914c-ea4a-4cbc-bf6b-07d622abf30b service nova] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Received event network-changed-b7271bae-a440-4d06-87d0-cece38122deb {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:57:30 user nova-compute[72129]: DEBUG nova.compute.manager [req-81576997-d1f5-4d68-90f1-a32032c58ec0 req-47e0914c-ea4a-4cbc-bf6b-07d622abf30b service nova] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Refreshing instance network info cache due to event network-changed-b7271bae-a440-4d06-87d0-cece38122deb. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 13:57:30 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-81576997-d1f5-4d68-90f1-a32032c58ec0 req-47e0914c-ea4a-4cbc-bf6b-07d622abf30b service nova] Acquiring lock "refresh_cache-53b76ca4-30f0-4fd4-9928-714c7073a490" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:57:30 user nova-compute[72129]: DEBUG nova.network.neutron [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Instance cache missing network info. {{(pid=72129) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 13:57:30 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:30 user nova-compute[72129]: DEBUG nova.network.neutron [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Updating instance_info_cache with network_info: [{"id": "b7271bae-a440-4d06-87d0-cece38122deb", "address": "fa:16:3e:6b:eb:be", "network": {"id": "b0eb2211-5a6a-4b7e-a119-92a0f0deb947", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1159988670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6120989bad342a4a6fa2a8975f5932f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7271bae-a4", "ovs_interfaceid": "b7271bae-a440-4d06-87d0-cece38122deb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:57:30 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Releasing lock "refresh_cache-53b76ca4-30f0-4fd4-9928-714c7073a490" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:57:30 user nova-compute[72129]: DEBUG nova.compute.manager [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Instance network_info: |[{"id": "b7271bae-a440-4d06-87d0-cece38122deb", "address": "fa:16:3e:6b:eb:be", "network": {"id": "b0eb2211-5a6a-4b7e-a119-92a0f0deb947", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1159988670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6120989bad342a4a6fa2a8975f5932f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7271bae-a4", "ovs_interfaceid": "b7271bae-a440-4d06-87d0-cece38122deb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 13:57:30 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-81576997-d1f5-4d68-90f1-a32032c58ec0 req-47e0914c-ea4a-4cbc-bf6b-07d622abf30b service nova] Acquired lock "refresh_cache-53b76ca4-30f0-4fd4-9928-714c7073a490" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:57:30 user nova-compute[72129]: DEBUG nova.network.neutron [req-81576997-d1f5-4d68-90f1-a32032c58ec0 req-47e0914c-ea4a-4cbc-bf6b-07d622abf30b service nova] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Refreshing network info cache for port b7271bae-a440-4d06-87d0-cece38122deb {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 13:57:30 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Start _get_guest_xml network_info=[{"id": "b7271bae-a440-4d06-87d0-cece38122deb", "address": "fa:16:3e:6b:eb:be", "network": {"id": "b0eb2211-5a6a-4b7e-a119-92a0f0deb947", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1159988670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6120989bad342a4a6fa2a8975f5932f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7271bae-a4", "ovs_interfaceid": "b7271bae-a440-4d06-87d0-cece38122deb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'image_id': 'b6472c34-1b0f-4034-ba3a-7e8eb5103715'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 13:57:30 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:57:30 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:57:30 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 13:57:30 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] CPU controller missing on host. {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 13:57:30 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 13:57:30 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] CPU controller found on host. {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 13:57:30 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72129) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 13:57:30 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T13:45:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 13:57:30 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Flavor limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 13:57:30 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Image limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 13:57:30 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Flavor pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 13:57:30 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Image pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 13:57:30 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 13:57:30 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 13:57:30 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 13:57:30 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Got 1 possible topologies {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 13:57:30 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 13:57:30 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 13:57:30 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:57:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-850515568',display_name='tempest-AttachVolumeTestJSON-server-850515568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-850515568',id=20,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMYJypdJqmxJKXNm404Q0Cl0WuuC4kkdldjTIBUyN/EtYQvDQbUuKBkqlwMSJuSlO9CdP4jtMdwoobiqIkSyVtZDYG9OaB7GLwJQRR3hShHH6YafWHv11ydfwe0fTFZOZw==',key_name='tempest-keypair-1711923464',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6120989bad342a4a6fa2a8975f5932f',ramdisk_id='',reservation_id='r-84r01nk5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-55653475',owner_user_name='tempest-AttachVolumeTestJSON-55653475-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:57:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13a3c19bbcbb4833abbb2997944a6564',uuid=53b76ca4-30f0-4fd4-9928-714c7073a490,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7271bae-a440-4d06-87d0-cece38122deb", "address": "fa:16:3e:6b:eb:be", "network": {"id": "b0eb2211-5a6a-4b7e-a119-92a0f0deb947", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1159988670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6120989bad342a4a6fa2a8975f5932f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7271bae-a4", "ovs_interfaceid": "b7271bae-a440-4d06-87d0-cece38122deb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 13:57:30 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Converting VIF {"id": "b7271bae-a440-4d06-87d0-cece38122deb", "address": "fa:16:3e:6b:eb:be", "network": {"id": "b0eb2211-5a6a-4b7e-a119-92a0f0deb947", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1159988670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6120989bad342a4a6fa2a8975f5932f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7271bae-a4", "ovs_interfaceid": "b7271bae-a440-4d06-87d0-cece38122deb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:57:30 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:eb:be,bridge_name='br-int',has_traffic_filtering=True,id=b7271bae-a440-4d06-87d0-cece38122deb,network=Network(b0eb2211-5a6a-4b7e-a119-92a0f0deb947),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7271bae-a4') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:57:30 user nova-compute[72129]: DEBUG nova.objects.instance [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lazy-loading 'pci_devices' on Instance uuid 53b76ca4-30f0-4fd4-9928-714c7073a490 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:57:30 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] End _get_guest_xml xml=<domain type="kvm">
Aug 01 13:57:30 user nova-compute[72129]:   <uuid>53b76ca4-30f0-4fd4-9928-714c7073a490</uuid>
Aug 01 13:57:30 user nova-compute[72129]:   <name>instance-00000014</name>
Aug 01 13:57:30 user nova-compute[72129]:   <memory>524288</memory>
Aug 01 13:57:30 user nova-compute[72129]:   <vcpu>1</vcpu>
Aug 01 13:57:30 user nova-compute[72129]:   <metadata>
Aug 01 13:57:30 user nova-compute[72129]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 13:57:30 user nova-compute[72129]:       <nova:package version="0.0.0"/>
Aug 01 13:57:30 user nova-compute[72129]:       <nova:name>tempest-AttachVolumeTestJSON-server-850515568</nova:name>
Aug 01 13:57:30 user nova-compute[72129]:       <nova:creationTime>2023-08-01 13:57:30</nova:creationTime>
Aug 01 13:57:30 user nova-compute[72129]:       <nova:flavor name="m1.tiny">
Aug 01 13:57:30 user nova-compute[72129]:         <nova:memory>512</nova:memory>
Aug 01 13:57:30 user nova-compute[72129]:         <nova:disk>1</nova:disk>
Aug 01 13:57:30 user nova-compute[72129]:         <nova:swap>0</nova:swap>
Aug 01 13:57:30 user nova-compute[72129]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 13:57:30 user nova-compute[72129]:         <nova:vcpus>1</nova:vcpus>
Aug 01 13:57:30 user nova-compute[72129]:       </nova:flavor>
Aug 01 13:57:30 user nova-compute[72129]:       <nova:owner>
Aug 01 13:57:30 user nova-compute[72129]:         <nova:user uuid="13a3c19bbcbb4833abbb2997944a6564">tempest-AttachVolumeTestJSON-55653475-project-member</nova:user>
Aug 01 13:57:30 user nova-compute[72129]:         <nova:project uuid="a6120989bad342a4a6fa2a8975f5932f">tempest-AttachVolumeTestJSON-55653475</nova:project>
Aug 01 13:57:30 user nova-compute[72129]:       </nova:owner>
Aug 01 13:57:30 user nova-compute[72129]:       <nova:root type="image" uuid="b6472c34-1b0f-4034-ba3a-7e8eb5103715"/>
Aug 01 13:57:30 user nova-compute[72129]:       <nova:ports>
Aug 01 13:57:30 user nova-compute[72129]:         <nova:port uuid="b7271bae-a440-4d06-87d0-cece38122deb">
Aug 01 13:57:30 user nova-compute[72129]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 01 13:57:30 user nova-compute[72129]:         </nova:port>
Aug 01 13:57:30 user nova-compute[72129]:       </nova:ports>
Aug 01 13:57:30 user nova-compute[72129]:     </nova:instance>
Aug 01 13:57:30 user nova-compute[72129]:   </metadata>
Aug 01 13:57:30 user nova-compute[72129]:   <sysinfo type="smbios">
Aug 01 13:57:30 user nova-compute[72129]:     <system>
Aug 01 13:57:30 user nova-compute[72129]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 13:57:30 user nova-compute[72129]:       <entry name="product">OpenStack Nova</entry>
Aug 01 13:57:30 user nova-compute[72129]:       <entry name="version">0.0.0</entry>
Aug 01 13:57:30 user nova-compute[72129]:       <entry name="serial">53b76ca4-30f0-4fd4-9928-714c7073a490</entry>
Aug 01 13:57:30 user nova-compute[72129]:       <entry name="uuid">53b76ca4-30f0-4fd4-9928-714c7073a490</entry>
Aug 01 13:57:30 user nova-compute[72129]:       <entry name="family">Virtual Machine</entry>
Aug 01 13:57:30 user nova-compute[72129]:     </system>
Aug 01 13:57:30 user nova-compute[72129]:   </sysinfo>
Aug 01 13:57:30 user nova-compute[72129]:   <os>
Aug 01 13:57:30 user nova-compute[72129]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 13:57:30 user nova-compute[72129]:     <boot dev="hd"/>
Aug 01 13:57:30 user nova-compute[72129]:     <smbios mode="sysinfo"/>
Aug 01 13:57:30 user nova-compute[72129]:   </os>
Aug 01 13:57:30 user nova-compute[72129]:   <features>
Aug 01 13:57:30 user nova-compute[72129]:     <acpi/>
Aug 01 13:57:30 user nova-compute[72129]:     <apic/>
Aug 01 13:57:30 user nova-compute[72129]:     <vmcoreinfo/>
Aug 01 13:57:30 user nova-compute[72129]:   </features>
Aug 01 13:57:30 user nova-compute[72129]:   <clock offset="utc">
Aug 01 13:57:30 user nova-compute[72129]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 13:57:30 user nova-compute[72129]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 13:57:30 user nova-compute[72129]:     <timer name="hpet" present="no"/>
Aug 01 13:57:30 user nova-compute[72129]:   </clock>
Aug 01 13:57:30 user nova-compute[72129]:   <cpu mode="custom" match="exact">
Aug 01 13:57:30 user nova-compute[72129]:     <model>Nehalem</model>
Aug 01 13:57:30 user nova-compute[72129]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 13:57:30 user nova-compute[72129]:   </cpu>
Aug 01 13:57:30 user nova-compute[72129]:   <devices>
Aug 01 13:57:30 user nova-compute[72129]:     <disk type="file" device="disk">
Aug 01 13:57:30 user nova-compute[72129]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 13:57:30 user nova-compute[72129]:       <source file="/opt/stack/data/nova/instances/53b76ca4-30f0-4fd4-9928-714c7073a490/disk"/>
Aug 01 13:57:30 user nova-compute[72129]:       <target dev="vda" bus="virtio"/>
Aug 01 13:57:30 user nova-compute[72129]:     </disk>
Aug 01 13:57:30 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 13:57:30 user nova-compute[72129]:       <mac address="fa:16:3e:6b:eb:be"/>
Aug 01 13:57:30 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 13:57:30 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 13:57:30 user nova-compute[72129]:       <target dev="tapb7271bae-a4"/>
Aug 01 13:57:30 user nova-compute[72129]:     </interface>
Aug 01 13:57:30 user nova-compute[72129]:     <serial type="pty">
Aug 01 13:57:30 user nova-compute[72129]:       <log file="/opt/stack/data/nova/instances/53b76ca4-30f0-4fd4-9928-714c7073a490/console.log" append="off"/>
Aug 01 13:57:30 user nova-compute[72129]:     </serial>
Aug 01 13:57:30 user nova-compute[72129]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 13:57:30 user nova-compute[72129]:     <video>
Aug 01 13:57:30 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 13:57:30 user nova-compute[72129]:     </video>
Aug 01 13:57:30 user nova-compute[72129]:     <rng model="virtio">
Aug 01 13:57:30 user nova-compute[72129]:       <backend model="random">/dev/urandom</backend>
Aug 01 13:57:30 user nova-compute[72129]:     </rng>
Aug 01 13:57:30 user nova-compute[72129]:     <controller type="usb" index="0" model="none"/>
Aug 01 13:57:30 user nova-compute[72129]:     <memballoon model="virtio">
Aug 01 13:57:30 user nova-compute[72129]:       <stats period="10"/>
Aug 01 13:57:30 user nova-compute[72129]:     </memballoon>
Aug 01 13:57:30 user nova-compute[72129]:   </devices>
Aug 01 13:57:30 user nova-compute[72129]: </domain>
Aug 01 13:57:30 user nova-compute[72129]:  {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 13:57:30 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:57:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-850515568',display_name='tempest-AttachVolumeTestJSON-server-850515568',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-850515568',id=20,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMYJypdJqmxJKXNm404Q0Cl0WuuC4kkdldjTIBUyN/EtYQvDQbUuKBkqlwMSJuSlO9CdP4jtMdwoobiqIkSyVtZDYG9OaB7GLwJQRR3hShHH6YafWHv11ydfwe0fTFZOZw==',key_name='tempest-keypair-1711923464',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6120989bad342a4a6fa2a8975f5932f',ramdisk_id='',reservation_id='r-84r01nk5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-55653475',owner_user_name='tempest-AttachVolumeTestJSON-55653475-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:57:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13a3c19bbcbb4833abbb2997944a6564',uuid=53b76ca4-30f0-4fd4-9928-714c7073a490,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7271bae-a440-4d06-87d0-cece38122deb", "address": "fa:16:3e:6b:eb:be", "network": {"id": "b0eb2211-5a6a-4b7e-a119-92a0f0deb947", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1159988670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6120989bad342a4a6fa2a8975f5932f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7271bae-a4", "ovs_interfaceid": "b7271bae-a440-4d06-87d0-cece38122deb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 13:57:30 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Converting VIF {"id": "b7271bae-a440-4d06-87d0-cece38122deb", "address": "fa:16:3e:6b:eb:be", "network": {"id": "b0eb2211-5a6a-4b7e-a119-92a0f0deb947", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1159988670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6120989bad342a4a6fa2a8975f5932f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7271bae-a4", "ovs_interfaceid": "b7271bae-a440-4d06-87d0-cece38122deb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:57:31 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:eb:be,bridge_name='br-int',has_traffic_filtering=True,id=b7271bae-a440-4d06-87d0-cece38122deb,network=Network(b0eb2211-5a6a-4b7e-a119-92a0f0deb947),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7271bae-a4') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:57:31 user nova-compute[72129]: DEBUG os_vif [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:eb:be,bridge_name='br-int',has_traffic_filtering=True,id=b7271bae-a440-4d06-87d0-cece38122deb,network=Network(b0eb2211-5a6a-4b7e-a119-92a0f0deb947),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7271bae-a4') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 13:57:31 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:31 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:57:31 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 13:57:31 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:31 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb7271bae-a4, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:57:31 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb7271bae-a4, col_values=(('external_ids', {'iface-id': 'b7271bae-a440-4d06-87d0-cece38122deb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:eb:be', 'vm-uuid': '53b76ca4-30f0-4fd4-9928-714c7073a490'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:57:31 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:31 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 13:57:31 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:31 user nova-compute[72129]: INFO os_vif [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:eb:be,bridge_name='br-int',has_traffic_filtering=True,id=b7271bae-a440-4d06-87d0-cece38122deb,network=Network(b0eb2211-5a6a-4b7e-a119-92a0f0deb947),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7271bae-a4')
Aug 01 13:57:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 13:57:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] No VIF found with MAC fa:16:3e:6b:eb:be, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 13:57:31 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:31 user nova-compute[72129]: DEBUG nova.network.neutron [req-81576997-d1f5-4d68-90f1-a32032c58ec0 req-47e0914c-ea4a-4cbc-bf6b-07d622abf30b service nova] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Updated VIF entry in instance network info cache for port b7271bae-a440-4d06-87d0-cece38122deb. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 13:57:31 user nova-compute[72129]: DEBUG nova.network.neutron [req-81576997-d1f5-4d68-90f1-a32032c58ec0 req-47e0914c-ea4a-4cbc-bf6b-07d622abf30b service nova] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Updating instance_info_cache with network_info: [{"id": "b7271bae-a440-4d06-87d0-cece38122deb", "address": "fa:16:3e:6b:eb:be", "network": {"id": "b0eb2211-5a6a-4b7e-a119-92a0f0deb947", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1159988670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6120989bad342a4a6fa2a8975f5932f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7271bae-a4", "ovs_interfaceid": "b7271bae-a440-4d06-87d0-cece38122deb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:57:31 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-81576997-d1f5-4d68-90f1-a32032c58ec0 req-47e0914c-ea4a-4cbc-bf6b-07d622abf30b service nova] Releasing lock "refresh_cache-53b76ca4-30f0-4fd4-9928-714c7073a490" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:57:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18565379-8727-4be7-90af-e7f9f375f070 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Calling os-brick to attach iSCSI Volume {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 13:57:31 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-18565379-8727-4be7-90af-e7f9f375f070 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OqyRvkgp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:57:31 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-18565379-8727-4be7-90af-e7f9f375f070 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 13:57:31 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-18565379-8727-4be7-90af-e7f9f375f070 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:57:31 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-18565379-8727-4be7-90af-e7f9f375f070 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:57:31 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-18565379-8727-4be7-90af-e7f9f375f070 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 13:57:31 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-18565379-8727-4be7-90af-e7f9f375f070 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:57:31 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-18565379-8727-4be7-90af-e7f9f375f070 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:57:31 user nova-compute[72129]: INFO os_brick.initiator.connectors.iscsi [None req-18565379-8727-4be7-90af-e7f9f375f070 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 13:57:31 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 -p 172.16.0.220:3260 {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 -p 172.16.0.220:3260" returned: 21 in 0.036s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:32 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d83d56-5010-4687-bbc2-31af844b5b57]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:32 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-18565379-8727-4be7-90af-e7f9f375f070 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 13:57:32 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:57:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 -p 172.16.0.220:3260 --interface default --op new {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:32 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1489513-9f5d-44b1-998b-bd2f895f6db8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2] added\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:32 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-18565379-8727-4be7-90af-e7f9f375f070 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2] added
Aug 01 13:57:32 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:57:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:32 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[0574bc1b-b61d-4e77-8585-337c1cbd7b6a]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:32 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-18565379-8727-4be7-90af-e7f9f375f070 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:57:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:32 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e6ccb8d-ee00-4b8e-b21a-a7841bdf6a8b]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:32 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-18565379-8727-4be7-90af-e7f9f375f070 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:57:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OqyRvkgp {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OqyRvkgp" returned: 0 in 0.045s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:32 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53ee0da-7979-453e-8e13-cf22d10df93a]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:32 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-18565379-8727-4be7-90af-e7f9f375f070 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OqyRvkgp'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:57:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:32 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[40407ae7-a9bd-485d-8bd5-0c92782a5510]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:32 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-18565379-8727-4be7-90af-e7f9f375f070 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:57:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:32 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bef87f4-d9a8-417b-a687-92cba7897e44]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:32 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-18565379-8727-4be7-90af-e7f9f375f070 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)
Aug 01 13:57:32 user nova-compute[72129]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 13:57:32 user nova-compute[72129]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f (non-flash)
Aug 01 13:57:32 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:57:32 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-18565379-8727-4be7-90af-e7f9f375f070 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)
Aug 01 13:57:32 user nova-compute[72129]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 13:57:32 user nova-compute[72129]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f (non-flash)
Aug 01 13:57:32 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:57:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 -p 172.16.0.220:3260 --login {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:32 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[add54eb9-a53b-4588-9aa9-a07c563239b3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:32 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-18565379-8727-4be7-90af-e7f9f375f070 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2, portal: 172.16.0.220,3260]
Aug 01 13:57:32 user nova-compute[72129]: Login to [iface: default, target: iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2, portal: 172.16.0.220,3260] successful.
Aug 01 13:57:32 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:57:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:32 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ad83a6-7354-49f0-9ecf-942cb68d315e]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:32 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-18565379-8727-4be7-90af-e7f9f375f070 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:57:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:32 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[9813ad20-1fc9-4fa8-9b38-de9db7e7acbe]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:32 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-18565379-8727-4be7-90af-e7f9f375f070 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)
Aug 01 13:57:32 user nova-compute[72129]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 13:57:32 user nova-compute[72129]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f (non-flash)
Aug 01 13:57:32 user nova-compute[72129]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 (non-flash)
Aug 01 13:57:32 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:57:32 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-18565379-8727-4be7-90af-e7f9f375f070 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)
Aug 01 13:57:32 user nova-compute[72129]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 13:57:32 user nova-compute[72129]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f (non-flash)
Aug 01 13:57:32 user nova-compute[72129]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 (non-flash)
Aug 01 13:57:32 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:57:32 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-18565379-8727-4be7-90af-e7f9f375f070 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.396s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:57:32 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-18565379-8727-4be7-90af-e7f9f375f070 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Connected to 172.16.0.220:3260 {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 13:57:32 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-18565379-8727-4be7-90af-e7f9f375f070 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] HCTL ('36', '-', '-', 0) found on session 24 with lun 0 {{(pid=72129) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 13:57:32 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-18565379-8727-4be7-90af-e7f9f375f070 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72129) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 13:57:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:32 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ed1d53-0e3f-4f44-8fef-7837227d2066]: (4, ('- - 0', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:32 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-18565379-8727-4be7-90af-e7f9f375f070 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Searching for a device in session 24 and hctl ['36', '*', '*', 0] yield: None {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 13:57:32 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:32 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:32 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:32 user nova-compute[72129]: DEBUG nova.compute.manager [req-2ae24e3e-15db-4712-a217-5f779a0869f3 req-162d3168-b98a-4754-848b-d8f589555c0a service nova] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Received event network-vif-plugged-b7271bae-a440-4d06-87d0-cece38122deb {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:57:32 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-2ae24e3e-15db-4712-a217-5f779a0869f3 req-162d3168-b98a-4754-848b-d8f589555c0a service nova] Acquiring lock "53b76ca4-30f0-4fd4-9928-714c7073a490-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:57:32 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-2ae24e3e-15db-4712-a217-5f779a0869f3 req-162d3168-b98a-4754-848b-d8f589555c0a service nova] Lock "53b76ca4-30f0-4fd4-9928-714c7073a490-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:57:32 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-2ae24e3e-15db-4712-a217-5f779a0869f3 req-162d3168-b98a-4754-848b-d8f589555c0a service nova] Lock "53b76ca4-30f0-4fd4-9928-714c7073a490-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:57:32 user nova-compute[72129]: DEBUG nova.compute.manager [req-2ae24e3e-15db-4712-a217-5f779a0869f3 req-162d3168-b98a-4754-848b-d8f589555c0a service nova] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] No waiting events found dispatching network-vif-plugged-b7271bae-a440-4d06-87d0-cece38122deb {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:57:32 user nova-compute[72129]: WARNING nova.compute.manager [req-2ae24e3e-15db-4712-a217-5f779a0869f3 req-162d3168-b98a-4754-848b-d8f589555c0a service nova] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Received unexpected event network-vif-plugged-b7271bae-a440-4d06-87d0-cece38122deb for instance with vm_state building and task_state spawning.
Aug 01 13:57:33 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:33 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:33 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:33 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:33 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-18565379-8727-4be7-90af-e7f9f375f070 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Searching for a device in session 24 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 13:57:33 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-18565379-8727-4be7-90af-e7f9f375f070 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OqyRvkgp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 13:57:33 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-18565379-8727-4be7-90af-e7f9f375f070 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.429s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:57:33 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-18565379-8727-4be7-90af-e7f9f375f070 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] <== connect_volume: return (1432ms) {'type': 'block', 'scsi_wwn': '23035366231363835', 'path': '/dev/sde'} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:57:33 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18565379-8727-4be7-90af-e7f9f375f070 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23035366231363835', 'path': '/dev/sde'} {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 13:57:33 user nova-compute[72129]: DEBUG nova.objects.instance [None req-18565379-8727-4be7-90af-e7f9f375f070 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lazy-loading 'flavor' on Instance uuid 133076de-14b5-4ceb-aa41-d9acef8506c5 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:57:33 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-18565379-8727-4be7-90af-e7f9f375f070 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 13:57:33 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 13:57:33 user nova-compute[72129]:   <source dev="/dev/sde"/>
Aug 01 13:57:33 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 13:57:33 user nova-compute[72129]:   <serial>a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2</serial>
Aug 01 13:57:33 user nova-compute[72129]: </disk>
Aug 01 13:57:33 user nova-compute[72129]:  {{(pid=72129) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 13:57:33 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-18565379-8727-4be7-90af-e7f9f375f070 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 13:57:33 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-18565379-8727-4be7-90af-e7f9f375f070 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 13:57:33 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-18565379-8727-4be7-90af-e7f9f375f070 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] No VIF found with MAC fa:16:3e:d3:ee:e0, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 13:57:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-18565379-8727-4be7-90af-e7f9f375f070 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lock "133076de-14b5-4ceb-aa41-d9acef8506c5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.290s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:57:34 user nova-compute[72129]: DEBUG nova.compute.manager [req-430bf5c2-7645-40b7-9230-472cebfecfe9 req-51af9400-561c-4809-ac1a-b16412a79d19 service nova] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Received event network-vif-plugged-b7271bae-a440-4d06-87d0-cece38122deb {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:57:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-430bf5c2-7645-40b7-9230-472cebfecfe9 req-51af9400-561c-4809-ac1a-b16412a79d19 service nova] Acquiring lock "53b76ca4-30f0-4fd4-9928-714c7073a490-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:57:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-430bf5c2-7645-40b7-9230-472cebfecfe9 req-51af9400-561c-4809-ac1a-b16412a79d19 service nova] Lock "53b76ca4-30f0-4fd4-9928-714c7073a490-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:57:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-430bf5c2-7645-40b7-9230-472cebfecfe9 req-51af9400-561c-4809-ac1a-b16412a79d19 service nova] Lock "53b76ca4-30f0-4fd4-9928-714c7073a490-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:57:34 user nova-compute[72129]: DEBUG nova.compute.manager [req-430bf5c2-7645-40b7-9230-472cebfecfe9 req-51af9400-561c-4809-ac1a-b16412a79d19 service nova] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] No waiting events found dispatching network-vif-plugged-b7271bae-a440-4d06-87d0-cece38122deb {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:57:34 user nova-compute[72129]: WARNING nova.compute.manager [req-430bf5c2-7645-40b7-9230-472cebfecfe9 req-51af9400-561c-4809-ac1a-b16412a79d19 service nova] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Received unexpected event network-vif-plugged-b7271bae-a440-4d06-87d0-cece38122deb for instance with vm_state building and task_state spawning.
Aug 01 13:57:34 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898254.916859, 53b76ca4-30f0-4fd4-9928-714c7073a490 => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:57:34 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] VM Resumed (Lifecycle Event)
Aug 01 13:57:34 user nova-compute[72129]: DEBUG nova.compute.manager [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Instance event wait completed in 0 seconds for  {{(pid=72129) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 13:57:34 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Guest created on hypervisor {{(pid=72129) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 13:57:34 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Instance spawned successfully.
Aug 01 13:57:34 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 13:57:34 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:57:34 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 13:57:34 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Found default for hw_cdrom_bus of ide {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:57:34 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Found default for hw_disk_bus of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:57:34 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Found default for hw_input_bus of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:57:34 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Found default for hw_pointer_model of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:57:34 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Found default for hw_video_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:57:34 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Found default for hw_vif_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:57:34 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 13:57:34 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898254.9178567, 53b76ca4-30f0-4fd4-9928-714c7073a490 => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:57:34 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] VM Started (Lifecycle Event)
Aug 01 13:57:34 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:57:35 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 13:57:35 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 13:57:35 user nova-compute[72129]: INFO nova.compute.manager [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Took 9.05 seconds to spawn the instance on the hypervisor.
Aug 01 13:57:35 user nova-compute[72129]: DEBUG nova.compute.manager [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:57:35 user nova-compute[72129]: INFO nova.compute.manager [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Took 10.02 seconds to build instance.
Aug 01 13:57:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-05a5324b-a91d-48ef-9977-d006da157b5d tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "53b76ca4-30f0-4fd4-9928-714c7073a490" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.139s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:57:35 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:36 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:37 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Acquiring lock "53dc7cc0-a52f-4540-b2f7-8b947f272628" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:57:37 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "53dc7cc0-a52f-4540-b2f7-8b947f272628" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:57:37 user nova-compute[72129]: DEBUG nova.compute.manager [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] Starting instance... {{(pid=72129) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 13:57:37 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:57:37 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:57:37 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72129) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 13:57:37 user nova-compute[72129]: INFO nova.compute.claims [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] Claim successful on node user
Aug 01 13:57:38 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 13:57:38 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 13:57:38 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.533s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:57:38 user nova-compute[72129]: DEBUG nova.compute.manager [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] Start building networks asynchronously for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 13:57:38 user nova-compute[72129]: DEBUG nova.compute.manager [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] Allocating IP information in the background. {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 13:57:38 user nova-compute[72129]: DEBUG nova.network.neutron [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] allocate_for_instance() {{(pid=72129) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 13:57:38 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 13:57:38 user nova-compute[72129]: DEBUG nova.compute.manager [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] Start building block device mappings for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 13:57:38 user nova-compute[72129]: INFO nova.virt.block_device [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] Booting with volume snapshot 11e173f3-7ef0-47f8-9d04-ed51c664c8cc at /dev/vda
Aug 01 13:57:38 user nova-compute[72129]: DEBUG nova.policy [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7c341be2816c43cfa9adb58ee84e942b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '210837255c8148ec9b482ba3e2551362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72129) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 13:57:39 user nova-compute[72129]: DEBUG nova.network.neutron [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] Successfully created port: 0c5a9562-3fb3-4983-8609-a81a74f572f9 {{(pid=72129) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 13:57:40 user nova-compute[72129]: DEBUG nova.network.neutron [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] Successfully updated port: 0c5a9562-3fb3-4983-8609-a81a74f572f9 {{(pid=72129) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 13:57:40 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Acquiring lock "refresh_cache-53dc7cc0-a52f-4540-b2f7-8b947f272628" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:57:40 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Acquired lock "refresh_cache-53dc7cc0-a52f-4540-b2f7-8b947f272628" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:57:40 user nova-compute[72129]: DEBUG nova.network.neutron [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 13:57:40 user nova-compute[72129]: DEBUG nova.compute.manager [req-dd7fa729-a13e-4ce0-ae99-fa39a5025d6b req-a6599706-c0e7-4b57-a4e0-6408dfdc7414 service nova] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] Received event network-changed-0c5a9562-3fb3-4983-8609-a81a74f572f9 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:57:40 user nova-compute[72129]: DEBUG nova.compute.manager [req-dd7fa729-a13e-4ce0-ae99-fa39a5025d6b req-a6599706-c0e7-4b57-a4e0-6408dfdc7414 service nova] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] Refreshing instance network info cache due to event network-changed-0c5a9562-3fb3-4983-8609-a81a74f572f9. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 13:57:40 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-dd7fa729-a13e-4ce0-ae99-fa39a5025d6b req-a6599706-c0e7-4b57-a4e0-6408dfdc7414 service nova] Acquiring lock "refresh_cache-53dc7cc0-a52f-4540-b2f7-8b947f272628" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:57:40 user nova-compute[72129]: DEBUG nova.network.neutron [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] Instance cache missing network info. {{(pid=72129) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 13:57:40 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:40 user nova-compute[72129]: DEBUG nova.network.neutron [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] Updating instance_info_cache with network_info: [{"id": "0c5a9562-3fb3-4983-8609-a81a74f572f9", "address": "fa:16:3e:10:1a:57", "network": {"id": "a7f4226b-73fe-4265-ba2c-5d7dcdf154fd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1142462884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210837255c8148ec9b482ba3e2551362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5a9562-3f", "ovs_interfaceid": "0c5a9562-3fb3-4983-8609-a81a74f572f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:57:40 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Releasing lock "refresh_cache-53dc7cc0-a52f-4540-b2f7-8b947f272628" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:57:40 user nova-compute[72129]: DEBUG nova.compute.manager [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] Instance network_info: |[{"id": "0c5a9562-3fb3-4983-8609-a81a74f572f9", "address": "fa:16:3e:10:1a:57", "network": {"id": "a7f4226b-73fe-4265-ba2c-5d7dcdf154fd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1142462884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210837255c8148ec9b482ba3e2551362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5a9562-3f", "ovs_interfaceid": "0c5a9562-3fb3-4983-8609-a81a74f572f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 13:57:40 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-dd7fa729-a13e-4ce0-ae99-fa39a5025d6b req-a6599706-c0e7-4b57-a4e0-6408dfdc7414 service nova] Acquired lock "refresh_cache-53dc7cc0-a52f-4540-b2f7-8b947f272628" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:57:40 user nova-compute[72129]: DEBUG nova.network.neutron [req-dd7fa729-a13e-4ce0-ae99-fa39a5025d6b req-a6599706-c0e7-4b57-a4e0-6408dfdc7414 service nova] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] Refreshing network info cache for port 0c5a9562-3fb3-4983-8609-a81a74f572f9 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 13:57:41 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:41 user nova-compute[72129]: DEBUG nova.network.neutron [req-dd7fa729-a13e-4ce0-ae99-fa39a5025d6b req-a6599706-c0e7-4b57-a4e0-6408dfdc7414 service nova] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] Updated VIF entry in instance network info cache for port 0c5a9562-3fb3-4983-8609-a81a74f572f9. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 13:57:41 user nova-compute[72129]: DEBUG nova.network.neutron [req-dd7fa729-a13e-4ce0-ae99-fa39a5025d6b req-a6599706-c0e7-4b57-a4e0-6408dfdc7414 service nova] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] Updating instance_info_cache with network_info: [{"id": "0c5a9562-3fb3-4983-8609-a81a74f572f9", "address": "fa:16:3e:10:1a:57", "network": {"id": "a7f4226b-73fe-4265-ba2c-5d7dcdf154fd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1142462884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210837255c8148ec9b482ba3e2551362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5a9562-3f", "ovs_interfaceid": "0c5a9562-3fb3-4983-8609-a81a74f572f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:57:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-dd7fa729-a13e-4ce0-ae99-fa39a5025d6b req-a6599706-c0e7-4b57-a4e0-6408dfdc7414 service nova] Releasing lock "refresh_cache-53dc7cc0-a52f-4540-b2f7-8b947f272628" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:57:42 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:57:42 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Starting heal instance info cache {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 13:57:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "refresh_cache-2efa87a6-1dd6-4441-a55e-8e86be7f0a35" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:57:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquired lock "refresh_cache-2efa87a6-1dd6-4441-a55e-8e86be7f0a35" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:57:42 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Forcefully refreshing network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 13:57:42 user nova-compute[72129]: DEBUG nova.compute.manager [req-f6cf179c-92b2-44cf-87d5-18552f669870 req-3513eaae-eaa7-407e-9de1-bc9404883a96 service nova] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Received event network-changed-09dc6abd-1d55-4e2d-8568-1f793ca45413 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:57:42 user nova-compute[72129]: DEBUG nova.compute.manager [req-f6cf179c-92b2-44cf-87d5-18552f669870 req-3513eaae-eaa7-407e-9de1-bc9404883a96 service nova] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Refreshing instance network info cache due to event network-changed-09dc6abd-1d55-4e2d-8568-1f793ca45413. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 13:57:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f6cf179c-92b2-44cf-87d5-18552f669870 req-3513eaae-eaa7-407e-9de1-bc9404883a96 service nova] Acquiring lock "refresh_cache-133076de-14b5-4ceb-aa41-d9acef8506c5" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:57:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f6cf179c-92b2-44cf-87d5-18552f669870 req-3513eaae-eaa7-407e-9de1-bc9404883a96 service nova] Acquired lock "refresh_cache-133076de-14b5-4ceb-aa41-d9acef8506c5" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:57:42 user nova-compute[72129]: DEBUG nova.network.neutron [req-f6cf179c-92b2-44cf-87d5-18552f669870 req-3513eaae-eaa7-407e-9de1-bc9404883a96 service nova] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Refreshing network info cache for port 09dc6abd-1d55-4e2d-8568-1f793ca45413 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 13:57:42 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Updating instance_info_cache with network_info: [{"id": "d59c6949-2748-4a57-b089-6219f9102815", "address": "fa:16:3e:20:eb:cf", "network": {"id": "4de0d3ee-7981-427b-9013-99cf0bc22cf8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-289359635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d693a983e4a44434b64c7983239371a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd59c6949-27", "ovs_interfaceid": "d59c6949-2748-4a57-b089-6219f9102815", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:57:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Releasing lock "refresh_cache-2efa87a6-1dd6-4441-a55e-8e86be7f0a35" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:57:42 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Updated the network info_cache for instance {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 13:57:42 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:57:42 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:57:42 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:57:42 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:57:43 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:57:43 user nova-compute[72129]: DEBUG nova.network.neutron [req-f6cf179c-92b2-44cf-87d5-18552f669870 req-3513eaae-eaa7-407e-9de1-bc9404883a96 service nova] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Updated VIF entry in instance network info cache for port 09dc6abd-1d55-4e2d-8568-1f793ca45413. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 13:57:43 user nova-compute[72129]: DEBUG nova.network.neutron [req-f6cf179c-92b2-44cf-87d5-18552f669870 req-3513eaae-eaa7-407e-9de1-bc9404883a96 service nova] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Updating instance_info_cache with network_info: [{"id": "09dc6abd-1d55-4e2d-8568-1f793ca45413", "address": "fa:16:3e:d3:ee:e0", "network": {"id": "a7ec6cc0-140b-446b-ae97-d4aafbc42693", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-397303278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43253b37caa747b090b14c707abf96cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09dc6abd-1d", "ovs_interfaceid": "09dc6abd-1d55-4e2d-8568-1f793ca45413", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:57:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f6cf179c-92b2-44cf-87d5-18552f669870 req-3513eaae-eaa7-407e-9de1-bc9404883a96 service nova] Releasing lock "refresh_cache-133076de-14b5-4ceb-aa41-d9acef8506c5" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:57:44 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:57:44 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72129) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 13:57:44 user nova-compute[72129]: DEBUG os_brick.utils [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:57:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:44 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf6ec92-2e15-416c-81ab-e20a8ea40323]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f9b449c2cd3d\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:44 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdded385-aa6f-40bd-9df6-c7c71ef31b4f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:44 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce586b55-3311-4004-9835-9cd95c82d360]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:44 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed3c12f3-88e2-4faf-b7be-603af9e9b668]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Running cmd (subprocess): nvme version {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] 'nvme version' failed. Not Retrying. {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 13:57:44 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.nvmeof [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] nvme not present on system {{(pid=72129) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 13:57:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 13:57:44 user nova-compute[72129]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 13:57:44 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ccdacbf-05df-43cc-98bd-41e1645686d0]: (4, '') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:44 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72129) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 13:57:44 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 13:57:44 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] LIGHTOS: no hostnqn found. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 13:57:44 user nova-compute[72129]: DEBUG os_brick.utils [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f9b449c2cd3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:57:44 user nova-compute[72129]: DEBUG nova.virt.block_device [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] Updating existing volume attachment record: 18564242-c3df-4417-bfa3-a3e1ecf54ba2 {{(pid=72129) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 13:57:45 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:57:45 user nova-compute[72129]: DEBUG nova.compute.manager [req-eddf673b-4fd9-41ad-9b70-d5a472e35fc8 req-09a2a7fc-7df3-41d7-b691-9095f8457fb1 service nova] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Received event network-changed-09dc6abd-1d55-4e2d-8568-1f793ca45413 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:57:45 user nova-compute[72129]: DEBUG nova.compute.manager [req-eddf673b-4fd9-41ad-9b70-d5a472e35fc8 req-09a2a7fc-7df3-41d7-b691-9095f8457fb1 service nova] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Refreshing instance network info cache due to event network-changed-09dc6abd-1d55-4e2d-8568-1f793ca45413. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 13:57:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-eddf673b-4fd9-41ad-9b70-d5a472e35fc8 req-09a2a7fc-7df3-41d7-b691-9095f8457fb1 service nova] Acquiring lock "refresh_cache-133076de-14b5-4ceb-aa41-d9acef8506c5" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:57:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-eddf673b-4fd9-41ad-9b70-d5a472e35fc8 req-09a2a7fc-7df3-41d7-b691-9095f8457fb1 service nova] Acquired lock "refresh_cache-133076de-14b5-4ceb-aa41-d9acef8506c5" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:57:45 user nova-compute[72129]: DEBUG nova.network.neutron [req-eddf673b-4fd9-41ad-9b70-d5a472e35fc8 req-09a2a7fc-7df3-41d7-b691-9095f8457fb1 service nova] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Refreshing network info cache for port 09dc6abd-1d55-4e2d-8568-1f793ca45413 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 13:57:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Acquiring lock "8e5e94dd-b575-48f1-a617-1bd917567220" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:57:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Lock "8e5e94dd-b575-48f1-a617-1bd917567220" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:57:45 user nova-compute[72129]: DEBUG nova.compute.manager [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Starting instance... {{(pid=72129) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 13:57:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:57:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:57:45 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72129) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 13:57:45 user nova-compute[72129]: INFO nova.compute.claims [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Claim successful on node user
Aug 01 13:57:45 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:45 user nova-compute[72129]: DEBUG nova.network.neutron [req-eddf673b-4fd9-41ad-9b70-d5a472e35fc8 req-09a2a7fc-7df3-41d7-b691-9095f8457fb1 service nova] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Updated VIF entry in instance network info cache for port 09dc6abd-1d55-4e2d-8568-1f793ca45413. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 13:57:45 user nova-compute[72129]: DEBUG nova.network.neutron [req-eddf673b-4fd9-41ad-9b70-d5a472e35fc8 req-09a2a7fc-7df3-41d7-b691-9095f8457fb1 service nova] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Updating instance_info_cache with network_info: [{"id": "09dc6abd-1d55-4e2d-8568-1f793ca45413", "address": "fa:16:3e:d3:ee:e0", "network": {"id": "a7ec6cc0-140b-446b-ae97-d4aafbc42693", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-397303278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43253b37caa747b090b14c707abf96cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09dc6abd-1d", "ovs_interfaceid": "09dc6abd-1d55-4e2d-8568-1f793ca45413", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:57:45 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 13:57:45 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 13:57:46 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:57:46 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-eddf673b-4fd9-41ad-9b70-d5a472e35fc8 req-09a2a7fc-7df3-41d7-b691-9095f8457fb1 service nova] Releasing lock "refresh_cache-133076de-14b5-4ceb-aa41-d9acef8506c5" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:57:46 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:57:46 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:46 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.487s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:57:46 user nova-compute[72129]: DEBUG nova.compute.manager [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Start building networks asynchronously for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 13:57:46 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:57:46 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:57:46 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:57:46 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Auditing locally available compute resources for user (node: user) {{(pid=72129) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 13:57:46 user nova-compute[72129]: DEBUG nova.compute.manager [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Allocating IP information in the background. {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 13:57:46 user nova-compute[72129]: DEBUG nova.network.neutron [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] allocate_for_instance() {{(pid=72129) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 13:57:46 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 13:57:46 user nova-compute[72129]: DEBUG nova.compute.manager [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Start building block device mappings for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 13:57:46 user nova-compute[72129]: DEBUG nova.policy [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fde5b0e7d7664dfe9f4d9ce0dc20a8e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0c65958662420fa6d8d73c5e9fdc25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72129) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 13:57:46 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 13:57:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:46 user nova-compute[72129]: INFO nova.virt.block_device [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Booting with volume 9e4d6571-fba3-42fe-9abd-cddd72d2c46d at /dev/vda
Aug 01 13:57:46 user nova-compute[72129]: DEBUG os_brick.utils [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:57:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:46 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[331eafd2-2560-40f9-b94d-9b25728d1f22]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f9b449c2cd3d\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:46 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e0710f-42ff-45a0-8e46-f71107e8fe28]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:46 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[da076a3b-12e7-421a-9b96-13e4ea2706fd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:46 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a39960-7b9a-40d5-adb9-e6f888003c6e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Running cmd (subprocess): nvme version {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] 'nvme version' failed. Not Retrying. {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 13:57:46 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] nvme not present on system {{(pid=72129) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 13:57:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 13:57:46 user nova-compute[72129]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 13:57:46 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02f9d68-7fa7-45e7-9208-f613821ab065]: (4, '') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:46 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72129) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 13:57:46 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 13:57:46 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] LIGHTOS: no hostnqn found. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 13:57:46 user nova-compute[72129]: DEBUG os_brick.utils [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f9b449c2cd3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:57:46 user nova-compute[72129]: DEBUG nova.virt.block_device [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Updating existing volume attachment record: 7e63608f-5608-4b72-9dcc-6a1f4ef0fd3a {{(pid=72129) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 13:57:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133076de-14b5-4ceb-aa41-d9acef8506c5/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133076de-14b5-4ceb-aa41-d9acef8506c5/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133076de-14b5-4ceb-aa41-d9acef8506c5/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133076de-14b5-4ceb-aa41-d9acef8506c5/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:46 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 13:57:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53b76ca4-30f0-4fd4-9928-714c7073a490/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:46 user nova-compute[72129]: DEBUG nova.network.neutron [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Successfully created port: 04bc1afa-2e8a-4dd9-961f-e695f43e3061 {{(pid=72129) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 13:57:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53b76ca4-30f0-4fd4-9928-714c7073a490/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53b76ca4-30f0-4fd4-9928-714c7073a490/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53b76ca4-30f0-4fd4-9928-714c7073a490/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:47 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 13:57:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28164e90-f7ad-4f7e-9dcf-2fc750201342/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28164e90-f7ad-4f7e-9dcf-2fc750201342/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28164e90-f7ad-4f7e-9dcf-2fc750201342/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:47 user nova-compute[72129]: DEBUG nova.network.neutron [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Successfully updated port: 04bc1afa-2e8a-4dd9-961f-e695f43e3061 {{(pid=72129) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 13:57:47 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Acquiring lock "refresh_cache-8e5e94dd-b575-48f1-a617-1bd917567220" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:57:47 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Acquired lock "refresh_cache-8e5e94dd-b575-48f1-a617-1bd917567220" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:57:47 user nova-compute[72129]: DEBUG nova.network.neutron [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 13:57:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28164e90-f7ad-4f7e-9dcf-2fc750201342/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:47 user nova-compute[72129]: DEBUG nova.compute.manager [req-32deafe8-ea6e-4ce9-9b37-133762a79838 req-94ed5120-0395-45c5-b92b-6003ebc187eb service nova] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Received event network-changed-04bc1afa-2e8a-4dd9-961f-e695f43e3061 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:57:47 user nova-compute[72129]: DEBUG nova.compute.manager [req-32deafe8-ea6e-4ce9-9b37-133762a79838 req-94ed5120-0395-45c5-b92b-6003ebc187eb service nova] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Refreshing instance network info cache due to event network-changed-04bc1afa-2e8a-4dd9-961f-e695f43e3061. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 13:57:47 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-32deafe8-ea6e-4ce9-9b37-133762a79838 req-94ed5120-0395-45c5-b92b-6003ebc187eb service nova] Acquiring lock "refresh_cache-8e5e94dd-b575-48f1-a617-1bd917567220" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:57:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63c0c1fe-7e4d-4763-8ede-a7662747a4c0/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:47 user nova-compute[72129]: DEBUG nova.network.neutron [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Instance cache missing network info. {{(pid=72129) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 13:57:48 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63c0c1fe-7e4d-4763-8ede-a7662747a4c0/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:48 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63c0c1fe-7e4d-4763-8ede-a7662747a4c0/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:48 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63c0c1fe-7e4d-4763-8ede-a7662747a4c0/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:48 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efa87a6-1dd6-4441-a55e-8e86be7f0a35/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:48 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efa87a6-1dd6-4441-a55e-8e86be7f0a35/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:48 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efa87a6-1dd6-4441-a55e-8e86be7f0a35/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:48 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efa87a6-1dd6-4441-a55e-8e86be7f0a35/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:48 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 13:57:49 user nova-compute[72129]: DEBUG nova.network.neutron [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Updating instance_info_cache with network_info: [{"id": "04bc1afa-2e8a-4dd9-961f-e695f43e3061", "address": "fa:16:3e:69:a4:f0", "network": {"id": "567d2893-d3e8-41e1-a0fe-4414df317d0c", "bridge": "br-int", "label": "tempest-TestShelveInstance-887577340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e0c65958662420fa6d8d73c5e9fdc25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04bc1afa-2e", "ovs_interfaceid": "04bc1afa-2e8a-4dd9-961f-e695f43e3061", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:57:49 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:57:49 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:57:49 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Hypervisor/Node resource view: name=user free_ram=7640MB free_disk=25.449447631835938GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72129) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 13:57:49 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:57:49 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:57:49 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Releasing lock "refresh_cache-8e5e94dd-b575-48f1-a617-1bd917567220" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:57:49 user nova-compute[72129]: DEBUG nova.compute.manager [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Instance network_info: |[{"id": "04bc1afa-2e8a-4dd9-961f-e695f43e3061", "address": "fa:16:3e:69:a4:f0", "network": {"id": "567d2893-d3e8-41e1-a0fe-4414df317d0c", "bridge": "br-int", "label": "tempest-TestShelveInstance-887577340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e0c65958662420fa6d8d73c5e9fdc25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04bc1afa-2e", "ovs_interfaceid": "04bc1afa-2e8a-4dd9-961f-e695f43e3061", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 13:57:49 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-32deafe8-ea6e-4ce9-9b37-133762a79838 req-94ed5120-0395-45c5-b92b-6003ebc187eb service nova] Acquired lock "refresh_cache-8e5e94dd-b575-48f1-a617-1bd917567220" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:57:49 user nova-compute[72129]: DEBUG nova.network.neutron [req-32deafe8-ea6e-4ce9-9b37-133762a79838 req-94ed5120-0395-45c5-b92b-6003ebc187eb service nova] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Refreshing network info cache for port 04bc1afa-2e8a-4dd9-961f-e695f43e3061 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 13:57:49 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 63c0c1fe-7e4d-4763-8ede-a7662747a4c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:57:49 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 97a5dccf-b499-443a-b332-cfa293a16047 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:57:49 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 2efa87a6-1dd6-4441-a55e-8e86be7f0a35 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:57:49 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:57:49 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 133076de-14b5-4ceb-aa41-d9acef8506c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:57:49 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 28164e90-f7ad-4f7e-9dcf-2fc750201342 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:57:49 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance d031973f-8f48-43b3-a338-040950103e4c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:57:49 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 53b76ca4-30f0-4fd4-9928-714c7073a490 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:57:49 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 53dc7cc0-a52f-4540-b2f7-8b947f272628 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:57:49 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 8e5e94dd-b575-48f1-a617-1bd917567220 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:57:49 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 13:57:49 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 13:57:49 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 13:57:49 user nova-compute[72129]: DEBUG nova.network.neutron [req-32deafe8-ea6e-4ce9-9b37-133762a79838 req-94ed5120-0395-45c5-b92b-6003ebc187eb service nova] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Updated VIF entry in instance network info cache for port 04bc1afa-2e8a-4dd9-961f-e695f43e3061. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 13:57:49 user nova-compute[72129]: DEBUG nova.network.neutron [req-32deafe8-ea6e-4ce9-9b37-133762a79838 req-94ed5120-0395-45c5-b92b-6003ebc187eb service nova] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Updating instance_info_cache with network_info: [{"id": "04bc1afa-2e8a-4dd9-961f-e695f43e3061", "address": "fa:16:3e:69:a4:f0", "network": {"id": "567d2893-d3e8-41e1-a0fe-4414df317d0c", "bridge": "br-int", "label": "tempest-TestShelveInstance-887577340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e0c65958662420fa6d8d73c5e9fdc25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04bc1afa-2e", "ovs_interfaceid": "04bc1afa-2e8a-4dd9-961f-e695f43e3061", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:57:49 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 13:57:49 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-32deafe8-ea6e-4ce9-9b37-133762a79838 req-94ed5120-0395-45c5-b92b-6003ebc187eb service nova] Releasing lock "refresh_cache-8e5e94dd-b575-48f1-a617-1bd917567220" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:57:49 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Compute_service record updated for user:user {{(pid=72129) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 13:57:49 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.651s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:57:50 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:51 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Acquiring lock "133076de-14b5-4ceb-aa41-d9acef8506c5" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:57:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lock "133076de-14b5-4ceb-aa41-d9acef8506c5" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:57:51 user nova-compute[72129]: INFO nova.compute.manager [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Rebooting instance
Aug 01 13:57:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Acquiring lock "refresh_cache-133076de-14b5-4ceb-aa41-d9acef8506c5" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:57:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Acquired lock "refresh_cache-133076de-14b5-4ceb-aa41-d9acef8506c5" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:57:51 user nova-compute[72129]: DEBUG nova.network.neutron [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 13:57:52 user nova-compute[72129]: DEBUG nova.network.neutron [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Updating instance_info_cache with network_info: [{"id": "09dc6abd-1d55-4e2d-8568-1f793ca45413", "address": "fa:16:3e:d3:ee:e0", "network": {"id": "a7ec6cc0-140b-446b-ae97-d4aafbc42693", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-397303278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43253b37caa747b090b14c707abf96cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09dc6abd-1d", "ovs_interfaceid": "09dc6abd-1d55-4e2d-8568-1f793ca45413", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:57:52 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Releasing lock "refresh_cache-133076de-14b5-4ceb-aa41-d9acef8506c5" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:57:52 user nova-compute[72129]: DEBUG nova.compute.manager [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:57:52 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:52 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:52 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:52 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:52 user nova-compute[72129]: DEBUG nova.compute.manager [req-09026ac9-6df2-49ae-90fc-73a65357fecd req-9790825b-ce80-4a8f-b4ac-56b7d579e2b4 service nova] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Received event network-vif-unplugged-09dc6abd-1d55-4e2d-8568-1f793ca45413 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:57:52 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-09026ac9-6df2-49ae-90fc-73a65357fecd req-9790825b-ce80-4a8f-b4ac-56b7d579e2b4 service nova] Acquiring lock "133076de-14b5-4ceb-aa41-d9acef8506c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:57:52 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-09026ac9-6df2-49ae-90fc-73a65357fecd req-9790825b-ce80-4a8f-b4ac-56b7d579e2b4 service nova] Lock "133076de-14b5-4ceb-aa41-d9acef8506c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:57:52 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-09026ac9-6df2-49ae-90fc-73a65357fecd req-9790825b-ce80-4a8f-b4ac-56b7d579e2b4 service nova] Lock "133076de-14b5-4ceb-aa41-d9acef8506c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:57:52 user nova-compute[72129]: DEBUG nova.compute.manager [req-09026ac9-6df2-49ae-90fc-73a65357fecd req-9790825b-ce80-4a8f-b4ac-56b7d579e2b4 service nova] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] No waiting events found dispatching network-vif-unplugged-09dc6abd-1d55-4e2d-8568-1f793ca45413 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:57:52 user nova-compute[72129]: WARNING nova.compute.manager [req-09026ac9-6df2-49ae-90fc-73a65357fecd req-9790825b-ce80-4a8f-b4ac-56b7d579e2b4 service nova] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Received unexpected event network-vif-unplugged-09dc6abd-1d55-4e2d-8568-1f793ca45413 for instance with vm_state active and task_state reboot_started_hard.
Aug 01 13:57:53 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Instance destroyed successfully.
Aug 01 13:57:53 user nova-compute[72129]: DEBUG nova.objects.instance [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lazy-loading 'resources' on Instance uuid 133076de-14b5-4ceb-aa41-d9acef8506c5 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:55:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-337029066',display_name='tempest-TestMinimumBasicScenario-server-337029066',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-337029066',id=17,image_ref='edea0658-dd0d-4712-83e7-608cd2089ee4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIF8pK0CTkVNfFPcWoAjeaWcCqpSHidxLzrNXnGzXid58N/NMzig5Fh+PrM0HmEtqXEVuFeC6ojSBtRRykq6gLAiPaZuHwOjhWv6j6ZSIDENuHN2kr+7tsEOeWGDThWqHw==',key_name='tempest-TestMinimumBasicScenario-1218723859',keypairs=<?>,launch_index=0,launched_at=2023-08-01T13:55:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='43253b37caa747b090b14c707abf96cf',ramdisk_id='',reservation_id='r-3dv71pgh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='edea0658-dd0d-4712-83e7-608cd2089ee4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-833844079',owner_user_name='tempest-TestMinimumBasicScenario-833844079-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T13:57:53Z,user_data=None,user_id='8acae20eb69f40c08bbe0799513b95e1',uuid=133076de-14b5-4ceb-aa41-d9acef8506c5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "09dc6abd-1d55-4e2d-8568-1f793ca45413", "address": "fa:16:3e:d3:ee:e0", "network": {"id": "a7ec6cc0-140b-446b-ae97-d4aafbc42693", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-397303278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43253b37caa747b090b14c707abf96cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09dc6abd-1d", "ovs_interfaceid": "09dc6abd-1d55-4e2d-8568-1f793ca45413", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Converting VIF {"id": "09dc6abd-1d55-4e2d-8568-1f793ca45413", "address": "fa:16:3e:d3:ee:e0", "network": {"id": "a7ec6cc0-140b-446b-ae97-d4aafbc42693", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-397303278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43253b37caa747b090b14c707abf96cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09dc6abd-1d", "ovs_interfaceid": "09dc6abd-1d55-4e2d-8568-1f793ca45413", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:ee:e0,bridge_name='br-int',has_traffic_filtering=True,id=09dc6abd-1d55-4e2d-8568-1f793ca45413,network=Network(a7ec6cc0-140b-446b-ae97-d4aafbc42693),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09dc6abd-1d') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG os_vif [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:ee:e0,bridge_name='br-int',has_traffic_filtering=True,id=09dc6abd-1d55-4e2d-8568-1f793ca45413,network=Network(a7ec6cc0-140b-446b-ae97-d4aafbc42693),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09dc6abd-1d') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap09dc6abd-1d, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 13:57:53 user nova-compute[72129]: INFO os_vif [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:ee:e0,bridge_name='br-int',has_traffic_filtering=True,id=09dc6abd-1d55-4e2d-8568-1f793ca45413,network=Network(a7ec6cc0-140b-446b-ae97-d4aafbc42693),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09dc6abd-1d')
Aug 01 13:57:53 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] calling os-brick to detach iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, {'target_iqns': ['iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OqyRvkgp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:57:53 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 13:57:53 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2', 0)] {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG nova.compute.manager [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] Start spawning the instance on the hypervisor. {{(pid=72129) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] Creating instance directory {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 13:57:53 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] Creating image(s)
Aug 01 13:57:53 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] Did not create local disks {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] Ensure instance console log exists: /opt/stack/data/nova/instances/53dc7cc0-a52f-4540-b2f7-8b947f272628/console.log {{(pid=72129) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] Start _get_guest_xml network_info=[{"id": "0c5a9562-3fb3-4983-8609-a81a74f572f9", "address": "fa:16:3e:10:1a:57", "network": {"id": "a7f4226b-73fe-4265-ba2c-5d7dcdf154fd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1142462884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210837255c8148ec9b482ba3e2551362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5a9562-3f", "ovs_interfaceid": "0c5a9562-3fb3-4983-8609-a81a74f572f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '18564242-c3df-4417-bfa3-a3e1ecf54ba2', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:bd0304ec-0e1c-42bf-bddd-0bd034f51691'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZrkINyWg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '53dc7cc0-a52f-4540-b2f7-8b947f272628', 'attached_at': '', 'detached_at': '', 'volume_id': 'bd0304ec-0e1c-42bf-bddd-0bd034f51691', 'serial': 'bd0304ec-0e1c-42bf-bddd-0bd034f51691'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[738619e7-532f-4722-ab8f-22fb52bddd2e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:53 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:57:53 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:57:53 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] CPU controller missing on host. {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] CPU controller found on host. {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72129) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T13:45:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Flavor limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Image limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Flavor pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Image pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Got 1 possible topologies {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] Calling os-brick to attach iSCSI Volume {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bd0304ec-0e1c-42bf-bddd-0bd034f51691'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZrkINyWg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:57:53 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 13:57:53 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[14994f12-322f-46a6-9e82-d721f17ce2d8]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)
Aug 01 13:57:53 user nova-compute[72129]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 13:57:53 user nova-compute[72129]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f (non-flash)
Aug 01 13:57:53 user nova-compute[72129]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 (non-flash)
Aug 01 13:57:53 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)
Aug 01 13:57:53 user nova-compute[72129]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 13:57:53 user nova-compute[72129]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f (non-flash)
Aug 01 13:57:53 user nova-compute[72129]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 (non-flash)
Aug 01 13:57:53 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2828119240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2'): ({'sde'}, set())}) {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Removing single pathed devices sde {{(pid=72129) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d028a9ef-8ed6-4801-8f6e-85a3ff61902f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d8430f-28e7-4e3e-8280-d2a200a3e10a]: (4, ('ok\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Flushing IO for device /dev/sde {{(pid=72129) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[858f059d-5c4d-400c-90b5-4944659f5b92]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72129) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.038s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9db4a7-bcde-4720-b661-25b9031f8fef]: (4, ('1', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] SCSI volumes sde have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2')] {{(pid=72129) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c95ceb8b-bcc1-4121-8745-bb8b83a357ac]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 -p 172.16.0.220:3260 --logout {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d20546-393b-424c-9792-3e151d05a238]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2, portal: 172.16.0.220,3260]
Aug 01 13:57:53 user nova-compute[72129]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2, portal: 172.16.0.220,3260] successful.
Aug 01 13:57:53 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 -p 172.16.0.220:3260 --op delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b983f021-ed03-475f-895f-e9e5313446f8]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] <== disconnect_volume: return (299ms) None {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Disconnected iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.217s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:57:53 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 13:57:53 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd0304ec-0e1c-42bf-bddd-0bd034f51691" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd0304ec-0e1c-42bf-bddd-0bd034f51691" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:57:53 user nova-compute[72129]: INFO os_brick.initiator.connectors.iscsi [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 13:57:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd0304ec-0e1c-42bf-bddd-0bd034f51691 -p 172.16.0.220:3260 {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Start _get_guest_xml network_info=[{"id": "09dc6abd-1d55-4e2d-8568-1f793ca45413", "address": "fa:16:3e:d3:ee:e0", "network": {"id": "a7ec6cc0-140b-446b-ae97-d4aafbc42693", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-397303278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43253b37caa747b090b14c707abf96cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09dc6abd-1d", "ovs_interfaceid": "09dc6abd-1d55-4e2d-8568-1f793ca45413", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=edea0658-dd0d-4712-83e7-608cd2089ee4,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'image_id': 'edea0658-dd0d-4712-83e7-608cd2089ee4'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'attachment_id': '949dd8bd-aff0-4753-b916-6e6afede0bd9', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OqyRvkgp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '133076de-14b5-4ceb-aa41-d9acef8506c5', 'attached_at': '', 'detached_at': '', 'volume_id': 'a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2', 'serial': 'a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 13:57:53 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:57:53 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:57:53 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] CPU controller missing on host. {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] CPU controller found on host. {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72129) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T13:45:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=edea0658-dd0d-4712-83e7-608cd2089ee4,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Flavor limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Image limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Flavor pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Image pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Got 1 possible topologies {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG nova.objects.instance [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lazy-loading 'vcpu_model' on Instance uuid 133076de-14b5-4ceb-aa41-d9acef8506c5 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd0304ec-0e1c-42bf-bddd-0bd034f51691 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cdb92d1-a2ac-494b-b326-e3cc0f648f19]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 13:57:53 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd0304ec-0e1c-42bf-bddd-0bd034f51691 -p 172.16.0.220:3260 --interface default --op new {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Calling os-brick to attach iSCSI Volume {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OqyRvkgp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:57:53 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 13:57:53 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd0304ec-0e1c-42bf-bddd-0bd034f51691 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[35247eb9-68a3-4342-a843-ef54862c6873]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bd0304ec-0e1c-42bf-bddd-0bd034f51691] added\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bd0304ec-0e1c-42bf-bddd-0bd034f51691] added
Aug 01 13:57:53 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd0304ec-0e1c-42bf-bddd-0bd034f51691 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd0304ec-0e1c-42bf-bddd-0bd034f51691 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0ba360-f33b-4349-af9d-38c859c5ddf5]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd0304ec-0e1c-42bf-bddd-0bd034f51691 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd0304ec-0e1c-42bf-bddd-0bd034f51691 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf26825-f16c-4e7e-8f5b-cd52f4cc1721]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd0304ec-0e1c-42bf-bddd-0bd034f51691 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZrkINyWg {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd0304ec-0e1c-42bf-bddd-0bd034f51691 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZrkINyWg" returned: 0 in 0.030s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c90c42-ce9b-4e9d-b25b-d8f94579849f]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZrkINyWg'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd0304ec-0e1c-42bf-bddd-0bd034f51691 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd0304ec-0e1c-42bf-bddd-0bd034f51691 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf7b65d-2032-4ac4-9f41-e49bf7631554]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e20ea78-62fd-466b-a6dc-560c49b2b49c]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)
Aug 01 13:57:53 user nova-compute[72129]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 13:57:53 user nova-compute[72129]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f (non-flash)
Aug 01 13:57:53 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)
Aug 01 13:57:53 user nova-compute[72129]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 13:57:53 user nova-compute[72129]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f (non-flash)
Aug 01 13:57:53 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:57:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd0304ec-0e1c-42bf-bddd-0bd034f51691 -p 172.16.0.220:3260 --login {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd0304ec-0e1c-42bf-bddd-0bd034f51691 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:54 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f6798cb-2220-4387-b0f3-345e73b66bd4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bd0304ec-0e1c-42bf-bddd-0bd034f51691, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bd0304ec-0e1c-42bf-bddd-0bd034f51691, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:54 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bd0304ec-0e1c-42bf-bddd-0bd034f51691, portal: 172.16.0.220,3260]
Aug 01 13:57:54 user nova-compute[72129]: Login to [iface: default, target: iqn.2010-10.org.openstack:bd0304ec-0e1c-42bf-bddd-0bd034f51691, portal: 172.16.0.220,3260] successful.
Aug 01 13:57:54 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:57:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd0304ec-0e1c-42bf-bddd-0bd034f51691 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd0304ec-0e1c-42bf-bddd-0bd034f51691 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:54 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[04328ef9-3b93-4d15-9439-d8ebf371f6c6]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:54 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:57:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:54 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd98421-c111-4343-9bb1-0771ac26b355]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd0304ec-0e1c-42bf-bddd-0bd034f51691 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:54 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)
Aug 01 13:57:54 user nova-compute[72129]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 13:57:54 user nova-compute[72129]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f (non-flash)
Aug 01 13:57:54 user nova-compute[72129]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd0304ec-0e1c-42bf-bddd-0bd034f51691 (non-flash)
Aug 01 13:57:54 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:57:54 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)
Aug 01 13:57:54 user nova-compute[72129]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 13:57:54 user nova-compute[72129]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f (non-flash)
Aug 01 13:57:54 user nova-compute[72129]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd0304ec-0e1c-42bf-bddd-0bd034f51691 (non-flash)
Aug 01 13:57:54 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:57:54 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd0304ec-0e1c-42bf-bddd-0bd034f51691" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:57:54 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Connected to 172.16.0.220:3260 {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 13:57:54 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] HCTL ('36', '-', '-', 0) found on session 25 with lun 0 {{(pid=72129) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 13:57:54 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72129) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 13:57:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:54 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85dc245-ad53-4085-bad2-327026f16649]: (4, ('- - 0', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:54 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Searching for a device in session 25 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 13:57:54 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZrkINyWg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 13:57:54 user nova-compute[72129]: DEBUG nova.compute.manager [req-2466ffc3-12ff-4201-a6b6-c912f6246911 req-0a6c3f91-30da-4a98-8251-1df7ebf0c774 service nova] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Received event network-vif-plugged-09dc6abd-1d55-4e2d-8568-1f793ca45413 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:57:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-2466ffc3-12ff-4201-a6b6-c912f6246911 req-0a6c3f91-30da-4a98-8251-1df7ebf0c774 service nova] Acquiring lock "133076de-14b5-4ceb-aa41-d9acef8506c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:57:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-2466ffc3-12ff-4201-a6b6-c912f6246911 req-0a6c3f91-30da-4a98-8251-1df7ebf0c774 service nova] Lock "133076de-14b5-4ceb-aa41-d9acef8506c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:57:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-2466ffc3-12ff-4201-a6b6-c912f6246911 req-0a6c3f91-30da-4a98-8251-1df7ebf0c774 service nova] Lock "133076de-14b5-4ceb-aa41-d9acef8506c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:57:54 user nova-compute[72129]: DEBUG nova.compute.manager [req-2466ffc3-12ff-4201-a6b6-c912f6246911 req-0a6c3f91-30da-4a98-8251-1df7ebf0c774 service nova] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] No waiting events found dispatching network-vif-plugged-09dc6abd-1d55-4e2d-8568-1f793ca45413 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:57:54 user nova-compute[72129]: WARNING nova.compute.manager [req-2466ffc3-12ff-4201-a6b6-c912f6246911 req-0a6c3f91-30da-4a98-8251-1df7ebf0c774 service nova] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Received unexpected event network-vif-plugged-09dc6abd-1d55-4e2d-8568-1f793ca45413 for instance with vm_state active and task_state reboot_started_hard.
Aug 01 13:57:55 user nova-compute[72129]: DEBUG nova.compute.manager [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Start spawning the instance on the hypervisor. {{(pid=72129) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Creating instance directory {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 13:57:55 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Creating image(s)
Aug 01 13:57:55 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Did not create local disks {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Ensure instance console log exists: /opt/stack/data/nova/instances/8e5e94dd-b575-48f1-a617-1bd917567220/console.log {{(pid=72129) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Start _get_guest_xml network_info=[{"id": "04bc1afa-2e8a-4dd9-961f-e695f43e3061", "address": "fa:16:3e:69:a4:f0", "network": {"id": "567d2893-d3e8-41e1-a0fe-4414df317d0c", "bridge": "br-int", "label": "tempest-TestShelveInstance-887577340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e0c65958662420fa6d8d73c5e9fdc25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04bc1afa-2e", "ovs_interfaceid": "04bc1afa-2e8a-4dd9-961f-e695f43e3061", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '7e63608f-5608-4b72-9dcc-6a1f4ef0fd3a', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'anVDsYRG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8e5e94dd-b575-48f1-a617-1bd917567220', 'attached_at': '', 'detached_at': '', 'volume_id': '9e4d6571-fba3-42fe-9abd-cddd72d2c46d', 'serial': '9e4d6571-fba3-42fe-9abd-cddd72d2c46d'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 13:57:55 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:57:55 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:57:55 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] CPU controller missing on host. {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] CPU controller found on host. {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72129) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T13:45:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Flavor limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Image limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Flavor pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Image pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Got 1 possible topologies {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Calling os-brick to attach iSCSI Volume {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'anVDsYRG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:57:55 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 13:57:55 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] <== connect_volume: return (1596ms) {'type': 'block', 'scsi_wwn': '26434306330613539', 'path': '/dev/sde'} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26434306330613539', 'path': '/dev/sde'} {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.307s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:57:55 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 13:57:55 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:57:55 user nova-compute[72129]: INFO os_brick.initiator.connectors.iscsi [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 13:57:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 -p 172.16.0.220:3260 {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a76ee94-ca83-4354-a578-add2ec7ab6cf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 13:57:55 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:57:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1770940535',display_name='tempest-TestVolumeBootPattern-server-1770940535',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1770940535',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='210837255c8148ec9b482ba3e2551362',ramdisk_id='',reservation_id='r-2qgu9ges',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1876154436',owner_user_name='tempest-TestVolumeBootPattern-1876154436-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:57:39Z,user_data=None,user_id='7c341be2816c43cfa9adb58ee84e942b',uuid=53dc7cc0-a52f-4540-b2f7-8b947f272628,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c5a9562-3fb3-4983-8609-a81a74f572f9", "address": "fa:16:3e:10:1a:57", "network": {"id": "a7f4226b-73fe-4265-ba2c-5d7dcdf154fd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1142462884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210837255c8148ec9b482ba3e2551362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5a9562-3f", "ovs_interfaceid": "0c5a9562-3fb3-4983-8609-a81a74f572f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Converting VIF {"id": "0c5a9562-3fb3-4983-8609-a81a74f572f9", "address": "fa:16:3e:10:1a:57", "network": {"id": "a7f4226b-73fe-4265-ba2c-5d7dcdf154fd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1142462884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210837255c8148ec9b482ba3e2551362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5a9562-3f", "ovs_interfaceid": "0c5a9562-3fb3-4983-8609-a81a74f572f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:1a:57,bridge_name='br-int',has_traffic_filtering=True,id=0c5a9562-3fb3-4983-8609-a81a74f572f9,network=Network(a7f4226b-73fe-4265-ba2c-5d7dcdf154fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c5a9562-3f') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG nova.objects.instance [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lazy-loading 'pci_devices' on Instance uuid 53dc7cc0-a52f-4540-b2f7-8b947f272628 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 -p 172.16.0.220:3260 --interface default --op new {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] End _get_guest_xml xml=<domain type="kvm">
Aug 01 13:57:55 user nova-compute[72129]:   <uuid>53dc7cc0-a52f-4540-b2f7-8b947f272628</uuid>
Aug 01 13:57:55 user nova-compute[72129]:   <name>instance-00000015</name>
Aug 01 13:57:55 user nova-compute[72129]:   <memory>524288</memory>
Aug 01 13:57:55 user nova-compute[72129]:   <vcpu>1</vcpu>
Aug 01 13:57:55 user nova-compute[72129]:   <metadata>
Aug 01 13:57:55 user nova-compute[72129]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 13:57:55 user nova-compute[72129]:       <nova:package version="0.0.0"/>
Aug 01 13:57:55 user nova-compute[72129]:       <nova:name>tempest-TestVolumeBootPattern-server-1770940535</nova:name>
Aug 01 13:57:55 user nova-compute[72129]:       <nova:creationTime>2023-08-01 13:57:53</nova:creationTime>
Aug 01 13:57:55 user nova-compute[72129]:       <nova:flavor name="m1.tiny">
Aug 01 13:57:55 user nova-compute[72129]:         <nova:memory>512</nova:memory>
Aug 01 13:57:55 user nova-compute[72129]:         <nova:disk>1</nova:disk>
Aug 01 13:57:55 user nova-compute[72129]:         <nova:swap>0</nova:swap>
Aug 01 13:57:55 user nova-compute[72129]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 13:57:55 user nova-compute[72129]:         <nova:vcpus>1</nova:vcpus>
Aug 01 13:57:55 user nova-compute[72129]:       </nova:flavor>
Aug 01 13:57:55 user nova-compute[72129]:       <nova:owner>
Aug 01 13:57:55 user nova-compute[72129]:         <nova:user uuid="7c341be2816c43cfa9adb58ee84e942b">tempest-TestVolumeBootPattern-1876154436-project-member</nova:user>
Aug 01 13:57:55 user nova-compute[72129]:         <nova:project uuid="210837255c8148ec9b482ba3e2551362">tempest-TestVolumeBootPattern-1876154436</nova:project>
Aug 01 13:57:55 user nova-compute[72129]:       </nova:owner>
Aug 01 13:57:55 user nova-compute[72129]:       <nova:ports>
Aug 01 13:57:55 user nova-compute[72129]:         <nova:port uuid="0c5a9562-3fb3-4983-8609-a81a74f572f9">
Aug 01 13:57:55 user nova-compute[72129]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 01 13:57:55 user nova-compute[72129]:         </nova:port>
Aug 01 13:57:55 user nova-compute[72129]:       </nova:ports>
Aug 01 13:57:55 user nova-compute[72129]:     </nova:instance>
Aug 01 13:57:55 user nova-compute[72129]:   </metadata>
Aug 01 13:57:55 user nova-compute[72129]:   <sysinfo type="smbios">
Aug 01 13:57:55 user nova-compute[72129]:     <system>
Aug 01 13:57:55 user nova-compute[72129]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 13:57:55 user nova-compute[72129]:       <entry name="product">OpenStack Nova</entry>
Aug 01 13:57:55 user nova-compute[72129]:       <entry name="version">0.0.0</entry>
Aug 01 13:57:55 user nova-compute[72129]:       <entry name="serial">53dc7cc0-a52f-4540-b2f7-8b947f272628</entry>
Aug 01 13:57:55 user nova-compute[72129]:       <entry name="uuid">53dc7cc0-a52f-4540-b2f7-8b947f272628</entry>
Aug 01 13:57:55 user nova-compute[72129]:       <entry name="family">Virtual Machine</entry>
Aug 01 13:57:55 user nova-compute[72129]:     </system>
Aug 01 13:57:55 user nova-compute[72129]:   </sysinfo>
Aug 01 13:57:55 user nova-compute[72129]:   <os>
Aug 01 13:57:55 user nova-compute[72129]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 13:57:55 user nova-compute[72129]:     <boot dev="hd"/>
Aug 01 13:57:55 user nova-compute[72129]:     <smbios mode="sysinfo"/>
Aug 01 13:57:55 user nova-compute[72129]:   </os>
Aug 01 13:57:55 user nova-compute[72129]:   <features>
Aug 01 13:57:55 user nova-compute[72129]:     <acpi/>
Aug 01 13:57:55 user nova-compute[72129]:     <apic/>
Aug 01 13:57:55 user nova-compute[72129]:     <vmcoreinfo/>
Aug 01 13:57:55 user nova-compute[72129]:   </features>
Aug 01 13:57:55 user nova-compute[72129]:   <clock offset="utc">
Aug 01 13:57:55 user nova-compute[72129]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 13:57:55 user nova-compute[72129]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 13:57:55 user nova-compute[72129]:     <timer name="hpet" present="no"/>
Aug 01 13:57:55 user nova-compute[72129]:   </clock>
Aug 01 13:57:55 user nova-compute[72129]:   <cpu mode="custom" match="exact">
Aug 01 13:57:55 user nova-compute[72129]:     <model>Nehalem</model>
Aug 01 13:57:55 user nova-compute[72129]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 13:57:55 user nova-compute[72129]:   </cpu>
Aug 01 13:57:55 user nova-compute[72129]:   <devices>
Aug 01 13:57:55 user nova-compute[72129]:     <disk type="block" device="disk">
Aug 01 13:57:55 user nova-compute[72129]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 13:57:55 user nova-compute[72129]:       <source dev="/dev/sde"/>
Aug 01 13:57:55 user nova-compute[72129]:       <target dev="vda" bus="virtio"/>
Aug 01 13:57:55 user nova-compute[72129]:       <serial>bd0304ec-0e1c-42bf-bddd-0bd034f51691</serial>
Aug 01 13:57:55 user nova-compute[72129]:     </disk>
Aug 01 13:57:55 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 13:57:55 user nova-compute[72129]:       <mac address="fa:16:3e:10:1a:57"/>
Aug 01 13:57:55 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 13:57:55 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 13:57:55 user nova-compute[72129]:       <target dev="tap0c5a9562-3f"/>
Aug 01 13:57:55 user nova-compute[72129]:     </interface>
Aug 01 13:57:55 user nova-compute[72129]:     <serial type="pty">
Aug 01 13:57:55 user nova-compute[72129]:       <log file="/opt/stack/data/nova/instances/53dc7cc0-a52f-4540-b2f7-8b947f272628/console.log" append="off"/>
Aug 01 13:57:55 user nova-compute[72129]:     </serial>
Aug 01 13:57:55 user nova-compute[72129]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 13:57:55 user nova-compute[72129]:     <video>
Aug 01 13:57:55 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 13:57:55 user nova-compute[72129]:     </video>
Aug 01 13:57:55 user nova-compute[72129]:     <rng model="virtio">
Aug 01 13:57:55 user nova-compute[72129]:       <backend model="random">/dev/urandom</backend>
Aug 01 13:57:55 user nova-compute[72129]:     </rng>
Aug 01 13:57:55 user nova-compute[72129]:     <controller type="usb" index="0" model="none"/>
Aug 01 13:57:55 user nova-compute[72129]:     <memballoon model="virtio">
Aug 01 13:57:55 user nova-compute[72129]:       <stats period="10"/>
Aug 01 13:57:55 user nova-compute[72129]:     </memballoon>
Aug 01 13:57:55 user nova-compute[72129]:   </devices>
Aug 01 13:57:55 user nova-compute[72129]: </domain>
Aug 01 13:57:55 user nova-compute[72129]:  {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:57:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1770940535',display_name='tempest-TestVolumeBootPattern-server-1770940535',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1770940535',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='210837255c8148ec9b482ba3e2551362',ramdisk_id='',reservation_id='r-2qgu9ges',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1876154436',owner_user_name='tempest-TestVolumeBootPattern-1876154436-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:57:39Z,user_data=None,user_id='7c341be2816c43cfa9adb58ee84e942b',uuid=53dc7cc0-a52f-4540-b2f7-8b947f272628,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c5a9562-3fb3-4983-8609-a81a74f572f9", "address": "fa:16:3e:10:1a:57", "network": {"id": "a7f4226b-73fe-4265-ba2c-5d7dcdf154fd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1142462884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210837255c8148ec9b482ba3e2551362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5a9562-3f", "ovs_interfaceid": "0c5a9562-3fb3-4983-8609-a81a74f572f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Converting VIF {"id": "0c5a9562-3fb3-4983-8609-a81a74f572f9", "address": "fa:16:3e:10:1a:57", "network": {"id": "a7f4226b-73fe-4265-ba2c-5d7dcdf154fd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1142462884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210837255c8148ec9b482ba3e2551362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5a9562-3f", "ovs_interfaceid": "0c5a9562-3fb3-4983-8609-a81a74f572f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:1a:57,bridge_name='br-int',has_traffic_filtering=True,id=0c5a9562-3fb3-4983-8609-a81a74f572f9,network=Network(a7f4226b-73fe-4265-ba2c-5d7dcdf154fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c5a9562-3f') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG os_vif [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:1a:57,bridge_name='br-int',has_traffic_filtering=True,id=0c5a9562-3fb3-4983-8609-a81a74f572f9,network=Network(a7f4226b-73fe-4265-ba2c-5d7dcdf154fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c5a9562-3f') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[f546752e-380f-407c-8791-622de11e472c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2] added\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2] added
Aug 01 13:57:55 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0c5a9562-3f, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0c5a9562-3f, col_values=(('external_ids', {'iface-id': '0c5a9562-3fb3-4983-8609-a81a74f572f9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:1a:57', 'vm-uuid': '53dc7cc0-a52f-4540-b2f7-8b947f272628'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:55 user nova-compute[72129]: INFO os_vif [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:1a:57,bridge_name='br-int',has_traffic_filtering=True,id=0c5a9562-3fb3-4983-8609-a81a74f572f9,network=Network(a7f4226b-73fe-4265-ba2c-5d7dcdf154fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c5a9562-3f')
Aug 01 13:57:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b54eb5-d96d-4149-af97-6c1116a39870]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0627380-dabc-4b88-901d-79ad70095853]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OqyRvkgp {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OqyRvkgp" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[591753b9-1b7c-46bb-b5aa-38082818a4e8]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OqyRvkgp'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be2c083-05bb-4328-b827-51088af18f56]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] No VIF found with MAC fa:16:3e:10:1a:57, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[81be8de5-ea0d-49a2-978e-031a8d9d6685]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd0304ec-0e1c-42bf-bddd-0bd034f51691 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)
Aug 01 13:57:55 user nova-compute[72129]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 13:57:55 user nova-compute[72129]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f (non-flash)
Aug 01 13:57:55 user nova-compute[72129]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd0304ec-0e1c-42bf-bddd-0bd034f51691 (non-flash)
Aug 01 13:57:55 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)
Aug 01 13:57:55 user nova-compute[72129]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 13:57:55 user nova-compute[72129]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f (non-flash)
Aug 01 13:57:55 user nova-compute[72129]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd0304ec-0e1c-42bf-bddd-0bd034f51691 (non-flash)
Aug 01 13:57:55 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 -p 172.16.0.220:3260 --login {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab36592-0b3e-410f-8b32-374415056c52]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2, portal: 172.16.0.220,3260]
Aug 01 13:57:55 user nova-compute[72129]: Login to [iface: default, target: iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2, portal: 172.16.0.220,3260] successful.
Aug 01 13:57:55 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e983f14-5c2c-4145-a087-da0c92fd02ca]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[41bc42c4-9304-41cf-96fb-24f52d684023]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd0304ec-0e1c-42bf-bddd-0bd034f51691 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)
Aug 01 13:57:55 user nova-compute[72129]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 13:57:55 user nova-compute[72129]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f (non-flash)
Aug 01 13:57:55 user nova-compute[72129]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd0304ec-0e1c-42bf-bddd-0bd034f51691 (non-flash)
Aug 01 13:57:55 user nova-compute[72129]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 (non-flash)
Aug 01 13:57:55 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)
Aug 01 13:57:55 user nova-compute[72129]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 13:57:55 user nova-compute[72129]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f (non-flash)
Aug 01 13:57:55 user nova-compute[72129]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd0304ec-0e1c-42bf-bddd-0bd034f51691 (non-flash)
Aug 01 13:57:55 user nova-compute[72129]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 (non-flash)
Aug 01 13:57:55 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Connected to 172.16.0.220:3260 {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] HCTL ('37', '-', '-', 0) found on session 26 with lun 0 {{(pid=72129) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72129) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f87d917-25c9-4376-90fd-7fe133a60f1d]: (4, ('- - 0', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Searching for a device in session 26 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OqyRvkgp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 13:57:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:56 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.383s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:57:56 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] <== connect_volume: return (2692ms) {'type': 'block', 'scsi_wwn': '23035366231363835', 'path': '/dev/sdf'} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:57:56 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23035366231363835', 'path': '/dev/sdf'} {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 13:57:56 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.391s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:57:56 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 13:57:56 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:57:56 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:57:56 user nova-compute[72129]: INFO os_brick.initiator.connectors.iscsi [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 13:57:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d -p 172.16.0.220:3260 {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:56 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b6d503-e3c8-4db2-b644-42df26f278fa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:56 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 13:57:56 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:57:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d -p 172.16.0.220:3260 --interface default --op new {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:56 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:55:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-337029066',display_name='tempest-TestMinimumBasicScenario-server-337029066',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-337029066',id=17,image_ref='edea0658-dd0d-4712-83e7-608cd2089ee4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIF8pK0CTkVNfFPcWoAjeaWcCqpSHidxLzrNXnGzXid58N/NMzig5Fh+PrM0HmEtqXEVuFeC6ojSBtRRykq6gLAiPaZuHwOjhWv6j6ZSIDENuHN2kr+7tsEOeWGDThWqHw==',key_name='tempest-TestMinimumBasicScenario-1218723859',keypairs=<?>,launch_index=0,launched_at=2023-08-01T13:55:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='43253b37caa747b090b14c707abf96cf',ramdisk_id='',reservation_id='r-3dv71pgh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='edea0658-dd0d-4712-83e7-608cd2089ee4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-833844079',owner_user_name='tempest-TestMinimumBasicScenario-833844079-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T13:57:53Z,user_data=None,user_id='8acae20eb69f40c08bbe0799513b95e1',uuid=133076de-14b5-4ceb-aa41-d9acef8506c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "09dc6abd-1d55-4e2d-8568-1f793ca45413", "address": "fa:16:3e:d3:ee:e0", "network": {"id": "a7ec6cc0-140b-446b-ae97-d4aafbc42693", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-397303278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43253b37caa747b090b14c707abf96cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09dc6abd-1d", "ovs_interfaceid": "09dc6abd-1d55-4e2d-8568-1f793ca45413", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 13:57:56 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Converting VIF {"id": "09dc6abd-1d55-4e2d-8568-1f793ca45413", "address": "fa:16:3e:d3:ee:e0", "network": {"id": "a7ec6cc0-140b-446b-ae97-d4aafbc42693", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-397303278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43253b37caa747b090b14c707abf96cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09dc6abd-1d", "ovs_interfaceid": "09dc6abd-1d55-4e2d-8568-1f793ca45413", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:57:56 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:ee:e0,bridge_name='br-int',has_traffic_filtering=True,id=09dc6abd-1d55-4e2d-8568-1f793ca45413,network=Network(a7ec6cc0-140b-446b-ae97-d4aafbc42693),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09dc6abd-1d') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:57:56 user nova-compute[72129]: DEBUG nova.objects.instance [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lazy-loading 'pci_devices' on Instance uuid 133076de-14b5-4ceb-aa41-d9acef8506c5 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:57:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:56 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[18dc93be-21fd-48a6-8c1c-8eb96918b2fb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d] added\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:56 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d] added
Aug 01 13:57:56 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:57:56 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] End _get_guest_xml xml=<domain type="kvm">
Aug 01 13:57:56 user nova-compute[72129]:   <uuid>133076de-14b5-4ceb-aa41-d9acef8506c5</uuid>
Aug 01 13:57:56 user nova-compute[72129]:   <name>instance-00000011</name>
Aug 01 13:57:56 user nova-compute[72129]:   <memory>524288</memory>
Aug 01 13:57:56 user nova-compute[72129]:   <vcpu>1</vcpu>
Aug 01 13:57:56 user nova-compute[72129]:   <metadata>
Aug 01 13:57:56 user nova-compute[72129]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 13:57:56 user nova-compute[72129]:       <nova:package version="0.0.0"/>
Aug 01 13:57:56 user nova-compute[72129]:       <nova:name>tempest-TestMinimumBasicScenario-server-337029066</nova:name>
Aug 01 13:57:56 user nova-compute[72129]:       <nova:creationTime>2023-08-01 13:57:53</nova:creationTime>
Aug 01 13:57:56 user nova-compute[72129]:       <nova:flavor name="m1.tiny">
Aug 01 13:57:56 user nova-compute[72129]:         <nova:memory>512</nova:memory>
Aug 01 13:57:56 user nova-compute[72129]:         <nova:disk>1</nova:disk>
Aug 01 13:57:56 user nova-compute[72129]:         <nova:swap>0</nova:swap>
Aug 01 13:57:56 user nova-compute[72129]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 13:57:56 user nova-compute[72129]:         <nova:vcpus>1</nova:vcpus>
Aug 01 13:57:56 user nova-compute[72129]:       </nova:flavor>
Aug 01 13:57:56 user nova-compute[72129]:       <nova:owner>
Aug 01 13:57:56 user nova-compute[72129]:         <nova:user uuid="8acae20eb69f40c08bbe0799513b95e1">tempest-TestMinimumBasicScenario-833844079-project-member</nova:user>
Aug 01 13:57:56 user nova-compute[72129]:         <nova:project uuid="43253b37caa747b090b14c707abf96cf">tempest-TestMinimumBasicScenario-833844079</nova:project>
Aug 01 13:57:56 user nova-compute[72129]:       </nova:owner>
Aug 01 13:57:56 user nova-compute[72129]:       <nova:root type="image" uuid="edea0658-dd0d-4712-83e7-608cd2089ee4"/>
Aug 01 13:57:56 user nova-compute[72129]:       <nova:ports>
Aug 01 13:57:56 user nova-compute[72129]:         <nova:port uuid="09dc6abd-1d55-4e2d-8568-1f793ca45413">
Aug 01 13:57:56 user nova-compute[72129]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 01 13:57:56 user nova-compute[72129]:         </nova:port>
Aug 01 13:57:56 user nova-compute[72129]:       </nova:ports>
Aug 01 13:57:56 user nova-compute[72129]:     </nova:instance>
Aug 01 13:57:56 user nova-compute[72129]:   </metadata>
Aug 01 13:57:56 user nova-compute[72129]:   <sysinfo type="smbios">
Aug 01 13:57:56 user nova-compute[72129]:     <system>
Aug 01 13:57:56 user nova-compute[72129]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 13:57:56 user nova-compute[72129]:       <entry name="product">OpenStack Nova</entry>
Aug 01 13:57:56 user nova-compute[72129]:       <entry name="version">0.0.0</entry>
Aug 01 13:57:56 user nova-compute[72129]:       <entry name="serial">133076de-14b5-4ceb-aa41-d9acef8506c5</entry>
Aug 01 13:57:56 user nova-compute[72129]:       <entry name="uuid">133076de-14b5-4ceb-aa41-d9acef8506c5</entry>
Aug 01 13:57:56 user nova-compute[72129]:       <entry name="family">Virtual Machine</entry>
Aug 01 13:57:56 user nova-compute[72129]:     </system>
Aug 01 13:57:56 user nova-compute[72129]:   </sysinfo>
Aug 01 13:57:56 user nova-compute[72129]:   <os>
Aug 01 13:57:56 user nova-compute[72129]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 13:57:56 user nova-compute[72129]:     <boot dev="hd"/>
Aug 01 13:57:56 user nova-compute[72129]:     <smbios mode="sysinfo"/>
Aug 01 13:57:56 user nova-compute[72129]:   </os>
Aug 01 13:57:56 user nova-compute[72129]:   <features>
Aug 01 13:57:56 user nova-compute[72129]:     <acpi/>
Aug 01 13:57:56 user nova-compute[72129]:     <apic/>
Aug 01 13:57:56 user nova-compute[72129]:     <vmcoreinfo/>
Aug 01 13:57:56 user nova-compute[72129]:   </features>
Aug 01 13:57:56 user nova-compute[72129]:   <clock offset="utc">
Aug 01 13:57:56 user nova-compute[72129]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 13:57:56 user nova-compute[72129]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 13:57:56 user nova-compute[72129]:     <timer name="hpet" present="no"/>
Aug 01 13:57:56 user nova-compute[72129]:   </clock>
Aug 01 13:57:56 user nova-compute[72129]:   <cpu mode="custom" match="exact">
Aug 01 13:57:56 user nova-compute[72129]:     <model>Nehalem</model>
Aug 01 13:57:56 user nova-compute[72129]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 13:57:56 user nova-compute[72129]:   </cpu>
Aug 01 13:57:56 user nova-compute[72129]:   <devices>
Aug 01 13:57:56 user nova-compute[72129]:     <disk type="file" device="disk">
Aug 01 13:57:56 user nova-compute[72129]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 13:57:56 user nova-compute[72129]:       <source file="/opt/stack/data/nova/instances/133076de-14b5-4ceb-aa41-d9acef8506c5/disk"/>
Aug 01 13:57:56 user nova-compute[72129]:       <target dev="vda" bus="virtio"/>
Aug 01 13:57:56 user nova-compute[72129]:     </disk>
Aug 01 13:57:56 user nova-compute[72129]:     <disk type="block" device="disk">
Aug 01 13:57:56 user nova-compute[72129]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 13:57:56 user nova-compute[72129]:       <source dev="/dev/sdf"/>
Aug 01 13:57:56 user nova-compute[72129]:       <target dev="vdb" bus="virtio"/>
Aug 01 13:57:56 user nova-compute[72129]:       <serial>a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2</serial>
Aug 01 13:57:56 user nova-compute[72129]:     </disk>
Aug 01 13:57:56 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 13:57:56 user nova-compute[72129]:       <mac address="fa:16:3e:d3:ee:e0"/>
Aug 01 13:57:56 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 13:57:56 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 13:57:56 user nova-compute[72129]:       <target dev="tap09dc6abd-1d"/>
Aug 01 13:57:56 user nova-compute[72129]:     </interface>
Aug 01 13:57:56 user nova-compute[72129]:     <serial type="pty">
Aug 01 13:57:56 user nova-compute[72129]:       <log file="/opt/stack/data/nova/instances/133076de-14b5-4ceb-aa41-d9acef8506c5/console.log" append="off"/>
Aug 01 13:57:56 user nova-compute[72129]:     </serial>
Aug 01 13:57:56 user nova-compute[72129]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 13:57:56 user nova-compute[72129]:     <video>
Aug 01 13:57:56 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 13:57:56 user nova-compute[72129]:     </video>
Aug 01 13:57:56 user nova-compute[72129]:     <rng model="virtio">
Aug 01 13:57:56 user nova-compute[72129]:       <backend model="random">/dev/urandom</backend>
Aug 01 13:57:56 user nova-compute[72129]:     </rng>
Aug 01 13:57:56 user nova-compute[72129]:     <controller type="usb" index="0" model="none"/>
Aug 01 13:57:56 user nova-compute[72129]:     <memballoon model="virtio">
Aug 01 13:57:56 user nova-compute[72129]:       <stats period="10"/>
Aug 01 13:57:56 user nova-compute[72129]:     </memballoon>
Aug 01 13:57:56 user nova-compute[72129]:   </devices>
Aug 01 13:57:56 user nova-compute[72129]: </domain>
Aug 01 13:57:56 user nova-compute[72129]:  {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 13:57:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133076de-14b5-4ceb-aa41-d9acef8506c5/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:56 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[0069d196-a450-47de-b640-5f70ac41bc4e]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:56 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:57:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:56 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[4825555f-a0f7-48ed-b034-c1c0345e57b2]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:56 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:57:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v anVDsYRG {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:56 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v anVDsYRG" returned: 0 in 0.026s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:56 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[693571a0-f7fa-47db-84b4-77da3724d2a2]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:56 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'anVDsYRG'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:57:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:56 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:56 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:56 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[7460fb5f-5898-4354-9df2-bba75fe312f0]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:56 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:57:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:56 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133076de-14b5-4ceb-aa41-d9acef8506c5/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133076de-14b5-4ceb-aa41-d9acef8506c5/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:56 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8962a5-6ae6-495a-9c75-718abb47c1a3]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd0304ec-0e1c-42bf-bddd-0bd034f51691 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:56 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)
Aug 01 13:57:56 user nova-compute[72129]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 13:57:56 user nova-compute[72129]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f (non-flash)
Aug 01 13:57:56 user nova-compute[72129]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd0304ec-0e1c-42bf-bddd-0bd034f51691 (non-flash)
Aug 01 13:57:56 user nova-compute[72129]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 (non-flash)
Aug 01 13:57:56 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:57:56 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)
Aug 01 13:57:56 user nova-compute[72129]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 13:57:56 user nova-compute[72129]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f (non-flash)
Aug 01 13:57:56 user nova-compute[72129]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd0304ec-0e1c-42bf-bddd-0bd034f51691 (non-flash)
Aug 01 13:57:56 user nova-compute[72129]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 (non-flash)
Aug 01 13:57:56 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:57:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d -p 172.16.0.220:3260 --login {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133076de-14b5-4ceb-aa41-d9acef8506c5/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:56 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 13:57:56 user nova-compute[72129]: DEBUG nova.objects.instance [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lazy-loading 'trusted_certs' on Instance uuid 133076de-14b5-4ceb-aa41-d9acef8506c5 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:57:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/734c552304c5993ab26a647b4af83e454a57c1ec --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:57 user nova-compute[72129]: DEBUG nova.compute.manager [req-9439d6b8-a5d4-4bf2-8dab-6c29ab44990b req-98b17a5e-0bfb-4bca-9680-96478f61119e service nova] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] Received event network-vif-plugged-0c5a9562-3fb3-4983-8609-a81a74f572f9 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:57:57 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-9439d6b8-a5d4-4bf2-8dab-6c29ab44990b req-98b17a5e-0bfb-4bca-9680-96478f61119e service nova] Acquiring lock "53dc7cc0-a52f-4540-b2f7-8b947f272628-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:57:57 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-9439d6b8-a5d4-4bf2-8dab-6c29ab44990b req-98b17a5e-0bfb-4bca-9680-96478f61119e service nova] Lock "53dc7cc0-a52f-4540-b2f7-8b947f272628-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:57:57 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-9439d6b8-a5d4-4bf2-8dab-6c29ab44990b req-98b17a5e-0bfb-4bca-9680-96478f61119e service nova] Lock "53dc7cc0-a52f-4540-b2f7-8b947f272628-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:57:57 user nova-compute[72129]: DEBUG nova.compute.manager [req-9439d6b8-a5d4-4bf2-8dab-6c29ab44990b req-98b17a5e-0bfb-4bca-9680-96478f61119e service nova] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] No waiting events found dispatching network-vif-plugged-0c5a9562-3fb3-4983-8609-a81a74f572f9 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:57:57 user nova-compute[72129]: WARNING nova.compute.manager [req-9439d6b8-a5d4-4bf2-8dab-6c29ab44990b req-98b17a5e-0bfb-4bca-9680-96478f61119e service nova] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] Received unexpected event network-vif-plugged-0c5a9562-3fb3-4983-8609-a81a74f572f9 for instance with vm_state building and task_state spawning.
Aug 01 13:57:57 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d -p 172.16.0.220:3260 --login" returned: 0 in 0.266s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:57 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[1443e19d-6b22-49fe-9164-9b2126c31876]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:57 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d, portal: 172.16.0.220,3260]
Aug 01 13:57:57 user nova-compute[72129]: Login to [iface: default, target: iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d, portal: 172.16.0.220,3260] successful.
Aug 01 13:57:57 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:57:57 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:57 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/734c552304c5993ab26a647b4af83e454a57c1ec --force-share --output=json" returned: 0 in 0.155s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:57 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Checking if we can resize image /opt/stack/data/nova/instances/133076de-14b5-4ceb-aa41-d9acef8506c5/disk. size=1073741824 {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 13:57:57 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133076de-14b5-4ceb-aa41-d9acef8506c5/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:57 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:57 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0164b8b-c7b1-4b03-97d6-5bc5bd25e8b8]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:57 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:57:57 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:57 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:57 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d50429-7ba2-4d96-a6e6-32de648facb1]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd0304ec-0e1c-42bf-bddd-0bd034f51691 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:57 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)
Aug 01 13:57:57 user nova-compute[72129]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 13:57:57 user nova-compute[72129]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f (non-flash)
Aug 01 13:57:57 user nova-compute[72129]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd0304ec-0e1c-42bf-bddd-0bd034f51691 (non-flash)
Aug 01 13:57:57 user nova-compute[72129]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 (non-flash)
Aug 01 13:57:57 user nova-compute[72129]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d (non-flash)
Aug 01 13:57:57 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:57:57 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)
Aug 01 13:57:57 user nova-compute[72129]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 13:57:57 user nova-compute[72129]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f (non-flash)
Aug 01 13:57:57 user nova-compute[72129]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd0304ec-0e1c-42bf-bddd-0bd034f51691 (non-flash)
Aug 01 13:57:57 user nova-compute[72129]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 (non-flash)
Aug 01 13:57:57 user nova-compute[72129]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d (non-flash)
Aug 01 13:57:57 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:57:57 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.627s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:57:57 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Connected to 172.16.0.220:3260 {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 13:57:57 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] HCTL ('38', '-', '-', 0) found on session 27 with lun 0 {{(pid=72129) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 13:57:57 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72129) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 13:57:57 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:57:57 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:57 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e777740-286e-4cac-ac17-f6a97a9a389d]: (4, ('- - 0', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:57:57 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Searching for a device in session 27 and hctl ['38', '*', '*', 0] yield: None {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 13:57:57 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133076de-14b5-4ceb-aa41-d9acef8506c5/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:57:57 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Cannot resize image /opt/stack/data/nova/instances/133076de-14b5-4ceb-aa41-d9acef8506c5/disk to a smaller size. {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 13:57:57 user nova-compute[72129]: DEBUG nova.objects.instance [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lazy-loading 'migration_context' on Instance uuid 133076de-14b5-4ceb-aa41-d9acef8506c5 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:57:57 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:55:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-337029066',display_name='tempest-TestMinimumBasicScenario-server-337029066',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-337029066',id=17,image_ref='edea0658-dd0d-4712-83e7-608cd2089ee4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIF8pK0CTkVNfFPcWoAjeaWcCqpSHidxLzrNXnGzXid58N/NMzig5Fh+PrM0HmEtqXEVuFeC6ojSBtRRykq6gLAiPaZuHwOjhWv6j6ZSIDENuHN2kr+7tsEOeWGDThWqHw==',key_name='tempest-TestMinimumBasicScenario-1218723859',keypairs=<?>,launch_index=0,launched_at=2023-08-01T13:55:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='43253b37caa747b090b14c707abf96cf',ramdisk_id='',reservation_id='r-3dv71pgh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='edea0658-dd0d-4712-83e7-608cd2089ee4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-833844079',owner_user_name='tempest-TestMinimumBasicScenario-833844079-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:57:53Z,user_data=None,user_id='8acae20eb69f40c08bbe0799513b95e1',uuid=133076de-14b5-4ceb-aa41-d9acef8506c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "09dc6abd-1d55-4e2d-8568-1f793ca45413", "address": "fa:16:3e:d3:ee:e0", "network": {"id": "a7ec6cc0-140b-446b-ae97-d4aafbc42693", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-397303278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43253b37caa747b090b14c707abf96cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09dc6abd-1d", "ovs_interfaceid": "09dc6abd-1d55-4e2d-8568-1f793ca45413", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 13:57:57 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Converting VIF {"id": "09dc6abd-1d55-4e2d-8568-1f793ca45413", "address": "fa:16:3e:d3:ee:e0", "network": {"id": "a7ec6cc0-140b-446b-ae97-d4aafbc42693", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-397303278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43253b37caa747b090b14c707abf96cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09dc6abd-1d", "ovs_interfaceid": "09dc6abd-1d55-4e2d-8568-1f793ca45413", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:57:57 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:ee:e0,bridge_name='br-int',has_traffic_filtering=True,id=09dc6abd-1d55-4e2d-8568-1f793ca45413,network=Network(a7ec6cc0-140b-446b-ae97-d4aafbc42693),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09dc6abd-1d') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:57:57 user nova-compute[72129]: DEBUG os_vif [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:ee:e0,bridge_name='br-int',has_traffic_filtering=True,id=09dc6abd-1d55-4e2d-8568-1f793ca45413,network=Network(a7ec6cc0-140b-446b-ae97-d4aafbc42693),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09dc6abd-1d') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 13:57:57 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:57 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:57:57 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 13:57:57 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:57 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap09dc6abd-1d, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:57:57 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap09dc6abd-1d, col_values=(('external_ids', {'iface-id': '09dc6abd-1d55-4e2d-8568-1f793ca45413', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:ee:e0', 'vm-uuid': '133076de-14b5-4ceb-aa41-d9acef8506c5'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:57:57 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:57 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 13:57:57 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:57 user nova-compute[72129]: INFO os_vif [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:ee:e0,bridge_name='br-int',has_traffic_filtering=True,id=09dc6abd-1d55-4e2d-8568-1f793ca45413,network=Network(a7ec6cc0-140b-446b-ae97-d4aafbc42693),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09dc6abd-1d')
Aug 01 13:57:57 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:57 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:57 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:57 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:57 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:58 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Searching for a device in session 27 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 13:57:58 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'anVDsYRG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 13:57:58 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.664s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:57:58 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] <== connect_volume: return (3055ms) {'type': 'block', 'scsi_wwn': '23366656332633462', 'path': '/dev/sdg'} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:57:58 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366656332633462', 'path': '/dev/sdg'} {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 13:57:58 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:57:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1168215618',display_name='tempest-TestShelveInstance-server-1168215618',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1168215618',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNFarSMkiI7/JpPdcoHACAwX8uNCAoNCeZYHIIMICpbfXLOVKT0O+wIjjJ8GmZRehNvjG5JuqMkHRVBmF7oISjKtI62K0zyKSE4F/GhjI/49epXOdkazkwngdzB9LjRJNQ==',key_name='tempest-TestShelveInstance-909637078',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e0c65958662420fa6d8d73c5e9fdc25',ramdisk_id='',reservation_id='r-xsrkrpme',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-419749450',owner_user_name='tempest-TestShelveInstance-419749450-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:57:46Z,user_data=None,user_id='fde5b0e7d7664dfe9f4d9ce0dc20a8e4',uuid=8e5e94dd-b575-48f1-a617-1bd917567220,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04bc1afa-2e8a-4dd9-961f-e695f43e3061", "address": "fa:16:3e:69:a4:f0", "network": {"id": "567d2893-d3e8-41e1-a0fe-4414df317d0c", "bridge": "br-int", "label": "tempest-TestShelveInstance-887577340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e0c65958662420fa6d8d73c5e9fdc25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04bc1afa-2e", "ovs_interfaceid": "04bc1afa-2e8a-4dd9-961f-e695f43e3061", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 13:57:58 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Converting VIF {"id": "04bc1afa-2e8a-4dd9-961f-e695f43e3061", "address": "fa:16:3e:69:a4:f0", "network": {"id": "567d2893-d3e8-41e1-a0fe-4414df317d0c", "bridge": "br-int", "label": "tempest-TestShelveInstance-887577340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e0c65958662420fa6d8d73c5e9fdc25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04bc1afa-2e", "ovs_interfaceid": "04bc1afa-2e8a-4dd9-961f-e695f43e3061", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:57:58 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:a4:f0,bridge_name='br-int',has_traffic_filtering=True,id=04bc1afa-2e8a-4dd9-961f-e695f43e3061,network=Network(567d2893-d3e8-41e1-a0fe-4414df317d0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04bc1afa-2e') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:57:58 user nova-compute[72129]: DEBUG nova.objects.instance [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Lazy-loading 'pci_devices' on Instance uuid 8e5e94dd-b575-48f1-a617-1bd917567220 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:57:58 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] End _get_guest_xml xml=<domain type="kvm">
Aug 01 13:57:58 user nova-compute[72129]:   <uuid>8e5e94dd-b575-48f1-a617-1bd917567220</uuid>
Aug 01 13:57:58 user nova-compute[72129]:   <name>instance-00000016</name>
Aug 01 13:57:58 user nova-compute[72129]:   <memory>524288</memory>
Aug 01 13:57:58 user nova-compute[72129]:   <vcpu>1</vcpu>
Aug 01 13:57:58 user nova-compute[72129]:   <metadata>
Aug 01 13:57:58 user nova-compute[72129]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 13:57:58 user nova-compute[72129]:       <nova:package version="0.0.0"/>
Aug 01 13:57:58 user nova-compute[72129]:       <nova:name>tempest-TestShelveInstance-server-1168215618</nova:name>
Aug 01 13:57:58 user nova-compute[72129]:       <nova:creationTime>2023-08-01 13:57:55</nova:creationTime>
Aug 01 13:57:58 user nova-compute[72129]:       <nova:flavor name="m1.tiny">
Aug 01 13:57:58 user nova-compute[72129]:         <nova:memory>512</nova:memory>
Aug 01 13:57:58 user nova-compute[72129]:         <nova:disk>1</nova:disk>
Aug 01 13:57:58 user nova-compute[72129]:         <nova:swap>0</nova:swap>
Aug 01 13:57:58 user nova-compute[72129]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 13:57:58 user nova-compute[72129]:         <nova:vcpus>1</nova:vcpus>
Aug 01 13:57:58 user nova-compute[72129]:       </nova:flavor>
Aug 01 13:57:58 user nova-compute[72129]:       <nova:owner>
Aug 01 13:57:58 user nova-compute[72129]:         <nova:user uuid="fde5b0e7d7664dfe9f4d9ce0dc20a8e4">tempest-TestShelveInstance-419749450-project-member</nova:user>
Aug 01 13:57:58 user nova-compute[72129]:         <nova:project uuid="4e0c65958662420fa6d8d73c5e9fdc25">tempest-TestShelveInstance-419749450</nova:project>
Aug 01 13:57:58 user nova-compute[72129]:       </nova:owner>
Aug 01 13:57:58 user nova-compute[72129]:       <nova:ports>
Aug 01 13:57:58 user nova-compute[72129]:         <nova:port uuid="04bc1afa-2e8a-4dd9-961f-e695f43e3061">
Aug 01 13:57:58 user nova-compute[72129]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 01 13:57:58 user nova-compute[72129]:         </nova:port>
Aug 01 13:57:58 user nova-compute[72129]:       </nova:ports>
Aug 01 13:57:58 user nova-compute[72129]:     </nova:instance>
Aug 01 13:57:58 user nova-compute[72129]:   </metadata>
Aug 01 13:57:58 user nova-compute[72129]:   <sysinfo type="smbios">
Aug 01 13:57:58 user nova-compute[72129]:     <system>
Aug 01 13:57:58 user nova-compute[72129]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 13:57:58 user nova-compute[72129]:       <entry name="product">OpenStack Nova</entry>
Aug 01 13:57:58 user nova-compute[72129]:       <entry name="version">0.0.0</entry>
Aug 01 13:57:58 user nova-compute[72129]:       <entry name="serial">8e5e94dd-b575-48f1-a617-1bd917567220</entry>
Aug 01 13:57:58 user nova-compute[72129]:       <entry name="uuid">8e5e94dd-b575-48f1-a617-1bd917567220</entry>
Aug 01 13:57:58 user nova-compute[72129]:       <entry name="family">Virtual Machine</entry>
Aug 01 13:57:58 user nova-compute[72129]:     </system>
Aug 01 13:57:58 user nova-compute[72129]:   </sysinfo>
Aug 01 13:57:58 user nova-compute[72129]:   <os>
Aug 01 13:57:58 user nova-compute[72129]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 13:57:58 user nova-compute[72129]:     <boot dev="hd"/>
Aug 01 13:57:58 user nova-compute[72129]:     <smbios mode="sysinfo"/>
Aug 01 13:57:58 user nova-compute[72129]:   </os>
Aug 01 13:57:58 user nova-compute[72129]:   <features>
Aug 01 13:57:58 user nova-compute[72129]:     <acpi/>
Aug 01 13:57:58 user nova-compute[72129]:     <apic/>
Aug 01 13:57:58 user nova-compute[72129]:     <vmcoreinfo/>
Aug 01 13:57:58 user nova-compute[72129]:   </features>
Aug 01 13:57:58 user nova-compute[72129]:   <clock offset="utc">
Aug 01 13:57:58 user nova-compute[72129]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 13:57:58 user nova-compute[72129]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 13:57:58 user nova-compute[72129]:     <timer name="hpet" present="no"/>
Aug 01 13:57:58 user nova-compute[72129]:   </clock>
Aug 01 13:57:58 user nova-compute[72129]:   <cpu mode="custom" match="exact">
Aug 01 13:57:58 user nova-compute[72129]:     <model>Nehalem</model>
Aug 01 13:57:58 user nova-compute[72129]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 13:57:58 user nova-compute[72129]:   </cpu>
Aug 01 13:57:58 user nova-compute[72129]:   <devices>
Aug 01 13:57:58 user nova-compute[72129]:     <disk type="block" device="disk">
Aug 01 13:57:58 user nova-compute[72129]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 13:57:58 user nova-compute[72129]:       <source dev="/dev/sdg"/>
Aug 01 13:57:58 user nova-compute[72129]:       <target dev="vda" bus="virtio"/>
Aug 01 13:57:58 user nova-compute[72129]:       <serial>9e4d6571-fba3-42fe-9abd-cddd72d2c46d</serial>
Aug 01 13:57:58 user nova-compute[72129]:     </disk>
Aug 01 13:57:58 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 13:57:58 user nova-compute[72129]:       <mac address="fa:16:3e:69:a4:f0"/>
Aug 01 13:57:58 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 13:57:58 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 13:57:58 user nova-compute[72129]:       <target dev="tap04bc1afa-2e"/>
Aug 01 13:57:58 user nova-compute[72129]:     </interface>
Aug 01 13:57:58 user nova-compute[72129]:     <serial type="pty">
Aug 01 13:57:58 user nova-compute[72129]:       <log file="/opt/stack/data/nova/instances/8e5e94dd-b575-48f1-a617-1bd917567220/console.log" append="off"/>
Aug 01 13:57:58 user nova-compute[72129]:     </serial>
Aug 01 13:57:58 user nova-compute[72129]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 13:57:58 user nova-compute[72129]:     <video>
Aug 01 13:57:58 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 13:57:58 user nova-compute[72129]:     </video>
Aug 01 13:57:58 user nova-compute[72129]:     <rng model="virtio">
Aug 01 13:57:58 user nova-compute[72129]:       <backend model="random">/dev/urandom</backend>
Aug 01 13:57:58 user nova-compute[72129]:     </rng>
Aug 01 13:57:58 user nova-compute[72129]:     <controller type="usb" index="0" model="none"/>
Aug 01 13:57:58 user nova-compute[72129]:     <memballoon model="virtio">
Aug 01 13:57:58 user nova-compute[72129]:       <stats period="10"/>
Aug 01 13:57:58 user nova-compute[72129]:     </memballoon>
Aug 01 13:57:58 user nova-compute[72129]:   </devices>
Aug 01 13:57:58 user nova-compute[72129]: </domain>
Aug 01 13:57:58 user nova-compute[72129]:  {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 13:57:58 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:57:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1168215618',display_name='tempest-TestShelveInstance-server-1168215618',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1168215618',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNFarSMkiI7/JpPdcoHACAwX8uNCAoNCeZYHIIMICpbfXLOVKT0O+wIjjJ8GmZRehNvjG5JuqMkHRVBmF7oISjKtI62K0zyKSE4F/GhjI/49epXOdkazkwngdzB9LjRJNQ==',key_name='tempest-TestShelveInstance-909637078',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e0c65958662420fa6d8d73c5e9fdc25',ramdisk_id='',reservation_id='r-xsrkrpme',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-419749450',owner_user_name='tempest-TestShelveInstance-419749450-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:57:46Z,user_data=None,user_id='fde5b0e7d7664dfe9f4d9ce0dc20a8e4',uuid=8e5e94dd-b575-48f1-a617-1bd917567220,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04bc1afa-2e8a-4dd9-961f-e695f43e3061", "address": "fa:16:3e:69:a4:f0", "network": {"id": "567d2893-d3e8-41e1-a0fe-4414df317d0c", "bridge": "br-int", "label": "tempest-TestShelveInstance-887577340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e0c65958662420fa6d8d73c5e9fdc25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04bc1afa-2e", "ovs_interfaceid": "04bc1afa-2e8a-4dd9-961f-e695f43e3061", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 13:57:58 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Converting VIF {"id": "04bc1afa-2e8a-4dd9-961f-e695f43e3061", "address": "fa:16:3e:69:a4:f0", "network": {"id": "567d2893-d3e8-41e1-a0fe-4414df317d0c", "bridge": "br-int", "label": "tempest-TestShelveInstance-887577340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e0c65958662420fa6d8d73c5e9fdc25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04bc1afa-2e", "ovs_interfaceid": "04bc1afa-2e8a-4dd9-961f-e695f43e3061", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:57:58 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:a4:f0,bridge_name='br-int',has_traffic_filtering=True,id=04bc1afa-2e8a-4dd9-961f-e695f43e3061,network=Network(567d2893-d3e8-41e1-a0fe-4414df317d0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04bc1afa-2e') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:57:58 user nova-compute[72129]: DEBUG os_vif [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:a4:f0,bridge_name='br-int',has_traffic_filtering=True,id=04bc1afa-2e8a-4dd9-961f-e695f43e3061,network=Network(567d2893-d3e8-41e1-a0fe-4414df317d0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04bc1afa-2e') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 13:57:58 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:58 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:57:58 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 13:57:58 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:58 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap04bc1afa-2e, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:57:58 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap04bc1afa-2e, col_values=(('external_ids', {'iface-id': '04bc1afa-2e8a-4dd9-961f-e695f43e3061', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:a4:f0', 'vm-uuid': '8e5e94dd-b575-48f1-a617-1bd917567220'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:57:58 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:58 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 13:57:58 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:58 user nova-compute[72129]: INFO os_vif [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:a4:f0,bridge_name='br-int',has_traffic_filtering=True,id=04bc1afa-2e8a-4dd9-961f-e695f43e3061,network=Network(567d2893-d3e8-41e1-a0fe-4414df317d0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04bc1afa-2e')
Aug 01 13:57:58 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 13:57:58 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] No VIF found with MAC fa:16:3e:69:a4:f0, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 13:57:59 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:59 user nova-compute[72129]: DEBUG nova.compute.manager [req-fac71f72-7ec6-44a5-a77a-a023f45a69dd req-a979536b-2e4c-4d34-a7dc-224d50a8e94b service nova] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] Received event network-vif-plugged-0c5a9562-3fb3-4983-8609-a81a74f572f9 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:57:59 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-fac71f72-7ec6-44a5-a77a-a023f45a69dd req-a979536b-2e4c-4d34-a7dc-224d50a8e94b service nova] Acquiring lock "53dc7cc0-a52f-4540-b2f7-8b947f272628-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:57:59 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-fac71f72-7ec6-44a5-a77a-a023f45a69dd req-a979536b-2e4c-4d34-a7dc-224d50a8e94b service nova] Lock "53dc7cc0-a52f-4540-b2f7-8b947f272628-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:57:59 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-fac71f72-7ec6-44a5-a77a-a023f45a69dd req-a979536b-2e4c-4d34-a7dc-224d50a8e94b service nova] Lock "53dc7cc0-a52f-4540-b2f7-8b947f272628-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:57:59 user nova-compute[72129]: DEBUG nova.compute.manager [req-fac71f72-7ec6-44a5-a77a-a023f45a69dd req-a979536b-2e4c-4d34-a7dc-224d50a8e94b service nova] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] No waiting events found dispatching network-vif-plugged-0c5a9562-3fb3-4983-8609-a81a74f572f9 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:57:59 user nova-compute[72129]: WARNING nova.compute.manager [req-fac71f72-7ec6-44a5-a77a-a023f45a69dd req-a979536b-2e4c-4d34-a7dc-224d50a8e94b service nova] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] Received unexpected event network-vif-plugged-0c5a9562-3fb3-4983-8609-a81a74f572f9 for instance with vm_state building and task_state spawning.
Aug 01 13:57:59 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:59 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:59 user nova-compute[72129]: DEBUG nova.compute.manager [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] Instance event wait completed in 0 seconds for  {{(pid=72129) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 13:57:59 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] Guest created on hypervisor {{(pid=72129) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 13:57:59 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898279.250949, 53dc7cc0-a52f-4540-b2f7-8b947f272628 => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:57:59 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] VM Resumed (Lifecycle Event)
Aug 01 13:57:59 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:57:59 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] Instance spawned successfully.
Aug 01 13:57:59 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 13:57:59 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 13:57:59 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 13:57:59 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898279.2510798, 53dc7cc0-a52f-4540-b2f7-8b947f272628 => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:57:59 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] VM Started (Lifecycle Event)
Aug 01 13:57:59 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] Found default for hw_cdrom_bus of ide {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:57:59 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] Found default for hw_disk_bus of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:57:59 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] Found default for hw_input_bus of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:57:59 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] Found default for hw_pointer_model of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:57:59 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] Found default for hw_video_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:57:59 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] Found default for hw_vif_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:57:59 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:57:59 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 13:57:59 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 13:57:59 user nova-compute[72129]: INFO nova.compute.manager [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] Took 5.94 seconds to spawn the instance on the hypervisor.
Aug 01 13:57:59 user nova-compute[72129]: DEBUG nova.compute.manager [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:57:59 user nova-compute[72129]: INFO nova.compute.manager [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] Took 21.76 seconds to build instance.
Aug 01 13:57:59 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-21c97df8-1870-4d43-9feb-b4f2a9da89de tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "53dc7cc0-a52f-4540-b2f7-8b947f272628" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.882s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:57:59 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:59 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:59 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:59 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:57:59 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:58:00 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:58:00 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:58:00 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:58:00 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:58:01 user nova-compute[72129]: DEBUG nova.compute.manager [req-f351a325-57b1-47ea-8194-1c63c06ee88a req-82d67006-933e-4d28-828b-0fb24ece8e5f service nova] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Received event network-vif-plugged-09dc6abd-1d55-4e2d-8568-1f793ca45413 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:58:01 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f351a325-57b1-47ea-8194-1c63c06ee88a req-82d67006-933e-4d28-828b-0fb24ece8e5f service nova] Acquiring lock "133076de-14b5-4ceb-aa41-d9acef8506c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:58:01 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f351a325-57b1-47ea-8194-1c63c06ee88a req-82d67006-933e-4d28-828b-0fb24ece8e5f service nova] Lock "133076de-14b5-4ceb-aa41-d9acef8506c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.009s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:58:01 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f351a325-57b1-47ea-8194-1c63c06ee88a req-82d67006-933e-4d28-828b-0fb24ece8e5f service nova] Lock "133076de-14b5-4ceb-aa41-d9acef8506c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:58:01 user nova-compute[72129]: DEBUG nova.compute.manager [req-f351a325-57b1-47ea-8194-1c63c06ee88a req-82d67006-933e-4d28-828b-0fb24ece8e5f service nova] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] No waiting events found dispatching network-vif-plugged-09dc6abd-1d55-4e2d-8568-1f793ca45413 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:58:01 user nova-compute[72129]: WARNING nova.compute.manager [req-f351a325-57b1-47ea-8194-1c63c06ee88a req-82d67006-933e-4d28-828b-0fb24ece8e5f service nova] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Received unexpected event network-vif-plugged-09dc6abd-1d55-4e2d-8568-1f793ca45413 for instance with vm_state active and task_state reboot_started_hard.
Aug 01 13:58:01 user nova-compute[72129]: DEBUG nova.compute.manager [req-f351a325-57b1-47ea-8194-1c63c06ee88a req-82d67006-933e-4d28-828b-0fb24ece8e5f service nova] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Received event network-vif-plugged-09dc6abd-1d55-4e2d-8568-1f793ca45413 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:58:01 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f351a325-57b1-47ea-8194-1c63c06ee88a req-82d67006-933e-4d28-828b-0fb24ece8e5f service nova] Acquiring lock "133076de-14b5-4ceb-aa41-d9acef8506c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:58:01 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f351a325-57b1-47ea-8194-1c63c06ee88a req-82d67006-933e-4d28-828b-0fb24ece8e5f service nova] Lock "133076de-14b5-4ceb-aa41-d9acef8506c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:58:01 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f351a325-57b1-47ea-8194-1c63c06ee88a req-82d67006-933e-4d28-828b-0fb24ece8e5f service nova] Lock "133076de-14b5-4ceb-aa41-d9acef8506c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:58:01 user nova-compute[72129]: DEBUG nova.compute.manager [req-f351a325-57b1-47ea-8194-1c63c06ee88a req-82d67006-933e-4d28-828b-0fb24ece8e5f service nova] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] No waiting events found dispatching network-vif-plugged-09dc6abd-1d55-4e2d-8568-1f793ca45413 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:58:01 user nova-compute[72129]: WARNING nova.compute.manager [req-f351a325-57b1-47ea-8194-1c63c06ee88a req-82d67006-933e-4d28-828b-0fb24ece8e5f service nova] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Received unexpected event network-vif-plugged-09dc6abd-1d55-4e2d-8568-1f793ca45413 for instance with vm_state active and task_state reboot_started_hard.
Aug 01 13:58:01 user nova-compute[72129]: DEBUG nova.compute.manager [req-f351a325-57b1-47ea-8194-1c63c06ee88a req-82d67006-933e-4d28-828b-0fb24ece8e5f service nova] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Received event network-vif-plugged-04bc1afa-2e8a-4dd9-961f-e695f43e3061 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:58:01 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f351a325-57b1-47ea-8194-1c63c06ee88a req-82d67006-933e-4d28-828b-0fb24ece8e5f service nova] Acquiring lock "8e5e94dd-b575-48f1-a617-1bd917567220-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:58:01 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f351a325-57b1-47ea-8194-1c63c06ee88a req-82d67006-933e-4d28-828b-0fb24ece8e5f service nova] Lock "8e5e94dd-b575-48f1-a617-1bd917567220-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:58:01 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f351a325-57b1-47ea-8194-1c63c06ee88a req-82d67006-933e-4d28-828b-0fb24ece8e5f service nova] Lock "8e5e94dd-b575-48f1-a617-1bd917567220-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:58:01 user nova-compute[72129]: DEBUG nova.compute.manager [req-f351a325-57b1-47ea-8194-1c63c06ee88a req-82d67006-933e-4d28-828b-0fb24ece8e5f service nova] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] No waiting events found dispatching network-vif-plugged-04bc1afa-2e8a-4dd9-961f-e695f43e3061 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:58:01 user nova-compute[72129]: WARNING nova.compute.manager [req-f351a325-57b1-47ea-8194-1c63c06ee88a req-82d67006-933e-4d28-828b-0fb24ece8e5f service nova] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Received unexpected event network-vif-plugged-04bc1afa-2e8a-4dd9-961f-e695f43e3061 for instance with vm_state building and task_state spawning.
Aug 01 13:58:01 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:58:01 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:58:02 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Removed pending event for 133076de-14b5-4ceb-aa41-d9acef8506c5 due to event {{(pid=72129) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 13:58:02 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898282.9818552, 133076de-14b5-4ceb-aa41-d9acef8506c5 => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:58:02 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] VM Resumed (Lifecycle Event)
Aug 01 13:58:02 user nova-compute[72129]: DEBUG nova.compute.manager [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Instance event wait completed in 0 seconds for  {{(pid=72129) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 13:58:02 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Instance rebooted successfully.
Aug 01 13:58:02 user nova-compute[72129]: DEBUG nova.compute.manager [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:58:03 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:58:03 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 13:58:03 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 01 13:58:03 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898282.9857352, 133076de-14b5-4ceb-aa41-d9acef8506c5 => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:58:03 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] VM Started (Lifecycle Event)
Aug 01 13:58:03 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d39216a3-3a23-40f9-9b26-fccc4bf8b21c tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lock "133076de-14b5-4ceb-aa41-d9acef8506c5" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 11.278s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:58:03 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:58:03 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 13:58:03 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898283.1189218, 8e5e94dd-b575-48f1-a617-1bd917567220 => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:58:03 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] VM Resumed (Lifecycle Event)
Aug 01 13:58:03 user nova-compute[72129]: DEBUG nova.compute.manager [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Instance event wait completed in 0 seconds for  {{(pid=72129) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 13:58:03 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Guest created on hypervisor {{(pid=72129) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 13:58:03 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Instance spawned successfully.
Aug 01 13:58:03 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 13:58:03 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:58:03 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Found default for hw_cdrom_bus of ide {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:58:03 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Found default for hw_disk_bus of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:58:03 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Found default for hw_input_bus of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:58:03 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Found default for hw_pointer_model of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:58:03 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Found default for hw_video_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:58:03 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Found default for hw_vif_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:58:03 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 13:58:03 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 13:58:03 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898283.1218386, 8e5e94dd-b575-48f1-a617-1bd917567220 => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:58:03 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] VM Started (Lifecycle Event)
Aug 01 13:58:03 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:58:03 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 13:58:03 user nova-compute[72129]: INFO nova.compute.manager [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Took 8.16 seconds to spawn the instance on the hypervisor.
Aug 01 13:58:03 user nova-compute[72129]: DEBUG nova.compute.manager [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:58:03 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 13:58:03 user nova-compute[72129]: DEBUG nova.compute.manager [req-f80c929e-01d3-46db-80f9-7751be62624d req-dcd7227e-e6db-4de8-bca6-7be41c5aebaa service nova] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Received event network-vif-plugged-04bc1afa-2e8a-4dd9-961f-e695f43e3061 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:58:03 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f80c929e-01d3-46db-80f9-7751be62624d req-dcd7227e-e6db-4de8-bca6-7be41c5aebaa service nova] Acquiring lock "8e5e94dd-b575-48f1-a617-1bd917567220-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:58:03 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f80c929e-01d3-46db-80f9-7751be62624d req-dcd7227e-e6db-4de8-bca6-7be41c5aebaa service nova] Lock "8e5e94dd-b575-48f1-a617-1bd917567220-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:58:03 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f80c929e-01d3-46db-80f9-7751be62624d req-dcd7227e-e6db-4de8-bca6-7be41c5aebaa service nova] Lock "8e5e94dd-b575-48f1-a617-1bd917567220-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:58:03 user nova-compute[72129]: DEBUG nova.compute.manager [req-f80c929e-01d3-46db-80f9-7751be62624d req-dcd7227e-e6db-4de8-bca6-7be41c5aebaa service nova] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] No waiting events found dispatching network-vif-plugged-04bc1afa-2e8a-4dd9-961f-e695f43e3061 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:58:03 user nova-compute[72129]: WARNING nova.compute.manager [req-f80c929e-01d3-46db-80f9-7751be62624d req-dcd7227e-e6db-4de8-bca6-7be41c5aebaa service nova] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Received unexpected event network-vif-plugged-04bc1afa-2e8a-4dd9-961f-e695f43e3061 for instance with vm_state building and task_state spawning.
Aug 01 13:58:03 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:58:03 user nova-compute[72129]: INFO nova.compute.manager [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Took 17.87 seconds to build instance.
Aug 01 13:58:03 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-bc76b1d6-ca1b-424a-acb0-094884c0a386 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Lock "8e5e94dd-b575-48f1-a617-1bd917567220" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.972s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:58:05 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:58:08 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:58:13 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 13:58:14 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c8d36824-374d-47ee-9c33-4c3ceb09094c tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] Acquiring lock "28164e90-f7ad-4f7e-9dcf-2fc750201342" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:58:14 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c8d36824-374d-47ee-9c33-4c3ceb09094c tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] Lock "28164e90-f7ad-4f7e-9dcf-2fc750201342" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:58:14 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c8d36824-374d-47ee-9c33-4c3ceb09094c tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] Acquiring lock "28164e90-f7ad-4f7e-9dcf-2fc750201342-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:58:14 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c8d36824-374d-47ee-9c33-4c3ceb09094c tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] Lock "28164e90-f7ad-4f7e-9dcf-2fc750201342-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:58:14 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c8d36824-374d-47ee-9c33-4c3ceb09094c tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] Lock "28164e90-f7ad-4f7e-9dcf-2fc750201342-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:58:14 user nova-compute[72129]: INFO nova.compute.manager [None req-c8d36824-374d-47ee-9c33-4c3ceb09094c tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] [instance: 28164e90-f7ad-4f7e-9dcf-2fc750201342] Terminating instance
Aug 01 13:58:14 user nova-compute[72129]: DEBUG nova.compute.manager [None req-c8d36824-374d-47ee-9c33-4c3ceb09094c tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] [instance: 28164e90-f7ad-4f7e-9dcf-2fc750201342] Start destroying the instance on the hypervisor. {{(pid=72129) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 13:58:14 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:58:14 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:58:14 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:58:14 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:58:14 user nova-compute[72129]: DEBUG nova.compute.manager [req-8b70818f-dc8c-4b77-af7e-40cfd06daf55 req-391992de-2291-44d5-902c-9bbcada72226 service nova] [instance: 28164e90-f7ad-4f7e-9dcf-2fc750201342] Received event network-vif-unplugged-a5c1a737-6ce0-4826-b20b-8d288bdd4283 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:58:14 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-8b70818f-dc8c-4b77-af7e-40cfd06daf55 req-391992de-2291-44d5-902c-9bbcada72226 service nova] Acquiring lock "28164e90-f7ad-4f7e-9dcf-2fc750201342-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:58:14 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-8b70818f-dc8c-4b77-af7e-40cfd06daf55 req-391992de-2291-44d5-902c-9bbcada72226 service nova] Lock "28164e90-f7ad-4f7e-9dcf-2fc750201342-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:58:14 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-8b70818f-dc8c-4b77-af7e-40cfd06daf55 req-391992de-2291-44d5-902c-9bbcada72226 service nova] Lock "28164e90-f7ad-4f7e-9dcf-2fc750201342-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:58:14 user nova-compute[72129]: DEBUG nova.compute.manager [req-8b70818f-dc8c-4b77-af7e-40cfd06daf55 req-391992de-2291-44d5-902c-9bbcada72226 service nova] [instance: 28164e90-f7ad-4f7e-9dcf-2fc750201342] No waiting events found dispatching network-vif-unplugged-a5c1a737-6ce0-4826-b20b-8d288bdd4283 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:58:14 user nova-compute[72129]: DEBUG nova.compute.manager [req-8b70818f-dc8c-4b77-af7e-40cfd06daf55 req-391992de-2291-44d5-902c-9bbcada72226 service nova] [instance: 28164e90-f7ad-4f7e-9dcf-2fc750201342] Received event network-vif-unplugged-a5c1a737-6ce0-4826-b20b-8d288bdd4283 for instance with task_state deleting. {{(pid=72129) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 13:58:14 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 28164e90-f7ad-4f7e-9dcf-2fc750201342] Instance destroyed successfully.
Aug 01 13:58:14 user nova-compute[72129]: DEBUG nova.objects.instance [None req-c8d36824-374d-47ee-9c33-4c3ceb09094c tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] Lazy-loading 'resources' on Instance uuid 28164e90-f7ad-4f7e-9dcf-2fc750201342 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:58:14 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-c8d36824-374d-47ee-9c33-4c3ceb09094c tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:56:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-886630369',display_name='tempest-VolumesNegativeTest-instance-886630369',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-886630369',id=18,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T13:56:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='149eac1fb49640de8b72140d879aea84',ramdisk_id='',reservation_id='r-onkmwbi9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1214026803',owner_user_name='tempest-VolumesNegativeTest-1214026803-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T13:56:31Z,user_data=None,user_id='b3277c75916d4781aff0a0f99951380e',uuid=28164e90-f7ad-4f7e-9dcf-2fc750201342,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a5c1a737-6ce0-4826-b20b-8d288bdd4283", "address": "fa:16:3e:9a:fa:ec", "network": {"id": "d1324d81-9cdd-4788-b5a6-319e831b3723", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c51a048b091340dab769abbab323121d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c1a737-6c", "ovs_interfaceid": "a5c1a737-6ce0-4826-b20b-8d288bdd4283", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 13:58:14 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-c8d36824-374d-47ee-9c33-4c3ceb09094c tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] Converting VIF {"id": "a5c1a737-6ce0-4826-b20b-8d288bdd4283", "address": "fa:16:3e:9a:fa:ec", "network": {"id": "d1324d81-9cdd-4788-b5a6-319e831b3723", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c51a048b091340dab769abbab323121d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c1a737-6c", "ovs_interfaceid": "a5c1a737-6ce0-4826-b20b-8d288bdd4283", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:58:14 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-c8d36824-374d-47ee-9c33-4c3ceb09094c tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:fa:ec,bridge_name='br-int',has_traffic_filtering=True,id=a5c1a737-6ce0-4826-b20b-8d288bdd4283,network=Network(d1324d81-9cdd-4788-b5a6-319e831b3723),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5c1a737-6c') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:58:14 user nova-compute[72129]: DEBUG os_vif [None req-c8d36824-374d-47ee-9c33-4c3ceb09094c tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:fa:ec,bridge_name='br-int',has_traffic_filtering=True,id=a5c1a737-6ce0-4826-b20b-8d288bdd4283,network=Network(d1324d81-9cdd-4788-b5a6-319e831b3723),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5c1a737-6c') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 13:58:14 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:58:14 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa5c1a737-6c, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:58:14 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 13:58:14 user nova-compute[72129]: INFO os_vif [None req-c8d36824-374d-47ee-9c33-4c3ceb09094c tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:fa:ec,bridge_name='br-int',has_traffic_filtering=True,id=a5c1a737-6ce0-4826-b20b-8d288bdd4283,network=Network(d1324d81-9cdd-4788-b5a6-319e831b3723),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5c1a737-6c')
Aug 01 13:58:14 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-c8d36824-374d-47ee-9c33-4c3ceb09094c tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] [instance: 28164e90-f7ad-4f7e-9dcf-2fc750201342] Deleting instance files /opt/stack/data/nova/instances/28164e90-f7ad-4f7e-9dcf-2fc750201342_del
Aug 01 13:58:14 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-c8d36824-374d-47ee-9c33-4c3ceb09094c tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] [instance: 28164e90-f7ad-4f7e-9dcf-2fc750201342] Deletion of /opt/stack/data/nova/instances/28164e90-f7ad-4f7e-9dcf-2fc750201342_del complete
Aug 01 13:58:14 user nova-compute[72129]: INFO nova.compute.manager [None req-c8d36824-374d-47ee-9c33-4c3ceb09094c tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] [instance: 28164e90-f7ad-4f7e-9dcf-2fc750201342] Took 0.77 seconds to destroy the instance on the hypervisor.
Aug 01 13:58:14 user nova-compute[72129]: DEBUG oslo.service.loopingcall [None req-c8d36824-374d-47ee-9c33-4c3ceb09094c tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72129) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 13:58:14 user nova-compute[72129]: DEBUG nova.compute.manager [-] [instance: 28164e90-f7ad-4f7e-9dcf-2fc750201342] Deallocating network for instance {{(pid=72129) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 13:58:14 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 28164e90-f7ad-4f7e-9dcf-2fc750201342] deallocate_for_instance() {{(pid=72129) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 13:58:15 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 28164e90-f7ad-4f7e-9dcf-2fc750201342] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:58:15 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 28164e90-f7ad-4f7e-9dcf-2fc750201342] Took 0.53 seconds to deallocate network for instance.
Aug 01 13:58:15 user nova-compute[72129]: DEBUG nova.compute.manager [req-e2a286aa-ae80-446f-8202-253c8a15026d req-af1c3641-b5b2-4ddc-b2c9-6e117f4dd0fc service nova] [instance: 28164e90-f7ad-4f7e-9dcf-2fc750201342] Received event network-vif-deleted-a5c1a737-6ce0-4826-b20b-8d288bdd4283 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:58:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c8d36824-374d-47ee-9c33-4c3ceb09094c tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:58:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c8d36824-374d-47ee-9c33-4c3ceb09094c tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:58:15 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:58:15 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-c8d36824-374d-47ee-9c33-4c3ceb09094c tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 13:58:15 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-c8d36824-374d-47ee-9c33-4c3ceb09094c tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 13:58:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c8d36824-374d-47ee-9c33-4c3ceb09094c tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.346s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:58:15 user nova-compute[72129]: INFO nova.scheduler.client.report [None req-c8d36824-374d-47ee-9c33-4c3ceb09094c tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] Deleted allocations for instance 28164e90-f7ad-4f7e-9dcf-2fc750201342
Aug 01 13:58:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c8d36824-374d-47ee-9c33-4c3ceb09094c tempest-VolumesNegativeTest-1214026803 tempest-VolumesNegativeTest-1214026803-project-member] Lock "28164e90-f7ad-4f7e-9dcf-2fc750201342" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.838s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:58:16 user nova-compute[72129]: DEBUG nova.compute.manager [req-a0d2f593-ae2a-4ff7-b781-da885f73c57b req-854e84fa-d1c6-4fa3-912d-f1f2ad69260a service nova] [instance: 28164e90-f7ad-4f7e-9dcf-2fc750201342] Received event network-vif-plugged-a5c1a737-6ce0-4826-b20b-8d288bdd4283 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:58:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-a0d2f593-ae2a-4ff7-b781-da885f73c57b req-854e84fa-d1c6-4fa3-912d-f1f2ad69260a service nova] Acquiring lock "28164e90-f7ad-4f7e-9dcf-2fc750201342-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:58:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-a0d2f593-ae2a-4ff7-b781-da885f73c57b req-854e84fa-d1c6-4fa3-912d-f1f2ad69260a service nova] Lock "28164e90-f7ad-4f7e-9dcf-2fc750201342-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:58:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-a0d2f593-ae2a-4ff7-b781-da885f73c57b req-854e84fa-d1c6-4fa3-912d-f1f2ad69260a service nova] Lock "28164e90-f7ad-4f7e-9dcf-2fc750201342-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:58:16 user nova-compute[72129]: DEBUG nova.compute.manager [req-a0d2f593-ae2a-4ff7-b781-da885f73c57b req-854e84fa-d1c6-4fa3-912d-f1f2ad69260a service nova] [instance: 28164e90-f7ad-4f7e-9dcf-2fc750201342] No waiting events found dispatching network-vif-plugged-a5c1a737-6ce0-4826-b20b-8d288bdd4283 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:58:16 user nova-compute[72129]: WARNING nova.compute.manager [req-a0d2f593-ae2a-4ff7-b781-da885f73c57b req-854e84fa-d1c6-4fa3-912d-f1f2ad69260a service nova] [instance: 28164e90-f7ad-4f7e-9dcf-2fc750201342] Received unexpected event network-vif-plugged-a5c1a737-6ce0-4826-b20b-8d288bdd4283 for instance with vm_state deleted and task_state None.
Aug 01 13:58:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:58:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:58:24 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:58:25 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:58:29 user nova-compute[72129]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690898294.720732, 28164e90-f7ad-4f7e-9dcf-2fc750201342 => Stopped> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:58:29 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 28164e90-f7ad-4f7e-9dcf-2fc750201342] VM Stopped (Lifecycle Event)
Aug 01 13:58:29 user nova-compute[72129]: DEBUG nova.compute.manager [None req-2e63e60b-baf7-408f-9240-c1edab07f355 None None] [instance: 28164e90-f7ad-4f7e-9dcf-2fc750201342] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:58:29 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:58:30 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:58:34 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:58:35 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:58:37 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-88769e73-cb79-46b1-8f11-3793f8344249 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Acquiring lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:58:37 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-88769e73-cb79-46b1-8f11-3793f8344249 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:58:37 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-88769e73-cb79-46b1-8f11-3793f8344249 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Acquiring lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:58:37 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-88769e73-cb79-46b1-8f11-3793f8344249 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:58:37 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-88769e73-cb79-46b1-8f11-3793f8344249 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:58:37 user nova-compute[72129]: INFO nova.compute.manager [None req-88769e73-cb79-46b1-8f11-3793f8344249 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Terminating instance
Aug 01 13:58:37 user nova-compute[72129]: DEBUG nova.compute.manager [None req-88769e73-cb79-46b1-8f11-3793f8344249 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Start destroying the instance on the hypervisor. {{(pid=72129) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 13:58:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:58:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:58:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:58:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:58:37 user nova-compute[72129]: DEBUG nova.compute.manager [req-5370251c-df0d-44f9-9501-c93de6ad415b req-fd118d39-53e6-44c4-9c4f-19d2e4c1415d service nova] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Received event network-vif-unplugged-d59c6949-2748-4a57-b089-6219f9102815 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:58:37 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-5370251c-df0d-44f9-9501-c93de6ad415b req-fd118d39-53e6-44c4-9c4f-19d2e4c1415d service nova] Acquiring lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:58:37 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-5370251c-df0d-44f9-9501-c93de6ad415b req-fd118d39-53e6-44c4-9c4f-19d2e4c1415d service nova] Lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:58:37 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-5370251c-df0d-44f9-9501-c93de6ad415b req-fd118d39-53e6-44c4-9c4f-19d2e4c1415d service nova] Lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:58:37 user nova-compute[72129]: DEBUG nova.compute.manager [req-5370251c-df0d-44f9-9501-c93de6ad415b req-fd118d39-53e6-44c4-9c4f-19d2e4c1415d service nova] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] No waiting events found dispatching network-vif-unplugged-d59c6949-2748-4a57-b089-6219f9102815 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:58:37 user nova-compute[72129]: DEBUG nova.compute.manager [req-5370251c-df0d-44f9-9501-c93de6ad415b req-fd118d39-53e6-44c4-9c4f-19d2e4c1415d service nova] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Received event network-vif-unplugged-d59c6949-2748-4a57-b089-6219f9102815 for instance with task_state deleting. {{(pid=72129) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 13:58:38 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:58:38 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:58:38 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:58:38 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:58:38 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Instance destroyed successfully.
Aug 01 13:58:38 user nova-compute[72129]: DEBUG nova.objects.instance [None req-88769e73-cb79-46b1-8f11-3793f8344249 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Lazy-loading 'resources' on Instance uuid 2efa87a6-1dd6-4441-a55e-8e86be7f0a35 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:58:38 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:58:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-88769e73-cb79-46b1-8f11-3793f8344249 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:49:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1892996256',display_name='tempest-ServerActionsTestOtherB-server-1892996256',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1892996256',id=3,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEv1XQzBjYoYpbhYYzAkxCcHUbemRkkK9uL3KJrV3p8Too9wSnun/4eb7cYSvdSK/lx7EWwYazfwFvI3n8xQWjsYEP2mWFNbGfwKAUlfbILCQIuiMev2z7hB1YDNH/wWXQ==',key_name='tempest-keypair-539050345',keypairs=<?>,launch_index=0,launched_at=2023-08-01T13:56:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d693a983e4a44434b64c7983239371a4',ramdisk_id='',reservation_id='r-ghzodbos',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-398231514',owner_user_name='tempest-ServerActionsTestOtherB-398231514-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T13:56:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1936f560fd794910af1fa6e9c4fffa90',uuid=2efa87a6-1dd6-4441-a55e-8e86be7f0a35,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d59c6949-2748-4a57-b089-6219f9102815", "address": "fa:16:3e:20:eb:cf", "network": {"id": "4de0d3ee-7981-427b-9013-99cf0bc22cf8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-289359635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d693a983e4a44434b64c7983239371a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd59c6949-27", "ovs_interfaceid": "d59c6949-2748-4a57-b089-6219f9102815", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 13:58:38 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-88769e73-cb79-46b1-8f11-3793f8344249 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Converting VIF {"id": "d59c6949-2748-4a57-b089-6219f9102815", "address": "fa:16:3e:20:eb:cf", "network": {"id": "4de0d3ee-7981-427b-9013-99cf0bc22cf8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-289359635-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d693a983e4a44434b64c7983239371a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd59c6949-27", "ovs_interfaceid": "d59c6949-2748-4a57-b089-6219f9102815", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:58:38 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-88769e73-cb79-46b1-8f11-3793f8344249 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:20:eb:cf,bridge_name='br-int',has_traffic_filtering=True,id=d59c6949-2748-4a57-b089-6219f9102815,network=Network(4de0d3ee-7981-427b-9013-99cf0bc22cf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd59c6949-27') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:58:38 user nova-compute[72129]: DEBUG os_vif [None req-88769e73-cb79-46b1-8f11-3793f8344249 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:eb:cf,bridge_name='br-int',has_traffic_filtering=True,id=d59c6949-2748-4a57-b089-6219f9102815,network=Network(4de0d3ee-7981-427b-9013-99cf0bc22cf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd59c6949-27') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 13:58:38 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:58:38 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd59c6949-27, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:58:38 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:58:38 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:58:38 user nova-compute[72129]: INFO os_vif [None req-88769e73-cb79-46b1-8f11-3793f8344249 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:eb:cf,bridge_name='br-int',has_traffic_filtering=True,id=d59c6949-2748-4a57-b089-6219f9102815,network=Network(4de0d3ee-7981-427b-9013-99cf0bc22cf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd59c6949-27')
Aug 01 13:58:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88769e73-cb79-46b1-8f11-3793f8344249 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] calling os-brick to detach iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 13:58:38 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-88769e73-cb79-46b1-8f11-3793f8344249 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, {'target_iqns': ['iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gmPMFjbA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:58:38 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-88769e73-cb79-46b1-8f11-3793f8344249 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 13:58:38 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-88769e73-cb79-46b1-8f11-3793f8344249 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:58:38 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-88769e73-cb79-46b1-8f11-3793f8344249 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:58:38 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-88769e73-cb79-46b1-8f11-3793f8344249 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17', 0)] {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 13:58:38 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:58:38 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:58:38 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd2e34d-36bc-47e6-ab33-d0a3e6bb6e08]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd0304ec-0e1c-42bf-bddd-0bd034f51691\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:58:38 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:58:38 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:58:38 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9f88de-b3a0-49e1-b322-20f37e9ff48c]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd0304ec-0e1c-42bf-bddd-0bd034f51691 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:58:38 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-88769e73-cb79-46b1-8f11-3793f8344249 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)
Aug 01 13:58:38 user nova-compute[72129]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 13:58:38 user nova-compute[72129]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f (non-flash)
Aug 01 13:58:38 user nova-compute[72129]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd0304ec-0e1c-42bf-bddd-0bd034f51691 (non-flash)
Aug 01 13:58:38 user nova-compute[72129]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 (non-flash)
Aug 01 13:58:38 user nova-compute[72129]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d (non-flash)
Aug 01 13:58:38 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:58:38 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-88769e73-cb79-46b1-8f11-3793f8344249 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 (non-flash)
Aug 01 13:58:38 user nova-compute[72129]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 13:58:38 user nova-compute[72129]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f (non-flash)
Aug 01 13:58:38 user nova-compute[72129]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd0304ec-0e1c-42bf-bddd-0bd034f51691 (non-flash)
Aug 01 13:58:38 user nova-compute[72129]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 (non-flash)
Aug 01 13:58:38 user nova-compute[72129]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d (non-flash)
Aug 01 13:58:38 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:58:38 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-88769e73-cb79-46b1-8f11-3793f8344249 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f28201770a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17'): ({'sdb'}, set())}) {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 13:58:38 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-88769e73-cb79-46b1-8f11-3793f8344249 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Removing single pathed devices sdb {{(pid=72129) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 13:58:38 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:58:38 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:58:38 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5344e7-37cc-4975-ab1e-ea7eaaf33bd2]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:58:38 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:58:38 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:58:38 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[400a7bb2-cef8-4954-8189-d5f2c49a7eb6]: (4, ('ok\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:58:38 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-88769e73-cb79-46b1-8f11-3793f8344249 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Flushing IO for device /dev/sdb {{(pid=72129) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 13:58:38 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:58:38 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:58:38 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[558ef148-ac58-40e4-a2be-438931063e3c]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:58:38 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-88769e73-cb79-46b1-8f11-3793f8344249 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72129) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 13:58:38 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:58:38 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:58:38 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[5adfaf3d-cd1c-4fe4-9dd5-97e3ead8866d]: (4, ('1', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:58:38 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-88769e73-cb79-46b1-8f11-3793f8344249 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 13:58:38 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-88769e73-cb79-46b1-8f11-3793f8344249 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] SCSI volumes sdb have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 13:58:38 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-88769e73-cb79-46b1-8f11-3793f8344249 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17')] {{(pid=72129) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 13:58:38 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:58:38 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:58:38 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f2277b-7591-4726-a9db-580081349ed8]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:58:38 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-88769e73-cb79-46b1-8f11-3793f8344249 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:58:38 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 -p 172.16.0.220:3260 --logout {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:58:38 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:58:38 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e8fa88-d3a3-478d-af18-243d8839ca55]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:58:38 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-88769e73-cb79-46b1-8f11-3793f8344249 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17, portal: 172.16.0.220,3260]
Aug 01 13:58:38 user nova-compute[72129]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17, portal: 172.16.0.220,3260] successful.
Aug 01 13:58:38 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:58:38 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 -p 172.16.0.220:3260 --op delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:58:38 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4abb01c8-017a-4ccc-a2dd-024a94775c17 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:58:38 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56d775d-e8d4-41e0-af03-720bb4206adc]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:58:38 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-88769e73-cb79-46b1-8f11-3793f8344249 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:58:38 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-88769e73-cb79-46b1-8f11-3793f8344249 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:58:38 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-88769e73-cb79-46b1-8f11-3793f8344249 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] <== disconnect_volume: return (343ms) None {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:58:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88769e73-cb79-46b1-8f11-3793f8344249 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Disconnected iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 13:58:38 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-88769e73-cb79-46b1-8f11-3793f8344249 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Deleting instance files /opt/stack/data/nova/instances/2efa87a6-1dd6-4441-a55e-8e86be7f0a35_del
Aug 01 13:58:38 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-88769e73-cb79-46b1-8f11-3793f8344249 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Deletion of /opt/stack/data/nova/instances/2efa87a6-1dd6-4441-a55e-8e86be7f0a35_del complete
Aug 01 13:58:38 user nova-compute[72129]: INFO nova.compute.manager [None req-88769e73-cb79-46b1-8f11-3793f8344249 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Took 1.28 seconds to destroy the instance on the hypervisor.
Aug 01 13:58:38 user nova-compute[72129]: DEBUG oslo.service.loopingcall [None req-88769e73-cb79-46b1-8f11-3793f8344249 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72129) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 13:58:38 user nova-compute[72129]: DEBUG nova.compute.manager [-] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Deallocating network for instance {{(pid=72129) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 13:58:38 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] deallocate_for_instance() {{(pid=72129) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 13:58:38 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:58:38 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:58:38 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:58:38 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:58:38 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:58:38 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:58:38 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:58:38 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:58:39 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:58:39 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Took 1.05 seconds to deallocate network for instance.
Aug 01 13:58:39 user nova-compute[72129]: DEBUG nova.compute.manager [req-539dfa17-4025-442f-bfb6-c812ac970476 req-96d4556b-ed1b-4a76-b158-f5f53f0e68f4 service nova] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Received event network-vif-deleted-d59c6949-2748-4a57-b089-6219f9102815 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:58:39 user nova-compute[72129]: DEBUG nova.compute.manager [req-95b863c8-501b-40a8-ab68-9d6549cb5f08 req-93036503-e160-4c07-8266-9757b13ea18e service nova] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Received event network-vif-plugged-d59c6949-2748-4a57-b089-6219f9102815 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:58:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-95b863c8-501b-40a8-ab68-9d6549cb5f08 req-93036503-e160-4c07-8266-9757b13ea18e service nova] Acquiring lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:58:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-95b863c8-501b-40a8-ab68-9d6549cb5f08 req-93036503-e160-4c07-8266-9757b13ea18e service nova] Lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:58:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-95b863c8-501b-40a8-ab68-9d6549cb5f08 req-93036503-e160-4c07-8266-9757b13ea18e service nova] Lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:58:39 user nova-compute[72129]: DEBUG nova.compute.manager [req-95b863c8-501b-40a8-ab68-9d6549cb5f08 req-93036503-e160-4c07-8266-9757b13ea18e service nova] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] No waiting events found dispatching network-vif-plugged-d59c6949-2748-4a57-b089-6219f9102815 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:58:39 user nova-compute[72129]: WARNING nova.compute.manager [req-95b863c8-501b-40a8-ab68-9d6549cb5f08 req-93036503-e160-4c07-8266-9757b13ea18e service nova] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Received unexpected event network-vif-plugged-d59c6949-2748-4a57-b089-6219f9102815 for instance with vm_state active and task_state deleting.
Aug 01 13:58:39 user nova-compute[72129]: DEBUG nova.compute.manager [req-95b863c8-501b-40a8-ab68-9d6549cb5f08 req-93036503-e160-4c07-8266-9757b13ea18e service nova] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Received event network-vif-plugged-d59c6949-2748-4a57-b089-6219f9102815 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:58:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-95b863c8-501b-40a8-ab68-9d6549cb5f08 req-93036503-e160-4c07-8266-9757b13ea18e service nova] Acquiring lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:58:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-95b863c8-501b-40a8-ab68-9d6549cb5f08 req-93036503-e160-4c07-8266-9757b13ea18e service nova] Lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:58:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-95b863c8-501b-40a8-ab68-9d6549cb5f08 req-93036503-e160-4c07-8266-9757b13ea18e service nova] Lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:58:39 user nova-compute[72129]: DEBUG nova.compute.manager [req-95b863c8-501b-40a8-ab68-9d6549cb5f08 req-93036503-e160-4c07-8266-9757b13ea18e service nova] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] No waiting events found dispatching network-vif-plugged-d59c6949-2748-4a57-b089-6219f9102815 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:58:39 user nova-compute[72129]: WARNING nova.compute.manager [req-95b863c8-501b-40a8-ab68-9d6549cb5f08 req-93036503-e160-4c07-8266-9757b13ea18e service nova] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Received unexpected event network-vif-plugged-d59c6949-2748-4a57-b089-6219f9102815 for instance with vm_state active and task_state deleting.
Aug 01 13:58:39 user nova-compute[72129]: DEBUG nova.compute.manager [req-95b863c8-501b-40a8-ab68-9d6549cb5f08 req-93036503-e160-4c07-8266-9757b13ea18e service nova] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Received event network-vif-plugged-d59c6949-2748-4a57-b089-6219f9102815 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:58:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-95b863c8-501b-40a8-ab68-9d6549cb5f08 req-93036503-e160-4c07-8266-9757b13ea18e service nova] Acquiring lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:58:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-95b863c8-501b-40a8-ab68-9d6549cb5f08 req-93036503-e160-4c07-8266-9757b13ea18e service nova] Lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:58:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-95b863c8-501b-40a8-ab68-9d6549cb5f08 req-93036503-e160-4c07-8266-9757b13ea18e service nova] Lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:58:39 user nova-compute[72129]: DEBUG nova.compute.manager [req-95b863c8-501b-40a8-ab68-9d6549cb5f08 req-93036503-e160-4c07-8266-9757b13ea18e service nova] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] No waiting events found dispatching network-vif-plugged-d59c6949-2748-4a57-b089-6219f9102815 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:58:39 user nova-compute[72129]: WARNING nova.compute.manager [req-95b863c8-501b-40a8-ab68-9d6549cb5f08 req-93036503-e160-4c07-8266-9757b13ea18e service nova] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Received unexpected event network-vif-plugged-d59c6949-2748-4a57-b089-6219f9102815 for instance with vm_state active and task_state deleting.
Aug 01 13:58:39 user nova-compute[72129]: DEBUG nova.compute.manager [req-95b863c8-501b-40a8-ab68-9d6549cb5f08 req-93036503-e160-4c07-8266-9757b13ea18e service nova] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Received event network-vif-unplugged-d59c6949-2748-4a57-b089-6219f9102815 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:58:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-95b863c8-501b-40a8-ab68-9d6549cb5f08 req-93036503-e160-4c07-8266-9757b13ea18e service nova] Acquiring lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:58:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-95b863c8-501b-40a8-ab68-9d6549cb5f08 req-93036503-e160-4c07-8266-9757b13ea18e service nova] Lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:58:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-95b863c8-501b-40a8-ab68-9d6549cb5f08 req-93036503-e160-4c07-8266-9757b13ea18e service nova] Lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:58:39 user nova-compute[72129]: DEBUG nova.compute.manager [req-95b863c8-501b-40a8-ab68-9d6549cb5f08 req-93036503-e160-4c07-8266-9757b13ea18e service nova] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] No waiting events found dispatching network-vif-unplugged-d59c6949-2748-4a57-b089-6219f9102815 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:58:39 user nova-compute[72129]: DEBUG nova.compute.manager [req-95b863c8-501b-40a8-ab68-9d6549cb5f08 req-93036503-e160-4c07-8266-9757b13ea18e service nova] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Received event network-vif-unplugged-d59c6949-2748-4a57-b089-6219f9102815 for instance with task_state deleting. {{(pid=72129) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 13:58:39 user nova-compute[72129]: DEBUG nova.compute.manager [req-95b863c8-501b-40a8-ab68-9d6549cb5f08 req-93036503-e160-4c07-8266-9757b13ea18e service nova] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Received event network-vif-plugged-d59c6949-2748-4a57-b089-6219f9102815 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:58:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-95b863c8-501b-40a8-ab68-9d6549cb5f08 req-93036503-e160-4c07-8266-9757b13ea18e service nova] Acquiring lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:58:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-95b863c8-501b-40a8-ab68-9d6549cb5f08 req-93036503-e160-4c07-8266-9757b13ea18e service nova] Lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:58:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-95b863c8-501b-40a8-ab68-9d6549cb5f08 req-93036503-e160-4c07-8266-9757b13ea18e service nova] Lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:58:39 user nova-compute[72129]: DEBUG nova.compute.manager [req-95b863c8-501b-40a8-ab68-9d6549cb5f08 req-93036503-e160-4c07-8266-9757b13ea18e service nova] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] No waiting events found dispatching network-vif-plugged-d59c6949-2748-4a57-b089-6219f9102815 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:58:39 user nova-compute[72129]: WARNING nova.compute.manager [req-95b863c8-501b-40a8-ab68-9d6549cb5f08 req-93036503-e160-4c07-8266-9757b13ea18e service nova] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Received unexpected event network-vif-plugged-d59c6949-2748-4a57-b089-6219f9102815 for instance with vm_state active and task_state deleting.
Aug 01 13:58:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:58:44 user nova-compute[72129]: INFO nova.compute.manager [None req-88769e73-cb79-46b1-8f11-3793f8344249 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Took 4.83 seconds to detach 1 volumes for instance.
Aug 01 13:58:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-88769e73-cb79-46b1-8f11-3793f8344249 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:58:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-88769e73-cb79-46b1-8f11-3793f8344249 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:58:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-76516c24-021f-459f-a4fa-1accb913b64d tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Acquiring lock "63c0c1fe-7e4d-4763-8ede-a7662747a4c0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:58:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-76516c24-021f-459f-a4fa-1accb913b64d tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Lock "63c0c1fe-7e4d-4763-8ede-a7662747a4c0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:58:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-76516c24-021f-459f-a4fa-1accb913b64d tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Acquiring lock "63c0c1fe-7e4d-4763-8ede-a7662747a4c0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:58:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-76516c24-021f-459f-a4fa-1accb913b64d tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Lock "63c0c1fe-7e4d-4763-8ede-a7662747a4c0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:58:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-76516c24-021f-459f-a4fa-1accb913b64d tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Lock "63c0c1fe-7e4d-4763-8ede-a7662747a4c0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:58:44 user nova-compute[72129]: INFO nova.compute.manager [None req-76516c24-021f-459f-a4fa-1accb913b64d tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] Terminating instance
Aug 01 13:58:44 user nova-compute[72129]: DEBUG nova.compute.manager [None req-76516c24-021f-459f-a4fa-1accb913b64d tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] Start destroying the instance on the hypervisor. {{(pid=72129) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 13:58:44 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:58:44 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Starting heal instance info cache {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 13:58:44 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:58:44 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:58:44 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:58:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "refresh_cache-97a5dccf-b499-443a-b332-cfa293a16047" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:58:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquired lock "refresh_cache-97a5dccf-b499-443a-b332-cfa293a16047" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:58:44 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Forcefully refreshing network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 13:58:44 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:58:44 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-88769e73-cb79-46b1-8f11-3793f8344249 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 13:58:44 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-88769e73-cb79-46b1-8f11-3793f8344249 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 13:58:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-88769e73-cb79-46b1-8f11-3793f8344249 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.350s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:58:45 user nova-compute[72129]: INFO nova.scheduler.client.report [None req-88769e73-cb79-46b1-8f11-3793f8344249 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Deleted allocations for instance 2efa87a6-1dd6-4441-a55e-8e86be7f0a35
Aug 01 13:58:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-88769e73-cb79-46b1-8f11-3793f8344249 tempest-ServerActionsTestOtherB-398231514 tempest-ServerActionsTestOtherB-398231514-project-member] Lock "2efa87a6-1dd6-4441-a55e-8e86be7f0a35" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.712s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:58:45 user nova-compute[72129]: DEBUG nova.compute.manager [req-7f57ce15-c3a2-4942-b784-680177e9e482 req-678502a7-86f7-4065-a692-ee0024079f8e service nova] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] Received event network-vif-unplugged-33a9acea-27a3-4a66-a5f9-4be39dc61ae7 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:58:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-7f57ce15-c3a2-4942-b784-680177e9e482 req-678502a7-86f7-4065-a692-ee0024079f8e service nova] Acquiring lock "63c0c1fe-7e4d-4763-8ede-a7662747a4c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:58:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-7f57ce15-c3a2-4942-b784-680177e9e482 req-678502a7-86f7-4065-a692-ee0024079f8e service nova] Lock "63c0c1fe-7e4d-4763-8ede-a7662747a4c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:58:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-7f57ce15-c3a2-4942-b784-680177e9e482 req-678502a7-86f7-4065-a692-ee0024079f8e service nova] Lock "63c0c1fe-7e4d-4763-8ede-a7662747a4c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:58:45 user nova-compute[72129]: DEBUG nova.compute.manager [req-7f57ce15-c3a2-4942-b784-680177e9e482 req-678502a7-86f7-4065-a692-ee0024079f8e service nova] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] No waiting events found dispatching network-vif-unplugged-33a9acea-27a3-4a66-a5f9-4be39dc61ae7 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:58:45 user nova-compute[72129]: DEBUG nova.compute.manager [req-7f57ce15-c3a2-4942-b784-680177e9e482 req-678502a7-86f7-4065-a692-ee0024079f8e service nova] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] Received event network-vif-unplugged-33a9acea-27a3-4a66-a5f9-4be39dc61ae7 for instance with task_state deleting. {{(pid=72129) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 13:58:45 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Updating instance_info_cache with network_info: [{"id": "4871bc74-6594-49e6-a6ef-343bc3800742", "address": "fa:16:3e:a3:52:a2", "network": {"id": "4b93ad92-9a3a-4472-ba6c-d215329da98b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-734108983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0e85d9b73a546dc95e0ace26233f2a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4871bc74-65", "ovs_interfaceid": "4871bc74-6594-49e6-a6ef-343bc3800742", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:58:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Releasing lock "refresh_cache-97a5dccf-b499-443a-b332-cfa293a16047" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:58:45 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Updated the network info_cache for instance {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 13:58:45 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:58:45 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:58:45 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:58:45 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:58:45 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:58:45 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:58:45 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72129) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 13:58:45 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] Instance destroyed successfully.
Aug 01 13:58:45 user nova-compute[72129]: DEBUG nova.objects.instance [None req-76516c24-021f-459f-a4fa-1accb913b64d tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Lazy-loading 'resources' on Instance uuid 63c0c1fe-7e4d-4763-8ede-a7662747a4c0 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:58:45 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-76516c24-021f-459f-a4fa-1accb913b64d tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:49:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-568926671',display_name='tempest-ServersNegativeTestJSON-server-568926671',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-568926671',id=2,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T13:50:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f34719c31d18460fa308e1f40130ed24',ramdisk_id='',reservation_id='r-gax1glqz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-281733508',owner_user_name='tempest-ServersNegativeTestJSON-281733508-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T13:50:06Z,user_data=None,user_id='14a1a4faeffb41a8bcebc292a7d73cb2',uuid=63c0c1fe-7e4d-4763-8ede-a7662747a4c0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "33a9acea-27a3-4a66-a5f9-4be39dc61ae7", "address": "fa:16:3e:65:63:71", "network": {"id": "90839969-290c-4555-ab2f-2215c33e89e9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1983064867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f34719c31d18460fa308e1f40130ed24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33a9acea-27", "ovs_interfaceid": "33a9acea-27a3-4a66-a5f9-4be39dc61ae7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 13:58:45 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-76516c24-021f-459f-a4fa-1accb913b64d tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Converting VIF {"id": "33a9acea-27a3-4a66-a5f9-4be39dc61ae7", "address": "fa:16:3e:65:63:71", "network": {"id": "90839969-290c-4555-ab2f-2215c33e89e9", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1983064867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f34719c31d18460fa308e1f40130ed24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33a9acea-27", "ovs_interfaceid": "33a9acea-27a3-4a66-a5f9-4be39dc61ae7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:58:45 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-76516c24-021f-459f-a4fa-1accb913b64d tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:65:63:71,bridge_name='br-int',has_traffic_filtering=True,id=33a9acea-27a3-4a66-a5f9-4be39dc61ae7,network=Network(90839969-290c-4555-ab2f-2215c33e89e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33a9acea-27') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:58:45 user nova-compute[72129]: DEBUG os_vif [None req-76516c24-021f-459f-a4fa-1accb913b64d tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:63:71,bridge_name='br-int',has_traffic_filtering=True,id=33a9acea-27a3-4a66-a5f9-4be39dc61ae7,network=Network(90839969-290c-4555-ab2f-2215c33e89e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33a9acea-27') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 13:58:45 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:58:45 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap33a9acea-27, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:58:45 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:58:45 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 13:58:45 user nova-compute[72129]: INFO os_vif [None req-76516c24-021f-459f-a4fa-1accb913b64d tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:63:71,bridge_name='br-int',has_traffic_filtering=True,id=33a9acea-27a3-4a66-a5f9-4be39dc61ae7,network=Network(90839969-290c-4555-ab2f-2215c33e89e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33a9acea-27')
Aug 01 13:58:45 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-76516c24-021f-459f-a4fa-1accb913b64d tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] Deleting instance files /opt/stack/data/nova/instances/63c0c1fe-7e4d-4763-8ede-a7662747a4c0_del
Aug 01 13:58:45 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-76516c24-021f-459f-a4fa-1accb913b64d tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] Deletion of /opt/stack/data/nova/instances/63c0c1fe-7e4d-4763-8ede-a7662747a4c0_del complete
Aug 01 13:58:45 user nova-compute[72129]: INFO nova.compute.manager [None req-76516c24-021f-459f-a4fa-1accb913b64d tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 01 13:58:45 user nova-compute[72129]: DEBUG oslo.service.loopingcall [None req-76516c24-021f-459f-a4fa-1accb913b64d tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72129) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 13:58:45 user nova-compute[72129]: DEBUG nova.compute.manager [-] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] Deallocating network for instance {{(pid=72129) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 13:58:45 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] deallocate_for_instance() {{(pid=72129) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 13:58:46 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:58:46 user nova-compute[72129]: DEBUG nova.compute.manager [req-3b19f433-1779-48b0-b993-272bfb9339b2 req-ced2b8a4-462a-47bc-a67b-fbad7350d693 service nova] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] Received event network-vif-deleted-33a9acea-27a3-4a66-a5f9-4be39dc61ae7 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:58:46 user nova-compute[72129]: INFO nova.compute.manager [req-3b19f433-1779-48b0-b993-272bfb9339b2 req-ced2b8a4-462a-47bc-a67b-fbad7350d693 service nova] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] Neutron deleted interface 33a9acea-27a3-4a66-a5f9-4be39dc61ae7; detaching it from the instance and deleting it from the info cache
Aug 01 13:58:46 user nova-compute[72129]: DEBUG nova.network.neutron [req-3b19f433-1779-48b0-b993-272bfb9339b2 req-ced2b8a4-462a-47bc-a67b-fbad7350d693 service nova] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:58:46 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] Took 1.04 seconds to deallocate network for instance.
Aug 01 13:58:46 user nova-compute[72129]: DEBUG nova.compute.manager [req-3b19f433-1779-48b0-b993-272bfb9339b2 req-ced2b8a4-462a-47bc-a67b-fbad7350d693 service nova] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] Detach interface failed, port_id=33a9acea-27a3-4a66-a5f9-4be39dc61ae7, reason: Instance 63c0c1fe-7e4d-4763-8ede-a7662747a4c0 could not be found. {{(pid=72129) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 13:58:46 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-76516c24-021f-459f-a4fa-1accb913b64d tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:58:46 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-76516c24-021f-459f-a4fa-1accb913b64d tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:58:46 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:58:46 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-76516c24-021f-459f-a4fa-1accb913b64d tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 13:58:46 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-76516c24-021f-459f-a4fa-1accb913b64d tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 13:58:46 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-76516c24-021f-459f-a4fa-1accb913b64d tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.267s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:58:46 user nova-compute[72129]: INFO nova.scheduler.client.report [None req-76516c24-021f-459f-a4fa-1accb913b64d tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Deleted allocations for instance 63c0c1fe-7e4d-4763-8ede-a7662747a4c0
Aug 01 13:58:47 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:58:47 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:58:47 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:58:47 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:58:47 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Auditing locally available compute resources for user (node: user) {{(pid=72129) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 13:58:47 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-76516c24-021f-459f-a4fa-1accb913b64d tempest-ServersNegativeTestJSON-281733508 tempest-ServersNegativeTestJSON-281733508-project-member] Lock "63c0c1fe-7e4d-4763-8ede-a7662747a4c0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.344s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:58:47 user nova-compute[72129]: DEBUG nova.compute.manager [req-4ee1ce8c-050b-4f4f-b48d-21c8272194ce req-5fc8fb4d-1faf-44b6-bf04-f525a3491392 service nova] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] Received event network-vif-plugged-33a9acea-27a3-4a66-a5f9-4be39dc61ae7 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:58:47 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-4ee1ce8c-050b-4f4f-b48d-21c8272194ce req-5fc8fb4d-1faf-44b6-bf04-f525a3491392 service nova] Acquiring lock "63c0c1fe-7e4d-4763-8ede-a7662747a4c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:58:47 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-4ee1ce8c-050b-4f4f-b48d-21c8272194ce req-5fc8fb4d-1faf-44b6-bf04-f525a3491392 service nova] Lock "63c0c1fe-7e4d-4763-8ede-a7662747a4c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:58:47 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-4ee1ce8c-050b-4f4f-b48d-21c8272194ce req-5fc8fb4d-1faf-44b6-bf04-f525a3491392 service nova] Lock "63c0c1fe-7e4d-4763-8ede-a7662747a4c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:58:47 user nova-compute[72129]: DEBUG nova.compute.manager [req-4ee1ce8c-050b-4f4f-b48d-21c8272194ce req-5fc8fb4d-1faf-44b6-bf04-f525a3491392 service nova] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] No waiting events found dispatching network-vif-plugged-33a9acea-27a3-4a66-a5f9-4be39dc61ae7 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:58:47 user nova-compute[72129]: WARNING nova.compute.manager [req-4ee1ce8c-050b-4f4f-b48d-21c8272194ce req-5fc8fb4d-1faf-44b6-bf04-f525a3491392 service nova] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] Received unexpected event network-vif-plugged-33a9acea-27a3-4a66-a5f9-4be39dc61ae7 for instance with vm_state deleted and task_state None.
Aug 01 13:58:47 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 13:58:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:58:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:58:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:58:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:58:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133076de-14b5-4ceb-aa41-d9acef8506c5/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:58:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133076de-14b5-4ceb-aa41-d9acef8506c5/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:58:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133076de-14b5-4ceb-aa41-d9acef8506c5/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:58:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133076de-14b5-4ceb-aa41-d9acef8506c5/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:58:47 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 13:58:47 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 13:58:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53b76ca4-30f0-4fd4-9928-714c7073a490/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:58:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53b76ca4-30f0-4fd4-9928-714c7073a490/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:58:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53b76ca4-30f0-4fd4-9928-714c7073a490/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:58:48 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53b76ca4-30f0-4fd4-9928-714c7073a490/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:58:48 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:58:48 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:58:48 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:58:48 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:58:48 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 13:58:48 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 13:58:48 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:58:48 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:58:48 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Hypervisor/Node resource view: name=user free_ram=7642MB free_disk=25.49203109741211GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72129) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 13:58:48 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:58:48 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:58:48 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 97a5dccf-b499-443a-b332-cfa293a16047 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:58:48 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:58:48 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 133076de-14b5-4ceb-aa41-d9acef8506c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:58:48 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance d031973f-8f48-43b3-a338-040950103e4c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:58:48 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 53b76ca4-30f0-4fd4-9928-714c7073a490 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:58:48 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 53dc7cc0-a52f-4540-b2f7-8b947f272628 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:58:48 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 8e5e94dd-b575-48f1-a617-1bd917567220 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:58:48 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 13:58:48 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 13:58:49 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 13:58:49 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 13:58:49 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Compute_service record updated for user:user {{(pid=72129) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 13:58:49 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.334s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:58:50 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:58:50 user nova-compute[72129]: INFO nova.compute.manager [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: d031973f-8f48-43b3-a338-040950103e4c] Rescuing
Aug 01 13:58:50 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Acquiring lock "refresh_cache-d031973f-8f48-43b3-a338-040950103e4c" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:58:50 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Acquired lock "refresh_cache-d031973f-8f48-43b3-a338-040950103e4c" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:58:50 user nova-compute[72129]: DEBUG nova.network.neutron [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: d031973f-8f48-43b3-a338-040950103e4c] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 13:58:51 user nova-compute[72129]: DEBUG nova.network.neutron [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: d031973f-8f48-43b3-a338-040950103e4c] Updating instance_info_cache with network_info: [{"id": "a978f40a-6406-423f-81f7-1e8077b43fd5", "address": "fa:16:3e:09:fd:e5", "network": {"id": "59b1e538-8bfe-45ce-ab7b-c5838ab25582", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1129024349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0929886fa54d1c8023793806f10d31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa978f40a-64", "ovs_interfaceid": "a978f40a-6406-423f-81f7-1e8077b43fd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:58:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Releasing lock "refresh_cache-d031973f-8f48-43b3-a338-040950103e4c" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:58:51 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:58:51 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:58:51 user nova-compute[72129]: DEBUG nova.compute.manager [req-b50cf60b-672b-4b2c-91ef-79b9a30373ba req-dd947fa2-2b13-474a-890b-cf9a68504096 service nova] [instance: d031973f-8f48-43b3-a338-040950103e4c] Received event network-vif-unplugged-a978f40a-6406-423f-81f7-1e8077b43fd5 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:58:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-b50cf60b-672b-4b2c-91ef-79b9a30373ba req-dd947fa2-2b13-474a-890b-cf9a68504096 service nova] Acquiring lock "d031973f-8f48-43b3-a338-040950103e4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:58:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-b50cf60b-672b-4b2c-91ef-79b9a30373ba req-dd947fa2-2b13-474a-890b-cf9a68504096 service nova] Lock "d031973f-8f48-43b3-a338-040950103e4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:58:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-b50cf60b-672b-4b2c-91ef-79b9a30373ba req-dd947fa2-2b13-474a-890b-cf9a68504096 service nova] Lock "d031973f-8f48-43b3-a338-040950103e4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:58:51 user nova-compute[72129]: DEBUG nova.compute.manager [req-b50cf60b-672b-4b2c-91ef-79b9a30373ba req-dd947fa2-2b13-474a-890b-cf9a68504096 service nova] [instance: d031973f-8f48-43b3-a338-040950103e4c] No waiting events found dispatching network-vif-unplugged-a978f40a-6406-423f-81f7-1e8077b43fd5 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:58:51 user nova-compute[72129]: WARNING nova.compute.manager [req-b50cf60b-672b-4b2c-91ef-79b9a30373ba req-dd947fa2-2b13-474a-890b-cf9a68504096 service nova] [instance: d031973f-8f48-43b3-a338-040950103e4c] Received unexpected event network-vif-unplugged-a978f40a-6406-423f-81f7-1e8077b43fd5 for instance with vm_state active and task_state rescuing.
Aug 01 13:58:51 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:58:51 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:58:52 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: d031973f-8f48-43b3-a338-040950103e4c] Instance destroyed successfully.
Aug 01 13:58:52 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: d031973f-8f48-43b3-a338-040950103e4c] Attempting a stable device rescue
Aug 01 13:58:52 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72129) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 01 13:58:52 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: d031973f-8f48-43b3-a338-040950103e4c] Instance directory exists: not creating {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 01 13:58:52 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: d031973f-8f48-43b3-a338-040950103e4c] Creating image(s)
Aug 01 13:58:52 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Acquiring lock "/opt/stack/data/nova/instances/d031973f-8f48-43b3-a338-040950103e4c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:58:52 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "/opt/stack/data/nova/instances/d031973f-8f48-43b3-a338-040950103e4c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:58:52 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "/opt/stack/data/nova/instances/d031973f-8f48-43b3-a338-040950103e4c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:58:52 user nova-compute[72129]: DEBUG nova.objects.instance [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lazy-loading 'trusted_certs' on Instance uuid d031973f-8f48-43b3-a338-040950103e4c {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:58:52 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Acquiring lock "054f12cf73719c130acff9aad217367fdfac9230" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:58:52 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "054f12cf73719c130acff9aad217367fdfac9230" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:58:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/054f12cf73719c130acff9aad217367fdfac9230.part --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:58:53 user nova-compute[72129]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690898318.1686566, 2efa87a6-1dd6-4441-a55e-8e86be7f0a35 => Stopped> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:58:53 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] VM Stopped (Lifecycle Event)
Aug 01 13:58:53 user nova-compute[72129]: DEBUG nova.compute.manager [None req-747ed460-b29a-4a41-9125-cc2ba26a6d79 None None] [instance: 2efa87a6-1dd6-4441-a55e-8e86be7f0a35] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:58:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/054f12cf73719c130acff9aad217367fdfac9230.part --force-share --output=json" returned: 0 in 0.135s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:58:53 user nova-compute[72129]: DEBUG nova.virt.images [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] 7831bd0f-ddab-49f5-a0a9-1482df706fc8 was qcow2, converting to raw {{(pid=72129) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 13:58:53 user nova-compute[72129]: DEBUG nova.privsep.utils [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72129) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 13:58:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/054f12cf73719c130acff9aad217367fdfac9230.part /opt/stack/data/nova/instances/_base/054f12cf73719c130acff9aad217367fdfac9230.converted {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:58:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/054f12cf73719c130acff9aad217367fdfac9230.part /opt/stack/data/nova/instances/_base/054f12cf73719c130acff9aad217367fdfac9230.converted" returned: 0 in 0.227s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:58:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/054f12cf73719c130acff9aad217367fdfac9230.converted --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:58:53 user nova-compute[72129]: DEBUG nova.compute.manager [req-43bf1e32-eaa8-4d2f-a54f-3878210f2df1 req-4b7d2314-78f9-4617-a10c-3ce905adb724 service nova] [instance: d031973f-8f48-43b3-a338-040950103e4c] Received event network-vif-plugged-a978f40a-6406-423f-81f7-1e8077b43fd5 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:58:53 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-43bf1e32-eaa8-4d2f-a54f-3878210f2df1 req-4b7d2314-78f9-4617-a10c-3ce905adb724 service nova] Acquiring lock "d031973f-8f48-43b3-a338-040950103e4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:58:53 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-43bf1e32-eaa8-4d2f-a54f-3878210f2df1 req-4b7d2314-78f9-4617-a10c-3ce905adb724 service nova] Lock "d031973f-8f48-43b3-a338-040950103e4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:58:53 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-43bf1e32-eaa8-4d2f-a54f-3878210f2df1 req-4b7d2314-78f9-4617-a10c-3ce905adb724 service nova] Lock "d031973f-8f48-43b3-a338-040950103e4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:58:53 user nova-compute[72129]: DEBUG nova.compute.manager [req-43bf1e32-eaa8-4d2f-a54f-3878210f2df1 req-4b7d2314-78f9-4617-a10c-3ce905adb724 service nova] [instance: d031973f-8f48-43b3-a338-040950103e4c] No waiting events found dispatching network-vif-plugged-a978f40a-6406-423f-81f7-1e8077b43fd5 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:58:53 user nova-compute[72129]: WARNING nova.compute.manager [req-43bf1e32-eaa8-4d2f-a54f-3878210f2df1 req-4b7d2314-78f9-4617-a10c-3ce905adb724 service nova] [instance: d031973f-8f48-43b3-a338-040950103e4c] Received unexpected event network-vif-plugged-a978f40a-6406-423f-81f7-1e8077b43fd5 for instance with vm_state active and task_state rescuing.
Aug 01 13:58:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/054f12cf73719c130acff9aad217367fdfac9230.converted --force-share --output=json" returned: 0 in 0.136s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:58:53 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "054f12cf73719c130acff9aad217367fdfac9230" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.598s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:58:53 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Acquiring lock "054f12cf73719c130acff9aad217367fdfac9230" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:58:53 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "054f12cf73719c130acff9aad217367fdfac9230" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:58:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/054f12cf73719c130acff9aad217367fdfac9230 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:58:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/054f12cf73719c130acff9aad217367fdfac9230 --force-share --output=json" returned: 0 in 0.146s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:58:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/054f12cf73719c130acff9aad217367fdfac9230,backing_fmt=raw /opt/stack/data/nova/instances/d031973f-8f48-43b3-a338-040950103e4c/disk.rescue {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:58:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/054f12cf73719c130acff9aad217367fdfac9230,backing_fmt=raw /opt/stack/data/nova/instances/d031973f-8f48-43b3-a338-040950103e4c/disk.rescue" returned: 0 in 0.047s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:58:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "054f12cf73719c130acff9aad217367fdfac9230" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:58:54 user nova-compute[72129]: DEBUG nova.objects.instance [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lazy-loading 'migration_context' on Instance uuid d031973f-8f48-43b3-a338-040950103e4c {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:58:54 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: d031973f-8f48-43b3-a338-040950103e4c] Created local disks {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 13:58:54 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: d031973f-8f48-43b3-a338-040950103e4c] Start _get_guest_xml network_info=[{"id": "a978f40a-6406-423f-81f7-1e8077b43fd5", "address": "fa:16:3e:09:fd:e5", "network": {"id": "59b1e538-8bfe-45ce-ab7b-c5838ab25582", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1129024349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1129024349-network", "vif_mac": "fa:16:3e:09:fd:e5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0929886fa54d1c8023793806f10d31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa978f40a-64", "ovs_interfaceid": "a978f40a-6406-423f-81f7-1e8077b43fd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '7831bd0f-ddab-49f5-a0a9-1482df706fc8', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '84b52685-fab2-4ada-83ad-002206870b22', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YbOIcMLV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'd031973f-8f48-43b3-a338-040950103e4c', 'attached_at': '', 'detached_at': '', 'volume_id': '11ec6e25-74a1-4f6b-a96c-634c55581fa6', 'serial': '11ec6e25-74a1-4f6b-a96c-634c55581fa6'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 13:58:54 user nova-compute[72129]: DEBUG nova.objects.instance [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lazy-loading 'resources' on Instance uuid d031973f-8f48-43b3-a338-040950103e4c {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:58:54 user nova-compute[72129]: DEBUG nova.objects.instance [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lazy-loading 'numa_topology' on Instance uuid d031973f-8f48-43b3-a338-040950103e4c {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:58:54 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:58:54 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:58:54 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 13:58:54 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] CPU controller missing on host. {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 13:58:54 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 13:58:54 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] CPU controller found on host. {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 13:58:54 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72129) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 13:58:54 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T13:45:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 13:58:54 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Flavor limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 13:58:54 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Image limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 13:58:54 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Flavor pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 13:58:54 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Image pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 13:58:54 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 13:58:54 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 13:58:54 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 13:58:54 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Got 1 possible topologies {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 13:58:54 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 13:58:54 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 13:58:54 user nova-compute[72129]: DEBUG nova.objects.instance [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lazy-loading 'vcpu_model' on Instance uuid d031973f-8f48-43b3-a338-040950103e4c {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:58:54 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: d031973f-8f48-43b3-a338-040950103e4c] Calling os-brick to attach iSCSI Volume {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 13:58:54 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YbOIcMLV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:58:54 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 13:58:54 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:58:54 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:58:54 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 13:58:54 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:58:54 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:58:54 user nova-compute[72129]: INFO os_brick.initiator.connectors.iscsi [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 13:58:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 -p 172.16.0.220:3260 {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:58:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:58:54 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e790f1c-615b-4ede-adbc-de787f3880e4]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = YbOIcMLV\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:58:54 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 01 13:58:54 user nova-compute[72129]: node.name = iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6
Aug 01 13:58:54 user nova-compute[72129]: node.tpgt = -1
Aug 01 13:58:54 user nova-compute[72129]: node.startup = automatic
Aug 01 13:58:54 user nova-compute[72129]: node.leading_login = No
Aug 01 13:58:54 user nova-compute[72129]: iface.iscsi_ifacename = default
Aug 01 13:58:54 user nova-compute[72129]: iface.net_ifacename = <empty>
Aug 01 13:58:54 user nova-compute[72129]: iface.ipaddress = <empty>
Aug 01 13:58:54 user nova-compute[72129]: iface.prefix_len = 0
Aug 01 13:58:54 user nova-compute[72129]: iface.hwaddress = <empty>
Aug 01 13:58:54 user nova-compute[72129]: iface.transport_name = tcp
Aug 01 13:58:54 user nova-compute[72129]: iface.initiatorname = <empty>
Aug 01 13:58:54 user nova-compute[72129]: iface.state = <empty>
Aug 01 13:58:54 user nova-compute[72129]: iface.vlan_id = 0
Aug 01 13:58:54 user nova-compute[72129]: iface.vlan_priority = 0
Aug 01 13:58:54 user nova-compute[72129]: iface.vlan_state = <empty>
Aug 01 13:58:54 user nova-compute[72129]: iface.iface_num = 0
Aug 01 13:58:54 user nova-compute[72129]: iface.mtu = 0
Aug 01 13:58:54 user nova-compute[72129]: iface.port = 0
Aug 01 13:58:54 user nova-compute[72129]: iface.bootproto = <empty>
Aug 01 13:58:54 user nova-compute[72129]: iface.subnet_mask = <empty>
Aug 01 13:58:54 user nova-compute[72129]: iface.gateway = <empty>
Aug 01 13:58:54 user nova-compute[72129]: iface.dhcp_alt_client_id_state = <empty>
Aug 01 13:58:54 user nova-compute[72129]: iface.dhcp_alt_client_id = <empty>
Aug 01 13:58:54 user nova-compute[72129]: iface.dhcp_dns = <empty>
Aug 01 13:58:54 user nova-compute[72129]: iface.dhcp_learn_iqn = <empty>
Aug 01 13:58:54 user nova-compute[72129]: iface.dhcp_req_vendor_id_state = <empty>
Aug 01 13:58:54 user nova-compute[72129]: iface.dhcp_vendor_id_state = <empty>
Aug 01 13:58:54 user nova-compute[72129]: iface.dhcp_vendor_id = <empty>
Aug 01 13:58:54 user nova-compute[72129]: iface.dhcp_slp_da = <empty>
Aug 01 13:58:54 user nova-compute[72129]: iface.fragmentation = <empty>
Aug 01 13:58:54 user nova-compute[72129]: iface.gratuitous_arp = <empty>
Aug 01 13:58:54 user nova-compute[72129]: iface.incoming_forwarding = <empty>
Aug 01 13:58:54 user nova-compute[72129]: iface.tos_state = <empty>
Aug 01 13:58:54 user nova-compute[72129]: iface.tos = 0
Aug 01 13:58:54 user nova-compute[72129]: iface.ttl = 0
Aug 01 13:58:54 user nova-compute[72129]: iface.delayed_ack = <empty>
Aug 01 13:58:54 user nova-compute[72129]: iface.tcp_nagle = <empty>
Aug 01 13:58:54 user nova-compute[72129]: iface.tcp_wsf_state = <empty>
Aug 01 13:58:54 user nova-compute[72129]: iface.tcp_wsf = 0
Aug 01 13:58:54 user nova-compute[72129]: iface.tcp_timer_scale = 0
Aug 01 13:58:54 user nova-compute[72129]: iface.tcp_timestamp = <empty>
Aug 01 13:58:54 user nova-compute[72129]: iface.redirect = <empty>
Aug 01 13:58:54 user nova-compute[72129]: iface.def_task_mgmt_timeout = 0
Aug 01 13:58:54 user nova-compute[72129]: iface.header_digest = <empty>
Aug 01 13:58:54 user nova-compute[72129]: iface.data_digest = <empty>
Aug 01 13:58:54 user nova-compute[72129]: iface.immediate_data = <empty>
Aug 01 13:58:54 user nova-compute[72129]: iface.initial_r2t = <empty>
Aug 01 13:58:54 user nova-compute[72129]: iface.data_seq_inorder = <empty>
Aug 01 13:58:54 user nova-compute[72129]: iface.data_pdu_inorder = <empty>
Aug 01 13:58:54 user nova-compute[72129]: iface.erl = 0
Aug 01 13:58:54 user nova-compute[72129]: iface.max_receive_data_len = 0
Aug 01 13:58:54 user nova-compute[72129]: iface.first_burst_len = 0
Aug 01 13:58:54 user nova-compute[72129]: iface.max_outstanding_r2t = 0
Aug 01 13:58:54 user nova-compute[72129]: iface.max_burst_len = 0
Aug 01 13:58:54 user nova-compute[72129]: iface.chap_auth = <empty>
Aug 01 13:58:54 user nova-compute[72129]: iface.bidi_chap = <empty>
Aug 01 13:58:54 user nova-compute[72129]: iface.strict_login_compliance = <empty>
Aug 01 13:58:54 user nova-compute[72129]: iface.discovery_auth = <empty>
Aug 01 13:58:54 user nova-compute[72129]: iface.discovery_logout = <empty>
Aug 01 13:58:54 user nova-compute[72129]: node.discovery_address = <empty>
Aug 01 13:58:54 user nova-compute[72129]: node.discovery_port = 0
Aug 01 13:58:54 user nova-compute[72129]: node.discovery_type = static
Aug 01 13:58:54 user nova-compute[72129]: node.session.initial_cmdsn = 0
Aug 01 13:58:54 user nova-compute[72129]: node.session.initial_login_retry_max = 8
Aug 01 13:58:54 user nova-compute[72129]: node.session.xmit_thread_priority = -20
Aug 01 13:58:54 user nova-compute[72129]: node.session.cmds_max = 128
Aug 01 13:58:54 user nova-compute[72129]: node.session.queue_depth = 32
Aug 01 13:58:54 user nova-compute[72129]: node.session.nr_sessions = 1
Aug 01 13:58:54 user nova-compute[72129]: node.session.auth.authmethod = CHAP
Aug 01 13:58:54 user nova-compute[72129]: node.session.auth.username = YbOIcMLV
Aug 01 13:58:54 user nova-compute[72129]: node.session.auth.password = ***
Aug 01 13:58:54 user nova-compute[72129]: node.session.auth.username_in = <empty>
Aug 01 13:58:54 user nova-compute[72129]: node.session.auth.password_in = <empty>
Aug 01 13:58:54 user nova-compute[72129]: node.session.auth.chap_algs = MD5
Aug 01 13:58:54 user nova-compute[72129]: node.session.timeo.replacement_timeout = 120
Aug 01 13:58:54 user nova-compute[72129]: node.session.err_timeo.abort_timeout = 15
Aug 01 13:58:54 user nova-compute[72129]: node.session.err_timeo.lu_reset_timeout = 30
Aug 01 13:58:54 user nova-compute[72129]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 01 13:58:54 user nova-compute[72129]: node.session.err_timeo.host_reset_timeout = 60
Aug 01 13:58:54 user nova-compute[72129]: node.session.iscsi.FastAbort = Yes
Aug 01 13:58:54 user nova-compute[72129]: node.session.iscsi.InitialR2T = No
Aug 01 13:58:54 user nova-compute[72129]: node.session.iscsi.ImmediateData = Yes
Aug 01 13:58:54 user nova-compute[72129]: node.session.iscsi.FirstBurstLength = 262144
Aug 01 13:58:54 user nova-compute[72129]: node.session.iscsi.MaxBurstLength = 16776192
Aug 01 13:58:54 user nova-compute[72129]: node.session.iscsi.DefaultTime2Retain = 0
Aug 01 13:58:54 user nova-compute[72129]: node.session.iscsi.DefaultTime2Wait = 2
Aug 01 13:58:54 user nova-compute[72129]: node.session.iscsi.MaxConnections = 1
Aug 01 13:58:54 user nova-compute[72129]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 01 13:58:54 user nova-compute[72129]: node.session.iscsi.ERL = 0
Aug 01 13:58:54 user nova-compute[72129]: node.session.scan = manual
Aug 01 13:58:54 user nova-compute[72129]: node.session.reopen_max = 0
Aug 01 13:58:54 user nova-compute[72129]: node.conn[0].address = 172.16.0.220
Aug 01 13:58:54 user nova-compute[72129]: node.conn[0].port = 3260
Aug 01 13:58:54 user nova-compute[72129]: node.conn[0].startup = manual
Aug 01 13:58:54 user nova-compute[72129]: node.conn[0].tcp.window_size = 524288
Aug 01 13:58:54 user nova-compute[72129]: node.conn[0].tcp.type_of_service = 0
Aug 01 13:58:54 user nova-compute[72129]: node.conn[0].timeo.logout_timeout = 15
Aug 01 13:58:54 user nova-compute[72129]: node.conn[0].timeo.login_timeout = 15
Aug 01 13:58:54 user nova-compute[72129]: node.conn[0].timeo.auth_timeout = 45
Aug 01 13:58:54 user nova-compute[72129]: node.conn[0].timeo.noop_out_interval = 5
Aug 01 13:58:54 user nova-compute[72129]: node.conn[0].timeo.noop_out_timeout = 5
Aug 01 13:58:54 user nova-compute[72129]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 01 13:58:54 user nova-compute[72129]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 01 13:58:54 user nova-compute[72129]: node.conn[0].iscsi.HeaderDigest = None
Aug 01 13:58:54 user nova-compute[72129]: node.conn[0].iscsi.DataDigest = None
Aug 01 13:58:54 user nova-compute[72129]: node.conn[0].iscsi.IFMarker = No
Aug 01 13:58:54 user nova-compute[72129]: node.conn[0].iscsi.OFMarker = No
Aug 01 13:58:54 user nova-compute[72129]: # END RECORD
Aug 01 13:58:54 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:58:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:58:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:58:54 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dfa73ba-54d0-4779-a174-715182810e5e]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:58:54 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:58:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:58:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:58:54 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e78c126-6159-4074-988a-4eea5e612c6f]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:58:54 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:58:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YbOIcMLV {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:58:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YbOIcMLV" returned: 0 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:58:54 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[74596e97-403b-4a65-b73a-18c3d1fb4db8]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:58:54 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YbOIcMLV'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:58:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:58:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:58:54 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac654e2a-383a-45cf-bcde-4014748079d5]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:58:54 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:58:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:58:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:58:54 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d366db-ec38-4fbb-b733-6cd32008807d]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd0304ec-0e1c-42bf-bddd-0bd034f51691 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:58:54 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 13:58:54 user nova-compute[72129]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f (non-flash)
Aug 01 13:58:54 user nova-compute[72129]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd0304ec-0e1c-42bf-bddd-0bd034f51691 (non-flash)
Aug 01 13:58:54 user nova-compute[72129]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 (non-flash)
Aug 01 13:58:54 user nova-compute[72129]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d (non-flash)
Aug 01 13:58:54 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:58:54 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 13:58:54 user nova-compute[72129]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f (non-flash)
Aug 01 13:58:54 user nova-compute[72129]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd0304ec-0e1c-42bf-bddd-0bd034f51691 (non-flash)
Aug 01 13:58:54 user nova-compute[72129]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 (non-flash)
Aug 01 13:58:54 user nova-compute[72129]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d (non-flash)
Aug 01 13:58:54 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:58:54 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.146s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:58:54 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Connected to 172.16.0.220:3260 {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 13:58:54 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] HCTL ('34', '0', '0', 0) found on session 22 with lun 0 {{(pid=72129) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 13:58:54 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=72129) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 13:58:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:58:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.013s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:58:54 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b28a299-26e5-4500-a03d-3f6efcd1fea7]: (4, ('0 0 0', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:58:54 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Searching for a device in session 22 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 13:58:54 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YbOIcMLV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 13:58:54 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.168s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:58:54 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] <== connect_volume: return (169ms) {'type': 'block', 'scsi_wwn': '23966376365666436', 'path': '/dev/sdc'} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:58:54 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: d031973f-8f48-43b3-a338-040950103e4c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23966376365666436', 'path': '/dev/sdc'} {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 13:58:54 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:56:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-750731877',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-750731877',id=19,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T13:57:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1e0929886fa54d1c8023793806f10d31',ramdisk_id='',reservation_id='r-n3dae9u5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1414609013',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:57:20Z,user_data=None,user_id='cdb6f66592fe4cdebea02e5f5c1f4a60',uuid=d031973f-8f48-43b3-a338-040950103e4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a978f40a-6406-423f-81f7-1e8077b43fd5", "address": "fa:16:3e:09:fd:e5", "network": {"id": "59b1e538-8bfe-45ce-ab7b-c5838ab25582", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1129024349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1129024349-network", "vif_mac": "fa:16:3e:09:fd:e5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0929886fa54d1c8023793806f10d31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa978f40a-64", "ovs_interfaceid": "a978f40a-6406-423f-81f7-1e8077b43fd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 13:58:54 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Converting VIF {"id": "a978f40a-6406-423f-81f7-1e8077b43fd5", "address": "fa:16:3e:09:fd:e5", "network": {"id": "59b1e538-8bfe-45ce-ab7b-c5838ab25582", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1129024349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1129024349-network", "vif_mac": "fa:16:3e:09:fd:e5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0929886fa54d1c8023793806f10d31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa978f40a-64", "ovs_interfaceid": "a978f40a-6406-423f-81f7-1e8077b43fd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:58:54 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:09:fd:e5,bridge_name='br-int',has_traffic_filtering=True,id=a978f40a-6406-423f-81f7-1e8077b43fd5,network=Network(59b1e538-8bfe-45ce-ab7b-c5838ab25582),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa978f40a-64') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:58:54 user nova-compute[72129]: DEBUG nova.objects.instance [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lazy-loading 'pci_devices' on Instance uuid d031973f-8f48-43b3-a338-040950103e4c {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:58:54 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: d031973f-8f48-43b3-a338-040950103e4c] End _get_guest_xml xml=<domain type="kvm">
Aug 01 13:58:54 user nova-compute[72129]:   <uuid>d031973f-8f48-43b3-a338-040950103e4c</uuid>
Aug 01 13:58:54 user nova-compute[72129]:   <name>instance-00000013</name>
Aug 01 13:58:54 user nova-compute[72129]:   <memory>524288</memory>
Aug 01 13:58:54 user nova-compute[72129]:   <vcpu>1</vcpu>
Aug 01 13:58:54 user nova-compute[72129]:   <metadata>
Aug 01 13:58:54 user nova-compute[72129]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 13:58:54 user nova-compute[72129]:       <nova:package version="0.0.0"/>
Aug 01 13:58:54 user nova-compute[72129]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-750731877</nova:name>
Aug 01 13:58:54 user nova-compute[72129]:       <nova:creationTime>2023-08-01 13:58:54</nova:creationTime>
Aug 01 13:58:54 user nova-compute[72129]:       <nova:flavor name="m1.tiny">
Aug 01 13:58:54 user nova-compute[72129]:         <nova:memory>512</nova:memory>
Aug 01 13:58:54 user nova-compute[72129]:         <nova:disk>1</nova:disk>
Aug 01 13:58:54 user nova-compute[72129]:         <nova:swap>0</nova:swap>
Aug 01 13:58:54 user nova-compute[72129]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 13:58:54 user nova-compute[72129]:         <nova:vcpus>1</nova:vcpus>
Aug 01 13:58:54 user nova-compute[72129]:       </nova:flavor>
Aug 01 13:58:54 user nova-compute[72129]:       <nova:owner>
Aug 01 13:58:54 user nova-compute[72129]:         <nova:user uuid="cdb6f66592fe4cdebea02e5f5c1f4a60">tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member</nova:user>
Aug 01 13:58:54 user nova-compute[72129]:         <nova:project uuid="1e0929886fa54d1c8023793806f10d31">tempest-ServerBootFromVolumeStableRescueTest-1414609013</nova:project>
Aug 01 13:58:54 user nova-compute[72129]:       </nova:owner>
Aug 01 13:58:54 user nova-compute[72129]:       <nova:root type="image" uuid="b6472c34-1b0f-4034-ba3a-7e8eb5103715"/>
Aug 01 13:58:54 user nova-compute[72129]:       <nova:ports>
Aug 01 13:58:54 user nova-compute[72129]:         <nova:port uuid="a978f40a-6406-423f-81f7-1e8077b43fd5">
Aug 01 13:58:54 user nova-compute[72129]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 01 13:58:54 user nova-compute[72129]:         </nova:port>
Aug 01 13:58:54 user nova-compute[72129]:       </nova:ports>
Aug 01 13:58:54 user nova-compute[72129]:     </nova:instance>
Aug 01 13:58:54 user nova-compute[72129]:   </metadata>
Aug 01 13:58:54 user nova-compute[72129]:   <sysinfo type="smbios">
Aug 01 13:58:54 user nova-compute[72129]:     <system>
Aug 01 13:58:54 user nova-compute[72129]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 13:58:54 user nova-compute[72129]:       <entry name="product">OpenStack Nova</entry>
Aug 01 13:58:54 user nova-compute[72129]:       <entry name="version">0.0.0</entry>
Aug 01 13:58:54 user nova-compute[72129]:       <entry name="serial">d031973f-8f48-43b3-a338-040950103e4c</entry>
Aug 01 13:58:54 user nova-compute[72129]:       <entry name="uuid">d031973f-8f48-43b3-a338-040950103e4c</entry>
Aug 01 13:58:54 user nova-compute[72129]:       <entry name="family">Virtual Machine</entry>
Aug 01 13:58:54 user nova-compute[72129]:     </system>
Aug 01 13:58:54 user nova-compute[72129]:   </sysinfo>
Aug 01 13:58:54 user nova-compute[72129]:   <os>
Aug 01 13:58:54 user nova-compute[72129]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 13:58:54 user nova-compute[72129]:     <smbios mode="sysinfo"/>
Aug 01 13:58:54 user nova-compute[72129]:   </os>
Aug 01 13:58:54 user nova-compute[72129]:   <features>
Aug 01 13:58:54 user nova-compute[72129]:     <acpi/>
Aug 01 13:58:54 user nova-compute[72129]:     <apic/>
Aug 01 13:58:54 user nova-compute[72129]:     <vmcoreinfo/>
Aug 01 13:58:54 user nova-compute[72129]:   </features>
Aug 01 13:58:54 user nova-compute[72129]:   <clock offset="utc">
Aug 01 13:58:54 user nova-compute[72129]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 13:58:54 user nova-compute[72129]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 13:58:54 user nova-compute[72129]:     <timer name="hpet" present="no"/>
Aug 01 13:58:54 user nova-compute[72129]:   </clock>
Aug 01 13:58:54 user nova-compute[72129]:   <cpu mode="custom" match="exact">
Aug 01 13:58:54 user nova-compute[72129]:     <model>Nehalem</model>
Aug 01 13:58:54 user nova-compute[72129]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 13:58:54 user nova-compute[72129]:   </cpu>
Aug 01 13:58:54 user nova-compute[72129]:   <devices>
Aug 01 13:58:54 user nova-compute[72129]:     <disk type="block" device="disk">
Aug 01 13:58:54 user nova-compute[72129]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 13:58:54 user nova-compute[72129]:       <source dev="/dev/sdc"/>
Aug 01 13:58:54 user nova-compute[72129]:       <target dev="vda" bus="virtio"/>
Aug 01 13:58:54 user nova-compute[72129]:       <serial>11ec6e25-74a1-4f6b-a96c-634c55581fa6</serial>
Aug 01 13:58:54 user nova-compute[72129]:     </disk>
Aug 01 13:58:54 user nova-compute[72129]:     <disk type="file" device="disk">
Aug 01 13:58:54 user nova-compute[72129]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 13:58:54 user nova-compute[72129]:       <source file="/opt/stack/data/nova/instances/d031973f-8f48-43b3-a338-040950103e4c/disk.rescue"/>
Aug 01 13:58:54 user nova-compute[72129]:       <target dev="vdb" bus="virtio"/>
Aug 01 13:58:54 user nova-compute[72129]:       <boot order="1"/>
Aug 01 13:58:54 user nova-compute[72129]:     </disk>
Aug 01 13:58:54 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 13:58:54 user nova-compute[72129]:       <mac address="fa:16:3e:09:fd:e5"/>
Aug 01 13:58:54 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 13:58:54 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 13:58:54 user nova-compute[72129]:       <target dev="tapa978f40a-64"/>
Aug 01 13:58:54 user nova-compute[72129]:     </interface>
Aug 01 13:58:54 user nova-compute[72129]:     <serial type="pty">
Aug 01 13:58:54 user nova-compute[72129]:       <log file="/opt/stack/data/nova/instances/d031973f-8f48-43b3-a338-040950103e4c/console.log" append="off"/>
Aug 01 13:58:54 user nova-compute[72129]:     </serial>
Aug 01 13:58:54 user nova-compute[72129]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 13:58:54 user nova-compute[72129]:     <video>
Aug 01 13:58:54 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 13:58:54 user nova-compute[72129]:     </video>
Aug 01 13:58:54 user nova-compute[72129]:     <rng model="virtio">
Aug 01 13:58:54 user nova-compute[72129]:       <backend model="random">/dev/urandom</backend>
Aug 01 13:58:54 user nova-compute[72129]:     </rng>
Aug 01 13:58:54 user nova-compute[72129]:     <controller type="usb" index="0" model="none"/>
Aug 01 13:58:54 user nova-compute[72129]:     <memballoon model="virtio">
Aug 01 13:58:54 user nova-compute[72129]:       <stats period="10"/>
Aug 01 13:58:54 user nova-compute[72129]:     </memballoon>
Aug 01 13:58:54 user nova-compute[72129]:   </devices>
Aug 01 13:58:54 user nova-compute[72129]: </domain>
Aug 01 13:58:54 user nova-compute[72129]:  {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 13:58:54 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: d031973f-8f48-43b3-a338-040950103e4c] Instance destroyed successfully.
Aug 01 13:58:54 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 13:58:54 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 13:58:54 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] No VIF found with MAC fa:16:3e:09:fd:e5, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 13:58:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:58:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:58:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:58:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:58:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:58:55 user nova-compute[72129]: DEBUG nova.compute.manager [req-09f6de97-435f-4d28-a5b3-3fde520debd6 req-5231dd81-d347-4aee-8400-691cb2b5a708 service nova] [instance: d031973f-8f48-43b3-a338-040950103e4c] Received event network-vif-plugged-a978f40a-6406-423f-81f7-1e8077b43fd5 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:58:55 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-09f6de97-435f-4d28-a5b3-3fde520debd6 req-5231dd81-d347-4aee-8400-691cb2b5a708 service nova] Acquiring lock "d031973f-8f48-43b3-a338-040950103e4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:58:55 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-09f6de97-435f-4d28-a5b3-3fde520debd6 req-5231dd81-d347-4aee-8400-691cb2b5a708 service nova] Lock "d031973f-8f48-43b3-a338-040950103e4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:58:55 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-09f6de97-435f-4d28-a5b3-3fde520debd6 req-5231dd81-d347-4aee-8400-691cb2b5a708 service nova] Lock "d031973f-8f48-43b3-a338-040950103e4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:58:55 user nova-compute[72129]: DEBUG nova.compute.manager [req-09f6de97-435f-4d28-a5b3-3fde520debd6 req-5231dd81-d347-4aee-8400-691cb2b5a708 service nova] [instance: d031973f-8f48-43b3-a338-040950103e4c] No waiting events found dispatching network-vif-plugged-a978f40a-6406-423f-81f7-1e8077b43fd5 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:58:55 user nova-compute[72129]: WARNING nova.compute.manager [req-09f6de97-435f-4d28-a5b3-3fde520debd6 req-5231dd81-d347-4aee-8400-691cb2b5a708 service nova] [instance: d031973f-8f48-43b3-a338-040950103e4c] Received unexpected event network-vif-plugged-a978f40a-6406-423f-81f7-1e8077b43fd5 for instance with vm_state active and task_state rescuing.
Aug 01 13:58:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:58:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:58:57 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Removed pending event for d031973f-8f48-43b3-a338-040950103e4c due to event {{(pid=72129) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 13:58:57 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898337.8047566, d031973f-8f48-43b3-a338-040950103e4c => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:58:57 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: d031973f-8f48-43b3-a338-040950103e4c] VM Resumed (Lifecycle Event)
Aug 01 13:58:57 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b2ee65f-3ff8-48e2-a18c-dba5fec0298c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: d031973f-8f48-43b3-a338-040950103e4c] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:58:57 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: d031973f-8f48-43b3-a338-040950103e4c] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:58:57 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: d031973f-8f48-43b3-a338-040950103e4c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 13:58:57 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: d031973f-8f48-43b3-a338-040950103e4c] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 01 13:58:57 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898337.808094, d031973f-8f48-43b3-a338-040950103e4c => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:58:57 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: d031973f-8f48-43b3-a338-040950103e4c] VM Started (Lifecycle Event)
Aug 01 13:58:57 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: d031973f-8f48-43b3-a338-040950103e4c] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:58:57 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: d031973f-8f48-43b3-a338-040950103e4c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 13:58:57 user nova-compute[72129]: DEBUG nova.compute.manager [req-bd036a22-e7a7-4aa8-8a39-f0e6027662e9 req-d18c3173-0f37-4c5d-b097-ce0682df7233 service nova] [instance: d031973f-8f48-43b3-a338-040950103e4c] Received event network-vif-plugged-a978f40a-6406-423f-81f7-1e8077b43fd5 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:58:57 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-bd036a22-e7a7-4aa8-8a39-f0e6027662e9 req-d18c3173-0f37-4c5d-b097-ce0682df7233 service nova] Acquiring lock "d031973f-8f48-43b3-a338-040950103e4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:58:57 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-bd036a22-e7a7-4aa8-8a39-f0e6027662e9 req-d18c3173-0f37-4c5d-b097-ce0682df7233 service nova] Lock "d031973f-8f48-43b3-a338-040950103e4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:58:57 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-bd036a22-e7a7-4aa8-8a39-f0e6027662e9 req-d18c3173-0f37-4c5d-b097-ce0682df7233 service nova] Lock "d031973f-8f48-43b3-a338-040950103e4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:58:57 user nova-compute[72129]: DEBUG nova.compute.manager [req-bd036a22-e7a7-4aa8-8a39-f0e6027662e9 req-d18c3173-0f37-4c5d-b097-ce0682df7233 service nova] [instance: d031973f-8f48-43b3-a338-040950103e4c] No waiting events found dispatching network-vif-plugged-a978f40a-6406-423f-81f7-1e8077b43fd5 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:58:57 user nova-compute[72129]: WARNING nova.compute.manager [req-bd036a22-e7a7-4aa8-8a39-f0e6027662e9 req-d18c3173-0f37-4c5d-b097-ce0682df7233 service nova] [instance: d031973f-8f48-43b3-a338-040950103e4c] Received unexpected event network-vif-plugged-a978f40a-6406-423f-81f7-1e8077b43fd5 for instance with vm_state rescued and task_state None.
Aug 01 13:59:00 user nova-compute[72129]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690898325.4902115, 63c0c1fe-7e4d-4763-8ede-a7662747a4c0 => Stopped> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:59:00 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] VM Stopped (Lifecycle Event)
Aug 01 13:59:00 user nova-compute[72129]: DEBUG nova.compute.manager [None req-f3ba082a-547c-4c65-9399-a744a363edd9 None None] [instance: 63c0c1fe-7e4d-4763-8ede-a7662747a4c0] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:59:00 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:59:00 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:59:05 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:59:10 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 13:59:10 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:59:10 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72129) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 13:59:10 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 13:59:10 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 13:59:10 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:59:15 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 13:59:15 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:59:15 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72129) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 13:59:15 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 13:59:15 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 13:59:15 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:59:15 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:59:16 user nova-compute[72129]: DEBUG nova.compute.manager [req-f6955716-439f-4a79-8772-f92413e8c8f1 req-ae3cfa13-f8fa-4351-9ca2-6259acf0f4b4 service nova] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Received event network-changed-b7271bae-a440-4d06-87d0-cece38122deb {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:59:16 user nova-compute[72129]: DEBUG nova.compute.manager [req-f6955716-439f-4a79-8772-f92413e8c8f1 req-ae3cfa13-f8fa-4351-9ca2-6259acf0f4b4 service nova] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Refreshing instance network info cache due to event network-changed-b7271bae-a440-4d06-87d0-cece38122deb. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 13:59:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f6955716-439f-4a79-8772-f92413e8c8f1 req-ae3cfa13-f8fa-4351-9ca2-6259acf0f4b4 service nova] Acquiring lock "refresh_cache-53b76ca4-30f0-4fd4-9928-714c7073a490" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:59:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f6955716-439f-4a79-8772-f92413e8c8f1 req-ae3cfa13-f8fa-4351-9ca2-6259acf0f4b4 service nova] Acquired lock "refresh_cache-53b76ca4-30f0-4fd4-9928-714c7073a490" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:59:16 user nova-compute[72129]: DEBUG nova.network.neutron [req-f6955716-439f-4a79-8772-f92413e8c8f1 req-ae3cfa13-f8fa-4351-9ca2-6259acf0f4b4 service nova] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Refreshing network info cache for port b7271bae-a440-4d06-87d0-cece38122deb {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 13:59:17 user nova-compute[72129]: DEBUG nova.network.neutron [req-f6955716-439f-4a79-8772-f92413e8c8f1 req-ae3cfa13-f8fa-4351-9ca2-6259acf0f4b4 service nova] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Updated VIF entry in instance network info cache for port b7271bae-a440-4d06-87d0-cece38122deb. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 13:59:17 user nova-compute[72129]: DEBUG nova.network.neutron [req-f6955716-439f-4a79-8772-f92413e8c8f1 req-ae3cfa13-f8fa-4351-9ca2-6259acf0f4b4 service nova] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Updating instance_info_cache with network_info: [{"id": "b7271bae-a440-4d06-87d0-cece38122deb", "address": "fa:16:3e:6b:eb:be", "network": {"id": "b0eb2211-5a6a-4b7e-a119-92a0f0deb947", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1159988670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6120989bad342a4a6fa2a8975f5932f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7271bae-a4", "ovs_interfaceid": "b7271bae-a440-4d06-87d0-cece38122deb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:59:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f6955716-439f-4a79-8772-f92413e8c8f1 req-ae3cfa13-f8fa-4351-9ca2-6259acf0f4b4 service nova] Releasing lock "refresh_cache-53b76ca4-30f0-4fd4-9928-714c7073a490" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:59:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:59:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a24a2882-c8d2-4551-9844-6a19ebcd1ab4 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Acquiring lock "53b76ca4-30f0-4fd4-9928-714c7073a490" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:59:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a24a2882-c8d2-4551-9844-6a19ebcd1ab4 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "53b76ca4-30f0-4fd4-9928-714c7073a490" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:59:20 user nova-compute[72129]: DEBUG nova.objects.instance [None req-a24a2882-c8d2-4551-9844-6a19ebcd1ab4 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lazy-loading 'flavor' on Instance uuid 53b76ca4-30f0-4fd4-9928-714c7073a490 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:59:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a24a2882-c8d2-4551-9844-6a19ebcd1ab4 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "53b76ca4-30f0-4fd4-9928-714c7073a490" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:59:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:59:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a24a2882-c8d2-4551-9844-6a19ebcd1ab4 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Acquiring lock "53b76ca4-30f0-4fd4-9928-714c7073a490" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:59:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a24a2882-c8d2-4551-9844-6a19ebcd1ab4 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "53b76ca4-30f0-4fd4-9928-714c7073a490" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:59:20 user nova-compute[72129]: INFO nova.compute.manager [None req-a24a2882-c8d2-4551-9844-6a19ebcd1ab4 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Attaching volume 00288fea-1b8e-4835-8b92-614365fa2be4 to /dev/vdb
Aug 01 13:59:20 user nova-compute[72129]: DEBUG os_brick.utils [None req-a24a2882-c8d2-4551-9844-6a19ebcd1ab4 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:59:20 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:59:20 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:59:20 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd74796-315c-4daa-bd14-f3b858637228]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f9b449c2cd3d\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:59:20 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:59:20 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:59:20 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[2edbf8a4-e6c7-48c0-a5b5-d23de9f91150]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:59:20 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:59:21 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:59:21 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b7b055-39ea-43d0-921e-fce309c709b6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:59:21 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dead5ee-85fb-4e54-8019-775b6912dadf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:59:21 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-a24a2882-c8d2-4551-9844-6a19ebcd1ab4 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Running cmd (subprocess): nvme version {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:59:21 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-a24a2882-c8d2-4551-9844-6a19ebcd1ab4 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] 'nvme version' failed. Not Retrying. {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 13:59:21 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a24a2882-c8d2-4551-9844-6a19ebcd1ab4 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] nvme not present on system {{(pid=72129) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 13:59:21 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:59:21 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 13:59:21 user nova-compute[72129]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 13:59:21 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[f495d0d7-a132-4490-a9f3-68711979b6b3]: (4, '') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:59:21 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-a24a2882-c8d2-4551-9844-6a19ebcd1ab4 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72129) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 13:59:21 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-a24a2882-c8d2-4551-9844-6a19ebcd1ab4 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 13:59:21 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-a24a2882-c8d2-4551-9844-6a19ebcd1ab4 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] LIGHTOS: no hostnqn found. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 13:59:21 user nova-compute[72129]: DEBUG os_brick.utils [None req-a24a2882-c8d2-4551-9844-6a19ebcd1ab4 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f9b449c2cd3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:59:21 user nova-compute[72129]: DEBUG nova.virt.block_device [None req-a24a2882-c8d2-4551-9844-6a19ebcd1ab4 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Updating existing volume attachment record: 56f43f6a-0d10-4831-8c20-8a4a6883ca19 {{(pid=72129) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 13:59:25 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:59:25 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:59:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c6d2f95b-404d-4802-af74-bac0ee31c1bf tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Acquiring lock "53dc7cc0-a52f-4540-b2f7-8b947f272628" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:59:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c6d2f95b-404d-4802-af74-bac0ee31c1bf tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "53dc7cc0-a52f-4540-b2f7-8b947f272628" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:59:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c6d2f95b-404d-4802-af74-bac0ee31c1bf tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Acquiring lock "53dc7cc0-a52f-4540-b2f7-8b947f272628-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:59:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c6d2f95b-404d-4802-af74-bac0ee31c1bf tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "53dc7cc0-a52f-4540-b2f7-8b947f272628-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:59:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c6d2f95b-404d-4802-af74-bac0ee31c1bf tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "53dc7cc0-a52f-4540-b2f7-8b947f272628-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:59:28 user nova-compute[72129]: INFO nova.compute.manager [None req-c6d2f95b-404d-4802-af74-bac0ee31c1bf tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] Terminating instance
Aug 01 13:59:28 user nova-compute[72129]: DEBUG nova.compute.manager [None req-c6d2f95b-404d-4802-af74-bac0ee31c1bf tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] Start destroying the instance on the hypervisor. {{(pid=72129) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 13:59:28 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:59:28 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:59:28 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:59:28 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:59:28 user nova-compute[72129]: DEBUG nova.compute.manager [req-285f64e0-529d-412a-a48d-5047da25334d req-3ed1889b-d111-4f93-899e-f58292b088b7 service nova] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] Received event network-vif-unplugged-0c5a9562-3fb3-4983-8609-a81a74f572f9 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:59:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-285f64e0-529d-412a-a48d-5047da25334d req-3ed1889b-d111-4f93-899e-f58292b088b7 service nova] Acquiring lock "53dc7cc0-a52f-4540-b2f7-8b947f272628-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:59:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-285f64e0-529d-412a-a48d-5047da25334d req-3ed1889b-d111-4f93-899e-f58292b088b7 service nova] Lock "53dc7cc0-a52f-4540-b2f7-8b947f272628-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:59:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-285f64e0-529d-412a-a48d-5047da25334d req-3ed1889b-d111-4f93-899e-f58292b088b7 service nova] Lock "53dc7cc0-a52f-4540-b2f7-8b947f272628-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:59:28 user nova-compute[72129]: DEBUG nova.compute.manager [req-285f64e0-529d-412a-a48d-5047da25334d req-3ed1889b-d111-4f93-899e-f58292b088b7 service nova] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] No waiting events found dispatching network-vif-unplugged-0c5a9562-3fb3-4983-8609-a81a74f572f9 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:59:28 user nova-compute[72129]: DEBUG nova.compute.manager [req-285f64e0-529d-412a-a48d-5047da25334d req-3ed1889b-d111-4f93-899e-f58292b088b7 service nova] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] Received event network-vif-unplugged-0c5a9562-3fb3-4983-8609-a81a74f572f9 for instance with task_state deleting. {{(pid=72129) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 13:59:29 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] Instance destroyed successfully.
Aug 01 13:59:29 user nova-compute[72129]: DEBUG nova.objects.instance [None req-c6d2f95b-404d-4802-af74-bac0ee31c1bf tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lazy-loading 'resources' on Instance uuid 53dc7cc0-a52f-4540-b2f7-8b947f272628 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-c6d2f95b-404d-4802-af74-bac0ee31c1bf tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:57:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1770940535',display_name='tempest-TestVolumeBootPattern-server-1770940535',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1770940535',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T13:57:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='210837255c8148ec9b482ba3e2551362',ramdisk_id='',reservation_id='r-2qgu9ges',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1876154436',owner_user_name='tempest-TestVolumeBootPattern-1876154436-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T13:57:59Z,user_data=None,user_id='7c341be2816c43cfa9adb58ee84e942b',uuid=53dc7cc0-a52f-4540-b2f7-8b947f272628,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0c5a9562-3fb3-4983-8609-a81a74f572f9", "address": "fa:16:3e:10:1a:57", "network": {"id": "a7f4226b-73fe-4265-ba2c-5d7dcdf154fd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1142462884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210837255c8148ec9b482ba3e2551362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5a9562-3f", "ovs_interfaceid": "0c5a9562-3fb3-4983-8609-a81a74f572f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-c6d2f95b-404d-4802-af74-bac0ee31c1bf tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Converting VIF {"id": "0c5a9562-3fb3-4983-8609-a81a74f572f9", "address": "fa:16:3e:10:1a:57", "network": {"id": "a7f4226b-73fe-4265-ba2c-5d7dcdf154fd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1142462884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210837255c8148ec9b482ba3e2551362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5a9562-3f", "ovs_interfaceid": "0c5a9562-3fb3-4983-8609-a81a74f572f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-c6d2f95b-404d-4802-af74-bac0ee31c1bf tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:1a:57,bridge_name='br-int',has_traffic_filtering=True,id=0c5a9562-3fb3-4983-8609-a81a74f572f9,network=Network(a7f4226b-73fe-4265-ba2c-5d7dcdf154fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c5a9562-3f') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG os_vif [None req-c6d2f95b-404d-4802-af74-bac0ee31c1bf tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:1a:57,bridge_name='br-int',has_traffic_filtering=True,id=0c5a9562-3fb3-4983-8609-a81a74f572f9,network=Network(a7f4226b-73fe-4265-ba2c-5d7dcdf154fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c5a9562-3f') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0c5a9562-3f, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 13:59:29 user nova-compute[72129]: INFO os_vif [None req-c6d2f95b-404d-4802-af74-bac0ee31c1bf tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:1a:57,bridge_name='br-int',has_traffic_filtering=True,id=0c5a9562-3fb3-4983-8609-a81a74f572f9,network=Network(a7f4226b-73fe-4265-ba2c-5d7dcdf154fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c5a9562-3f')
Aug 01 13:59:29 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6d2f95b-404d-4802-af74-bac0ee31c1bf tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] calling os-brick to detach iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d2f95b-404d-4802-af74-bac0ee31c1bf tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, {'target_iqns': ['iqn.2010-10.org.openstack:bd0304ec-0e1c-42bf-bddd-0bd034f51691'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZrkINyWg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:59:29 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-c6d2f95b-404d-4802-af74-bac0ee31c1bf tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 13:59:29 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-c6d2f95b-404d-4802-af74-bac0ee31c1bf tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-c6d2f95b-404d-4802-af74-bac0ee31c1bf tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d2f95b-404d-4802-af74-bac0ee31c1bf tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd0304ec-0e1c-42bf-bddd-0bd034f51691', 0)] {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[820ddcd6-6872-4b57-b6b7-c5b019e522f6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd0304ec-0e1c-42bf-bddd-0bd034f51691\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[0867835c-fe07-4a8d-af62-7f71bc79459f]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd0304ec-0e1c-42bf-bddd-0bd034f51691 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d2f95b-404d-4802-af74-bac0ee31c1bf tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 13:59:29 user nova-compute[72129]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f (non-flash)
Aug 01 13:59:29 user nova-compute[72129]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd0304ec-0e1c-42bf-bddd-0bd034f51691 (non-flash)
Aug 01 13:59:29 user nova-compute[72129]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 (non-flash)
Aug 01 13:59:29 user nova-compute[72129]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d (non-flash)
Aug 01 13:59:29 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d2f95b-404d-4802-af74-bac0ee31c1bf tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 13:59:29 user nova-compute[72129]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f (non-flash)
Aug 01 13:59:29 user nova-compute[72129]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd0304ec-0e1c-42bf-bddd-0bd034f51691 (non-flash)
Aug 01 13:59:29 user nova-compute[72129]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 (non-flash)
Aug 01 13:59:29 user nova-compute[72129]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d (non-flash)
Aug 01 13:59:29 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d2f95b-404d-4802-af74-bac0ee31c1bf tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f28202d2a70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd0304ec-0e1c-42bf-bddd-0bd034f51691'): ({'sde'}, set())}) {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-c6d2f95b-404d-4802-af74-bac0ee31c1bf tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Removing single pathed devices sde {{(pid=72129) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[10710f7b-e550-49ee-abda-6db6138240ee]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.025s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b6057f-2470-4032-a597-2e3a2ec9342a]: (4, ('ok\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-c6d2f95b-404d-4802-af74-bac0ee31c1bf tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Flushing IO for device /dev/sde {{(pid=72129) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c9cd58-7cf0-4e2b-90b4-353059626288]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-c6d2f95b-404d-4802-af74-bac0ee31c1bf tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72129) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5e35a7-af09-407e-b6a2-6c1c3c58bd32]: (4, ('1', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-c6d2f95b-404d-4802-af74-bac0ee31c1bf tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-c6d2f95b-404d-4802-af74-bac0ee31c1bf tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] SCSI volumes sde have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d2f95b-404d-4802-af74-bac0ee31c1bf tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd0304ec-0e1c-42bf-bddd-0bd034f51691')] {{(pid=72129) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd0304ec-0e1c-42bf-bddd-0bd034f51691 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd0304ec-0e1c-42bf-bddd-0bd034f51691 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5273ce3-6698-4a19-9d59-471a94135425]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d2f95b-404d-4802-af74-bac0ee31c1bf tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd0304ec-0e1c-42bf-bddd-0bd034f51691 -p 172.16.0.220:3260 --logout {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd0304ec-0e1c-42bf-bddd-0bd034f51691 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4addd86-965e-4f85-8691-34d043ae880d]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:bd0304ec-0e1c-42bf-bddd-0bd034f51691, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:bd0304ec-0e1c-42bf-bddd-0bd034f51691, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d2f95b-404d-4802-af74-bac0ee31c1bf tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:bd0304ec-0e1c-42bf-bddd-0bd034f51691, portal: 172.16.0.220,3260]
Aug 01 13:59:29 user nova-compute[72129]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:bd0304ec-0e1c-42bf-bddd-0bd034f51691, portal: 172.16.0.220,3260] successful.
Aug 01 13:59:29 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd0304ec-0e1c-42bf-bddd-0bd034f51691 -p 172.16.0.220:3260 --op delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd0304ec-0e1c-42bf-bddd-0bd034f51691 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[9358a559-deb3-4e5b-902f-c407a884add1]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d2f95b-404d-4802-af74-bac0ee31c1bf tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-c6d2f95b-404d-4802-af74-bac0ee31c1bf tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6d2f95b-404d-4802-af74-bac0ee31c1bf tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] <== disconnect_volume: return (361ms) None {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6d2f95b-404d-4802-af74-bac0ee31c1bf tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] Disconnected iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 13:59:29 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-c6d2f95b-404d-4802-af74-bac0ee31c1bf tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] Deleting instance files /opt/stack/data/nova/instances/53dc7cc0-a52f-4540-b2f7-8b947f272628_del
Aug 01 13:59:29 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-c6d2f95b-404d-4802-af74-bac0ee31c1bf tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] Deletion of /opt/stack/data/nova/instances/53dc7cc0-a52f-4540-b2f7-8b947f272628_del complete
Aug 01 13:59:29 user nova-compute[72129]: INFO nova.compute.manager [None req-c6d2f95b-404d-4802-af74-bac0ee31c1bf tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] Took 1.27 seconds to destroy the instance on the hypervisor.
Aug 01 13:59:29 user nova-compute[72129]: DEBUG oslo.service.loopingcall [None req-c6d2f95b-404d-4802-af74-bac0ee31c1bf tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72129) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG nova.compute.manager [-] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] Deallocating network for instance {{(pid=72129) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] deallocate_for_instance() {{(pid=72129) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a24a2882-c8d2-4551-9844-6a19ebcd1ab4 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Calling os-brick to attach iSCSI Volume {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24a2882-c8d2-4551-9844-6a19ebcd1ab4 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ruipGBEm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:59:29 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-a24a2882-c8d2-4551-9844-6a19ebcd1ab4 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 13:59:29 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-a24a2882-c8d2-4551-9844-6a19ebcd1ab4 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-a24a2882-c8d2-4551-9844-6a19ebcd1ab4 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:59:29 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-a24a2882-c8d2-4551-9844-6a19ebcd1ab4 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 13:59:29 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-a24a2882-c8d2-4551-9844-6a19ebcd1ab4 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-a24a2882-c8d2-4551-9844-6a19ebcd1ab4 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:59:29 user nova-compute[72129]: INFO os_brick.initiator.connectors.iscsi [None req-a24a2882-c8d2-4551-9844-6a19ebcd1ab4 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 13:59:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 -p 172.16.0.220:3260 {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[75eaebb1-4382-4c84-b29b-e657a6224df1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24a2882-c8d2-4551-9844-6a19ebcd1ab4 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 13:59:29 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 -p 172.16.0.220:3260 --interface default --op new {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[5191da7a-6863-49af-91b2-26e20abb90fc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4] added\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24a2882-c8d2-4551-9844-6a19ebcd1ab4 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4] added
Aug 01 13:59:29 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[77790db7-ddcc-423f-be6e-4b9532c8ba67]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24a2882-c8d2-4551-9844-6a19ebcd1ab4 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[502ce781-370d-4e1a-877f-8af7801c128d]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24a2882-c8d2-4551-9844-6a19ebcd1ab4 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ruipGBEm {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ruipGBEm" returned: 0 in 0.026s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe4ca72-f08d-48cb-b2fc-2a27f2f390f1]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24a2882-c8d2-4551-9844-6a19ebcd1ab4 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ruipGBEm'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[faff585f-bf58-4961-bd06-88977b577afe]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24a2882-c8d2-4551-9844-6a19ebcd1ab4 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bdf5a77-b3ca-4fba-885d-eb11ef105f9a]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24a2882-c8d2-4551-9844-6a19ebcd1ab4 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 13:59:29 user nova-compute[72129]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f (non-flash)
Aug 01 13:59:29 user nova-compute[72129]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 (non-flash)
Aug 01 13:59:29 user nova-compute[72129]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d (non-flash)
Aug 01 13:59:29 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24a2882-c8d2-4551-9844-6a19ebcd1ab4 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 13:59:29 user nova-compute[72129]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f (non-flash)
Aug 01 13:59:29 user nova-compute[72129]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 (non-flash)
Aug 01 13:59:29 user nova-compute[72129]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d (non-flash)
Aug 01 13:59:29 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:59:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 -p 172.16.0.220:3260 --login {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:59:30 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:59:30 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b579a2f2-2baa-4d1d-94bb-44c17df3679f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:59:30 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24a2882-c8d2-4551-9844-6a19ebcd1ab4 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4, portal: 172.16.0.220,3260]
Aug 01 13:59:30 user nova-compute[72129]: Login to [iface: default, target: iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4, portal: 172.16.0.220,3260] successful.
Aug 01 13:59:30 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:59:30 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:59:30 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:59:30 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a28ab0f-962d-4b3c-a552-2b807ffada42]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:59:30 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24a2882-c8d2-4551-9844-6a19ebcd1ab4 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:59:30 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:59:30 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:59:30 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c853e240-bbaa-498f-b9ed-1f0bf147e7d3]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:59:30 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24a2882-c8d2-4551-9844-6a19ebcd1ab4 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 13:59:30 user nova-compute[72129]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f (non-flash)
Aug 01 13:59:30 user nova-compute[72129]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 (non-flash)
Aug 01 13:59:30 user nova-compute[72129]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d (non-flash)
Aug 01 13:59:30 user nova-compute[72129]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 (non-flash)
Aug 01 13:59:30 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:59:30 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24a2882-c8d2-4551-9844-6a19ebcd1ab4 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 13:59:30 user nova-compute[72129]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f (non-flash)
Aug 01 13:59:30 user nova-compute[72129]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 (non-flash)
Aug 01 13:59:30 user nova-compute[72129]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d (non-flash)
Aug 01 13:59:30 user nova-compute[72129]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 (non-flash)
Aug 01 13:59:30 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:59:30 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-a24a2882-c8d2-4551-9844-6a19ebcd1ab4 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:59:30 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24a2882-c8d2-4551-9844-6a19ebcd1ab4 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Connected to 172.16.0.220:3260 {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 13:59:30 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-a24a2882-c8d2-4551-9844-6a19ebcd1ab4 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] HCTL ('33', '-', '-', 0) found on session 28 with lun 0 {{(pid=72129) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 13:59:30 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-a24a2882-c8d2-4551-9844-6a19ebcd1ab4 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72129) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 13:59:30 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:59:30 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:59:30 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c0268d-973a-40e5-a4cf-651f5b3d3d0a]: (4, ('- - 0', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:59:30 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-a24a2882-c8d2-4551-9844-6a19ebcd1ab4 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 13:59:30 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24a2882-c8d2-4551-9844-6a19ebcd1ab4 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ruipGBEm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 13:59:30 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:59:30 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] Took 0.60 seconds to deallocate network for instance.
Aug 01 13:59:30 user nova-compute[72129]: DEBUG nova.compute.manager [req-fb3e7764-547d-4019-b402-1df32c8e4d6f req-d48639dc-f2cc-4f80-93ca-7c11eeead443 service nova] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] Received event network-vif-plugged-0c5a9562-3fb3-4983-8609-a81a74f572f9 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:59:30 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-fb3e7764-547d-4019-b402-1df32c8e4d6f req-d48639dc-f2cc-4f80-93ca-7c11eeead443 service nova] Acquiring lock "53dc7cc0-a52f-4540-b2f7-8b947f272628-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:59:30 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-fb3e7764-547d-4019-b402-1df32c8e4d6f req-d48639dc-f2cc-4f80-93ca-7c11eeead443 service nova] Lock "53dc7cc0-a52f-4540-b2f7-8b947f272628-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:59:30 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-fb3e7764-547d-4019-b402-1df32c8e4d6f req-d48639dc-f2cc-4f80-93ca-7c11eeead443 service nova] Lock "53dc7cc0-a52f-4540-b2f7-8b947f272628-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:59:30 user nova-compute[72129]: DEBUG nova.compute.manager [req-fb3e7764-547d-4019-b402-1df32c8e4d6f req-d48639dc-f2cc-4f80-93ca-7c11eeead443 service nova] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] No waiting events found dispatching network-vif-plugged-0c5a9562-3fb3-4983-8609-a81a74f572f9 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:59:30 user nova-compute[72129]: WARNING nova.compute.manager [req-fb3e7764-547d-4019-b402-1df32c8e4d6f req-d48639dc-f2cc-4f80-93ca-7c11eeead443 service nova] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] Received unexpected event network-vif-plugged-0c5a9562-3fb3-4983-8609-a81a74f572f9 for instance with vm_state active and task_state deleting.
Aug 01 13:59:30 user nova-compute[72129]: DEBUG nova.compute.manager [req-fb3e7764-547d-4019-b402-1df32c8e4d6f req-d48639dc-f2cc-4f80-93ca-7c11eeead443 service nova] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] Received event network-vif-deleted-0c5a9562-3fb3-4983-8609-a81a74f572f9 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:59:31 user nova-compute[72129]: INFO nova.compute.manager [None req-c6d2f95b-404d-4802-af74-bac0ee31c1bf tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] Took 0.81 seconds to detach 1 volumes for instance.
Aug 01 13:59:31 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-a24a2882-c8d2-4551-9844-6a19ebcd1ab4 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:59:31 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-a24a2882-c8d2-4551-9844-6a19ebcd1ab4 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '26430346237396439', 'path': '/dev/sdb'} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:59:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a24a2882-c8d2-4551-9844-6a19ebcd1ab4 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430346237396439', 'path': '/dev/sdb'} {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 13:59:31 user nova-compute[72129]: DEBUG nova.compute.manager [None req-c6d2f95b-404d-4802-af74-bac0ee31c1bf tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] Deleting volume: bd0304ec-0e1c-42bf-bddd-0bd034f51691 {{(pid=72129) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 01 13:59:31 user nova-compute[72129]: DEBUG nova.objects.instance [None req-a24a2882-c8d2-4551-9844-6a19ebcd1ab4 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lazy-loading 'flavor' on Instance uuid 53b76ca4-30f0-4fd4-9928-714c7073a490 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:59:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-a24a2882-c8d2-4551-9844-6a19ebcd1ab4 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 13:59:31 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 13:59:31 user nova-compute[72129]:   <source dev="/dev/sdb"/>
Aug 01 13:59:31 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 13:59:31 user nova-compute[72129]:   <serial>00288fea-1b8e-4835-8b92-614365fa2be4</serial>
Aug 01 13:59:31 user nova-compute[72129]: </disk>
Aug 01 13:59:31 user nova-compute[72129]:  {{(pid=72129) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 13:59:31 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c6d2f95b-404d-4802-af74-bac0ee31c1bf tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:59:31 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c6d2f95b-404d-4802-af74-bac0ee31c1bf tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:59:31 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-c6d2f95b-404d-4802-af74-bac0ee31c1bf tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 13:59:31 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-c6d2f95b-404d-4802-af74-bac0ee31c1bf tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 13:59:31 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c6d2f95b-404d-4802-af74-bac0ee31c1bf tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.267s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:59:31 user nova-compute[72129]: INFO nova.scheduler.client.report [None req-c6d2f95b-404d-4802-af74-bac0ee31c1bf tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Deleted allocations for instance 53dc7cc0-a52f-4540-b2f7-8b947f272628
Aug 01 13:59:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-a24a2882-c8d2-4551-9844-6a19ebcd1ab4 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 13:59:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-a24a2882-c8d2-4551-9844-6a19ebcd1ab4 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 13:59:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-a24a2882-c8d2-4551-9844-6a19ebcd1ab4 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] No VIF found with MAC fa:16:3e:6b:eb:be, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 13:59:31 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c6d2f95b-404d-4802-af74-bac0ee31c1bf tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "53dc7cc0-a52f-4540-b2f7-8b947f272628" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.198s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:59:31 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a24a2882-c8d2-4551-9844-6a19ebcd1ab4 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "53b76ca4-30f0-4fd4-9928-714c7073a490" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.845s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:59:32 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-014631ff-4350-49c0-a44e-28276f8740dd tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Acquiring lock "53b76ca4-30f0-4fd4-9928-714c7073a490" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:59:32 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-014631ff-4350-49c0-a44e-28276f8740dd tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "53b76ca4-30f0-4fd4-9928-714c7073a490" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:59:32 user nova-compute[72129]: DEBUG nova.compute.manager [None req-014631ff-4350-49c0-a44e-28276f8740dd tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:59:32 user nova-compute[72129]: DEBUG nova.compute.manager [None req-014631ff-4350-49c0-a44e-28276f8740dd tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72129) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 01 13:59:32 user nova-compute[72129]: DEBUG nova.objects.instance [None req-014631ff-4350-49c0-a44e-28276f8740dd tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lazy-loading 'flavor' on Instance uuid 53b76ca4-30f0-4fd4-9928-714c7073a490 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:59:32 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:59:32 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:59:32 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:59:32 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:59:32 user nova-compute[72129]: DEBUG nova.compute.manager [req-336d5472-e7df-4343-bb67-3ba8f5105bb7 req-f00eb1cd-bb8b-4c09-a1ee-26624661ae94 service nova] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Received event network-vif-unplugged-b7271bae-a440-4d06-87d0-cece38122deb {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:59:32 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-336d5472-e7df-4343-bb67-3ba8f5105bb7 req-f00eb1cd-bb8b-4c09-a1ee-26624661ae94 service nova] Acquiring lock "53b76ca4-30f0-4fd4-9928-714c7073a490-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:59:32 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-336d5472-e7df-4343-bb67-3ba8f5105bb7 req-f00eb1cd-bb8b-4c09-a1ee-26624661ae94 service nova] Lock "53b76ca4-30f0-4fd4-9928-714c7073a490-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:59:32 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-336d5472-e7df-4343-bb67-3ba8f5105bb7 req-f00eb1cd-bb8b-4c09-a1ee-26624661ae94 service nova] Lock "53b76ca4-30f0-4fd4-9928-714c7073a490-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:59:32 user nova-compute[72129]: DEBUG nova.compute.manager [req-336d5472-e7df-4343-bb67-3ba8f5105bb7 req-f00eb1cd-bb8b-4c09-a1ee-26624661ae94 service nova] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] No waiting events found dispatching network-vif-unplugged-b7271bae-a440-4d06-87d0-cece38122deb {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:59:32 user nova-compute[72129]: WARNING nova.compute.manager [req-336d5472-e7df-4343-bb67-3ba8f5105bb7 req-f00eb1cd-bb8b-4c09-a1ee-26624661ae94 service nova] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Received unexpected event network-vif-unplugged-b7271bae-a440-4d06-87d0-cece38122deb for instance with vm_state active and task_state powering-off.
Aug 01 13:59:32 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:59:32 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Instance destroyed successfully.
Aug 01 13:59:32 user nova-compute[72129]: DEBUG nova.compute.manager [None req-014631ff-4350-49c0-a44e-28276f8740dd tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:59:33 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-014631ff-4350-49c0-a44e-28276f8740dd tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "53b76ca4-30f0-4fd4-9928-714c7073a490" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.951s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:59:34 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:59:34 user nova-compute[72129]: DEBUG nova.compute.manager [req-e9116a02-77c7-495e-9966-2ba11cdc5077 req-93a7908f-f896-43ee-b547-0ea2aa65512a service nova] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Received event network-vif-plugged-b7271bae-a440-4d06-87d0-cece38122deb {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:59:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-e9116a02-77c7-495e-9966-2ba11cdc5077 req-93a7908f-f896-43ee-b547-0ea2aa65512a service nova] Acquiring lock "53b76ca4-30f0-4fd4-9928-714c7073a490-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:59:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-e9116a02-77c7-495e-9966-2ba11cdc5077 req-93a7908f-f896-43ee-b547-0ea2aa65512a service nova] Lock "53b76ca4-30f0-4fd4-9928-714c7073a490-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:59:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-e9116a02-77c7-495e-9966-2ba11cdc5077 req-93a7908f-f896-43ee-b547-0ea2aa65512a service nova] Lock "53b76ca4-30f0-4fd4-9928-714c7073a490-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:59:34 user nova-compute[72129]: DEBUG nova.compute.manager [req-e9116a02-77c7-495e-9966-2ba11cdc5077 req-93a7908f-f896-43ee-b547-0ea2aa65512a service nova] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] No waiting events found dispatching network-vif-plugged-b7271bae-a440-4d06-87d0-cece38122deb {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:59:34 user nova-compute[72129]: WARNING nova.compute.manager [req-e9116a02-77c7-495e-9966-2ba11cdc5077 req-93a7908f-f896-43ee-b547-0ea2aa65512a service nova] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Received unexpected event network-vif-plugged-b7271bae-a440-4d06-87d0-cece38122deb for instance with vm_state stopped and task_state None.
Aug 01 13:59:35 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:59:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:59:38 user nova-compute[72129]: DEBUG nova.compute.manager [req-755dbe14-8413-4968-bf6a-291e6aabfd9e req-a4f6ee50-bc55-4d23-8c1c-02794b1d3aec service nova] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Received event network-changed-04bc1afa-2e8a-4dd9-961f-e695f43e3061 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:59:38 user nova-compute[72129]: DEBUG nova.compute.manager [req-755dbe14-8413-4968-bf6a-291e6aabfd9e req-a4f6ee50-bc55-4d23-8c1c-02794b1d3aec service nova] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Refreshing instance network info cache due to event network-changed-04bc1afa-2e8a-4dd9-961f-e695f43e3061. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 13:59:38 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-755dbe14-8413-4968-bf6a-291e6aabfd9e req-a4f6ee50-bc55-4d23-8c1c-02794b1d3aec service nova] Acquiring lock "refresh_cache-8e5e94dd-b575-48f1-a617-1bd917567220" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:59:38 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-755dbe14-8413-4968-bf6a-291e6aabfd9e req-a4f6ee50-bc55-4d23-8c1c-02794b1d3aec service nova] Acquired lock "refresh_cache-8e5e94dd-b575-48f1-a617-1bd917567220" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:59:38 user nova-compute[72129]: DEBUG nova.network.neutron [req-755dbe14-8413-4968-bf6a-291e6aabfd9e req-a4f6ee50-bc55-4d23-8c1c-02794b1d3aec service nova] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Refreshing network info cache for port 04bc1afa-2e8a-4dd9-961f-e695f43e3061 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 13:59:38 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:59:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:59:39 user nova-compute[72129]: DEBUG nova.network.neutron [req-755dbe14-8413-4968-bf6a-291e6aabfd9e req-a4f6ee50-bc55-4d23-8c1c-02794b1d3aec service nova] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Updated VIF entry in instance network info cache for port 04bc1afa-2e8a-4dd9-961f-e695f43e3061. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 13:59:39 user nova-compute[72129]: DEBUG nova.network.neutron [req-755dbe14-8413-4968-bf6a-291e6aabfd9e req-a4f6ee50-bc55-4d23-8c1c-02794b1d3aec service nova] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Updating instance_info_cache with network_info: [{"id": "04bc1afa-2e8a-4dd9-961f-e695f43e3061", "address": "fa:16:3e:69:a4:f0", "network": {"id": "567d2893-d3e8-41e1-a0fe-4414df317d0c", "bridge": "br-int", "label": "tempest-TestShelveInstance-887577340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e0c65958662420fa6d8d73c5e9fdc25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04bc1afa-2e", "ovs_interfaceid": "04bc1afa-2e8a-4dd9-961f-e695f43e3061", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:59:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-755dbe14-8413-4968-bf6a-291e6aabfd9e req-a4f6ee50-bc55-4d23-8c1c-02794b1d3aec service nova] Releasing lock "refresh_cache-8e5e94dd-b575-48f1-a617-1bd917567220" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:59:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-3f4e25af-909c-46c0-aad1-d1869d315913 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Acquiring lock "8e5e94dd-b575-48f1-a617-1bd917567220" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:59:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-3f4e25af-909c-46c0-aad1-d1869d315913 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Lock "8e5e94dd-b575-48f1-a617-1bd917567220" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:59:39 user nova-compute[72129]: INFO nova.compute.manager [None req-3f4e25af-909c-46c0-aad1-d1869d315913 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Shelve offloading
Aug 01 13:59:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:59:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:59:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:59:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:59:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:59:40 user nova-compute[72129]: DEBUG nova.compute.manager [req-8cd17793-1d8b-4ae9-be7a-679bed8cc924 req-143b5905-36c8-4ef2-8f16-8fc5c9d03f36 service nova] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Received event network-vif-unplugged-04bc1afa-2e8a-4dd9-961f-e695f43e3061 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:59:40 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-8cd17793-1d8b-4ae9-be7a-679bed8cc924 req-143b5905-36c8-4ef2-8f16-8fc5c9d03f36 service nova] Acquiring lock "8e5e94dd-b575-48f1-a617-1bd917567220-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:59:40 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-8cd17793-1d8b-4ae9-be7a-679bed8cc924 req-143b5905-36c8-4ef2-8f16-8fc5c9d03f36 service nova] Lock "8e5e94dd-b575-48f1-a617-1bd917567220-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:59:40 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-8cd17793-1d8b-4ae9-be7a-679bed8cc924 req-143b5905-36c8-4ef2-8f16-8fc5c9d03f36 service nova] Lock "8e5e94dd-b575-48f1-a617-1bd917567220-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:59:40 user nova-compute[72129]: DEBUG nova.compute.manager [req-8cd17793-1d8b-4ae9-be7a-679bed8cc924 req-143b5905-36c8-4ef2-8f16-8fc5c9d03f36 service nova] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] No waiting events found dispatching network-vif-unplugged-04bc1afa-2e8a-4dd9-961f-e695f43e3061 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:59:40 user nova-compute[72129]: WARNING nova.compute.manager [req-8cd17793-1d8b-4ae9-be7a-679bed8cc924 req-143b5905-36c8-4ef2-8f16-8fc5c9d03f36 service nova] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Received unexpected event network-vif-unplugged-04bc1afa-2e8a-4dd9-961f-e695f43e3061 for instance with vm_state active and task_state shelving.
Aug 01 13:59:40 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Instance destroyed successfully.
Aug 01 13:59:40 user nova-compute[72129]: DEBUG nova.compute.manager [None req-3f4e25af-909c-46c0-aad1-d1869d315913 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:59:40 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-3f4e25af-909c-46c0-aad1-d1869d315913 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Acquiring lock "refresh_cache-8e5e94dd-b575-48f1-a617-1bd917567220" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:59:40 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-3f4e25af-909c-46c0-aad1-d1869d315913 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Acquired lock "refresh_cache-8e5e94dd-b575-48f1-a617-1bd917567220" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:59:40 user nova-compute[72129]: DEBUG nova.network.neutron [None req-3f4e25af-909c-46c0-aad1-d1869d315913 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 13:59:40 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:59:41 user nova-compute[72129]: DEBUG nova.network.neutron [None req-3f4e25af-909c-46c0-aad1-d1869d315913 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Updating instance_info_cache with network_info: [{"id": "04bc1afa-2e8a-4dd9-961f-e695f43e3061", "address": "fa:16:3e:69:a4:f0", "network": {"id": "567d2893-d3e8-41e1-a0fe-4414df317d0c", "bridge": "br-int", "label": "tempest-TestShelveInstance-887577340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e0c65958662420fa6d8d73c5e9fdc25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04bc1afa-2e", "ovs_interfaceid": "04bc1afa-2e8a-4dd9-961f-e695f43e3061", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:59:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-3f4e25af-909c-46c0-aad1-d1869d315913 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Releasing lock "refresh_cache-8e5e94dd-b575-48f1-a617-1bd917567220" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:59:42 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Instance destroyed successfully.
Aug 01 13:59:42 user nova-compute[72129]: DEBUG nova.objects.instance [None req-3f4e25af-909c-46c0-aad1-d1869d315913 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Lazy-loading 'resources' on Instance uuid 8e5e94dd-b575-48f1-a617-1bd917567220 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:59:42 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-3f4e25af-909c-46c0-aad1-d1869d315913 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:57:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1168215618',display_name='tempest-TestShelveInstance-server-1168215618',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1168215618',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNFarSMkiI7/JpPdcoHACAwX8uNCAoNCeZYHIIMICpbfXLOVKT0O+wIjjJ8GmZRehNvjG5JuqMkHRVBmF7oISjKtI62K0zyKSE4F/GhjI/49epXOdkazkwngdzB9LjRJNQ==',key_name='tempest-TestShelveInstance-909637078',keypairs=<?>,launch_index=0,launched_at=2023-08-01T13:58:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4e0c65958662420fa6d8d73c5e9fdc25',ramdisk_id='',reservation_id='r-xsrkrpme',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-419749450',owner_user_name='tempest-TestShelveInstance-419749450-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T13:58:03Z,user_data=None,user_id='fde5b0e7d7664dfe9f4d9ce0dc20a8e4',uuid=8e5e94dd-b575-48f1-a617-1bd917567220,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "04bc1afa-2e8a-4dd9-961f-e695f43e3061", "address": "fa:16:3e:69:a4:f0", "network": {"id": "567d2893-d3e8-41e1-a0fe-4414df317d0c", "bridge": "br-int", "label": "tempest-TestShelveInstance-887577340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e0c65958662420fa6d8d73c5e9fdc25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04bc1afa-2e", "ovs_interfaceid": "04bc1afa-2e8a-4dd9-961f-e695f43e3061", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 13:59:42 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-3f4e25af-909c-46c0-aad1-d1869d315913 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Converting VIF {"id": "04bc1afa-2e8a-4dd9-961f-e695f43e3061", "address": "fa:16:3e:69:a4:f0", "network": {"id": "567d2893-d3e8-41e1-a0fe-4414df317d0c", "bridge": "br-int", "label": "tempest-TestShelveInstance-887577340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e0c65958662420fa6d8d73c5e9fdc25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04bc1afa-2e", "ovs_interfaceid": "04bc1afa-2e8a-4dd9-961f-e695f43e3061", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:59:42 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-3f4e25af-909c-46c0-aad1-d1869d315913 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:a4:f0,bridge_name='br-int',has_traffic_filtering=True,id=04bc1afa-2e8a-4dd9-961f-e695f43e3061,network=Network(567d2893-d3e8-41e1-a0fe-4414df317d0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04bc1afa-2e') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:59:42 user nova-compute[72129]: DEBUG os_vif [None req-3f4e25af-909c-46c0-aad1-d1869d315913 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:a4:f0,bridge_name='br-int',has_traffic_filtering=True,id=04bc1afa-2e8a-4dd9-961f-e695f43e3061,network=Network(567d2893-d3e8-41e1-a0fe-4414df317d0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04bc1afa-2e') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 13:59:42 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:59:42 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap04bc1afa-2e, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:59:42 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:59:42 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 13:59:42 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:59:42 user nova-compute[72129]: INFO os_vif [None req-3f4e25af-909c-46c0-aad1-d1869d315913 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:a4:f0,bridge_name='br-int',has_traffic_filtering=True,id=04bc1afa-2e8a-4dd9-961f-e695f43e3061,network=Network(567d2893-d3e8-41e1-a0fe-4414df317d0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04bc1afa-2e')
Aug 01 13:59:42 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f4e25af-909c-46c0-aad1-d1869d315913 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] calling os-brick to detach iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 13:59:42 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f4e25af-909c-46c0-aad1-d1869d315913 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, {'target_iqns': ['iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'anVDsYRG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:59:42 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-3f4e25af-909c-46c0-aad1-d1869d315913 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 13:59:42 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-3f4e25af-909c-46c0-aad1-d1869d315913 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:59:42 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-3f4e25af-909c-46c0-aad1-d1869d315913 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:59:42 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f4e25af-909c-46c0-aad1-d1869d315913 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d', 0)] {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 13:59:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:59:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:59:42 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47e8e32-14ed-43bf-88ff-54e20cfb5bf2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:59:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:59:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:59:42 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[7639821f-f155-4be2-ad67-f07bb0646ce5]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:59:42 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f4e25af-909c-46c0-aad1-d1869d315913 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 13:59:42 user nova-compute[72129]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f (non-flash)
Aug 01 13:59:42 user nova-compute[72129]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 (non-flash)
Aug 01 13:59:42 user nova-compute[72129]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d (non-flash)
Aug 01 13:59:42 user nova-compute[72129]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 (non-flash)
Aug 01 13:59:42 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:59:42 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f4e25af-909c-46c0-aad1-d1869d315913 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 13:59:42 user nova-compute[72129]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f (non-flash)
Aug 01 13:59:42 user nova-compute[72129]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 (non-flash)
Aug 01 13:59:42 user nova-compute[72129]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d (non-flash)
Aug 01 13:59:42 user nova-compute[72129]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 (non-flash)
Aug 01 13:59:42 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:59:42 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f4e25af-909c-46c0-aad1-d1869d315913 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f28201505e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d'): ({'sdg'}, set())}) {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 13:59:42 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-3f4e25af-909c-46c0-aad1-d1869d315913 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Removing single pathed devices sdg {{(pid=72129) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 13:59:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:59:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:59:42 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe35da9c-a9cb-4843-97b4-3a60a95b1058]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:59:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:59:42 user nova-compute[72129]: DEBUG nova.compute.manager [req-0fc5e469-b817-4a8d-9fca-63af22304d3d req-b28af779-2db9-4f8d-a150-98b7cc1f77c2 service nova] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Received event network-vif-plugged-04bc1afa-2e8a-4dd9-961f-e695f43e3061 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:59:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-0fc5e469-b817-4a8d-9fca-63af22304d3d req-b28af779-2db9-4f8d-a150-98b7cc1f77c2 service nova] Acquiring lock "8e5e94dd-b575-48f1-a617-1bd917567220-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:59:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-0fc5e469-b817-4a8d-9fca-63af22304d3d req-b28af779-2db9-4f8d-a150-98b7cc1f77c2 service nova] Lock "8e5e94dd-b575-48f1-a617-1bd917567220-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:59:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-0fc5e469-b817-4a8d-9fca-63af22304d3d req-b28af779-2db9-4f8d-a150-98b7cc1f77c2 service nova] Lock "8e5e94dd-b575-48f1-a617-1bd917567220-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:59:42 user nova-compute[72129]: DEBUG nova.compute.manager [req-0fc5e469-b817-4a8d-9fca-63af22304d3d req-b28af779-2db9-4f8d-a150-98b7cc1f77c2 service nova] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] No waiting events found dispatching network-vif-plugged-04bc1afa-2e8a-4dd9-961f-e695f43e3061 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:59:42 user nova-compute[72129]: WARNING nova.compute.manager [req-0fc5e469-b817-4a8d-9fca-63af22304d3d req-b28af779-2db9-4f8d-a150-98b7cc1f77c2 service nova] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Received unexpected event network-vif-plugged-04bc1afa-2e8a-4dd9-961f-e695f43e3061 for instance with vm_state active and task_state shelving.
Aug 01 13:59:42 user nova-compute[72129]: DEBUG nova.compute.manager [req-0fc5e469-b817-4a8d-9fca-63af22304d3d req-b28af779-2db9-4f8d-a150-98b7cc1f77c2 service nova] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Received event network-changed-04bc1afa-2e8a-4dd9-961f-e695f43e3061 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:59:42 user nova-compute[72129]: DEBUG nova.compute.manager [req-0fc5e469-b817-4a8d-9fca-63af22304d3d req-b28af779-2db9-4f8d-a150-98b7cc1f77c2 service nova] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Refreshing instance network info cache due to event network-changed-04bc1afa-2e8a-4dd9-961f-e695f43e3061. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 13:59:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-0fc5e469-b817-4a8d-9fca-63af22304d3d req-b28af779-2db9-4f8d-a150-98b7cc1f77c2 service nova] Acquiring lock "refresh_cache-8e5e94dd-b575-48f1-a617-1bd917567220" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:59:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-0fc5e469-b817-4a8d-9fca-63af22304d3d req-b28af779-2db9-4f8d-a150-98b7cc1f77c2 service nova] Acquired lock "refresh_cache-8e5e94dd-b575-48f1-a617-1bd917567220" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:59:42 user nova-compute[72129]: DEBUG nova.network.neutron [req-0fc5e469-b817-4a8d-9fca-63af22304d3d req-b28af779-2db9-4f8d-a150-98b7cc1f77c2 service nova] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Refreshing network info cache for port 04bc1afa-2e8a-4dd9-961f-e695f43e3061 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 13:59:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.039s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:59:42 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a9dfaa-0883-4e0c-88fc-3258263de52a]: (4, ('ok\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:59:42 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-3f4e25af-909c-46c0-aad1-d1869d315913 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Flushing IO for device /dev/sdg {{(pid=72129) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 13:59:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:59:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:59:42 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03c1878-74dd-4e17-99ef-65fa87ff6361]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:59:42 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-3f4e25af-909c-46c0-aad1-d1869d315913 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72129) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 13:59:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:59:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.045s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:59:42 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf94f4f-ac7e-4c92-b4f7-7e9fa069a6c0]: (4, ('1', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:59:42 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-3f4e25af-909c-46c0-aad1-d1869d315913 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 13:59:42 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-3f4e25af-909c-46c0-aad1-d1869d315913 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] SCSI volumes sdg have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 13:59:42 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f4e25af-909c-46c0-aad1-d1869d315913 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d')] {{(pid=72129) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 13:59:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:59:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:59:42 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd994d46-1b90-47e8-a42e-d55e77a9c861]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:59:42 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f4e25af-909c-46c0-aad1-d1869d315913 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:59:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d -p 172.16.0.220:3260 --logout {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:59:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:59:42 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f50cc5-9fe0-49cc-b0d3-ec28bb4ca429]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:59:42 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f4e25af-909c-46c0-aad1-d1869d315913 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d, portal: 172.16.0.220,3260]
Aug 01 13:59:42 user nova-compute[72129]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d, portal: 172.16.0.220,3260] successful.
Aug 01 13:59:42 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:59:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d -p 172.16.0.220:3260 --op delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:59:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:59:42 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaead650-a53b-474a-9c97-b9990789eea1]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:59:42 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f4e25af-909c-46c0-aad1-d1869d315913 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:59:42 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-3f4e25af-909c-46c0-aad1-d1869d315913 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:59:42 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f4e25af-909c-46c0-aad1-d1869d315913 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] <== disconnect_volume: return (347ms) None {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:59:42 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f4e25af-909c-46c0-aad1-d1869d315913 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Disconnected iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 13:59:42 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-3f4e25af-909c-46c0-aad1-d1869d315913 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Deleting instance files /opt/stack/data/nova/instances/8e5e94dd-b575-48f1-a617-1bd917567220_del
Aug 01 13:59:42 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-3f4e25af-909c-46c0-aad1-d1869d315913 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Deletion of /opt/stack/data/nova/instances/8e5e94dd-b575-48f1-a617-1bd917567220_del complete
Aug 01 13:59:43 user nova-compute[72129]: DEBUG nova.network.neutron [req-0fc5e469-b817-4a8d-9fca-63af22304d3d req-b28af779-2db9-4f8d-a150-98b7cc1f77c2 service nova] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Updated VIF entry in instance network info cache for port 04bc1afa-2e8a-4dd9-961f-e695f43e3061. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 13:59:43 user nova-compute[72129]: DEBUG nova.network.neutron [req-0fc5e469-b817-4a8d-9fca-63af22304d3d req-b28af779-2db9-4f8d-a150-98b7cc1f77c2 service nova] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Updating instance_info_cache with network_info: [{"id": "04bc1afa-2e8a-4dd9-961f-e695f43e3061", "address": "fa:16:3e:69:a4:f0", "network": {"id": "567d2893-d3e8-41e1-a0fe-4414df317d0c", "bridge": null, "label": "tempest-TestShelveInstance-887577340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e0c65958662420fa6d8d73c5e9fdc25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap04bc1afa-2e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:59:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-0fc5e469-b817-4a8d-9fca-63af22304d3d req-b28af779-2db9-4f8d-a150-98b7cc1f77c2 service nova] Releasing lock "refresh_cache-8e5e94dd-b575-48f1-a617-1bd917567220" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:59:43 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:59:43 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:59:43 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:59:43 user nova-compute[72129]: INFO nova.scheduler.client.report [None req-3f4e25af-909c-46c0-aad1-d1869d315913 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Deleted allocations for instance 8e5e94dd-b575-48f1-a617-1bd917567220
Aug 01 13:59:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-3f4e25af-909c-46c0-aad1-d1869d315913 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:59:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-3f4e25af-909c-46c0-aad1-d1869d315913 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:59:43 user nova-compute[72129]: DEBUG nova.objects.instance [None req-3f4e25af-909c-46c0-aad1-d1869d315913 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Lazy-loading 'numa_topology' on Instance uuid 8e5e94dd-b575-48f1-a617-1bd917567220 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:59:44 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:59:44 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Starting heal instance info cache {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 13:59:44 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-3f4e25af-909c-46c0-aad1-d1869d315913 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 13:59:44 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-3f4e25af-909c-46c0-aad1-d1869d315913 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 13:59:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-3f4e25af-909c-46c0-aad1-d1869d315913 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.302s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:59:44 user nova-compute[72129]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690898369.2144172, 53dc7cc0-a52f-4540-b2f7-8b947f272628 => Stopped> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:59:44 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] VM Stopped (Lifecycle Event)
Aug 01 13:59:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-3f4e25af-909c-46c0-aad1-d1869d315913 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Lock "8e5e94dd-b575-48f1-a617-1bd917567220" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.572s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:59:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "refresh_cache-0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:59:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquired lock "refresh_cache-0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:59:44 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Forcefully refreshing network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 13:59:44 user nova-compute[72129]: DEBUG nova.compute.manager [None req-c63beeb3-88c4-48de-94d8-a97c230f5b2c None None] [instance: 53dc7cc0-a52f-4540-b2f7-8b947f272628] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:59:44 user nova-compute[72129]: DEBUG nova.compute.manager [req-a54cfdbf-41b8-415c-88c1-7349c7a88038 req-9f8773c0-8b13-4512-b819-f4aa1b24789b service nova] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Received event network-changed-09dc6abd-1d55-4e2d-8568-1f793ca45413 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:59:44 user nova-compute[72129]: DEBUG nova.compute.manager [req-a54cfdbf-41b8-415c-88c1-7349c7a88038 req-9f8773c0-8b13-4512-b819-f4aa1b24789b service nova] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Refreshing instance network info cache due to event network-changed-09dc6abd-1d55-4e2d-8568-1f793ca45413. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 13:59:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-a54cfdbf-41b8-415c-88c1-7349c7a88038 req-9f8773c0-8b13-4512-b819-f4aa1b24789b service nova] Acquiring lock "refresh_cache-133076de-14b5-4ceb-aa41-d9acef8506c5" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:59:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-a54cfdbf-41b8-415c-88c1-7349c7a88038 req-9f8773c0-8b13-4512-b819-f4aa1b24789b service nova] Acquired lock "refresh_cache-133076de-14b5-4ceb-aa41-d9acef8506c5" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:59:44 user nova-compute[72129]: DEBUG nova.network.neutron [req-a54cfdbf-41b8-415c-88c1-7349c7a88038 req-9f8773c0-8b13-4512-b819-f4aa1b24789b service nova] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Refreshing network info cache for port 09dc6abd-1d55-4e2d-8568-1f793ca45413 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 13:59:44 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Updating instance_info_cache with network_info: [{"id": "d4f68f78-6df9-41b7-8d32-27f55f224683", "address": "fa:16:3e:23:49:b3", "network": {"id": "59b1e538-8bfe-45ce-ab7b-c5838ab25582", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1129024349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0929886fa54d1c8023793806f10d31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f68f78-6d", "ovs_interfaceid": "d4f68f78-6df9-41b7-8d32-27f55f224683", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:59:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Releasing lock "refresh_cache-0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:59:44 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Updated the network info_cache for instance {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 13:59:44 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:59:45 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:59:45 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72129) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 13:59:45 user nova-compute[72129]: DEBUG nova.network.neutron [req-a54cfdbf-41b8-415c-88c1-7349c7a88038 req-9f8773c0-8b13-4512-b819-f4aa1b24789b service nova] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Updated VIF entry in instance network info cache for port 09dc6abd-1d55-4e2d-8568-1f793ca45413. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 13:59:45 user nova-compute[72129]: DEBUG nova.network.neutron [req-a54cfdbf-41b8-415c-88c1-7349c7a88038 req-9f8773c0-8b13-4512-b819-f4aa1b24789b service nova] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Updating instance_info_cache with network_info: [{"id": "09dc6abd-1d55-4e2d-8568-1f793ca45413", "address": "fa:16:3e:d3:ee:e0", "network": {"id": "a7ec6cc0-140b-446b-ae97-d4aafbc42693", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-397303278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43253b37caa747b090b14c707abf96cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09dc6abd-1d", "ovs_interfaceid": "09dc6abd-1d55-4e2d-8568-1f793ca45413", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:59:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-a54cfdbf-41b8-415c-88c1-7349c7a88038 req-9f8773c0-8b13-4512-b819-f4aa1b24789b service nova] Releasing lock "refresh_cache-133076de-14b5-4ceb-aa41-d9acef8506c5" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:59:45 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:59:46 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:59:46 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:59:46 user nova-compute[72129]: DEBUG nova.compute.manager [req-eb16ab16-8fb7-42f4-b400-47bd9debebbb req-6f354890-2c09-41b1-9d44-fbd9deb085f9 service nova] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Received event network-changed-09dc6abd-1d55-4e2d-8568-1f793ca45413 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:59:46 user nova-compute[72129]: DEBUG nova.compute.manager [req-eb16ab16-8fb7-42f4-b400-47bd9debebbb req-6f354890-2c09-41b1-9d44-fbd9deb085f9 service nova] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Refreshing instance network info cache due to event network-changed-09dc6abd-1d55-4e2d-8568-1f793ca45413. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 13:59:46 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-eb16ab16-8fb7-42f4-b400-47bd9debebbb req-6f354890-2c09-41b1-9d44-fbd9deb085f9 service nova] Acquiring lock "refresh_cache-133076de-14b5-4ceb-aa41-d9acef8506c5" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:59:46 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-eb16ab16-8fb7-42f4-b400-47bd9debebbb req-6f354890-2c09-41b1-9d44-fbd9deb085f9 service nova] Acquired lock "refresh_cache-133076de-14b5-4ceb-aa41-d9acef8506c5" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:59:46 user nova-compute[72129]: DEBUG nova.network.neutron [req-eb16ab16-8fb7-42f4-b400-47bd9debebbb req-6f354890-2c09-41b1-9d44-fbd9deb085f9 service nova] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Refreshing network info cache for port 09dc6abd-1d55-4e2d-8568-1f793ca45413 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 13:59:46 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:59:46 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9b7b3707-3a04-4dd4-ae3c-2e3f44324ae7 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Acquiring lock "133076de-14b5-4ceb-aa41-d9acef8506c5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:59:46 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9b7b3707-3a04-4dd4-ae3c-2e3f44324ae7 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lock "133076de-14b5-4ceb-aa41-d9acef8506c5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:59:46 user nova-compute[72129]: INFO nova.compute.manager [None req-9b7b3707-3a04-4dd4-ae3c-2e3f44324ae7 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Detaching volume a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2
Aug 01 13:59:46 user nova-compute[72129]: INFO nova.virt.block_device [None req-9b7b3707-3a04-4dd4-ae3c-2e3f44324ae7 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Attempting to driver detach volume a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 from mountpoint /dev/vdb
Aug 01 13:59:46 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9b7b3707-3a04-4dd4-ae3c-2e3f44324ae7 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Attempting to detach device vdb from instance 133076de-14b5-4ceb-aa41-d9acef8506c5 from the persistent domain config. {{(pid=72129) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 13:59:46 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-9b7b3707-3a04-4dd4-ae3c-2e3f44324ae7 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 13:59:46 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 13:59:46 user nova-compute[72129]:   <source dev="/dev/sdf"/>
Aug 01 13:59:46 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 13:59:46 user nova-compute[72129]:   <serial>a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2</serial>
Aug 01 13:59:46 user nova-compute[72129]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 01 13:59:46 user nova-compute[72129]: </disk>
Aug 01 13:59:46 user nova-compute[72129]:  {{(pid=72129) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 13:59:46 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-9b7b3707-3a04-4dd4-ae3c-2e3f44324ae7 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Successfully detached device vdb from instance 133076de-14b5-4ceb-aa41-d9acef8506c5 from the persistent domain config.
Aug 01 13:59:46 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9b7b3707-3a04-4dd4-ae3c-2e3f44324ae7 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 133076de-14b5-4ceb-aa41-d9acef8506c5 from the live domain config. {{(pid=72129) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 13:59:46 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-9b7b3707-3a04-4dd4-ae3c-2e3f44324ae7 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 13:59:46 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 13:59:46 user nova-compute[72129]:   <source dev="/dev/sdf"/>
Aug 01 13:59:46 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 13:59:46 user nova-compute[72129]:   <serial>a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2</serial>
Aug 01 13:59:46 user nova-compute[72129]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 01 13:59:46 user nova-compute[72129]: </disk>
Aug 01 13:59:46 user nova-compute[72129]:  {{(pid=72129) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 13:59:47 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:59:47 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:59:47 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Received event <DeviceRemovedEvent: 1690898387.430292, 133076de-14b5-4ceb-aa41-d9acef8506c5 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72129) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 13:59:47 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9b7b3707-3a04-4dd4-ae3c-2e3f44324ae7 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 133076de-14b5-4ceb-aa41-d9acef8506c5 {{(pid=72129) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 13:59:47 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-9b7b3707-3a04-4dd4-ae3c-2e3f44324ae7 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Successfully detached device vdb from instance 133076de-14b5-4ceb-aa41-d9acef8506c5 from the live domain config.
Aug 01 13:59:47 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b7b3707-3a04-4dd4-ae3c-2e3f44324ae7 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] calling os-brick to detach iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 13:59:47 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b7b3707-3a04-4dd4-ae3c-2e3f44324ae7 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, {'target_iqns': ['iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OqyRvkgp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:59:47 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-9b7b3707-3a04-4dd4-ae3c-2e3f44324ae7 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 13:59:47 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-9b7b3707-3a04-4dd4-ae3c-2e3f44324ae7 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:59:47 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-9b7b3707-3a04-4dd4-ae3c-2e3f44324ae7 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:59:47 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b7b3707-3a04-4dd4-ae3c-2e3f44324ae7 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2', 0)] {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 13:59:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:59:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:59:47 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37ffd97-58a6-42e5-8735-3d2707419994]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:59:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:59:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:59:47 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb068f3-f298-4030-8310-617928353193]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:59:47 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b7b3707-3a04-4dd4-ae3c-2e3f44324ae7 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 13:59:47 user nova-compute[72129]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f (non-flash)
Aug 01 13:59:47 user nova-compute[72129]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 (non-flash)
Aug 01 13:59:47 user nova-compute[72129]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 (non-flash)
Aug 01 13:59:47 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:59:47 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b7b3707-3a04-4dd4-ae3c-2e3f44324ae7 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 13:59:47 user nova-compute[72129]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f (non-flash)
Aug 01 13:59:47 user nova-compute[72129]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 (non-flash)
Aug 01 13:59:47 user nova-compute[72129]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 (non-flash)
Aug 01 13:59:47 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:59:47 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b7b3707-3a04-4dd4-ae3c-2e3f44324ae7 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f28281192d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2'): ({'sdf'}, set())}) {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 13:59:47 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-9b7b3707-3a04-4dd4-ae3c-2e3f44324ae7 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Removing single pathed devices sdf {{(pid=72129) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 13:59:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:59:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:59:47 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9470b1-fd38-4621-a569-1e77a4804c1d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:59:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:59:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:59:47 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67bf7dd-d447-4748-8a3c-8f80ee47f18b]: (4, ('ok\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:59:47 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-9b7b3707-3a04-4dd4-ae3c-2e3f44324ae7 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Flushing IO for device /dev/sdf {{(pid=72129) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 13:59:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:59:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.027s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:59:47 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d632e8e-966a-482a-a7db-55715354403d]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:59:47 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-9b7b3707-3a04-4dd4-ae3c-2e3f44324ae7 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72129) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 13:59:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:59:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.051s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:59:47 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb9fded-bd96-4490-8470-13507e584130]: (4, ('1', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:59:47 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-9b7b3707-3a04-4dd4-ae3c-2e3f44324ae7 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 13:59:47 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-9b7b3707-3a04-4dd4-ae3c-2e3f44324ae7 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] SCSI volumes sdf have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 13:59:47 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b7b3707-3a04-4dd4-ae3c-2e3f44324ae7 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2')] {{(pid=72129) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 13:59:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:59:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:59:47 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ba773b-8542-4448-9a4c-e294b3d9eec9]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:59:47 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b7b3707-3a04-4dd4-ae3c-2e3f44324ae7 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:59:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 -p 172.16.0.220:3260 --logout {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:59:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:59:47 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[9503d421-3b13-4a58-85c8-c47b45b80793]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:59:47 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b7b3707-3a04-4dd4-ae3c-2e3f44324ae7 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2, portal: 172.16.0.220,3260]
Aug 01 13:59:47 user nova-compute[72129]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2, portal: 172.16.0.220,3260] successful.
Aug 01 13:59:47 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:59:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 -p 172.16.0.220:3260 --op delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:59:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a10e05fe-1ae8-453f-8d8d-f9f51c2e41d2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:59:47 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c20689-0db0-4229-8ba2-f3a73324f576]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:59:47 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b7b3707-3a04-4dd4-ae3c-2e3f44324ae7 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:59:47 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-9b7b3707-3a04-4dd4-ae3c-2e3f44324ae7 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:59:47 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b7b3707-3a04-4dd4-ae3c-2e3f44324ae7 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] <== disconnect_volume: return (349ms) None {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:59:47 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b7b3707-3a04-4dd4-ae3c-2e3f44324ae7 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Disconnected iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 13:59:47 user nova-compute[72129]: DEBUG nova.network.neutron [req-eb16ab16-8fb7-42f4-b400-47bd9debebbb req-6f354890-2c09-41b1-9d44-fbd9deb085f9 service nova] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Updated VIF entry in instance network info cache for port 09dc6abd-1d55-4e2d-8568-1f793ca45413. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 13:59:47 user nova-compute[72129]: DEBUG nova.network.neutron [req-eb16ab16-8fb7-42f4-b400-47bd9debebbb req-6f354890-2c09-41b1-9d44-fbd9deb085f9 service nova] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Updating instance_info_cache with network_info: [{"id": "09dc6abd-1d55-4e2d-8568-1f793ca45413", "address": "fa:16:3e:d3:ee:e0", "network": {"id": "a7ec6cc0-140b-446b-ae97-d4aafbc42693", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-397303278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43253b37caa747b090b14c707abf96cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09dc6abd-1d", "ovs_interfaceid": "09dc6abd-1d55-4e2d-8568-1f793ca45413", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:59:47 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-eb16ab16-8fb7-42f4-b400-47bd9debebbb req-6f354890-2c09-41b1-9d44-fbd9deb085f9 service nova] Releasing lock "refresh_cache-133076de-14b5-4ceb-aa41-d9acef8506c5" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:59:47 user nova-compute[72129]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690898372.9918203, 53b76ca4-30f0-4fd4-9928-714c7073a490 => Stopped> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:59:47 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] VM Stopped (Lifecycle Event)
Aug 01 13:59:48 user nova-compute[72129]: DEBUG nova.compute.manager [None req-b46fed8f-b2b2-4cde-ab3e-d54b4306a0c0 None None] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:59:48 user nova-compute[72129]: DEBUG nova.compute.manager [None req-b46fed8f-b2b2-4cde-ab3e-d54b4306a0c0 None None] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 13:59:48 user nova-compute[72129]: DEBUG nova.objects.instance [None req-9b7b3707-3a04-4dd4-ae3c-2e3f44324ae7 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lazy-loading 'flavor' on Instance uuid 133076de-14b5-4ceb-aa41-d9acef8506c5 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:59:48 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9b7b3707-3a04-4dd4-ae3c-2e3f44324ae7 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lock "133076de-14b5-4ceb-aa41-d9acef8506c5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.850s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:59:49 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:59:49 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 13:59:49 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:59:49 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:59:49 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:59:49 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Auditing locally available compute resources for user (node: user) {{(pid=72129) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 13:59:49 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:59:49 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 13:59:49 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d031973f-8f48-43b3-a338-040950103e4c/disk.rescue --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:59:49 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d031973f-8f48-43b3-a338-040950103e4c/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:59:49 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d031973f-8f48-43b3-a338-040950103e4c/disk.rescue --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:59:49 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d031973f-8f48-43b3-a338-040950103e4c/disk.rescue --force-share --output=json" returned: 0 in 0.152s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:59:49 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:59:49 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:59:49 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:59:49 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:59:49 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133076de-14b5-4ceb-aa41-d9acef8506c5/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:59:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133076de-14b5-4ceb-aa41-d9acef8506c5/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:59:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133076de-14b5-4ceb-aa41-d9acef8506c5/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:59:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133076de-14b5-4ceb-aa41-d9acef8506c5/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:59:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53b76ca4-30f0-4fd4-9928-714c7073a490/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:59:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53b76ca4-30f0-4fd4-9928-714c7073a490/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:59:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53b76ca4-30f0-4fd4-9928-714c7073a490/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:59:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53b76ca4-30f0-4fd4-9928-714c7073a490/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:59:50 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 13:59:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:59:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:59:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:59:50 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:59:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:59:50 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 13:59:51 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:59:51 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:59:51 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:59:51 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Hypervisor/Node resource view: name=user free_ram=8108MB free_disk=25.381088256835938GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72129) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 13:59:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:59:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:59:51 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 97a5dccf-b499-443a-b332-cfa293a16047 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:59:51 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:59:51 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 133076de-14b5-4ceb-aa41-d9acef8506c5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:59:51 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance d031973f-8f48-43b3-a338-040950103e4c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:59:51 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 53b76ca4-30f0-4fd4-9928-714c7073a490 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 13:59:51 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 13:59:51 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 13:59:51 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 13:59:51 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 13:59:51 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Compute_service record updated for user:user {{(pid=72129) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 13:59:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.371s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:59:52 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:59:52 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Acquiring lock "3891b9d3-832d-4ef7-8ebb-970ddd0a387a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:59:52 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lock "3891b9d3-832d-4ef7-8ebb-970ddd0a387a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:59:52 user nova-compute[72129]: DEBUG nova.compute.manager [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Starting instance... {{(pid=72129) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 13:59:52 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:59:52 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:59:52 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72129) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 13:59:52 user nova-compute[72129]: INFO nova.compute.claims [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Claim successful on node user
Aug 01 13:59:52 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 13:59:52 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 13:59:52 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.411s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:59:52 user nova-compute[72129]: DEBUG nova.compute.manager [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Start building networks asynchronously for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 13:59:52 user nova-compute[72129]: DEBUG nova.compute.manager [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Allocating IP information in the background. {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 13:59:52 user nova-compute[72129]: DEBUG nova.network.neutron [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] allocate_for_instance() {{(pid=72129) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 13:59:52 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 13:59:52 user nova-compute[72129]: DEBUG nova.compute.manager [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Start building block device mappings for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 13:59:52 user nova-compute[72129]: DEBUG nova.compute.manager [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Start spawning the instance on the hypervisor. {{(pid=72129) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 13:59:52 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Creating instance directory {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 13:59:52 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Creating image(s)
Aug 01 13:59:52 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Acquiring lock "/opt/stack/data/nova/instances/3891b9d3-832d-4ef7-8ebb-970ddd0a387a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:59:52 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lock "/opt/stack/data/nova/instances/3891b9d3-832d-4ef7-8ebb-970ddd0a387a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:59:52 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lock "/opt/stack/data/nova/instances/3891b9d3-832d-4ef7-8ebb-970ddd0a387a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:59:52 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:59:53 user nova-compute[72129]: DEBUG nova.policy [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e5630ede467c4c99915b1b2f455ca0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b724093fa43c4afb9130efa2cfc713d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72129) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 13:59:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.161s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:59:53 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Acquiring lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:59:53 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:59:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:59:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.149s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:59:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/3891b9d3-832d-4ef7-8ebb-970ddd0a387a/disk 1073741824 {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:59:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/3891b9d3-832d-4ef7-8ebb-970ddd0a387a/disk 1073741824" returned: 0 in 0.055s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:59:53 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.213s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:59:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:59:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.152s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:59:53 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3891b9d3-832d-4ef7-8ebb-970ddd0a387a/disk. size=1073741824 {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 13:59:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3891b9d3-832d-4ef7-8ebb-970ddd0a387a/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:59:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3891b9d3-832d-4ef7-8ebb-970ddd0a387a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:59:53 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Cannot resize image /opt/stack/data/nova/instances/3891b9d3-832d-4ef7-8ebb-970ddd0a387a/disk to a smaller size. {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 13:59:53 user nova-compute[72129]: DEBUG nova.objects.instance [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lazy-loading 'migration_context' on Instance uuid 3891b9d3-832d-4ef7-8ebb-970ddd0a387a {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:59:53 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Created local disks {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 13:59:53 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Ensure instance console log exists: /opt/stack/data/nova/instances/3891b9d3-832d-4ef7-8ebb-970ddd0a387a/console.log {{(pid=72129) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 13:59:53 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:59:53 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:59:53 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:59:54 user nova-compute[72129]: DEBUG nova.network.neutron [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Successfully created port: acb5d1d2-f038-4111-90e1-00bf99a2a7bb {{(pid=72129) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 13:59:54 user nova-compute[72129]: DEBUG nova.network.neutron [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Successfully updated port: acb5d1d2-f038-4111-90e1-00bf99a2a7bb {{(pid=72129) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 13:59:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Acquiring lock "ea050cd6-60e9-41fd-a35c-05fe63d60e57" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:59:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Lock "ea050cd6-60e9-41fd-a35c-05fe63d60e57" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:59:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Acquiring lock "refresh_cache-3891b9d3-832d-4ef7-8ebb-970ddd0a387a" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:59:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Acquired lock "refresh_cache-3891b9d3-832d-4ef7-8ebb-970ddd0a387a" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:59:54 user nova-compute[72129]: DEBUG nova.network.neutron [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 13:59:54 user nova-compute[72129]: DEBUG nova.compute.manager [req-2e4a48fd-9ffd-46ac-a2d1-73644ea0b7b4 req-5fe423cd-3049-452a-93ae-8bcdb888c6bc service nova] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Received event network-changed-acb5d1d2-f038-4111-90e1-00bf99a2a7bb {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:59:54 user nova-compute[72129]: DEBUG nova.compute.manager [req-2e4a48fd-9ffd-46ac-a2d1-73644ea0b7b4 req-5fe423cd-3049-452a-93ae-8bcdb888c6bc service nova] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Refreshing instance network info cache due to event network-changed-acb5d1d2-f038-4111-90e1-00bf99a2a7bb. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 13:59:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-2e4a48fd-9ffd-46ac-a2d1-73644ea0b7b4 req-5fe423cd-3049-452a-93ae-8bcdb888c6bc service nova] Acquiring lock "refresh_cache-3891b9d3-832d-4ef7-8ebb-970ddd0a387a" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:59:54 user nova-compute[72129]: DEBUG nova.compute.manager [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Starting instance... {{(pid=72129) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 13:59:54 user nova-compute[72129]: DEBUG nova.network.neutron [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Instance cache missing network info. {{(pid=72129) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 13:59:55 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:59:55 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:59:55 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72129) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 13:59:55 user nova-compute[72129]: INFO nova.compute.claims [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Claim successful on node user
Aug 01 13:59:55 user nova-compute[72129]: DEBUG nova.network.neutron [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Updating instance_info_cache with network_info: [{"id": "acb5d1d2-f038-4111-90e1-00bf99a2a7bb", "address": "fa:16:3e:ec:4a:5e", "network": {"id": "ce10dac7-17d0-425a-bfee-70b8220d7871", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1288141476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b724093fa43c4afb9130efa2cfc713d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacb5d1d2-f0", "ovs_interfaceid": "acb5d1d2-f038-4111-90e1-00bf99a2a7bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:59:55 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Releasing lock "refresh_cache-3891b9d3-832d-4ef7-8ebb-970ddd0a387a" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:59:55 user nova-compute[72129]: DEBUG nova.compute.manager [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Instance network_info: |[{"id": "acb5d1d2-f038-4111-90e1-00bf99a2a7bb", "address": "fa:16:3e:ec:4a:5e", "network": {"id": "ce10dac7-17d0-425a-bfee-70b8220d7871", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1288141476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b724093fa43c4afb9130efa2cfc713d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacb5d1d2-f0", "ovs_interfaceid": "acb5d1d2-f038-4111-90e1-00bf99a2a7bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 13:59:55 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-2e4a48fd-9ffd-46ac-a2d1-73644ea0b7b4 req-5fe423cd-3049-452a-93ae-8bcdb888c6bc service nova] Acquired lock "refresh_cache-3891b9d3-832d-4ef7-8ebb-970ddd0a387a" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:59:55 user nova-compute[72129]: DEBUG nova.network.neutron [req-2e4a48fd-9ffd-46ac-a2d1-73644ea0b7b4 req-5fe423cd-3049-452a-93ae-8bcdb888c6bc service nova] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Refreshing network info cache for port acb5d1d2-f038-4111-90e1-00bf99a2a7bb {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 13:59:55 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Start _get_guest_xml network_info=[{"id": "acb5d1d2-f038-4111-90e1-00bf99a2a7bb", "address": "fa:16:3e:ec:4a:5e", "network": {"id": "ce10dac7-17d0-425a-bfee-70b8220d7871", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1288141476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b724093fa43c4afb9130efa2cfc713d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacb5d1d2-f0", "ovs_interfaceid": "acb5d1d2-f038-4111-90e1-00bf99a2a7bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'image_id': 'b6472c34-1b0f-4034-ba3a-7e8eb5103715'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 13:59:55 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:59:55 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:59:55 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 13:59:55 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] CPU controller missing on host. {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 13:59:55 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 13:59:55 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] CPU controller found on host. {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 13:59:55 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72129) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 13:59:55 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T13:45:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 13:59:55 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Flavor limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 13:59:55 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Image limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 13:59:55 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Flavor pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 13:59:55 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Image pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 13:59:55 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 13:59:55 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 13:59:55 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 13:59:55 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Got 1 possible topologies {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 13:59:55 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 13:59:55 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 13:59:55 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:59:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-331489091',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-331489091',id=23,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKNwLt9cG/6UYIO5eEhR/1sQRqxswPW3s3IV/zKywgy3aWV4brDlp6I18ZlFxAhUiEoZChgO4LCEJ1KG2zNJDnYs8CHJgeupzFEtMFvJdCyWU9LKgI89N0dlz92eDVpGtw==',key_name='tempest-keypair-2118933419',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b724093fa43c4afb9130efa2cfc713d9',ramdisk_id='',reservation_id='r-ynze9bkr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1864942034',owner_user_name='tempest-AttachVolumeShelveTestJSON-1864942034-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:59:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e5630ede467c4c99915b1b2f455ca0fb',uuid=3891b9d3-832d-4ef7-8ebb-970ddd0a387a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "acb5d1d2-f038-4111-90e1-00bf99a2a7bb", "address": "fa:16:3e:ec:4a:5e", "network": {"id": "ce10dac7-17d0-425a-bfee-70b8220d7871", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1288141476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b724093fa43c4afb9130efa2cfc713d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacb5d1d2-f0", "ovs_interfaceid": "acb5d1d2-f038-4111-90e1-00bf99a2a7bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 13:59:55 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Converting VIF {"id": "acb5d1d2-f038-4111-90e1-00bf99a2a7bb", "address": "fa:16:3e:ec:4a:5e", "network": {"id": "ce10dac7-17d0-425a-bfee-70b8220d7871", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1288141476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b724093fa43c4afb9130efa2cfc713d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacb5d1d2-f0", "ovs_interfaceid": "acb5d1d2-f038-4111-90e1-00bf99a2a7bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:59:55 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:4a:5e,bridge_name='br-int',has_traffic_filtering=True,id=acb5d1d2-f038-4111-90e1-00bf99a2a7bb,network=Network(ce10dac7-17d0-425a-bfee-70b8220d7871),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacb5d1d2-f0') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:59:55 user nova-compute[72129]: DEBUG nova.objects.instance [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lazy-loading 'pci_devices' on Instance uuid 3891b9d3-832d-4ef7-8ebb-970ddd0a387a {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:59:55 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] End _get_guest_xml xml=<domain type="kvm">
Aug 01 13:59:55 user nova-compute[72129]:   <uuid>3891b9d3-832d-4ef7-8ebb-970ddd0a387a</uuid>
Aug 01 13:59:55 user nova-compute[72129]:   <name>instance-00000017</name>
Aug 01 13:59:55 user nova-compute[72129]:   <memory>524288</memory>
Aug 01 13:59:55 user nova-compute[72129]:   <vcpu>1</vcpu>
Aug 01 13:59:55 user nova-compute[72129]:   <metadata>
Aug 01 13:59:55 user nova-compute[72129]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 13:59:55 user nova-compute[72129]:       <nova:package version="0.0.0"/>
Aug 01 13:59:55 user nova-compute[72129]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-331489091</nova:name>
Aug 01 13:59:55 user nova-compute[72129]:       <nova:creationTime>2023-08-01 13:59:55</nova:creationTime>
Aug 01 13:59:55 user nova-compute[72129]:       <nova:flavor name="m1.tiny">
Aug 01 13:59:55 user nova-compute[72129]:         <nova:memory>512</nova:memory>
Aug 01 13:59:55 user nova-compute[72129]:         <nova:disk>1</nova:disk>
Aug 01 13:59:55 user nova-compute[72129]:         <nova:swap>0</nova:swap>
Aug 01 13:59:55 user nova-compute[72129]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 13:59:55 user nova-compute[72129]:         <nova:vcpus>1</nova:vcpus>
Aug 01 13:59:55 user nova-compute[72129]:       </nova:flavor>
Aug 01 13:59:55 user nova-compute[72129]:       <nova:owner>
Aug 01 13:59:55 user nova-compute[72129]:         <nova:user uuid="e5630ede467c4c99915b1b2f455ca0fb">tempest-AttachVolumeShelveTestJSON-1864942034-project-member</nova:user>
Aug 01 13:59:55 user nova-compute[72129]:         <nova:project uuid="b724093fa43c4afb9130efa2cfc713d9">tempest-AttachVolumeShelveTestJSON-1864942034</nova:project>
Aug 01 13:59:55 user nova-compute[72129]:       </nova:owner>
Aug 01 13:59:55 user nova-compute[72129]:       <nova:root type="image" uuid="b6472c34-1b0f-4034-ba3a-7e8eb5103715"/>
Aug 01 13:59:55 user nova-compute[72129]:       <nova:ports>
Aug 01 13:59:55 user nova-compute[72129]:         <nova:port uuid="acb5d1d2-f038-4111-90e1-00bf99a2a7bb">
Aug 01 13:59:55 user nova-compute[72129]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 01 13:59:55 user nova-compute[72129]:         </nova:port>
Aug 01 13:59:55 user nova-compute[72129]:       </nova:ports>
Aug 01 13:59:55 user nova-compute[72129]:     </nova:instance>
Aug 01 13:59:55 user nova-compute[72129]:   </metadata>
Aug 01 13:59:55 user nova-compute[72129]:   <sysinfo type="smbios">
Aug 01 13:59:55 user nova-compute[72129]:     <system>
Aug 01 13:59:55 user nova-compute[72129]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 13:59:55 user nova-compute[72129]:       <entry name="product">OpenStack Nova</entry>
Aug 01 13:59:55 user nova-compute[72129]:       <entry name="version">0.0.0</entry>
Aug 01 13:59:55 user nova-compute[72129]:       <entry name="serial">3891b9d3-832d-4ef7-8ebb-970ddd0a387a</entry>
Aug 01 13:59:55 user nova-compute[72129]:       <entry name="uuid">3891b9d3-832d-4ef7-8ebb-970ddd0a387a</entry>
Aug 01 13:59:55 user nova-compute[72129]:       <entry name="family">Virtual Machine</entry>
Aug 01 13:59:55 user nova-compute[72129]:     </system>
Aug 01 13:59:55 user nova-compute[72129]:   </sysinfo>
Aug 01 13:59:55 user nova-compute[72129]:   <os>
Aug 01 13:59:55 user nova-compute[72129]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 13:59:55 user nova-compute[72129]:     <boot dev="hd"/>
Aug 01 13:59:55 user nova-compute[72129]:     <smbios mode="sysinfo"/>
Aug 01 13:59:55 user nova-compute[72129]:   </os>
Aug 01 13:59:55 user nova-compute[72129]:   <features>
Aug 01 13:59:55 user nova-compute[72129]:     <acpi/>
Aug 01 13:59:55 user nova-compute[72129]:     <apic/>
Aug 01 13:59:55 user nova-compute[72129]:     <vmcoreinfo/>
Aug 01 13:59:55 user nova-compute[72129]:   </features>
Aug 01 13:59:55 user nova-compute[72129]:   <clock offset="utc">
Aug 01 13:59:55 user nova-compute[72129]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 13:59:55 user nova-compute[72129]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 13:59:55 user nova-compute[72129]:     <timer name="hpet" present="no"/>
Aug 01 13:59:55 user nova-compute[72129]:   </clock>
Aug 01 13:59:55 user nova-compute[72129]:   <cpu mode="custom" match="exact">
Aug 01 13:59:55 user nova-compute[72129]:     <model>Nehalem</model>
Aug 01 13:59:55 user nova-compute[72129]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 13:59:55 user nova-compute[72129]:   </cpu>
Aug 01 13:59:55 user nova-compute[72129]:   <devices>
Aug 01 13:59:55 user nova-compute[72129]:     <disk type="file" device="disk">
Aug 01 13:59:55 user nova-compute[72129]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 13:59:55 user nova-compute[72129]:       <source file="/opt/stack/data/nova/instances/3891b9d3-832d-4ef7-8ebb-970ddd0a387a/disk"/>
Aug 01 13:59:55 user nova-compute[72129]:       <target dev="vda" bus="virtio"/>
Aug 01 13:59:55 user nova-compute[72129]:     </disk>
Aug 01 13:59:55 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 13:59:55 user nova-compute[72129]:       <mac address="fa:16:3e:ec:4a:5e"/>
Aug 01 13:59:55 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 13:59:55 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 13:59:55 user nova-compute[72129]:       <target dev="tapacb5d1d2-f0"/>
Aug 01 13:59:55 user nova-compute[72129]:     </interface>
Aug 01 13:59:55 user nova-compute[72129]:     <serial type="pty">
Aug 01 13:59:55 user nova-compute[72129]:       <log file="/opt/stack/data/nova/instances/3891b9d3-832d-4ef7-8ebb-970ddd0a387a/console.log" append="off"/>
Aug 01 13:59:55 user nova-compute[72129]:     </serial>
Aug 01 13:59:55 user nova-compute[72129]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 13:59:55 user nova-compute[72129]:     <video>
Aug 01 13:59:55 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 13:59:55 user nova-compute[72129]:     </video>
Aug 01 13:59:55 user nova-compute[72129]:     <rng model="virtio">
Aug 01 13:59:55 user nova-compute[72129]:       <backend model="random">/dev/urandom</backend>
Aug 01 13:59:55 user nova-compute[72129]:     </rng>
Aug 01 13:59:55 user nova-compute[72129]:     <controller type="usb" index="0" model="none"/>
Aug 01 13:59:55 user nova-compute[72129]:     <memballoon model="virtio">
Aug 01 13:59:55 user nova-compute[72129]:       <stats period="10"/>
Aug 01 13:59:55 user nova-compute[72129]:     </memballoon>
Aug 01 13:59:55 user nova-compute[72129]:   </devices>
Aug 01 13:59:55 user nova-compute[72129]: </domain>
Aug 01 13:59:55 user nova-compute[72129]:  {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 13:59:55 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:59:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-331489091',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-331489091',id=23,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKNwLt9cG/6UYIO5eEhR/1sQRqxswPW3s3IV/zKywgy3aWV4brDlp6I18ZlFxAhUiEoZChgO4LCEJ1KG2zNJDnYs8CHJgeupzFEtMFvJdCyWU9LKgI89N0dlz92eDVpGtw==',key_name='tempest-keypair-2118933419',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b724093fa43c4afb9130efa2cfc713d9',ramdisk_id='',reservation_id='r-ynze9bkr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1864942034',owner_user_name='tempest-AttachVolumeShelveTestJSON-1864942034-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:59:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e5630ede467c4c99915b1b2f455ca0fb',uuid=3891b9d3-832d-4ef7-8ebb-970ddd0a387a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "acb5d1d2-f038-4111-90e1-00bf99a2a7bb", "address": "fa:16:3e:ec:4a:5e", "network": {"id": "ce10dac7-17d0-425a-bfee-70b8220d7871", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1288141476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b724093fa43c4afb9130efa2cfc713d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacb5d1d2-f0", "ovs_interfaceid": "acb5d1d2-f038-4111-90e1-00bf99a2a7bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 13:59:55 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Converting VIF {"id": "acb5d1d2-f038-4111-90e1-00bf99a2a7bb", "address": "fa:16:3e:ec:4a:5e", "network": {"id": "ce10dac7-17d0-425a-bfee-70b8220d7871", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1288141476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b724093fa43c4afb9130efa2cfc713d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacb5d1d2-f0", "ovs_interfaceid": "acb5d1d2-f038-4111-90e1-00bf99a2a7bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:59:55 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:4a:5e,bridge_name='br-int',has_traffic_filtering=True,id=acb5d1d2-f038-4111-90e1-00bf99a2a7bb,network=Network(ce10dac7-17d0-425a-bfee-70b8220d7871),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacb5d1d2-f0') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:59:55 user nova-compute[72129]: DEBUG os_vif [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:4a:5e,bridge_name='br-int',has_traffic_filtering=True,id=acb5d1d2-f038-4111-90e1-00bf99a2a7bb,network=Network(ce10dac7-17d0-425a-bfee-70b8220d7871),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacb5d1d2-f0') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 13:59:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:59:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:59:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 13:59:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:59:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapacb5d1d2-f0, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:59:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapacb5d1d2-f0, col_values=(('external_ids', {'iface-id': 'acb5d1d2-f038-4111-90e1-00bf99a2a7bb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:4a:5e', 'vm-uuid': '3891b9d3-832d-4ef7-8ebb-970ddd0a387a'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:59:55 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 13:59:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:59:55 user nova-compute[72129]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690898380.4475079, 8e5e94dd-b575-48f1-a617-1bd917567220 => Stopped> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:59:55 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] VM Stopped (Lifecycle Event)
Aug 01 13:59:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 13:59:55 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 13:59:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:59:55 user nova-compute[72129]: DEBUG nova.compute.manager [None req-a0e6d5f3-b0cf-4f6b-90ff-64e77a20ef7f None None] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:59:55 user nova-compute[72129]: INFO os_vif [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:4a:5e,bridge_name='br-int',has_traffic_filtering=True,id=acb5d1d2-f038-4111-90e1-00bf99a2a7bb,network=Network(ce10dac7-17d0-425a-bfee-70b8220d7871),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacb5d1d2-f0')
Aug 01 13:59:55 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.431s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:59:55 user nova-compute[72129]: DEBUG nova.compute.manager [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Start building networks asynchronously for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 13:59:55 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 13:59:55 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] No VIF found with MAC fa:16:3e:ec:4a:5e, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 13:59:55 user nova-compute[72129]: DEBUG nova.compute.manager [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Allocating IP information in the background. {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 13:59:55 user nova-compute[72129]: DEBUG nova.network.neutron [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] allocate_for_instance() {{(pid=72129) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 13:59:55 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 13:59:55 user nova-compute[72129]: DEBUG nova.compute.manager [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Start building block device mappings for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 13:59:55 user nova-compute[72129]: DEBUG nova.policy [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f762f3eb1908471eae5197b9aca91734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a13467840342f281bd8b8e115eccaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72129) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 13:59:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:59:55 user nova-compute[72129]: DEBUG nova.compute.manager [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Start spawning the instance on the hypervisor. {{(pid=72129) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 13:59:55 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Creating instance directory {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 13:59:55 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Creating image(s)
Aug 01 13:59:55 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Acquiring lock "/opt/stack/data/nova/instances/ea050cd6-60e9-41fd-a35c-05fe63d60e57/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:59:55 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Lock "/opt/stack/data/nova/instances/ea050cd6-60e9-41fd-a35c-05fe63d60e57/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:59:55 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Lock "/opt/stack/data/nova/instances/ea050cd6-60e9-41fd-a35c-05fe63d60e57/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:59:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:59:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.164s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:59:55 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Acquiring lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:59:55 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:59:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:59:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.131s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:59:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/ea050cd6-60e9-41fd-a35c-05fe63d60e57/disk 1073741824 {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:59:56 user nova-compute[72129]: DEBUG nova.network.neutron [req-2e4a48fd-9ffd-46ac-a2d1-73644ea0b7b4 req-5fe423cd-3049-452a-93ae-8bcdb888c6bc service nova] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Updated VIF entry in instance network info cache for port acb5d1d2-f038-4111-90e1-00bf99a2a7bb. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 13:59:56 user nova-compute[72129]: DEBUG nova.network.neutron [req-2e4a48fd-9ffd-46ac-a2d1-73644ea0b7b4 req-5fe423cd-3049-452a-93ae-8bcdb888c6bc service nova] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Updating instance_info_cache with network_info: [{"id": "acb5d1d2-f038-4111-90e1-00bf99a2a7bb", "address": "fa:16:3e:ec:4a:5e", "network": {"id": "ce10dac7-17d0-425a-bfee-70b8220d7871", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1288141476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b724093fa43c4afb9130efa2cfc713d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacb5d1d2-f0", "ovs_interfaceid": "acb5d1d2-f038-4111-90e1-00bf99a2a7bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:59:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/ea050cd6-60e9-41fd-a35c-05fe63d60e57/disk 1073741824" returned: 0 in 0.050s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:59:56 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.187s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:59:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:59:56 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-2e4a48fd-9ffd-46ac-a2d1-73644ea0b7b4 req-5fe423cd-3049-452a-93ae-8bcdb888c6bc service nova] Releasing lock "refresh_cache-3891b9d3-832d-4ef7-8ebb-970ddd0a387a" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:59:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.174s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:59:56 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ea050cd6-60e9-41fd-a35c-05fe63d60e57/disk. size=1073741824 {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 13:59:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea050cd6-60e9-41fd-a35c-05fe63d60e57/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:59:56 user nova-compute[72129]: DEBUG nova.network.neutron [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Successfully created port: fe1f3453-e3ae-494c-965a-c20868179163 {{(pid=72129) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 13:59:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea050cd6-60e9-41fd-a35c-05fe63d60e57/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:59:56 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Cannot resize image /opt/stack/data/nova/instances/ea050cd6-60e9-41fd-a35c-05fe63d60e57/disk to a smaller size. {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 13:59:56 user nova-compute[72129]: DEBUG nova.objects.instance [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Lazy-loading 'migration_context' on Instance uuid ea050cd6-60e9-41fd-a35c-05fe63d60e57 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:59:56 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Created local disks {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 13:59:56 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Ensure instance console log exists: /opt/stack/data/nova/instances/ea050cd6-60e9-41fd-a35c-05fe63d60e57/console.log {{(pid=72129) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 13:59:56 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:59:56 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:59:56 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:59:56 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:59:56 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:59:56 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:59:56 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:59:57 user nova-compute[72129]: DEBUG nova.compute.manager [req-7ca50221-6da9-4ec0-95f2-8ae27712e0c9 req-eb9eee69-90fb-48c0-b083-8b582ecf5fda service nova] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Received event network-vif-plugged-acb5d1d2-f038-4111-90e1-00bf99a2a7bb {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:59:57 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-7ca50221-6da9-4ec0-95f2-8ae27712e0c9 req-eb9eee69-90fb-48c0-b083-8b582ecf5fda service nova] Acquiring lock "3891b9d3-832d-4ef7-8ebb-970ddd0a387a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:59:57 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-7ca50221-6da9-4ec0-95f2-8ae27712e0c9 req-eb9eee69-90fb-48c0-b083-8b582ecf5fda service nova] Lock "3891b9d3-832d-4ef7-8ebb-970ddd0a387a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:59:57 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-7ca50221-6da9-4ec0-95f2-8ae27712e0c9 req-eb9eee69-90fb-48c0-b083-8b582ecf5fda service nova] Lock "3891b9d3-832d-4ef7-8ebb-970ddd0a387a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:59:57 user nova-compute[72129]: DEBUG nova.compute.manager [req-7ca50221-6da9-4ec0-95f2-8ae27712e0c9 req-eb9eee69-90fb-48c0-b083-8b582ecf5fda service nova] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] No waiting events found dispatching network-vif-plugged-acb5d1d2-f038-4111-90e1-00bf99a2a7bb {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:59:57 user nova-compute[72129]: WARNING nova.compute.manager [req-7ca50221-6da9-4ec0-95f2-8ae27712e0c9 req-eb9eee69-90fb-48c0-b083-8b582ecf5fda service nova] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Received unexpected event network-vif-plugged-acb5d1d2-f038-4111-90e1-00bf99a2a7bb for instance with vm_state building and task_state spawning.
Aug 01 13:59:57 user nova-compute[72129]: DEBUG nova.network.neutron [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Successfully updated port: fe1f3453-e3ae-494c-965a-c20868179163 {{(pid=72129) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 13:59:57 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Acquiring lock "refresh_cache-ea050cd6-60e9-41fd-a35c-05fe63d60e57" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:59:57 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Acquired lock "refresh_cache-ea050cd6-60e9-41fd-a35c-05fe63d60e57" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:59:57 user nova-compute[72129]: DEBUG nova.network.neutron [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 13:59:57 user nova-compute[72129]: DEBUG nova.compute.manager [req-20be6bf4-d014-4121-9f30-cdd515d7b3be req-7e59fdac-e331-4370-8ca3-c8e2ee3edd8c service nova] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Received event network-changed-fe1f3453-e3ae-494c-965a-c20868179163 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:59:57 user nova-compute[72129]: DEBUG nova.compute.manager [req-20be6bf4-d014-4121-9f30-cdd515d7b3be req-7e59fdac-e331-4370-8ca3-c8e2ee3edd8c service nova] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Refreshing instance network info cache due to event network-changed-fe1f3453-e3ae-494c-965a-c20868179163. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 13:59:57 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-20be6bf4-d014-4121-9f30-cdd515d7b3be req-7e59fdac-e331-4370-8ca3-c8e2ee3edd8c service nova] Acquiring lock "refresh_cache-ea050cd6-60e9-41fd-a35c-05fe63d60e57" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 13:59:57 user nova-compute[72129]: DEBUG nova.network.neutron [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Instance cache missing network info. {{(pid=72129) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 13:59:57 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:59:57 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:59:57 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:59:57 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:59:57 user nova-compute[72129]: DEBUG nova.network.neutron [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Updating instance_info_cache with network_info: [{"id": "fe1f3453-e3ae-494c-965a-c20868179163", "address": "fa:16:3e:d8:46:16", "network": {"id": "ce187b11-5e3e-45a9-af0f-0be815ad0a3d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1245856112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0a13467840342f281bd8b8e115eccaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1f3453-e3", "ovs_interfaceid": "fe1f3453-e3ae-494c-965a-c20868179163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:59:57 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Releasing lock "refresh_cache-ea050cd6-60e9-41fd-a35c-05fe63d60e57" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:59:57 user nova-compute[72129]: DEBUG nova.compute.manager [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Instance network_info: |[{"id": "fe1f3453-e3ae-494c-965a-c20868179163", "address": "fa:16:3e:d8:46:16", "network": {"id": "ce187b11-5e3e-45a9-af0f-0be815ad0a3d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1245856112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0a13467840342f281bd8b8e115eccaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1f3453-e3", "ovs_interfaceid": "fe1f3453-e3ae-494c-965a-c20868179163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 13:59:57 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-20be6bf4-d014-4121-9f30-cdd515d7b3be req-7e59fdac-e331-4370-8ca3-c8e2ee3edd8c service nova] Acquired lock "refresh_cache-ea050cd6-60e9-41fd-a35c-05fe63d60e57" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 13:59:57 user nova-compute[72129]: DEBUG nova.network.neutron [req-20be6bf4-d014-4121-9f30-cdd515d7b3be req-7e59fdac-e331-4370-8ca3-c8e2ee3edd8c service nova] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Refreshing network info cache for port fe1f3453-e3ae-494c-965a-c20868179163 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 13:59:57 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Start _get_guest_xml network_info=[{"id": "fe1f3453-e3ae-494c-965a-c20868179163", "address": "fa:16:3e:d8:46:16", "network": {"id": "ce187b11-5e3e-45a9-af0f-0be815ad0a3d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1245856112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0a13467840342f281bd8b8e115eccaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1f3453-e3", "ovs_interfaceid": "fe1f3453-e3ae-494c-965a-c20868179163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'image_id': 'b6472c34-1b0f-4034-ba3a-7e8eb5103715'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 13:59:57 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:59:57 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 13:59:57 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 13:59:57 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] CPU controller missing on host. {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 13:59:57 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 13:59:57 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] CPU controller found on host. {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 13:59:57 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72129) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 13:59:57 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T13:45:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 13:59:57 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Flavor limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 13:59:57 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Image limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 13:59:57 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Flavor pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 13:59:57 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Image pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 13:59:57 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 13:59:57 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 13:59:57 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 13:59:57 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Got 1 possible topologies {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 13:59:57 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 13:59:57 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 13:59:57 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:59:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1906674292',display_name='tempest-ServerStableDeviceRescueTest-server-1906674292',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1906674292',id=24,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIloluvmwA40zqhKfuyL8nZt7CgiX8ycwdXiaBEv6UgW1UUaWlsEz3XFkowqJh9nGVbhgatwD83ZWu+nsHtuLJfq7q8QT/aiQlyv0PZxM67apvpWxm9Sutw/U44d43g6fg==',key_name='tempest-keypair-520937592',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0a13467840342f281bd8b8e115eccaf',ramdisk_id='',reservation_id='r-iiig76vr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1490642453',owner_user_name='tempest-ServerStableDeviceRescueTest-1490642453-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:59:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f762f3eb1908471eae5197b9aca91734',uuid=ea050cd6-60e9-41fd-a35c-05fe63d60e57,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe1f3453-e3ae-494c-965a-c20868179163", "address": "fa:16:3e:d8:46:16", "network": {"id": "ce187b11-5e3e-45a9-af0f-0be815ad0a3d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1245856112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0a13467840342f281bd8b8e115eccaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1f3453-e3", "ovs_interfaceid": "fe1f3453-e3ae-494c-965a-c20868179163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 13:59:57 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Converting VIF {"id": "fe1f3453-e3ae-494c-965a-c20868179163", "address": "fa:16:3e:d8:46:16", "network": {"id": "ce187b11-5e3e-45a9-af0f-0be815ad0a3d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1245856112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0a13467840342f281bd8b8e115eccaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1f3453-e3", "ovs_interfaceid": "fe1f3453-e3ae-494c-965a-c20868179163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:59:57 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:46:16,bridge_name='br-int',has_traffic_filtering=True,id=fe1f3453-e3ae-494c-965a-c20868179163,network=Network(ce187b11-5e3e-45a9-af0f-0be815ad0a3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe1f3453-e3') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:59:57 user nova-compute[72129]: DEBUG nova.objects.instance [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Lazy-loading 'pci_devices' on Instance uuid ea050cd6-60e9-41fd-a35c-05fe63d60e57 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 13:59:57 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-3a8ff733-02e6-42aa-8901-7b7aa9e66697 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Acquiring lock "97a5dccf-b499-443a-b332-cfa293a16047" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:59:57 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-3a8ff733-02e6-42aa-8901-7b7aa9e66697 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "97a5dccf-b499-443a-b332-cfa293a16047" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:59:57 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] End _get_guest_xml xml=<domain type="kvm">
Aug 01 13:59:57 user nova-compute[72129]:   <uuid>ea050cd6-60e9-41fd-a35c-05fe63d60e57</uuid>
Aug 01 13:59:57 user nova-compute[72129]:   <name>instance-00000018</name>
Aug 01 13:59:57 user nova-compute[72129]:   <memory>524288</memory>
Aug 01 13:59:57 user nova-compute[72129]:   <vcpu>1</vcpu>
Aug 01 13:59:57 user nova-compute[72129]:   <metadata>
Aug 01 13:59:57 user nova-compute[72129]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 13:59:57 user nova-compute[72129]:       <nova:package version="0.0.0"/>
Aug 01 13:59:57 user nova-compute[72129]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1906674292</nova:name>
Aug 01 13:59:57 user nova-compute[72129]:       <nova:creationTime>2023-08-01 13:59:57</nova:creationTime>
Aug 01 13:59:57 user nova-compute[72129]:       <nova:flavor name="m1.tiny">
Aug 01 13:59:57 user nova-compute[72129]:         <nova:memory>512</nova:memory>
Aug 01 13:59:57 user nova-compute[72129]:         <nova:disk>1</nova:disk>
Aug 01 13:59:57 user nova-compute[72129]:         <nova:swap>0</nova:swap>
Aug 01 13:59:57 user nova-compute[72129]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 13:59:57 user nova-compute[72129]:         <nova:vcpus>1</nova:vcpus>
Aug 01 13:59:57 user nova-compute[72129]:       </nova:flavor>
Aug 01 13:59:57 user nova-compute[72129]:       <nova:owner>
Aug 01 13:59:57 user nova-compute[72129]:         <nova:user uuid="f762f3eb1908471eae5197b9aca91734">tempest-ServerStableDeviceRescueTest-1490642453-project-member</nova:user>
Aug 01 13:59:57 user nova-compute[72129]:         <nova:project uuid="d0a13467840342f281bd8b8e115eccaf">tempest-ServerStableDeviceRescueTest-1490642453</nova:project>
Aug 01 13:59:57 user nova-compute[72129]:       </nova:owner>
Aug 01 13:59:57 user nova-compute[72129]:       <nova:root type="image" uuid="b6472c34-1b0f-4034-ba3a-7e8eb5103715"/>
Aug 01 13:59:57 user nova-compute[72129]:       <nova:ports>
Aug 01 13:59:57 user nova-compute[72129]:         <nova:port uuid="fe1f3453-e3ae-494c-965a-c20868179163">
Aug 01 13:59:57 user nova-compute[72129]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 01 13:59:57 user nova-compute[72129]:         </nova:port>
Aug 01 13:59:57 user nova-compute[72129]:       </nova:ports>
Aug 01 13:59:57 user nova-compute[72129]:     </nova:instance>
Aug 01 13:59:57 user nova-compute[72129]:   </metadata>
Aug 01 13:59:57 user nova-compute[72129]:   <sysinfo type="smbios">
Aug 01 13:59:57 user nova-compute[72129]:     <system>
Aug 01 13:59:57 user nova-compute[72129]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 13:59:57 user nova-compute[72129]:       <entry name="product">OpenStack Nova</entry>
Aug 01 13:59:57 user nova-compute[72129]:       <entry name="version">0.0.0</entry>
Aug 01 13:59:57 user nova-compute[72129]:       <entry name="serial">ea050cd6-60e9-41fd-a35c-05fe63d60e57</entry>
Aug 01 13:59:57 user nova-compute[72129]:       <entry name="uuid">ea050cd6-60e9-41fd-a35c-05fe63d60e57</entry>
Aug 01 13:59:57 user nova-compute[72129]:       <entry name="family">Virtual Machine</entry>
Aug 01 13:59:57 user nova-compute[72129]:     </system>
Aug 01 13:59:57 user nova-compute[72129]:   </sysinfo>
Aug 01 13:59:57 user nova-compute[72129]:   <os>
Aug 01 13:59:57 user nova-compute[72129]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 13:59:57 user nova-compute[72129]:     <boot dev="hd"/>
Aug 01 13:59:57 user nova-compute[72129]:     <smbios mode="sysinfo"/>
Aug 01 13:59:57 user nova-compute[72129]:   </os>
Aug 01 13:59:57 user nova-compute[72129]:   <features>
Aug 01 13:59:57 user nova-compute[72129]:     <acpi/>
Aug 01 13:59:57 user nova-compute[72129]:     <apic/>
Aug 01 13:59:57 user nova-compute[72129]:     <vmcoreinfo/>
Aug 01 13:59:57 user nova-compute[72129]:   </features>
Aug 01 13:59:57 user nova-compute[72129]:   <clock offset="utc">
Aug 01 13:59:57 user nova-compute[72129]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 13:59:57 user nova-compute[72129]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 13:59:57 user nova-compute[72129]:     <timer name="hpet" present="no"/>
Aug 01 13:59:57 user nova-compute[72129]:   </clock>
Aug 01 13:59:57 user nova-compute[72129]:   <cpu mode="custom" match="exact">
Aug 01 13:59:57 user nova-compute[72129]:     <model>Nehalem</model>
Aug 01 13:59:57 user nova-compute[72129]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 13:59:57 user nova-compute[72129]:   </cpu>
Aug 01 13:59:57 user nova-compute[72129]:   <devices>
Aug 01 13:59:57 user nova-compute[72129]:     <disk type="file" device="disk">
Aug 01 13:59:57 user nova-compute[72129]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 13:59:57 user nova-compute[72129]:       <source file="/opt/stack/data/nova/instances/ea050cd6-60e9-41fd-a35c-05fe63d60e57/disk"/>
Aug 01 13:59:57 user nova-compute[72129]:       <target dev="vda" bus="virtio"/>
Aug 01 13:59:57 user nova-compute[72129]:     </disk>
Aug 01 13:59:57 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 13:59:57 user nova-compute[72129]:       <mac address="fa:16:3e:d8:46:16"/>
Aug 01 13:59:57 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 13:59:57 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 13:59:57 user nova-compute[72129]:       <target dev="tapfe1f3453-e3"/>
Aug 01 13:59:57 user nova-compute[72129]:     </interface>
Aug 01 13:59:57 user nova-compute[72129]:     <serial type="pty">
Aug 01 13:59:57 user nova-compute[72129]:       <log file="/opt/stack/data/nova/instances/ea050cd6-60e9-41fd-a35c-05fe63d60e57/console.log" append="off"/>
Aug 01 13:59:57 user nova-compute[72129]:     </serial>
Aug 01 13:59:57 user nova-compute[72129]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 13:59:57 user nova-compute[72129]:     <video>
Aug 01 13:59:57 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 13:59:57 user nova-compute[72129]:     </video>
Aug 01 13:59:57 user nova-compute[72129]:     <rng model="virtio">
Aug 01 13:59:57 user nova-compute[72129]:       <backend model="random">/dev/urandom</backend>
Aug 01 13:59:57 user nova-compute[72129]:     </rng>
Aug 01 13:59:57 user nova-compute[72129]:     <controller type="usb" index="0" model="none"/>
Aug 01 13:59:57 user nova-compute[72129]:     <memballoon model="virtio">
Aug 01 13:59:57 user nova-compute[72129]:       <stats period="10"/>
Aug 01 13:59:57 user nova-compute[72129]:     </memballoon>
Aug 01 13:59:57 user nova-compute[72129]:   </devices>
Aug 01 13:59:57 user nova-compute[72129]: </domain>
Aug 01 13:59:57 user nova-compute[72129]:  {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 13:59:57 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:59:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1906674292',display_name='tempest-ServerStableDeviceRescueTest-server-1906674292',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1906674292',id=24,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIloluvmwA40zqhKfuyL8nZt7CgiX8ycwdXiaBEv6UgW1UUaWlsEz3XFkowqJh9nGVbhgatwD83ZWu+nsHtuLJfq7q8QT/aiQlyv0PZxM67apvpWxm9Sutw/U44d43g6fg==',key_name='tempest-keypair-520937592',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0a13467840342f281bd8b8e115eccaf',ramdisk_id='',reservation_id='r-iiig76vr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1490642453',owner_user_name='tempest-ServerStableDeviceRescueTest-1490642453-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:59:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f762f3eb1908471eae5197b9aca91734',uuid=ea050cd6-60e9-41fd-a35c-05fe63d60e57,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe1f3453-e3ae-494c-965a-c20868179163", "address": "fa:16:3e:d8:46:16", "network": {"id": "ce187b11-5e3e-45a9-af0f-0be815ad0a3d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1245856112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0a13467840342f281bd8b8e115eccaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1f3453-e3", "ovs_interfaceid": "fe1f3453-e3ae-494c-965a-c20868179163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 13:59:57 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Converting VIF {"id": "fe1f3453-e3ae-494c-965a-c20868179163", "address": "fa:16:3e:d8:46:16", "network": {"id": "ce187b11-5e3e-45a9-af0f-0be815ad0a3d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1245856112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0a13467840342f281bd8b8e115eccaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1f3453-e3", "ovs_interfaceid": "fe1f3453-e3ae-494c-965a-c20868179163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 13:59:57 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:46:16,bridge_name='br-int',has_traffic_filtering=True,id=fe1f3453-e3ae-494c-965a-c20868179163,network=Network(ce187b11-5e3e-45a9-af0f-0be815ad0a3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe1f3453-e3') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 13:59:57 user nova-compute[72129]: DEBUG os_vif [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:46:16,bridge_name='br-int',has_traffic_filtering=True,id=fe1f3453-e3ae-494c-965a-c20868179163,network=Network(ce187b11-5e3e-45a9-af0f-0be815ad0a3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe1f3453-e3') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 13:59:57 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:59:57 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:59:57 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 13:59:57 user nova-compute[72129]: INFO nova.compute.manager [None req-3a8ff733-02e6-42aa-8901-7b7aa9e66697 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Detaching volume de3acab7-803c-4154-926b-fa47bdeb988f
Aug 01 13:59:57 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:59:57 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe1f3453-e3, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:59:57 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfe1f3453-e3, col_values=(('external_ids', {'iface-id': 'fe1f3453-e3ae-494c-965a-c20868179163', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:46:16', 'vm-uuid': 'ea050cd6-60e9-41fd-a35c-05fe63d60e57'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 13:59:57 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:59:57 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 13:59:57 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:59:57 user nova-compute[72129]: INFO os_vif [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:46:16,bridge_name='br-int',has_traffic_filtering=True,id=fe1f3453-e3ae-494c-965a-c20868179163,network=Network(ce187b11-5e3e-45a9-af0f-0be815ad0a3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe1f3453-e3')
Aug 01 13:59:58 user nova-compute[72129]: INFO nova.virt.block_device [None req-3a8ff733-02e6-42aa-8901-7b7aa9e66697 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Attempting to driver detach volume de3acab7-803c-4154-926b-fa47bdeb988f from mountpoint /dev/vdb
Aug 01 13:59:58 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-3a8ff733-02e6-42aa-8901-7b7aa9e66697 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Attempting to detach device vdb from instance 97a5dccf-b499-443a-b332-cfa293a16047 from the persistent domain config. {{(pid=72129) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 13:59:58 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-3a8ff733-02e6-42aa-8901-7b7aa9e66697 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 13:59:58 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 13:59:58 user nova-compute[72129]:   <source dev="/dev/sdd"/>
Aug 01 13:59:58 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 13:59:58 user nova-compute[72129]:   <serial>de3acab7-803c-4154-926b-fa47bdeb988f</serial>
Aug 01 13:59:58 user nova-compute[72129]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 01 13:59:58 user nova-compute[72129]: </disk>
Aug 01 13:59:58 user nova-compute[72129]:  {{(pid=72129) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 13:59:58 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 13:59:58 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] No VIF found with MAC fa:16:3e:d8:46:16, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 13:59:58 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-3a8ff733-02e6-42aa-8901-7b7aa9e66697 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Successfully detached device vdb from instance 97a5dccf-b499-443a-b332-cfa293a16047 from the persistent domain config.
Aug 01 13:59:58 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-3a8ff733-02e6-42aa-8901-7b7aa9e66697 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 97a5dccf-b499-443a-b332-cfa293a16047 from the live domain config. {{(pid=72129) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 13:59:58 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-3a8ff733-02e6-42aa-8901-7b7aa9e66697 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 13:59:58 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 13:59:58 user nova-compute[72129]:   <source dev="/dev/sdd"/>
Aug 01 13:59:58 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 13:59:58 user nova-compute[72129]:   <serial>de3acab7-803c-4154-926b-fa47bdeb988f</serial>
Aug 01 13:59:58 user nova-compute[72129]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 01 13:59:58 user nova-compute[72129]: </disk>
Aug 01 13:59:58 user nova-compute[72129]:  {{(pid=72129) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 13:59:58 user nova-compute[72129]: DEBUG nova.network.neutron [req-20be6bf4-d014-4121-9f30-cdd515d7b3be req-7e59fdac-e331-4370-8ca3-c8e2ee3edd8c service nova] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Updated VIF entry in instance network info cache for port fe1f3453-e3ae-494c-965a-c20868179163. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 13:59:58 user nova-compute[72129]: DEBUG nova.network.neutron [req-20be6bf4-d014-4121-9f30-cdd515d7b3be req-7e59fdac-e331-4370-8ca3-c8e2ee3edd8c service nova] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Updating instance_info_cache with network_info: [{"id": "fe1f3453-e3ae-494c-965a-c20868179163", "address": "fa:16:3e:d8:46:16", "network": {"id": "ce187b11-5e3e-45a9-af0f-0be815ad0a3d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1245856112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0a13467840342f281bd8b8e115eccaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1f3453-e3", "ovs_interfaceid": "fe1f3453-e3ae-494c-965a-c20868179163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 13:59:58 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-20be6bf4-d014-4121-9f30-cdd515d7b3be req-7e59fdac-e331-4370-8ca3-c8e2ee3edd8c service nova] Releasing lock "refresh_cache-ea050cd6-60e9-41fd-a35c-05fe63d60e57" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 13:59:58 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Received event <DeviceRemovedEvent: 1690898398.7430134, 97a5dccf-b499-443a-b332-cfa293a16047 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72129) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 13:59:58 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-3a8ff733-02e6-42aa-8901-7b7aa9e66697 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 97a5dccf-b499-443a-b332-cfa293a16047 {{(pid=72129) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 13:59:58 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-3a8ff733-02e6-42aa-8901-7b7aa9e66697 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Successfully detached device vdb from instance 97a5dccf-b499-443a-b332-cfa293a16047 from the live domain config.
Aug 01 13:59:58 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a8ff733-02e6-42aa-8901-7b7aa9e66697 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] calling os-brick to detach iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 13:59:58 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a8ff733-02e6-42aa-8901-7b7aa9e66697 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, {'target_iqns': ['iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DMmEigrw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 13:59:58 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-3a8ff733-02e6-42aa-8901-7b7aa9e66697 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 13:59:58 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-3a8ff733-02e6-42aa-8901-7b7aa9e66697 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 13:59:58 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-3a8ff733-02e6-42aa-8901-7b7aa9e66697 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 13:59:58 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a8ff733-02e6-42aa-8901-7b7aa9e66697 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f', 0)] {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 13:59:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:59:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:59:58 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e931d48-a8d2-47fd-83f3-af47a2f74329]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:59:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:59:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:59:58 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[e87315a8-a376-4a7d-bb24-88e2fc1daf9e]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:59:58 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a8ff733-02e6-42aa-8901-7b7aa9e66697 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 13:59:58 user nova-compute[72129]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f (non-flash)
Aug 01 13:59:58 user nova-compute[72129]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 (non-flash)
Aug 01 13:59:58 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 13:59:58 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a8ff733-02e6-42aa-8901-7b7aa9e66697 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 13:59:58 user nova-compute[72129]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f (non-flash)
Aug 01 13:59:58 user nova-compute[72129]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 (non-flash)
Aug 01 13:59:58 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 13:59:58 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a8ff733-02e6-42aa-8901-7b7aa9e66697 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2810420dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f'): ({'sdd'}, set())}) {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 13:59:58 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-3a8ff733-02e6-42aa-8901-7b7aa9e66697 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Removing single pathed devices sdd {{(pid=72129) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 13:59:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:59:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:59:58 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[676431e8-f33f-402b-891d-9e10c86f5656]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:59:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:59:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.027s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:59:58 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2cb8dc-8bc1-4705-b02a-32260039eca8]: (4, ('ok\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:59:58 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-3a8ff733-02e6-42aa-8901-7b7aa9e66697 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Flushing IO for device /dev/sdd {{(pid=72129) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 13:59:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:59:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:59:58 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e9afc4-e1b4-454e-a7a1-85549ce72256]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:59:58 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-3a8ff733-02e6-42aa-8901-7b7aa9e66697 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72129) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 13:59:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:59:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.053s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:59:58 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ffa0c6-d63e-4cfa-aa3e-06f397d39206]: (4, ('1', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:59:58 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-3a8ff733-02e6-42aa-8901-7b7aa9e66697 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 13:59:58 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-3a8ff733-02e6-42aa-8901-7b7aa9e66697 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] SCSI volumes sdd have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 13:59:58 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a8ff733-02e6-42aa-8901-7b7aa9e66697 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f')] {{(pid=72129) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 13:59:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:59:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:59:58 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[e853314e-137f-45a9-bd91-be7a100ec207]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:59:58 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a8ff733-02e6-42aa-8901-7b7aa9e66697 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:59:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f -p 172.16.0.220:3260 --logout {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:59:59 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:59:59 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b95c55-9ae1-4794-835e-ae8a65d72270]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:59:59 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a8ff733-02e6-42aa-8901-7b7aa9e66697 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f, portal: 172.16.0.220,3260]
Aug 01 13:59:59 user nova-compute[72129]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f, portal: 172.16.0.220,3260] successful.
Aug 01 13:59:59 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:59:59 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f -p 172.16.0.220:3260 --op delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 13:59:59 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de3acab7-803c-4154-926b-fa47bdeb988f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 13:59:59 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e112e67-7c91-4f33-890c-2187b7846502]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 13:59:59 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a8ff733-02e6-42aa-8901-7b7aa9e66697 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 13:59:59 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-3a8ff733-02e6-42aa-8901-7b7aa9e66697 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 13:59:59 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a8ff733-02e6-42aa-8901-7b7aa9e66697 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] <== disconnect_volume: return (329ms) None {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 13:59:59 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a8ff733-02e6-42aa-8901-7b7aa9e66697 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Disconnected iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 13:59:59 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898399.2388787, 3891b9d3-832d-4ef7-8ebb-970ddd0a387a => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:59:59 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] VM Resumed (Lifecycle Event)
Aug 01 13:59:59 user nova-compute[72129]: DEBUG nova.compute.manager [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Instance event wait completed in 0 seconds for  {{(pid=72129) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 13:59:59 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Guest created on hypervisor {{(pid=72129) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 13:59:59 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Instance spawned successfully.
Aug 01 13:59:59 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 13:59:59 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:59:59 user nova-compute[72129]: DEBUG nova.compute.manager [req-5373b67c-5e0a-4353-9652-102a68ea99e5 req-90f99b71-c8ba-45ed-9328-afdf74a728d9 service nova] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Received event network-vif-plugged-acb5d1d2-f038-4111-90e1-00bf99a2a7bb {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 13:59:59 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-5373b67c-5e0a-4353-9652-102a68ea99e5 req-90f99b71-c8ba-45ed-9328-afdf74a728d9 service nova] Acquiring lock "3891b9d3-832d-4ef7-8ebb-970ddd0a387a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 13:59:59 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-5373b67c-5e0a-4353-9652-102a68ea99e5 req-90f99b71-c8ba-45ed-9328-afdf74a728d9 service nova] Lock "3891b9d3-832d-4ef7-8ebb-970ddd0a387a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 13:59:59 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-5373b67c-5e0a-4353-9652-102a68ea99e5 req-90f99b71-c8ba-45ed-9328-afdf74a728d9 service nova] Lock "3891b9d3-832d-4ef7-8ebb-970ddd0a387a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:59:59 user nova-compute[72129]: DEBUG nova.compute.manager [req-5373b67c-5e0a-4353-9652-102a68ea99e5 req-90f99b71-c8ba-45ed-9328-afdf74a728d9 service nova] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] No waiting events found dispatching network-vif-plugged-acb5d1d2-f038-4111-90e1-00bf99a2a7bb {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 13:59:59 user nova-compute[72129]: WARNING nova.compute.manager [req-5373b67c-5e0a-4353-9652-102a68ea99e5 req-90f99b71-c8ba-45ed-9328-afdf74a728d9 service nova] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Received unexpected event network-vif-plugged-acb5d1d2-f038-4111-90e1-00bf99a2a7bb for instance with vm_state building and task_state spawning.
Aug 01 13:59:59 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 13:59:59 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Found default for hw_cdrom_bus of ide {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:59:59 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Found default for hw_disk_bus of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:59:59 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Found default for hw_input_bus of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:59:59 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Found default for hw_pointer_model of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:59:59 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Found default for hw_video_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:59:59 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Found default for hw_vif_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 13:59:59 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 13:59:59 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898399.246759, 3891b9d3-832d-4ef7-8ebb-970ddd0a387a => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 13:59:59 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] VM Started (Lifecycle Event)
Aug 01 13:59:59 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:59:59 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 13:59:59 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 13:59:59 user nova-compute[72129]: INFO nova.compute.manager [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Took 6.41 seconds to spawn the instance on the hypervisor.
Aug 01 13:59:59 user nova-compute[72129]: DEBUG nova.compute.manager [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 13:59:59 user nova-compute[72129]: INFO nova.compute.manager [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Took 7.17 seconds to build instance.
Aug 01 13:59:59 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-855bce11-43dd-46d5-8959-724514de0abf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lock "3891b9d3-832d-4ef7-8ebb-970ddd0a387a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.293s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 13:59:59 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:59:59 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:59:59 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 13:59:59 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:00 user nova-compute[72129]: DEBUG nova.compute.manager [req-c8d726bd-b15a-4dab-b233-b252a98d9bd0 req-4947f28e-77d8-42ee-86bb-8468369c95bb service nova] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Received event network-vif-plugged-fe1f3453-e3ae-494c-965a-c20868179163 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:00:00 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-c8d726bd-b15a-4dab-b233-b252a98d9bd0 req-4947f28e-77d8-42ee-86bb-8468369c95bb service nova] Acquiring lock "ea050cd6-60e9-41fd-a35c-05fe63d60e57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:00:00 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-c8d726bd-b15a-4dab-b233-b252a98d9bd0 req-4947f28e-77d8-42ee-86bb-8468369c95bb service nova] Lock "ea050cd6-60e9-41fd-a35c-05fe63d60e57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:00:00 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-c8d726bd-b15a-4dab-b233-b252a98d9bd0 req-4947f28e-77d8-42ee-86bb-8468369c95bb service nova] Lock "ea050cd6-60e9-41fd-a35c-05fe63d60e57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:00:00 user nova-compute[72129]: DEBUG nova.compute.manager [req-c8d726bd-b15a-4dab-b233-b252a98d9bd0 req-4947f28e-77d8-42ee-86bb-8468369c95bb service nova] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] No waiting events found dispatching network-vif-plugged-fe1f3453-e3ae-494c-965a-c20868179163 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:00:00 user nova-compute[72129]: WARNING nova.compute.manager [req-c8d726bd-b15a-4dab-b233-b252a98d9bd0 req-4947f28e-77d8-42ee-86bb-8468369c95bb service nova] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Received unexpected event network-vif-plugged-fe1f3453-e3ae-494c-965a-c20868179163 for instance with vm_state building and task_state spawning.
Aug 01 14:00:00 user nova-compute[72129]: DEBUG nova.objects.instance [None req-3a8ff733-02e6-42aa-8901-7b7aa9e66697 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lazy-loading 'flavor' on Instance uuid 97a5dccf-b499-443a-b332-cfa293a16047 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:00:00 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-3a8ff733-02e6-42aa-8901-7b7aa9e66697 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "97a5dccf-b499-443a-b332-cfa293a16047" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.319s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:00:00 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:00 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:00 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:00 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:00 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:00 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:02 user nova-compute[72129]: DEBUG nova.compute.manager [req-f4d5b187-ea42-4348-ad9d-d75c903597c6 req-a8a06c90-9efd-4025-b561-e79f96da8543 service nova] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Received event network-vif-plugged-fe1f3453-e3ae-494c-965a-c20868179163 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:00:02 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f4d5b187-ea42-4348-ad9d-d75c903597c6 req-a8a06c90-9efd-4025-b561-e79f96da8543 service nova] Acquiring lock "ea050cd6-60e9-41fd-a35c-05fe63d60e57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:00:02 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f4d5b187-ea42-4348-ad9d-d75c903597c6 req-a8a06c90-9efd-4025-b561-e79f96da8543 service nova] Lock "ea050cd6-60e9-41fd-a35c-05fe63d60e57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:00:02 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f4d5b187-ea42-4348-ad9d-d75c903597c6 req-a8a06c90-9efd-4025-b561-e79f96da8543 service nova] Lock "ea050cd6-60e9-41fd-a35c-05fe63d60e57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:00:02 user nova-compute[72129]: DEBUG nova.compute.manager [req-f4d5b187-ea42-4348-ad9d-d75c903597c6 req-a8a06c90-9efd-4025-b561-e79f96da8543 service nova] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] No waiting events found dispatching network-vif-plugged-fe1f3453-e3ae-494c-965a-c20868179163 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:00:02 user nova-compute[72129]: WARNING nova.compute.manager [req-f4d5b187-ea42-4348-ad9d-d75c903597c6 req-a8a06c90-9efd-4025-b561-e79f96da8543 service nova] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Received unexpected event network-vif-plugged-fe1f3453-e3ae-494c-965a-c20868179163 for instance with vm_state building and task_state spawning.
Aug 01 14:00:02 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898402.3320336, ea050cd6-60e9-41fd-a35c-05fe63d60e57 => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:00:02 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] VM Resumed (Lifecycle Event)
Aug 01 14:00:02 user nova-compute[72129]: DEBUG nova.compute.manager [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Instance event wait completed in 0 seconds for  {{(pid=72129) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 14:00:02 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Guest created on hypervisor {{(pid=72129) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 14:00:02 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Instance spawned successfully.
Aug 01 14:00:02 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 14:00:02 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:00:02 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:00:02 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Found default for hw_cdrom_bus of ide {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:00:02 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Found default for hw_disk_bus of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:00:02 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Found default for hw_input_bus of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:00:02 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Found default for hw_pointer_model of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:00:02 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Found default for hw_video_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:00:02 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Found default for hw_vif_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:00:02 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 14:00:02 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898402.3324, ea050cd6-60e9-41fd-a35c-05fe63d60e57 => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:00:02 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] VM Started (Lifecycle Event)
Aug 01 14:00:02 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:00:02 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:00:02 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 14:00:02 user nova-compute[72129]: INFO nova.compute.manager [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Took 6.70 seconds to spawn the instance on the hypervisor.
Aug 01 14:00:02 user nova-compute[72129]: DEBUG nova.compute.manager [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:00:02 user nova-compute[72129]: INFO nova.compute.manager [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Took 7.53 seconds to build instance.
Aug 01 14:00:02 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-567d1468-081d-48cf-948d-d3877e8c5561 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Lock "ea050cd6-60e9-41fd-a35c-05fe63d60e57" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.722s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:00:02 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:02 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:05 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:05 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:07 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:09 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:10 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:12 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:12 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:15 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Acquiring lock "e2cf5877-55dd-44ce-9b58-b662afe8e62e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:00:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lock "e2cf5877-55dd-44ce-9b58-b662afe8e62e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:00:17 user nova-compute[72129]: DEBUG nova.compute.manager [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Starting instance... {{(pid=72129) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 14:00:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:00:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:00:17 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72129) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 14:00:17 user nova-compute[72129]: INFO nova.compute.claims [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Claim successful on node user
Aug 01 14:00:17 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:00:17 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:00:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.374s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:00:17 user nova-compute[72129]: DEBUG nova.compute.manager [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Start building networks asynchronously for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 14:00:17 user nova-compute[72129]: DEBUG nova.compute.manager [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Allocating IP information in the background. {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 14:00:17 user nova-compute[72129]: DEBUG nova.network.neutron [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] allocate_for_instance() {{(pid=72129) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 14:00:17 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 14:00:17 user nova-compute[72129]: DEBUG nova.compute.manager [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Start building block device mappings for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 14:00:17 user nova-compute[72129]: DEBUG nova.policy [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd537f7656c624f77967c8feed5a351d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822d8992f146492cb98e0f57d42e0571', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72129) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 14:00:17 user nova-compute[72129]: DEBUG nova.compute.manager [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Start spawning the instance on the hypervisor. {{(pid=72129) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 14:00:17 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Creating instance directory {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 14:00:17 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Creating image(s)
Aug 01 14:00:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Acquiring lock "/opt/stack/data/nova/instances/e2cf5877-55dd-44ce-9b58-b662afe8e62e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:00:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lock "/opt/stack/data/nova/instances/e2cf5877-55dd-44ce-9b58-b662afe8e62e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:00:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lock "/opt/stack/data/nova/instances/e2cf5877-55dd-44ce-9b58-b662afe8e62e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:00:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:00:17 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:18 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.148s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:00:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Acquiring lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:00:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:00:18 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:00:18 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.137s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:00:18 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/e2cf5877-55dd-44ce-9b58-b662afe8e62e/disk 1073741824 {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:00:18 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/e2cf5877-55dd-44ce-9b58-b662afe8e62e/disk 1073741824" returned: 0 in 0.050s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:00:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:00:18 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:00:18 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.153s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:00:18 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e2cf5877-55dd-44ce-9b58-b662afe8e62e/disk. size=1073741824 {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 14:00:18 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cf5877-55dd-44ce-9b58-b662afe8e62e/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:00:18 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cf5877-55dd-44ce-9b58-b662afe8e62e/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:00:18 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Cannot resize image /opt/stack/data/nova/instances/e2cf5877-55dd-44ce-9b58-b662afe8e62e/disk to a smaller size. {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 14:00:18 user nova-compute[72129]: DEBUG nova.objects.instance [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lazy-loading 'migration_context' on Instance uuid e2cf5877-55dd-44ce-9b58-b662afe8e62e {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:00:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Created local disks {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 14:00:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Ensure instance console log exists: /opt/stack/data/nova/instances/e2cf5877-55dd-44ce-9b58-b662afe8e62e/console.log {{(pid=72129) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 14:00:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:00:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:00:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:00:18 user nova-compute[72129]: DEBUG nova.network.neutron [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Successfully created port: ed105f30-6ea8-4e9d-aedc-44a11f2ae5d5 {{(pid=72129) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 14:00:19 user nova-compute[72129]: DEBUG nova.network.neutron [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Successfully updated port: ed105f30-6ea8-4e9d-aedc-44a11f2ae5d5 {{(pid=72129) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 14:00:19 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Acquiring lock "refresh_cache-e2cf5877-55dd-44ce-9b58-b662afe8e62e" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:00:19 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Acquired lock "refresh_cache-e2cf5877-55dd-44ce-9b58-b662afe8e62e" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:00:19 user nova-compute[72129]: DEBUG nova.network.neutron [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 14:00:19 user nova-compute[72129]: DEBUG nova.network.neutron [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Instance cache missing network info. {{(pid=72129) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 14:00:19 user nova-compute[72129]: DEBUG nova.compute.manager [req-ee9ff152-ee7f-40b5-a560-02daa69a139b req-acc9b153-2d54-49ea-b9e9-41d769a83387 service nova] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Received event network-changed-ed105f30-6ea8-4e9d-aedc-44a11f2ae5d5 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:00:19 user nova-compute[72129]: DEBUG nova.compute.manager [req-ee9ff152-ee7f-40b5-a560-02daa69a139b req-acc9b153-2d54-49ea-b9e9-41d769a83387 service nova] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Refreshing instance network info cache due to event network-changed-ed105f30-6ea8-4e9d-aedc-44a11f2ae5d5. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 14:00:19 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ee9ff152-ee7f-40b5-a560-02daa69a139b req-acc9b153-2d54-49ea-b9e9-41d769a83387 service nova] Acquiring lock "refresh_cache-e2cf5877-55dd-44ce-9b58-b662afe8e62e" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:00:20 user nova-compute[72129]: DEBUG nova.network.neutron [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Updating instance_info_cache with network_info: [{"id": "ed105f30-6ea8-4e9d-aedc-44a11f2ae5d5", "address": "fa:16:3e:18:48:0e", "network": {"id": "c31f34d8-03c6-40d0-868b-d82fdc9c5169", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1378125554-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "822d8992f146492cb98e0f57d42e0571", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped105f30-6e", "ovs_interfaceid": "ed105f30-6ea8-4e9d-aedc-44a11f2ae5d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:00:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Releasing lock "refresh_cache-e2cf5877-55dd-44ce-9b58-b662afe8e62e" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:00:20 user nova-compute[72129]: DEBUG nova.compute.manager [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Instance network_info: |[{"id": "ed105f30-6ea8-4e9d-aedc-44a11f2ae5d5", "address": "fa:16:3e:18:48:0e", "network": {"id": "c31f34d8-03c6-40d0-868b-d82fdc9c5169", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1378125554-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "822d8992f146492cb98e0f57d42e0571", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped105f30-6e", "ovs_interfaceid": "ed105f30-6ea8-4e9d-aedc-44a11f2ae5d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 14:00:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ee9ff152-ee7f-40b5-a560-02daa69a139b req-acc9b153-2d54-49ea-b9e9-41d769a83387 service nova] Acquired lock "refresh_cache-e2cf5877-55dd-44ce-9b58-b662afe8e62e" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:00:20 user nova-compute[72129]: DEBUG nova.network.neutron [req-ee9ff152-ee7f-40b5-a560-02daa69a139b req-acc9b153-2d54-49ea-b9e9-41d769a83387 service nova] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Refreshing network info cache for port ed105f30-6ea8-4e9d-aedc-44a11f2ae5d5 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 14:00:20 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Start _get_guest_xml network_info=[{"id": "ed105f30-6ea8-4e9d-aedc-44a11f2ae5d5", "address": "fa:16:3e:18:48:0e", "network": {"id": "c31f34d8-03c6-40d0-868b-d82fdc9c5169", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1378125554-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "822d8992f146492cb98e0f57d42e0571", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped105f30-6e", "ovs_interfaceid": "ed105f30-6ea8-4e9d-aedc-44a11f2ae5d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'image_id': 'b6472c34-1b0f-4034-ba3a-7e8eb5103715'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 14:00:20 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:00:20 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:00:20 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 14:00:20 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] CPU controller missing on host. {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 14:00:20 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 14:00:20 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] CPU controller found on host. {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 14:00:20 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72129) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 14:00:20 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T13:45:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 14:00:20 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Flavor limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 14:00:20 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Image limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 14:00:20 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Flavor pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 14:00:20 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Image pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 14:00:20 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 14:00:20 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 14:00:20 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 14:00:20 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Got 1 possible topologies {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 14:00:20 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 14:00:20 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 14:00:20 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:00:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1025565412',display_name='tempest-SnapshotDataIntegrityTests-server-1025565412',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1025565412',id=25,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDjD1eqd7I1REZPNLxth25Cri6aMSgVthWL0+MG1EEDyrZmfpc+KmhtStPMOI/tSkvR3AGD/m5FagqQXododlRh29GS9NGtfqWAOnY9Tx+KrD1Mousn2hs2pQivIfX3wgg==',key_name='tempest-keypair-289836616',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='822d8992f146492cb98e0f57d42e0571',ramdisk_id='',reservation_id='r-umd0od5q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-846799905',owner_user_name='tempest-SnapshotDataIntegrityTests-846799905-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T14:00:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d537f7656c624f77967c8feed5a351d6',uuid=e2cf5877-55dd-44ce-9b58-b662afe8e62e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed105f30-6ea8-4e9d-aedc-44a11f2ae5d5", "address": "fa:16:3e:18:48:0e", "network": {"id": "c31f34d8-03c6-40d0-868b-d82fdc9c5169", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1378125554-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "822d8992f146492cb98e0f57d42e0571", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped105f30-6e", "ovs_interfaceid": "ed105f30-6ea8-4e9d-aedc-44a11f2ae5d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 14:00:20 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Converting VIF {"id": "ed105f30-6ea8-4e9d-aedc-44a11f2ae5d5", "address": "fa:16:3e:18:48:0e", "network": {"id": "c31f34d8-03c6-40d0-868b-d82fdc9c5169", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1378125554-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "822d8992f146492cb98e0f57d42e0571", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped105f30-6e", "ovs_interfaceid": "ed105f30-6ea8-4e9d-aedc-44a11f2ae5d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:00:20 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:48:0e,bridge_name='br-int',has_traffic_filtering=True,id=ed105f30-6ea8-4e9d-aedc-44a11f2ae5d5,network=Network(c31f34d8-03c6-40d0-868b-d82fdc9c5169),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped105f30-6e') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:00:20 user nova-compute[72129]: DEBUG nova.objects.instance [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lazy-loading 'pci_devices' on Instance uuid e2cf5877-55dd-44ce-9b58-b662afe8e62e {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:00:20 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] End _get_guest_xml xml=<domain type="kvm">
Aug 01 14:00:20 user nova-compute[72129]:   <uuid>e2cf5877-55dd-44ce-9b58-b662afe8e62e</uuid>
Aug 01 14:00:20 user nova-compute[72129]:   <name>instance-00000019</name>
Aug 01 14:00:20 user nova-compute[72129]:   <memory>524288</memory>
Aug 01 14:00:20 user nova-compute[72129]:   <vcpu>1</vcpu>
Aug 01 14:00:20 user nova-compute[72129]:   <metadata>
Aug 01 14:00:20 user nova-compute[72129]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 14:00:20 user nova-compute[72129]:       <nova:package version="0.0.0"/>
Aug 01 14:00:20 user nova-compute[72129]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1025565412</nova:name>
Aug 01 14:00:20 user nova-compute[72129]:       <nova:creationTime>2023-08-01 14:00:20</nova:creationTime>
Aug 01 14:00:20 user nova-compute[72129]:       <nova:flavor name="m1.tiny">
Aug 01 14:00:20 user nova-compute[72129]:         <nova:memory>512</nova:memory>
Aug 01 14:00:20 user nova-compute[72129]:         <nova:disk>1</nova:disk>
Aug 01 14:00:20 user nova-compute[72129]:         <nova:swap>0</nova:swap>
Aug 01 14:00:20 user nova-compute[72129]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 14:00:20 user nova-compute[72129]:         <nova:vcpus>1</nova:vcpus>
Aug 01 14:00:20 user nova-compute[72129]:       </nova:flavor>
Aug 01 14:00:20 user nova-compute[72129]:       <nova:owner>
Aug 01 14:00:20 user nova-compute[72129]:         <nova:user uuid="d537f7656c624f77967c8feed5a351d6">tempest-SnapshotDataIntegrityTests-846799905-project-member</nova:user>
Aug 01 14:00:20 user nova-compute[72129]:         <nova:project uuid="822d8992f146492cb98e0f57d42e0571">tempest-SnapshotDataIntegrityTests-846799905</nova:project>
Aug 01 14:00:20 user nova-compute[72129]:       </nova:owner>
Aug 01 14:00:20 user nova-compute[72129]:       <nova:root type="image" uuid="b6472c34-1b0f-4034-ba3a-7e8eb5103715"/>
Aug 01 14:00:20 user nova-compute[72129]:       <nova:ports>
Aug 01 14:00:20 user nova-compute[72129]:         <nova:port uuid="ed105f30-6ea8-4e9d-aedc-44a11f2ae5d5">
Aug 01 14:00:20 user nova-compute[72129]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 01 14:00:20 user nova-compute[72129]:         </nova:port>
Aug 01 14:00:20 user nova-compute[72129]:       </nova:ports>
Aug 01 14:00:20 user nova-compute[72129]:     </nova:instance>
Aug 01 14:00:20 user nova-compute[72129]:   </metadata>
Aug 01 14:00:20 user nova-compute[72129]:   <sysinfo type="smbios">
Aug 01 14:00:20 user nova-compute[72129]:     <system>
Aug 01 14:00:20 user nova-compute[72129]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 14:00:20 user nova-compute[72129]:       <entry name="product">OpenStack Nova</entry>
Aug 01 14:00:20 user nova-compute[72129]:       <entry name="version">0.0.0</entry>
Aug 01 14:00:20 user nova-compute[72129]:       <entry name="serial">e2cf5877-55dd-44ce-9b58-b662afe8e62e</entry>
Aug 01 14:00:20 user nova-compute[72129]:       <entry name="uuid">e2cf5877-55dd-44ce-9b58-b662afe8e62e</entry>
Aug 01 14:00:20 user nova-compute[72129]:       <entry name="family">Virtual Machine</entry>
Aug 01 14:00:20 user nova-compute[72129]:     </system>
Aug 01 14:00:20 user nova-compute[72129]:   </sysinfo>
Aug 01 14:00:20 user nova-compute[72129]:   <os>
Aug 01 14:00:20 user nova-compute[72129]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 14:00:20 user nova-compute[72129]:     <boot dev="hd"/>
Aug 01 14:00:20 user nova-compute[72129]:     <smbios mode="sysinfo"/>
Aug 01 14:00:20 user nova-compute[72129]:   </os>
Aug 01 14:00:20 user nova-compute[72129]:   <features>
Aug 01 14:00:20 user nova-compute[72129]:     <acpi/>
Aug 01 14:00:20 user nova-compute[72129]:     <apic/>
Aug 01 14:00:20 user nova-compute[72129]:     <vmcoreinfo/>
Aug 01 14:00:20 user nova-compute[72129]:   </features>
Aug 01 14:00:20 user nova-compute[72129]:   <clock offset="utc">
Aug 01 14:00:20 user nova-compute[72129]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 14:00:20 user nova-compute[72129]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 14:00:20 user nova-compute[72129]:     <timer name="hpet" present="no"/>
Aug 01 14:00:20 user nova-compute[72129]:   </clock>
Aug 01 14:00:20 user nova-compute[72129]:   <cpu mode="custom" match="exact">
Aug 01 14:00:20 user nova-compute[72129]:     <model>Nehalem</model>
Aug 01 14:00:20 user nova-compute[72129]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 14:00:20 user nova-compute[72129]:   </cpu>
Aug 01 14:00:20 user nova-compute[72129]:   <devices>
Aug 01 14:00:20 user nova-compute[72129]:     <disk type="file" device="disk">
Aug 01 14:00:20 user nova-compute[72129]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 14:00:20 user nova-compute[72129]:       <source file="/opt/stack/data/nova/instances/e2cf5877-55dd-44ce-9b58-b662afe8e62e/disk"/>
Aug 01 14:00:20 user nova-compute[72129]:       <target dev="vda" bus="virtio"/>
Aug 01 14:00:20 user nova-compute[72129]:     </disk>
Aug 01 14:00:20 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 14:00:20 user nova-compute[72129]:       <mac address="fa:16:3e:18:48:0e"/>
Aug 01 14:00:20 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:00:20 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 14:00:20 user nova-compute[72129]:       <target dev="taped105f30-6e"/>
Aug 01 14:00:20 user nova-compute[72129]:     </interface>
Aug 01 14:00:20 user nova-compute[72129]:     <serial type="pty">
Aug 01 14:00:20 user nova-compute[72129]:       <log file="/opt/stack/data/nova/instances/e2cf5877-55dd-44ce-9b58-b662afe8e62e/console.log" append="off"/>
Aug 01 14:00:20 user nova-compute[72129]:     </serial>
Aug 01 14:00:20 user nova-compute[72129]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 14:00:20 user nova-compute[72129]:     <video>
Aug 01 14:00:20 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:00:20 user nova-compute[72129]:     </video>
Aug 01 14:00:20 user nova-compute[72129]:     <rng model="virtio">
Aug 01 14:00:20 user nova-compute[72129]:       <backend model="random">/dev/urandom</backend>
Aug 01 14:00:20 user nova-compute[72129]:     </rng>
Aug 01 14:00:20 user nova-compute[72129]:     <controller type="usb" index="0" model="none"/>
Aug 01 14:00:20 user nova-compute[72129]:     <memballoon model="virtio">
Aug 01 14:00:20 user nova-compute[72129]:       <stats period="10"/>
Aug 01 14:00:20 user nova-compute[72129]:     </memballoon>
Aug 01 14:00:20 user nova-compute[72129]:   </devices>
Aug 01 14:00:20 user nova-compute[72129]: </domain>
Aug 01 14:00:20 user nova-compute[72129]:  {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 14:00:20 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:00:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1025565412',display_name='tempest-SnapshotDataIntegrityTests-server-1025565412',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1025565412',id=25,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDjD1eqd7I1REZPNLxth25Cri6aMSgVthWL0+MG1EEDyrZmfpc+KmhtStPMOI/tSkvR3AGD/m5FagqQXododlRh29GS9NGtfqWAOnY9Tx+KrD1Mousn2hs2pQivIfX3wgg==',key_name='tempest-keypair-289836616',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='822d8992f146492cb98e0f57d42e0571',ramdisk_id='',reservation_id='r-umd0od5q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-846799905',owner_user_name='tempest-SnapshotDataIntegrityTests-846799905-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T14:00:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d537f7656c624f77967c8feed5a351d6',uuid=e2cf5877-55dd-44ce-9b58-b662afe8e62e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed105f30-6ea8-4e9d-aedc-44a11f2ae5d5", "address": "fa:16:3e:18:48:0e", "network": {"id": "c31f34d8-03c6-40d0-868b-d82fdc9c5169", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1378125554-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "822d8992f146492cb98e0f57d42e0571", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped105f30-6e", "ovs_interfaceid": "ed105f30-6ea8-4e9d-aedc-44a11f2ae5d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 14:00:20 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Converting VIF {"id": "ed105f30-6ea8-4e9d-aedc-44a11f2ae5d5", "address": "fa:16:3e:18:48:0e", "network": {"id": "c31f34d8-03c6-40d0-868b-d82fdc9c5169", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1378125554-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "822d8992f146492cb98e0f57d42e0571", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped105f30-6e", "ovs_interfaceid": "ed105f30-6ea8-4e9d-aedc-44a11f2ae5d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:00:20 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:48:0e,bridge_name='br-int',has_traffic_filtering=True,id=ed105f30-6ea8-4e9d-aedc-44a11f2ae5d5,network=Network(c31f34d8-03c6-40d0-868b-d82fdc9c5169),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped105f30-6e') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:00:20 user nova-compute[72129]: DEBUG os_vif [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:48:0e,bridge_name='br-int',has_traffic_filtering=True,id=ed105f30-6ea8-4e9d-aedc-44a11f2ae5d5,network=Network(c31f34d8-03c6-40d0-868b-d82fdc9c5169),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped105f30-6e') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 14:00:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:00:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 14:00:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=taped105f30-6e, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:00:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=taped105f30-6e, col_values=(('external_ids', {'iface-id': 'ed105f30-6ea8-4e9d-aedc-44a11f2ae5d5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:48:0e', 'vm-uuid': 'e2cf5877-55dd-44ce-9b58-b662afe8e62e'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:00:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:00:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:20 user nova-compute[72129]: INFO os_vif [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:48:0e,bridge_name='br-int',has_traffic_filtering=True,id=ed105f30-6ea8-4e9d-aedc-44a11f2ae5d5,network=Network(c31f34d8-03c6-40d0-868b-d82fdc9c5169),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped105f30-6e')
Aug 01 14:00:20 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:00:20 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] No VIF found with MAC fa:16:3e:18:48:0e, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 14:00:20 user nova-compute[72129]: DEBUG nova.network.neutron [req-ee9ff152-ee7f-40b5-a560-02daa69a139b req-acc9b153-2d54-49ea-b9e9-41d769a83387 service nova] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Updated VIF entry in instance network info cache for port ed105f30-6ea8-4e9d-aedc-44a11f2ae5d5. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 14:00:20 user nova-compute[72129]: DEBUG nova.network.neutron [req-ee9ff152-ee7f-40b5-a560-02daa69a139b req-acc9b153-2d54-49ea-b9e9-41d769a83387 service nova] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Updating instance_info_cache with network_info: [{"id": "ed105f30-6ea8-4e9d-aedc-44a11f2ae5d5", "address": "fa:16:3e:18:48:0e", "network": {"id": "c31f34d8-03c6-40d0-868b-d82fdc9c5169", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1378125554-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "822d8992f146492cb98e0f57d42e0571", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped105f30-6e", "ovs_interfaceid": "ed105f30-6ea8-4e9d-aedc-44a11f2ae5d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:00:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ee9ff152-ee7f-40b5-a560-02daa69a139b req-acc9b153-2d54-49ea-b9e9-41d769a83387 service nova] Releasing lock "refresh_cache-e2cf5877-55dd-44ce-9b58-b662afe8e62e" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:00:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:22 user nova-compute[72129]: DEBUG nova.compute.manager [req-7e6bb4df-25ef-44b7-9fc4-974297b967b8 req-d488bf8d-95cf-4b62-9440-dba826922cc2 service nova] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Received event network-vif-plugged-ed105f30-6ea8-4e9d-aedc-44a11f2ae5d5 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:00:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-7e6bb4df-25ef-44b7-9fc4-974297b967b8 req-d488bf8d-95cf-4b62-9440-dba826922cc2 service nova] Acquiring lock "e2cf5877-55dd-44ce-9b58-b662afe8e62e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:00:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-7e6bb4df-25ef-44b7-9fc4-974297b967b8 req-d488bf8d-95cf-4b62-9440-dba826922cc2 service nova] Lock "e2cf5877-55dd-44ce-9b58-b662afe8e62e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:00:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-7e6bb4df-25ef-44b7-9fc4-974297b967b8 req-d488bf8d-95cf-4b62-9440-dba826922cc2 service nova] Lock "e2cf5877-55dd-44ce-9b58-b662afe8e62e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:00:22 user nova-compute[72129]: DEBUG nova.compute.manager [req-7e6bb4df-25ef-44b7-9fc4-974297b967b8 req-d488bf8d-95cf-4b62-9440-dba826922cc2 service nova] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] No waiting events found dispatching network-vif-plugged-ed105f30-6ea8-4e9d-aedc-44a11f2ae5d5 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:00:22 user nova-compute[72129]: WARNING nova.compute.manager [req-7e6bb4df-25ef-44b7-9fc4-974297b967b8 req-d488bf8d-95cf-4b62-9440-dba826922cc2 service nova] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Received unexpected event network-vif-plugged-ed105f30-6ea8-4e9d-aedc-44a11f2ae5d5 for instance with vm_state building and task_state spawning.
Aug 01 14:00:22 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:22 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:22 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:22 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:23 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898423.940334, e2cf5877-55dd-44ce-9b58-b662afe8e62e => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:00:23 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] VM Resumed (Lifecycle Event)
Aug 01 14:00:23 user nova-compute[72129]: DEBUG nova.compute.manager [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Instance event wait completed in 0 seconds for  {{(pid=72129) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 14:00:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Guest created on hypervisor {{(pid=72129) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 14:00:23 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Instance spawned successfully.
Aug 01 14:00:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 14:00:23 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:00:23 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:00:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Found default for hw_cdrom_bus of ide {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:00:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Found default for hw_disk_bus of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:00:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Found default for hw_input_bus of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:00:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Found default for hw_pointer_model of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:00:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Found default for hw_video_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:00:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Found default for hw_vif_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:00:24 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 14:00:24 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898423.9415615, e2cf5877-55dd-44ce-9b58-b662afe8e62e => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:00:24 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] VM Started (Lifecycle Event)
Aug 01 14:00:24 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:00:24 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:00:24 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 14:00:24 user nova-compute[72129]: DEBUG nova.compute.manager [req-bca5adc4-83a0-405e-9cbe-0801a242c1f5 req-b133d5f9-8439-4642-bb5d-77288cf49363 service nova] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Received event network-vif-plugged-ed105f30-6ea8-4e9d-aedc-44a11f2ae5d5 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:00:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-bca5adc4-83a0-405e-9cbe-0801a242c1f5 req-b133d5f9-8439-4642-bb5d-77288cf49363 service nova] Acquiring lock "e2cf5877-55dd-44ce-9b58-b662afe8e62e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:00:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-bca5adc4-83a0-405e-9cbe-0801a242c1f5 req-b133d5f9-8439-4642-bb5d-77288cf49363 service nova] Lock "e2cf5877-55dd-44ce-9b58-b662afe8e62e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:00:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-bca5adc4-83a0-405e-9cbe-0801a242c1f5 req-b133d5f9-8439-4642-bb5d-77288cf49363 service nova] Lock "e2cf5877-55dd-44ce-9b58-b662afe8e62e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:00:24 user nova-compute[72129]: DEBUG nova.compute.manager [req-bca5adc4-83a0-405e-9cbe-0801a242c1f5 req-b133d5f9-8439-4642-bb5d-77288cf49363 service nova] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] No waiting events found dispatching network-vif-plugged-ed105f30-6ea8-4e9d-aedc-44a11f2ae5d5 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:00:24 user nova-compute[72129]: WARNING nova.compute.manager [req-bca5adc4-83a0-405e-9cbe-0801a242c1f5 req-b133d5f9-8439-4642-bb5d-77288cf49363 service nova] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Received unexpected event network-vif-plugged-ed105f30-6ea8-4e9d-aedc-44a11f2ae5d5 for instance with vm_state building and task_state spawning.
Aug 01 14:00:24 user nova-compute[72129]: INFO nova.compute.manager [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Took 6.19 seconds to spawn the instance on the hypervisor.
Aug 01 14:00:24 user nova-compute[72129]: DEBUG nova.compute.manager [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:00:24 user nova-compute[72129]: INFO nova.compute.manager [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Took 6.92 seconds to build instance.
Aug 01 14:00:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5f622b40-86e7-4011-8c46-ec1e3af53efd tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lock "e2cf5877-55dd-44ce-9b58-b662afe8e62e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.025s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:00:25 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:25 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:30 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:30 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:35 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:35 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:35 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:37 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Acquiring lock "954db8d6-4806-43e6-8310-5d7f3437dc71" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:00:37 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "954db8d6-4806-43e6-8310-5d7f3437dc71" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:00:37 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] Starting instance... {{(pid=72129) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 14:00:37 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:00:37 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:00:37 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72129) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 14:00:37 user nova-compute[72129]: INFO nova.compute.claims [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] Claim successful on node user
Aug 01 14:00:37 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:00:37 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:00:37 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.460s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:00:37 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] Start building networks asynchronously for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 14:00:38 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] Allocating IP information in the background. {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 14:00:38 user nova-compute[72129]: DEBUG nova.network.neutron [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] allocate_for_instance() {{(pid=72129) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 14:00:38 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 14:00:38 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] Start building block device mappings for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 14:00:38 user nova-compute[72129]: INFO nova.virt.block_device [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] Booting with volume 92501218-291d-42fd-bb6f-d9402326b043 at /dev/vda
Aug 01 14:00:38 user nova-compute[72129]: DEBUG nova.policy [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7c341be2816c43cfa9adb58ee84e942b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '210837255c8148ec9b482ba3e2551362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72129) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 14:00:38 user nova-compute[72129]: DEBUG os_brick.utils [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:00:38 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:00:38 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:00:38 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fdd3c7e-7cc5-4f59-b484-fafa83a134c6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f9b449c2cd3d\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:00:38 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:00:38 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:00:38 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[6425b818-cf9e-4e72-a2e7-0046b6c4e245]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:00:38 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:00:38 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:00:38 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[9558b4ef-93ac-4a46-8d9d-a72e644ea076]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:00:38 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc92647-eb17-46ce-a7cc-420ea093ad08]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:00:38 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Running cmd (subprocess): nvme version {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:00:38 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] 'nvme version' failed. Not Retrying. {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 14:00:38 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] nvme not present on system {{(pid=72129) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 14:00:38 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:00:38 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 14:00:38 user nova-compute[72129]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 14:00:38 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee4947e-aeaa-4c45-a3ba-8764bb0f5337]: (4, '') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:00:38 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72129) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 14:00:38 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 14:00:38 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] LIGHTOS: no hostnqn found. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 14:00:38 user nova-compute[72129]: DEBUG os_brick.utils [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f9b449c2cd3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:00:38 user nova-compute[72129]: DEBUG nova.virt.block_device [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] Updating existing volume attachment record: f200abfa-446f-42b3-828a-822b46a26d1f {{(pid=72129) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 14:00:39 user nova-compute[72129]: DEBUG nova.network.neutron [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] Successfully created port: f6944a05-0ad8-4f1a-b849-0dbb7732b739 {{(pid=72129) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 14:00:40 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:40 user nova-compute[72129]: DEBUG nova.network.neutron [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] Successfully updated port: f6944a05-0ad8-4f1a-b849-0dbb7732b739 {{(pid=72129) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 14:00:40 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Acquiring lock "refresh_cache-954db8d6-4806-43e6-8310-5d7f3437dc71" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:00:40 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Acquired lock "refresh_cache-954db8d6-4806-43e6-8310-5d7f3437dc71" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:00:40 user nova-compute[72129]: DEBUG nova.network.neutron [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 14:00:40 user nova-compute[72129]: DEBUG nova.compute.manager [req-3810caec-a27c-435b-9c3b-7cb64e5d9430 req-8843a003-450d-470f-a28c-6b368ee44985 service nova] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] Received event network-changed-f6944a05-0ad8-4f1a-b849-0dbb7732b739 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:00:40 user nova-compute[72129]: DEBUG nova.compute.manager [req-3810caec-a27c-435b-9c3b-7cb64e5d9430 req-8843a003-450d-470f-a28c-6b368ee44985 service nova] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] Refreshing instance network info cache due to event network-changed-f6944a05-0ad8-4f1a-b849-0dbb7732b739. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 14:00:40 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-3810caec-a27c-435b-9c3b-7cb64e5d9430 req-8843a003-450d-470f-a28c-6b368ee44985 service nova] Acquiring lock "refresh_cache-954db8d6-4806-43e6-8310-5d7f3437dc71" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:00:40 user nova-compute[72129]: DEBUG nova.network.neutron [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] Instance cache missing network info. {{(pid=72129) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 14:00:40 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:40 user nova-compute[72129]: DEBUG nova.network.neutron [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] Updating instance_info_cache with network_info: [{"id": "f6944a05-0ad8-4f1a-b849-0dbb7732b739", "address": "fa:16:3e:b7:4f:45", "network": {"id": "a7f4226b-73fe-4265-ba2c-5d7dcdf154fd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1142462884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210837255c8148ec9b482ba3e2551362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6944a05-0a", "ovs_interfaceid": "f6944a05-0ad8-4f1a-b849-0dbb7732b739", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:00:40 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Releasing lock "refresh_cache-954db8d6-4806-43e6-8310-5d7f3437dc71" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:00:40 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] Instance network_info: |[{"id": "f6944a05-0ad8-4f1a-b849-0dbb7732b739", "address": "fa:16:3e:b7:4f:45", "network": {"id": "a7f4226b-73fe-4265-ba2c-5d7dcdf154fd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1142462884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210837255c8148ec9b482ba3e2551362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6944a05-0a", "ovs_interfaceid": "f6944a05-0ad8-4f1a-b849-0dbb7732b739", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 14:00:40 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-3810caec-a27c-435b-9c3b-7cb64e5d9430 req-8843a003-450d-470f-a28c-6b368ee44985 service nova] Acquired lock "refresh_cache-954db8d6-4806-43e6-8310-5d7f3437dc71" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:00:40 user nova-compute[72129]: DEBUG nova.network.neutron [req-3810caec-a27c-435b-9c3b-7cb64e5d9430 req-8843a003-450d-470f-a28c-6b368ee44985 service nova] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] Refreshing network info cache for port f6944a05-0ad8-4f1a-b849-0dbb7732b739 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 14:00:41 user nova-compute[72129]: DEBUG nova.network.neutron [req-3810caec-a27c-435b-9c3b-7cb64e5d9430 req-8843a003-450d-470f-a28c-6b368ee44985 service nova] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] Updated VIF entry in instance network info cache for port f6944a05-0ad8-4f1a-b849-0dbb7732b739. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 14:00:41 user nova-compute[72129]: DEBUG nova.network.neutron [req-3810caec-a27c-435b-9c3b-7cb64e5d9430 req-8843a003-450d-470f-a28c-6b368ee44985 service nova] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] Updating instance_info_cache with network_info: [{"id": "f6944a05-0ad8-4f1a-b849-0dbb7732b739", "address": "fa:16:3e:b7:4f:45", "network": {"id": "a7f4226b-73fe-4265-ba2c-5d7dcdf154fd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1142462884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210837255c8148ec9b482ba3e2551362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6944a05-0a", "ovs_interfaceid": "f6944a05-0ad8-4f1a-b849-0dbb7732b739", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:00:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-3810caec-a27c-435b-9c3b-7cb64e5d9430 req-8843a003-450d-470f-a28c-6b368ee44985 service nova] Releasing lock "refresh_cache-954db8d6-4806-43e6-8310-5d7f3437dc71" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:00:42 user nova-compute[72129]: INFO nova.compute.manager [None req-c6b692a6-5c65-49ca-8804-e03c166f8809 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: d031973f-8f48-43b3-a338-040950103e4c] Unrescuing
Aug 01 14:00:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c6b692a6-5c65-49ca-8804-e03c166f8809 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Acquiring lock "refresh_cache-d031973f-8f48-43b3-a338-040950103e4c" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:00:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c6b692a6-5c65-49ca-8804-e03c166f8809 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Acquired lock "refresh_cache-d031973f-8f48-43b3-a338-040950103e4c" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:00:42 user nova-compute[72129]: DEBUG nova.network.neutron [None req-c6b692a6-5c65-49ca-8804-e03c166f8809 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: d031973f-8f48-43b3-a338-040950103e4c] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 14:00:42 user nova-compute[72129]: DEBUG nova.network.neutron [None req-c6b692a6-5c65-49ca-8804-e03c166f8809 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: d031973f-8f48-43b3-a338-040950103e4c] Updating instance_info_cache with network_info: [{"id": "a978f40a-6406-423f-81f7-1e8077b43fd5", "address": "fa:16:3e:09:fd:e5", "network": {"id": "59b1e538-8bfe-45ce-ab7b-c5838ab25582", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1129024349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0929886fa54d1c8023793806f10d31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa978f40a-64", "ovs_interfaceid": "a978f40a-6406-423f-81f7-1e8077b43fd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:00:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c6b692a6-5c65-49ca-8804-e03c166f8809 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Releasing lock "refresh_cache-d031973f-8f48-43b3-a338-040950103e4c" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:00:42 user nova-compute[72129]: DEBUG nova.objects.instance [None req-c6b692a6-5c65-49ca-8804-e03c166f8809 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lazy-loading 'flavor' on Instance uuid d031973f-8f48-43b3-a338-040950103e4c {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:00:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a0bd8f06-75f3-43b0-a6e9-6b615cc02fb2 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Acquiring lock "133076de-14b5-4ceb-aa41-d9acef8506c5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:00:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a0bd8f06-75f3-43b0-a6e9-6b615cc02fb2 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lock "133076de-14b5-4ceb-aa41-d9acef8506c5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:00:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a0bd8f06-75f3-43b0-a6e9-6b615cc02fb2 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Acquiring lock "133076de-14b5-4ceb-aa41-d9acef8506c5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:00:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a0bd8f06-75f3-43b0-a6e9-6b615cc02fb2 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lock "133076de-14b5-4ceb-aa41-d9acef8506c5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:00:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a0bd8f06-75f3-43b0-a6e9-6b615cc02fb2 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lock "133076de-14b5-4ceb-aa41-d9acef8506c5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:00:42 user nova-compute[72129]: INFO nova.compute.manager [None req-a0bd8f06-75f3-43b0-a6e9-6b615cc02fb2 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Terminating instance
Aug 01 14:00:42 user nova-compute[72129]: DEBUG nova.compute.manager [None req-a0bd8f06-75f3-43b0-a6e9-6b615cc02fb2 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Start destroying the instance on the hypervisor. {{(pid=72129) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 14:00:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:43 user nova-compute[72129]: DEBUG nova.compute.manager [req-7692411b-0b38-4ebc-b4cf-58e58acb2c41 req-c1e3613a-c704-4f6d-9f93-3c6e600d55af service nova] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Received event network-vif-unplugged-09dc6abd-1d55-4e2d-8568-1f793ca45413 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:00:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-7692411b-0b38-4ebc-b4cf-58e58acb2c41 req-c1e3613a-c704-4f6d-9f93-3c6e600d55af service nova] Acquiring lock "133076de-14b5-4ceb-aa41-d9acef8506c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:00:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-7692411b-0b38-4ebc-b4cf-58e58acb2c41 req-c1e3613a-c704-4f6d-9f93-3c6e600d55af service nova] Lock "133076de-14b5-4ceb-aa41-d9acef8506c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:00:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-7692411b-0b38-4ebc-b4cf-58e58acb2c41 req-c1e3613a-c704-4f6d-9f93-3c6e600d55af service nova] Lock "133076de-14b5-4ceb-aa41-d9acef8506c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:00:43 user nova-compute[72129]: DEBUG nova.compute.manager [req-7692411b-0b38-4ebc-b4cf-58e58acb2c41 req-c1e3613a-c704-4f6d-9f93-3c6e600d55af service nova] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] No waiting events found dispatching network-vif-unplugged-09dc6abd-1d55-4e2d-8568-1f793ca45413 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:00:43 user nova-compute[72129]: DEBUG nova.compute.manager [req-7692411b-0b38-4ebc-b4cf-58e58acb2c41 req-c1e3613a-c704-4f6d-9f93-3c6e600d55af service nova] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Received event network-vif-unplugged-09dc6abd-1d55-4e2d-8568-1f793ca45413 for instance with task_state deleting. {{(pid=72129) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 14:00:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:43 user nova-compute[72129]: DEBUG nova.compute.manager [req-7de1840a-6408-427c-84f6-4099618d1715 req-fa01c87c-049c-4222-a77a-36f57e9e10be service nova] [instance: d031973f-8f48-43b3-a338-040950103e4c] Received event network-vif-unplugged-a978f40a-6406-423f-81f7-1e8077b43fd5 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:00:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-7de1840a-6408-427c-84f6-4099618d1715 req-fa01c87c-049c-4222-a77a-36f57e9e10be service nova] Acquiring lock "d031973f-8f48-43b3-a338-040950103e4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:00:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-7de1840a-6408-427c-84f6-4099618d1715 req-fa01c87c-049c-4222-a77a-36f57e9e10be service nova] Lock "d031973f-8f48-43b3-a338-040950103e4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:00:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-7de1840a-6408-427c-84f6-4099618d1715 req-fa01c87c-049c-4222-a77a-36f57e9e10be service nova] Lock "d031973f-8f48-43b3-a338-040950103e4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:00:43 user nova-compute[72129]: DEBUG nova.compute.manager [req-7de1840a-6408-427c-84f6-4099618d1715 req-fa01c87c-049c-4222-a77a-36f57e9e10be service nova] [instance: d031973f-8f48-43b3-a338-040950103e4c] No waiting events found dispatching network-vif-unplugged-a978f40a-6406-423f-81f7-1e8077b43fd5 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:00:43 user nova-compute[72129]: WARNING nova.compute.manager [req-7de1840a-6408-427c-84f6-4099618d1715 req-fa01c87c-049c-4222-a77a-36f57e9e10be service nova] [instance: d031973f-8f48-43b3-a338-040950103e4c] Received unexpected event network-vif-unplugged-a978f40a-6406-423f-81f7-1e8077b43fd5 for instance with vm_state rescued and task_state unrescuing.
Aug 01 14:00:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:44 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Instance destroyed successfully.
Aug 01 14:00:44 user nova-compute[72129]: DEBUG nova.objects.instance [None req-a0bd8f06-75f3-43b0-a6e9-6b615cc02fb2 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lazy-loading 'resources' on Instance uuid 133076de-14b5-4ceb-aa41-d9acef8506c5 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:00:44 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-a0bd8f06-75f3-43b0-a6e9-6b615cc02fb2 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:55:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-337029066',display_name='tempest-TestMinimumBasicScenario-server-337029066',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-337029066',id=17,image_ref='edea0658-dd0d-4712-83e7-608cd2089ee4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIF8pK0CTkVNfFPcWoAjeaWcCqpSHidxLzrNXnGzXid58N/NMzig5Fh+PrM0HmEtqXEVuFeC6ojSBtRRykq6gLAiPaZuHwOjhWv6j6ZSIDENuHN2kr+7tsEOeWGDThWqHw==',key_name='tempest-TestMinimumBasicScenario-1218723859',keypairs=<?>,launch_index=0,launched_at=2023-08-01T13:55:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='43253b37caa747b090b14c707abf96cf',ramdisk_id='',reservation_id='r-3dv71pgh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='edea0658-dd0d-4712-83e7-608cd2089ee4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-833844079',owner_user_name='tempest-TestMinimumBasicScenario-833844079-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T13:58:03Z,user_data=None,user_id='8acae20eb69f40c08bbe0799513b95e1',uuid=133076de-14b5-4ceb-aa41-d9acef8506c5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "09dc6abd-1d55-4e2d-8568-1f793ca45413", "address": "fa:16:3e:d3:ee:e0", "network": {"id": "a7ec6cc0-140b-446b-ae97-d4aafbc42693", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-397303278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43253b37caa747b090b14c707abf96cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09dc6abd-1d", "ovs_interfaceid": "09dc6abd-1d55-4e2d-8568-1f793ca45413", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 14:00:44 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-a0bd8f06-75f3-43b0-a6e9-6b615cc02fb2 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Converting VIF {"id": "09dc6abd-1d55-4e2d-8568-1f793ca45413", "address": "fa:16:3e:d3:ee:e0", "network": {"id": "a7ec6cc0-140b-446b-ae97-d4aafbc42693", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-397303278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43253b37caa747b090b14c707abf96cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09dc6abd-1d", "ovs_interfaceid": "09dc6abd-1d55-4e2d-8568-1f793ca45413", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:00:44 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-a0bd8f06-75f3-43b0-a6e9-6b615cc02fb2 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:ee:e0,bridge_name='br-int',has_traffic_filtering=True,id=09dc6abd-1d55-4e2d-8568-1f793ca45413,network=Network(a7ec6cc0-140b-446b-ae97-d4aafbc42693),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09dc6abd-1d') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:00:44 user nova-compute[72129]: DEBUG os_vif [None req-a0bd8f06-75f3-43b0-a6e9-6b615cc02fb2 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:ee:e0,bridge_name='br-int',has_traffic_filtering=True,id=09dc6abd-1d55-4e2d-8568-1f793ca45413,network=Network(a7ec6cc0-140b-446b-ae97-d4aafbc42693),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09dc6abd-1d') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 14:00:44 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:44 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap09dc6abd-1d, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:00:44 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:44 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: d031973f-8f48-43b3-a338-040950103e4c] Instance destroyed successfully.
Aug 01 14:00:44 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:00:44 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:44 user nova-compute[72129]: INFO os_vif [None req-a0bd8f06-75f3-43b0-a6e9-6b615cc02fb2 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:ee:e0,bridge_name='br-int',has_traffic_filtering=True,id=09dc6abd-1d55-4e2d-8568-1f793ca45413,network=Network(a7ec6cc0-140b-446b-ae97-d4aafbc42693),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09dc6abd-1d')
Aug 01 14:00:44 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-a0bd8f06-75f3-43b0-a6e9-6b615cc02fb2 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Deleting instance files /opt/stack/data/nova/instances/133076de-14b5-4ceb-aa41-d9acef8506c5_del
Aug 01 14:00:44 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-a0bd8f06-75f3-43b0-a6e9-6b615cc02fb2 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Deletion of /opt/stack/data/nova/instances/133076de-14b5-4ceb-aa41-d9acef8506c5_del complete
Aug 01 14:00:44 user nova-compute[72129]: INFO nova.compute.manager [None req-a0bd8f06-75f3-43b0-a6e9-6b615cc02fb2 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Took 1.37 seconds to destroy the instance on the hypervisor.
Aug 01 14:00:44 user nova-compute[72129]: DEBUG oslo.service.loopingcall [None req-a0bd8f06-75f3-43b0-a6e9-6b615cc02fb2 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72129) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 14:00:44 user nova-compute[72129]: DEBUG nova.compute.manager [-] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Deallocating network for instance {{(pid=72129) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 14:00:44 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] deallocate_for_instance() {{(pid=72129) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 14:00:44 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:44 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:44 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:44 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:44 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:44 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:44 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:45 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:00:45 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Took 1.06 seconds to deallocate network for instance.
Aug 01 14:00:45 user nova-compute[72129]: DEBUG nova.compute.manager [req-9fc8d436-9cca-493a-8d81-bf4d593dc665 req-ac8292d0-7553-4f37-b055-f9c53e858093 service nova] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Received event network-vif-plugged-09dc6abd-1d55-4e2d-8568-1f793ca45413 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:00:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-9fc8d436-9cca-493a-8d81-bf4d593dc665 req-ac8292d0-7553-4f37-b055-f9c53e858093 service nova] Acquiring lock "133076de-14b5-4ceb-aa41-d9acef8506c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:00:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-9fc8d436-9cca-493a-8d81-bf4d593dc665 req-ac8292d0-7553-4f37-b055-f9c53e858093 service nova] Lock "133076de-14b5-4ceb-aa41-d9acef8506c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:00:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-9fc8d436-9cca-493a-8d81-bf4d593dc665 req-ac8292d0-7553-4f37-b055-f9c53e858093 service nova] Lock "133076de-14b5-4ceb-aa41-d9acef8506c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:00:45 user nova-compute[72129]: DEBUG nova.compute.manager [req-9fc8d436-9cca-493a-8d81-bf4d593dc665 req-ac8292d0-7553-4f37-b055-f9c53e858093 service nova] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] No waiting events found dispatching network-vif-plugged-09dc6abd-1d55-4e2d-8568-1f793ca45413 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:00:45 user nova-compute[72129]: WARNING nova.compute.manager [req-9fc8d436-9cca-493a-8d81-bf4d593dc665 req-ac8292d0-7553-4f37-b055-f9c53e858093 service nova] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Received unexpected event network-vif-plugged-09dc6abd-1d55-4e2d-8568-1f793ca45413 for instance with vm_state active and task_state deleting.
Aug 01 14:00:45 user nova-compute[72129]: DEBUG nova.compute.manager [req-9fc8d436-9cca-493a-8d81-bf4d593dc665 req-ac8292d0-7553-4f37-b055-f9c53e858093 service nova] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Received event network-vif-plugged-09dc6abd-1d55-4e2d-8568-1f793ca45413 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:00:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-9fc8d436-9cca-493a-8d81-bf4d593dc665 req-ac8292d0-7553-4f37-b055-f9c53e858093 service nova] Acquiring lock "133076de-14b5-4ceb-aa41-d9acef8506c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:00:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-9fc8d436-9cca-493a-8d81-bf4d593dc665 req-ac8292d0-7553-4f37-b055-f9c53e858093 service nova] Lock "133076de-14b5-4ceb-aa41-d9acef8506c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:00:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-9fc8d436-9cca-493a-8d81-bf4d593dc665 req-ac8292d0-7553-4f37-b055-f9c53e858093 service nova] Lock "133076de-14b5-4ceb-aa41-d9acef8506c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:00:45 user nova-compute[72129]: DEBUG nova.compute.manager [req-9fc8d436-9cca-493a-8d81-bf4d593dc665 req-ac8292d0-7553-4f37-b055-f9c53e858093 service nova] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] No waiting events found dispatching network-vif-plugged-09dc6abd-1d55-4e2d-8568-1f793ca45413 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:00:45 user nova-compute[72129]: WARNING nova.compute.manager [req-9fc8d436-9cca-493a-8d81-bf4d593dc665 req-ac8292d0-7553-4f37-b055-f9c53e858093 service nova] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Received unexpected event network-vif-plugged-09dc6abd-1d55-4e2d-8568-1f793ca45413 for instance with vm_state active and task_state deleting.
Aug 01 14:00:45 user nova-compute[72129]: DEBUG nova.compute.manager [req-9fc8d436-9cca-493a-8d81-bf4d593dc665 req-ac8292d0-7553-4f37-b055-f9c53e858093 service nova] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Received event network-vif-plugged-09dc6abd-1d55-4e2d-8568-1f793ca45413 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:00:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-9fc8d436-9cca-493a-8d81-bf4d593dc665 req-ac8292d0-7553-4f37-b055-f9c53e858093 service nova] Acquiring lock "133076de-14b5-4ceb-aa41-d9acef8506c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:00:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-9fc8d436-9cca-493a-8d81-bf4d593dc665 req-ac8292d0-7553-4f37-b055-f9c53e858093 service nova] Lock "133076de-14b5-4ceb-aa41-d9acef8506c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:00:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-9fc8d436-9cca-493a-8d81-bf4d593dc665 req-ac8292d0-7553-4f37-b055-f9c53e858093 service nova] Lock "133076de-14b5-4ceb-aa41-d9acef8506c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:00:45 user nova-compute[72129]: DEBUG nova.compute.manager [req-9fc8d436-9cca-493a-8d81-bf4d593dc665 req-ac8292d0-7553-4f37-b055-f9c53e858093 service nova] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] No waiting events found dispatching network-vif-plugged-09dc6abd-1d55-4e2d-8568-1f793ca45413 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:00:45 user nova-compute[72129]: WARNING nova.compute.manager [req-9fc8d436-9cca-493a-8d81-bf4d593dc665 req-ac8292d0-7553-4f37-b055-f9c53e858093 service nova] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Received unexpected event network-vif-plugged-09dc6abd-1d55-4e2d-8568-1f793ca45413 for instance with vm_state active and task_state deleting.
Aug 01 14:00:45 user nova-compute[72129]: DEBUG nova.compute.manager [req-9fc8d436-9cca-493a-8d81-bf4d593dc665 req-ac8292d0-7553-4f37-b055-f9c53e858093 service nova] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Received event network-vif-unplugged-09dc6abd-1d55-4e2d-8568-1f793ca45413 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:00:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-9fc8d436-9cca-493a-8d81-bf4d593dc665 req-ac8292d0-7553-4f37-b055-f9c53e858093 service nova] Acquiring lock "133076de-14b5-4ceb-aa41-d9acef8506c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:00:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-9fc8d436-9cca-493a-8d81-bf4d593dc665 req-ac8292d0-7553-4f37-b055-f9c53e858093 service nova] Lock "133076de-14b5-4ceb-aa41-d9acef8506c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:00:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-9fc8d436-9cca-493a-8d81-bf4d593dc665 req-ac8292d0-7553-4f37-b055-f9c53e858093 service nova] Lock "133076de-14b5-4ceb-aa41-d9acef8506c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:00:45 user nova-compute[72129]: DEBUG nova.compute.manager [req-9fc8d436-9cca-493a-8d81-bf4d593dc665 req-ac8292d0-7553-4f37-b055-f9c53e858093 service nova] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] No waiting events found dispatching network-vif-unplugged-09dc6abd-1d55-4e2d-8568-1f793ca45413 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:00:45 user nova-compute[72129]: DEBUG nova.compute.manager [req-9fc8d436-9cca-493a-8d81-bf4d593dc665 req-ac8292d0-7553-4f37-b055-f9c53e858093 service nova] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Received event network-vif-unplugged-09dc6abd-1d55-4e2d-8568-1f793ca45413 for instance with task_state deleting. {{(pid=72129) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 14:00:45 user nova-compute[72129]: DEBUG nova.compute.manager [req-9fc8d436-9cca-493a-8d81-bf4d593dc665 req-ac8292d0-7553-4f37-b055-f9c53e858093 service nova] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Received event network-vif-plugged-09dc6abd-1d55-4e2d-8568-1f793ca45413 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:00:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-9fc8d436-9cca-493a-8d81-bf4d593dc665 req-ac8292d0-7553-4f37-b055-f9c53e858093 service nova] Acquiring lock "133076de-14b5-4ceb-aa41-d9acef8506c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:00:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-9fc8d436-9cca-493a-8d81-bf4d593dc665 req-ac8292d0-7553-4f37-b055-f9c53e858093 service nova] Lock "133076de-14b5-4ceb-aa41-d9acef8506c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:00:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-9fc8d436-9cca-493a-8d81-bf4d593dc665 req-ac8292d0-7553-4f37-b055-f9c53e858093 service nova] Lock "133076de-14b5-4ceb-aa41-d9acef8506c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:00:45 user nova-compute[72129]: DEBUG nova.compute.manager [req-9fc8d436-9cca-493a-8d81-bf4d593dc665 req-ac8292d0-7553-4f37-b055-f9c53e858093 service nova] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] No waiting events found dispatching network-vif-plugged-09dc6abd-1d55-4e2d-8568-1f793ca45413 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:00:45 user nova-compute[72129]: WARNING nova.compute.manager [req-9fc8d436-9cca-493a-8d81-bf4d593dc665 req-ac8292d0-7553-4f37-b055-f9c53e858093 service nova] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Received unexpected event network-vif-plugged-09dc6abd-1d55-4e2d-8568-1f793ca45413 for instance with vm_state active and task_state deleting.
Aug 01 14:00:45 user nova-compute[72129]: DEBUG nova.compute.manager [req-9fc8d436-9cca-493a-8d81-bf4d593dc665 req-ac8292d0-7553-4f37-b055-f9c53e858093 service nova] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Received event network-vif-deleted-09dc6abd-1d55-4e2d-8568-1f793ca45413 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:00:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a0bd8f06-75f3-43b0-a6e9-6b615cc02fb2 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:00:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a0bd8f06-75f3-43b0-a6e9-6b615cc02fb2 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:00:45 user nova-compute[72129]: DEBUG nova.compute.manager [req-529f24e6-91c2-4205-b23e-7ac6230339ff req-bd9b143e-b3a4-4451-afe4-0ec2c25f70cc service nova] [instance: d031973f-8f48-43b3-a338-040950103e4c] Received event network-vif-plugged-a978f40a-6406-423f-81f7-1e8077b43fd5 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:00:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-529f24e6-91c2-4205-b23e-7ac6230339ff req-bd9b143e-b3a4-4451-afe4-0ec2c25f70cc service nova] Acquiring lock "d031973f-8f48-43b3-a338-040950103e4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:00:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-529f24e6-91c2-4205-b23e-7ac6230339ff req-bd9b143e-b3a4-4451-afe4-0ec2c25f70cc service nova] Lock "d031973f-8f48-43b3-a338-040950103e4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:00:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-529f24e6-91c2-4205-b23e-7ac6230339ff req-bd9b143e-b3a4-4451-afe4-0ec2c25f70cc service nova] Lock "d031973f-8f48-43b3-a338-040950103e4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:00:45 user nova-compute[72129]: DEBUG nova.compute.manager [req-529f24e6-91c2-4205-b23e-7ac6230339ff req-bd9b143e-b3a4-4451-afe4-0ec2c25f70cc service nova] [instance: d031973f-8f48-43b3-a338-040950103e4c] No waiting events found dispatching network-vif-plugged-a978f40a-6406-423f-81f7-1e8077b43fd5 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:00:45 user nova-compute[72129]: WARNING nova.compute.manager [req-529f24e6-91c2-4205-b23e-7ac6230339ff req-bd9b143e-b3a4-4451-afe4-0ec2c25f70cc service nova] [instance: d031973f-8f48-43b3-a338-040950103e4c] Received unexpected event network-vif-plugged-a978f40a-6406-423f-81f7-1e8077b43fd5 for instance with vm_state rescued and task_state unrescuing.
Aug 01 14:00:45 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-a0bd8f06-75f3-43b0-a6e9-6b615cc02fb2 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Refreshing inventories for resource provider c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 14:00:45 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:45 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:45 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-a0bd8f06-75f3-43b0-a6e9-6b615cc02fb2 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Updating ProviderTree inventory for provider c2f345c3-9b82-4164-b21d-1eef8e661842 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 14:00:45 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-a0bd8f06-75f3-43b0-a6e9-6b615cc02fb2 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Updating inventory in ProviderTree for provider c2f345c3-9b82-4164-b21d-1eef8e661842 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 14:00:45 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:45 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:00:45 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Starting heal instance info cache {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 14:00:45 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-a0bd8f06-75f3-43b0-a6e9-6b615cc02fb2 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Refreshing aggregate associations for resource provider c2f345c3-9b82-4164-b21d-1eef8e661842, aggregates: None {{(pid=72129) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 14:00:45 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-a0bd8f06-75f3-43b0-a6e9-6b615cc02fb2 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Refreshing trait associations for resource provider c2f345c3-9b82-4164-b21d-1eef8e661842, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE {{(pid=72129) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 14:00:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "refresh_cache-133076de-14b5-4ceb-aa41-d9acef8506c5" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:00:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquired lock "refresh_cache-133076de-14b5-4ceb-aa41-d9acef8506c5" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:00:45 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Forcefully refreshing network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 14:00:45 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Instance cache missing network info. {{(pid=72129) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 14:00:45 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:45 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:45 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:46 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:00:46 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Releasing lock "refresh_cache-133076de-14b5-4ceb-aa41-d9acef8506c5" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:00:46 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Updated the network info_cache for instance {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 14:00:46 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:00:46 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:00:46 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:00:46 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:00:46 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-a0bd8f06-75f3-43b0-a6e9-6b615cc02fb2 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:00:46 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-a0bd8f06-75f3-43b0-a6e9-6b615cc02fb2 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:00:46 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a0bd8f06-75f3-43b0-a6e9-6b615cc02fb2 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.745s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:00:46 user nova-compute[72129]: INFO nova.scheduler.client.report [None req-a0bd8f06-75f3-43b0-a6e9-6b615cc02fb2 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Deleted allocations for instance 133076de-14b5-4ceb-aa41-d9acef8506c5
Aug 01 14:00:46 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a0bd8f06-75f3-43b0-a6e9-6b615cc02fb2 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lock "133076de-14b5-4ceb-aa41-d9acef8506c5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.387s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:00:46 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] Start spawning the instance on the hypervisor. {{(pid=72129) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 14:00:46 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] Creating instance directory {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 14:00:46 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] Creating image(s)
Aug 01 14:00:46 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] Did not create local disks {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 14:00:46 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] Ensure instance console log exists: /opt/stack/data/nova/instances/954db8d6-4806-43e6-8310-5d7f3437dc71/console.log {{(pid=72129) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 14:00:46 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:00:46 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:00:46 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:00:46 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] Start _get_guest_xml network_info=[{"id": "f6944a05-0ad8-4f1a-b849-0dbb7732b739", "address": "fa:16:3e:b7:4f:45", "network": {"id": "a7f4226b-73fe-4265-ba2c-5d7dcdf154fd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1142462884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210837255c8148ec9b482ba3e2551362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6944a05-0a", "ovs_interfaceid": "f6944a05-0ad8-4f1a-b849-0dbb7732b739", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': 'f200abfa-446f-42b3-828a-822b46a26d1f', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MgpKnyzA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '954db8d6-4806-43e6-8310-5d7f3437dc71', 'attached_at': '', 'detached_at': '', 'volume_id': '92501218-291d-42fd-bb6f-d9402326b043', 'serial': '92501218-291d-42fd-bb6f-d9402326b043'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 14:00:46 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:00:46 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:00:46 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 14:00:46 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] CPU controller missing on host. {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 14:00:46 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 14:00:46 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] CPU controller found on host. {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 14:00:46 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72129) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 14:00:46 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T13:45:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 14:00:46 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Flavor limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 14:00:46 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Image limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 14:00:46 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Flavor pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 14:00:46 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Image pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 14:00:46 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 14:00:46 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 14:00:46 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 14:00:46 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Got 1 possible topologies {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 14:00:46 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 14:00:46 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 14:00:46 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] Calling os-brick to attach iSCSI Volume {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 14:00:46 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MgpKnyzA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:00:46 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:00:46 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:00:46 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:00:46 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:00:46 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:00:46 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:00:46 user nova-compute[72129]: INFO os_brick.initiator.connectors.iscsi [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 14:00:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 -p 172.16.0.220:3260 {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:00:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:00:46 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce1a6cb-6527-4303-8717-ecc1c9650e19]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:00:46 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 14:00:46 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:00:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 -p 172.16.0.220:3260 --interface default --op new {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:00:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:00:46 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[890e1d51-bbf3-49a5-be25-7341eedfae8c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043] added\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:00:46 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043] added
Aug 01 14:00:46 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:00:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:00:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:00:47 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30333fd-771d-46ba-bfc0-2cf26fc1962f]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:00:47 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:00:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:00:47 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:00:47 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:00:47 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72129) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 14:00:47 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:00:47 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72129) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 14:00:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:00:47 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab30033-f7ef-4fd6-b039-f6036260b150]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:00:47 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:00:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MgpKnyzA {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:00:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MgpKnyzA" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:00:47 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd4b844-849f-4179-abdc-ebb90cdebb62]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:00:47 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MgpKnyzA'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:00:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:00:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:00:47 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f6f178b-a213-45ae-8904-6fb27501e594]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:00:47 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:00:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:00:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:00:47 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc37e95c-668b-47a1-adae-5fec1cbc4b89]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:00:47 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:00:47 user nova-compute[72129]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 (non-flash)
Aug 01 14:00:47 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:00:47 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:00:47 user nova-compute[72129]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 (non-flash)
Aug 01 14:00:47 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:00:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 -p 172.16.0.220:3260 --login {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:00:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:00:47 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae1831f-aa2f-44d6-bcdb-c7fa1d5d2301]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:00:47 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043, portal: 172.16.0.220,3260]
Aug 01 14:00:47 user nova-compute[72129]: Login to [iface: default, target: iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043, portal: 172.16.0.220,3260] successful.
Aug 01 14:00:47 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:00:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:00:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:00:47 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc896c99-3fad-4a02-b5f4-fabb615a43a4]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:00:47 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:00:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:00:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:00:47 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3cc2138-16d2-44dc-8dc0-23a85a942d15]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:00:47 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:00:47 user nova-compute[72129]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 (non-flash)
Aug 01 14:00:47 user nova-compute[72129]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)
Aug 01 14:00:47 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:00:47 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:00:47 user nova-compute[72129]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 (non-flash)
Aug 01 14:00:47 user nova-compute[72129]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)
Aug 01 14:00:47 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:00:47 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:00:47 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Connected to 172.16.0.220:3260 {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 14:00:47 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] HCTL ('35', '-', '-', 0) found on session 29 with lun 0 {{(pid=72129) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 14:00:47 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72129) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 14:00:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:00:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:00:47 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6cd5b29-765e-47b9-b5b2-f9fdf29bd789]: (4, ('- - 0', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:00:47 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Searching for a device in session 29 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 14:00:47 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MgpKnyzA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 14:00:47 user nova-compute[72129]: DEBUG nova.compute.manager [req-50d32e36-78a4-4f8f-8cd0-6597e0198bd8 req-32bc6883-c86f-4827-8a54-7c0dfc488155 service nova] [instance: d031973f-8f48-43b3-a338-040950103e4c] Received event network-vif-plugged-a978f40a-6406-423f-81f7-1e8077b43fd5 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:00:47 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-50d32e36-78a4-4f8f-8cd0-6597e0198bd8 req-32bc6883-c86f-4827-8a54-7c0dfc488155 service nova] Acquiring lock "d031973f-8f48-43b3-a338-040950103e4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:00:47 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-50d32e36-78a4-4f8f-8cd0-6597e0198bd8 req-32bc6883-c86f-4827-8a54-7c0dfc488155 service nova] Lock "d031973f-8f48-43b3-a338-040950103e4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:00:47 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-50d32e36-78a4-4f8f-8cd0-6597e0198bd8 req-32bc6883-c86f-4827-8a54-7c0dfc488155 service nova] Lock "d031973f-8f48-43b3-a338-040950103e4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:00:47 user nova-compute[72129]: DEBUG nova.compute.manager [req-50d32e36-78a4-4f8f-8cd0-6597e0198bd8 req-32bc6883-c86f-4827-8a54-7c0dfc488155 service nova] [instance: d031973f-8f48-43b3-a338-040950103e4c] No waiting events found dispatching network-vif-plugged-a978f40a-6406-423f-81f7-1e8077b43fd5 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:00:47 user nova-compute[72129]: WARNING nova.compute.manager [req-50d32e36-78a4-4f8f-8cd0-6597e0198bd8 req-32bc6883-c86f-4827-8a54-7c0dfc488155 service nova] [instance: d031973f-8f48-43b3-a338-040950103e4c] Received unexpected event network-vif-plugged-a978f40a-6406-423f-81f7-1e8077b43fd5 for instance with vm_state rescued and task_state unrescuing.
Aug 01 14:00:47 user nova-compute[72129]: DEBUG nova.compute.manager [req-50d32e36-78a4-4f8f-8cd0-6597e0198bd8 req-32bc6883-c86f-4827-8a54-7c0dfc488155 service nova] [instance: d031973f-8f48-43b3-a338-040950103e4c] Received event network-vif-plugged-a978f40a-6406-423f-81f7-1e8077b43fd5 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:00:47 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-50d32e36-78a4-4f8f-8cd0-6597e0198bd8 req-32bc6883-c86f-4827-8a54-7c0dfc488155 service nova] Acquiring lock "d031973f-8f48-43b3-a338-040950103e4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:00:47 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-50d32e36-78a4-4f8f-8cd0-6597e0198bd8 req-32bc6883-c86f-4827-8a54-7c0dfc488155 service nova] Lock "d031973f-8f48-43b3-a338-040950103e4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:00:47 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-50d32e36-78a4-4f8f-8cd0-6597e0198bd8 req-32bc6883-c86f-4827-8a54-7c0dfc488155 service nova] Lock "d031973f-8f48-43b3-a338-040950103e4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:00:47 user nova-compute[72129]: DEBUG nova.compute.manager [req-50d32e36-78a4-4f8f-8cd0-6597e0198bd8 req-32bc6883-c86f-4827-8a54-7c0dfc488155 service nova] [instance: d031973f-8f48-43b3-a338-040950103e4c] No waiting events found dispatching network-vif-plugged-a978f40a-6406-423f-81f7-1e8077b43fd5 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:00:47 user nova-compute[72129]: WARNING nova.compute.manager [req-50d32e36-78a4-4f8f-8cd0-6597e0198bd8 req-32bc6883-c86f-4827-8a54-7c0dfc488155 service nova] [instance: d031973f-8f48-43b3-a338-040950103e4c] Received unexpected event network-vif-plugged-a978f40a-6406-423f-81f7-1e8077b43fd5 for instance with vm_state rescued and task_state unrescuing.
Aug 01 14:00:47 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Removed pending event for d031973f-8f48-43b3-a338-040950103e4c due to event {{(pid=72129) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 14:00:47 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898447.8445487, d031973f-8f48-43b3-a338-040950103e4c => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:00:47 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: d031973f-8f48-43b3-a338-040950103e4c] VM Resumed (Lifecycle Event)
Aug 01 14:00:47 user nova-compute[72129]: DEBUG nova.compute.manager [None req-c6b692a6-5c65-49ca-8804-e03c166f8809 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: d031973f-8f48-43b3-a338-040950103e4c] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:00:47 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: d031973f-8f48-43b3-a338-040950103e4c] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:00:47 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: d031973f-8f48-43b3-a338-040950103e4c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:00:47 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: d031973f-8f48-43b3-a338-040950103e4c] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 01 14:00:47 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898447.8459036, d031973f-8f48-43b3-a338-040950103e4c => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:00:47 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: d031973f-8f48-43b3-a338-040950103e4c] VM Started (Lifecycle Event)
Aug 01 14:00:47 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: d031973f-8f48-43b3-a338-040950103e4c] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:00:47 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: d031973f-8f48-43b3-a338-040950103e4c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:00:48 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:00:48 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:00:48 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23737333563303132', 'path': '/dev/sdd'} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:00:48 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23737333563303132', 'path': '/dev/sdd'} {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 14:00:48 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:00:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-775511038',display_name='tempest-TestVolumeBootPattern-volume-backed-server-775511038',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-775511038',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJHOBrrs6TVudk7SfefpSSEcPt7HQlUtN6DNv8+fPk/DIRISiQFoniGVIEcnGGU1SfBAEX5XOn/G2LwqxOXKb4sePVF953dRaT2SKqC8aavY3f30YH4vNGxqZFU7uy0DqQ==',key_name='tempest-keypair-778397316',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='210837255c8148ec9b482ba3e2551362',ramdisk_id='',reservation_id='r-lmvee45i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1876154436',owner_user_name='tempest-TestVolumeBootPattern-1876154436-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T14:00:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c341be2816c43cfa9adb58ee84e942b',uuid=954db8d6-4806-43e6-8310-5d7f3437dc71,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f6944a05-0ad8-4f1a-b849-0dbb7732b739", "address": "fa:16:3e:b7:4f:45", "network": {"id": "a7f4226b-73fe-4265-ba2c-5d7dcdf154fd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1142462884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210837255c8148ec9b482ba3e2551362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6944a05-0a", "ovs_interfaceid": "f6944a05-0ad8-4f1a-b849-0dbb7732b739", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 14:00:48 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Converting VIF {"id": "f6944a05-0ad8-4f1a-b849-0dbb7732b739", "address": "fa:16:3e:b7:4f:45", "network": {"id": "a7f4226b-73fe-4265-ba2c-5d7dcdf154fd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1142462884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210837255c8148ec9b482ba3e2551362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6944a05-0a", "ovs_interfaceid": "f6944a05-0ad8-4f1a-b849-0dbb7732b739", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:00:48 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:4f:45,bridge_name='br-int',has_traffic_filtering=True,id=f6944a05-0ad8-4f1a-b849-0dbb7732b739,network=Network(a7f4226b-73fe-4265-ba2c-5d7dcdf154fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6944a05-0a') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:00:48 user nova-compute[72129]: DEBUG nova.objects.instance [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lazy-loading 'pci_devices' on Instance uuid 954db8d6-4806-43e6-8310-5d7f3437dc71 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:00:48 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] End _get_guest_xml xml=<domain type="kvm">
Aug 01 14:00:48 user nova-compute[72129]:   <uuid>954db8d6-4806-43e6-8310-5d7f3437dc71</uuid>
Aug 01 14:00:48 user nova-compute[72129]:   <name>instance-0000001a</name>
Aug 01 14:00:48 user nova-compute[72129]:   <memory>524288</memory>
Aug 01 14:00:48 user nova-compute[72129]:   <vcpu>1</vcpu>
Aug 01 14:00:48 user nova-compute[72129]:   <metadata>
Aug 01 14:00:48 user nova-compute[72129]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 14:00:48 user nova-compute[72129]:       <nova:package version="0.0.0"/>
Aug 01 14:00:48 user nova-compute[72129]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-775511038</nova:name>
Aug 01 14:00:48 user nova-compute[72129]:       <nova:creationTime>2023-08-01 14:00:46</nova:creationTime>
Aug 01 14:00:48 user nova-compute[72129]:       <nova:flavor name="m1.tiny">
Aug 01 14:00:48 user nova-compute[72129]:         <nova:memory>512</nova:memory>
Aug 01 14:00:48 user nova-compute[72129]:         <nova:disk>1</nova:disk>
Aug 01 14:00:48 user nova-compute[72129]:         <nova:swap>0</nova:swap>
Aug 01 14:00:48 user nova-compute[72129]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 14:00:48 user nova-compute[72129]:         <nova:vcpus>1</nova:vcpus>
Aug 01 14:00:48 user nova-compute[72129]:       </nova:flavor>
Aug 01 14:00:48 user nova-compute[72129]:       <nova:owner>
Aug 01 14:00:48 user nova-compute[72129]:         <nova:user uuid="7c341be2816c43cfa9adb58ee84e942b">tempest-TestVolumeBootPattern-1876154436-project-member</nova:user>
Aug 01 14:00:48 user nova-compute[72129]:         <nova:project uuid="210837255c8148ec9b482ba3e2551362">tempest-TestVolumeBootPattern-1876154436</nova:project>
Aug 01 14:00:48 user nova-compute[72129]:       </nova:owner>
Aug 01 14:00:48 user nova-compute[72129]:       <nova:ports>
Aug 01 14:00:48 user nova-compute[72129]:         <nova:port uuid="f6944a05-0ad8-4f1a-b849-0dbb7732b739">
Aug 01 14:00:48 user nova-compute[72129]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 01 14:00:48 user nova-compute[72129]:         </nova:port>
Aug 01 14:00:48 user nova-compute[72129]:       </nova:ports>
Aug 01 14:00:48 user nova-compute[72129]:     </nova:instance>
Aug 01 14:00:48 user nova-compute[72129]:   </metadata>
Aug 01 14:00:48 user nova-compute[72129]:   <sysinfo type="smbios">
Aug 01 14:00:48 user nova-compute[72129]:     <system>
Aug 01 14:00:48 user nova-compute[72129]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 14:00:48 user nova-compute[72129]:       <entry name="product">OpenStack Nova</entry>
Aug 01 14:00:48 user nova-compute[72129]:       <entry name="version">0.0.0</entry>
Aug 01 14:00:48 user nova-compute[72129]:       <entry name="serial">954db8d6-4806-43e6-8310-5d7f3437dc71</entry>
Aug 01 14:00:48 user nova-compute[72129]:       <entry name="uuid">954db8d6-4806-43e6-8310-5d7f3437dc71</entry>
Aug 01 14:00:48 user nova-compute[72129]:       <entry name="family">Virtual Machine</entry>
Aug 01 14:00:48 user nova-compute[72129]:     </system>
Aug 01 14:00:48 user nova-compute[72129]:   </sysinfo>
Aug 01 14:00:48 user nova-compute[72129]:   <os>
Aug 01 14:00:48 user nova-compute[72129]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 14:00:48 user nova-compute[72129]:     <boot dev="hd"/>
Aug 01 14:00:48 user nova-compute[72129]:     <smbios mode="sysinfo"/>
Aug 01 14:00:48 user nova-compute[72129]:   </os>
Aug 01 14:00:48 user nova-compute[72129]:   <features>
Aug 01 14:00:48 user nova-compute[72129]:     <acpi/>
Aug 01 14:00:48 user nova-compute[72129]:     <apic/>
Aug 01 14:00:48 user nova-compute[72129]:     <vmcoreinfo/>
Aug 01 14:00:48 user nova-compute[72129]:   </features>
Aug 01 14:00:48 user nova-compute[72129]:   <clock offset="utc">
Aug 01 14:00:48 user nova-compute[72129]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 14:00:48 user nova-compute[72129]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 14:00:48 user nova-compute[72129]:     <timer name="hpet" present="no"/>
Aug 01 14:00:48 user nova-compute[72129]:   </clock>
Aug 01 14:00:48 user nova-compute[72129]:   <cpu mode="custom" match="exact">
Aug 01 14:00:48 user nova-compute[72129]:     <model>Nehalem</model>
Aug 01 14:00:48 user nova-compute[72129]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 14:00:48 user nova-compute[72129]:   </cpu>
Aug 01 14:00:48 user nova-compute[72129]:   <devices>
Aug 01 14:00:48 user nova-compute[72129]:     <disk type="block" device="disk">
Aug 01 14:00:48 user nova-compute[72129]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:00:48 user nova-compute[72129]:       <source dev="/dev/sdd"/>
Aug 01 14:00:48 user nova-compute[72129]:       <target dev="vda" bus="virtio"/>
Aug 01 14:00:48 user nova-compute[72129]:       <serial>92501218-291d-42fd-bb6f-d9402326b043</serial>
Aug 01 14:00:48 user nova-compute[72129]:     </disk>
Aug 01 14:00:48 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 14:00:48 user nova-compute[72129]:       <mac address="fa:16:3e:b7:4f:45"/>
Aug 01 14:00:48 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:00:48 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 14:00:48 user nova-compute[72129]:       <target dev="tapf6944a05-0a"/>
Aug 01 14:00:48 user nova-compute[72129]:     </interface>
Aug 01 14:00:48 user nova-compute[72129]:     <serial type="pty">
Aug 01 14:00:48 user nova-compute[72129]:       <log file="/opt/stack/data/nova/instances/954db8d6-4806-43e6-8310-5d7f3437dc71/console.log" append="off"/>
Aug 01 14:00:48 user nova-compute[72129]:     </serial>
Aug 01 14:00:48 user nova-compute[72129]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 14:00:48 user nova-compute[72129]:     <video>
Aug 01 14:00:48 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:00:48 user nova-compute[72129]:     </video>
Aug 01 14:00:48 user nova-compute[72129]:     <rng model="virtio">
Aug 01 14:00:48 user nova-compute[72129]:       <backend model="random">/dev/urandom</backend>
Aug 01 14:00:48 user nova-compute[72129]:     </rng>
Aug 01 14:00:48 user nova-compute[72129]:     <controller type="usb" index="0" model="none"/>
Aug 01 14:00:48 user nova-compute[72129]:     <memballoon model="virtio">
Aug 01 14:00:48 user nova-compute[72129]:       <stats period="10"/>
Aug 01 14:00:48 user nova-compute[72129]:     </memballoon>
Aug 01 14:00:48 user nova-compute[72129]:   </devices>
Aug 01 14:00:48 user nova-compute[72129]: </domain>
Aug 01 14:00:48 user nova-compute[72129]:  {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 14:00:48 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:00:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-775511038',display_name='tempest-TestVolumeBootPattern-volume-backed-server-775511038',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-775511038',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJHOBrrs6TVudk7SfefpSSEcPt7HQlUtN6DNv8+fPk/DIRISiQFoniGVIEcnGGU1SfBAEX5XOn/G2LwqxOXKb4sePVF953dRaT2SKqC8aavY3f30YH4vNGxqZFU7uy0DqQ==',key_name='tempest-keypair-778397316',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='210837255c8148ec9b482ba3e2551362',ramdisk_id='',reservation_id='r-lmvee45i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1876154436',owner_user_name='tempest-TestVolumeBootPattern-1876154436-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T14:00:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c341be2816c43cfa9adb58ee84e942b',uuid=954db8d6-4806-43e6-8310-5d7f3437dc71,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f6944a05-0ad8-4f1a-b849-0dbb7732b739", "address": "fa:16:3e:b7:4f:45", "network": {"id": "a7f4226b-73fe-4265-ba2c-5d7dcdf154fd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1142462884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210837255c8148ec9b482ba3e2551362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6944a05-0a", "ovs_interfaceid": "f6944a05-0ad8-4f1a-b849-0dbb7732b739", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 14:00:48 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Converting VIF {"id": "f6944a05-0ad8-4f1a-b849-0dbb7732b739", "address": "fa:16:3e:b7:4f:45", "network": {"id": "a7f4226b-73fe-4265-ba2c-5d7dcdf154fd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1142462884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210837255c8148ec9b482ba3e2551362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6944a05-0a", "ovs_interfaceid": "f6944a05-0ad8-4f1a-b849-0dbb7732b739", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:00:48 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:4f:45,bridge_name='br-int',has_traffic_filtering=True,id=f6944a05-0ad8-4f1a-b849-0dbb7732b739,network=Network(a7f4226b-73fe-4265-ba2c-5d7dcdf154fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6944a05-0a') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:00:48 user nova-compute[72129]: DEBUG os_vif [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:4f:45,bridge_name='br-int',has_traffic_filtering=True,id=f6944a05-0ad8-4f1a-b849-0dbb7732b739,network=Network(a7f4226b-73fe-4265-ba2c-5d7dcdf154fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6944a05-0a') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 14:00:48 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:48 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:00:48 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 14:00:48 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:48 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf6944a05-0a, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:00:48 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf6944a05-0a, col_values=(('external_ids', {'iface-id': 'f6944a05-0ad8-4f1a-b849-0dbb7732b739', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:4f:45', 'vm-uuid': '954db8d6-4806-43e6-8310-5d7f3437dc71'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:00:48 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:48 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:00:48 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:48 user nova-compute[72129]: INFO os_vif [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:4f:45,bridge_name='br-int',has_traffic_filtering=True,id=f6944a05-0ad8-4f1a-b849-0dbb7732b739,network=Network(a7f4226b-73fe-4265-ba2c-5d7dcdf154fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6944a05-0a')
Aug 01 14:00:48 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:00:48 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] No VIF found with MAC fa:16:3e:b7:4f:45, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 14:00:49 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:49 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:49 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:49 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:49 user nova-compute[72129]: DEBUG nova.compute.manager [req-c54a9c00-9938-4e59-9dc1-b7b025a16571 req-c9af5deb-2fe9-4212-8d09-c28365f55c02 service nova] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] Received event network-vif-plugged-f6944a05-0ad8-4f1a-b849-0dbb7732b739 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:00:49 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-c54a9c00-9938-4e59-9dc1-b7b025a16571 req-c9af5deb-2fe9-4212-8d09-c28365f55c02 service nova] Acquiring lock "954db8d6-4806-43e6-8310-5d7f3437dc71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:00:49 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-c54a9c00-9938-4e59-9dc1-b7b025a16571 req-c9af5deb-2fe9-4212-8d09-c28365f55c02 service nova] Lock "954db8d6-4806-43e6-8310-5d7f3437dc71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:00:49 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-c54a9c00-9938-4e59-9dc1-b7b025a16571 req-c9af5deb-2fe9-4212-8d09-c28365f55c02 service nova] Lock "954db8d6-4806-43e6-8310-5d7f3437dc71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:00:49 user nova-compute[72129]: DEBUG nova.compute.manager [req-c54a9c00-9938-4e59-9dc1-b7b025a16571 req-c9af5deb-2fe9-4212-8d09-c28365f55c02 service nova] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] No waiting events found dispatching network-vif-plugged-f6944a05-0ad8-4f1a-b849-0dbb7732b739 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:00:49 user nova-compute[72129]: WARNING nova.compute.manager [req-c54a9c00-9938-4e59-9dc1-b7b025a16571 req-c9af5deb-2fe9-4212-8d09-c28365f55c02 service nova] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] Received unexpected event network-vif-plugged-f6944a05-0ad8-4f1a-b849-0dbb7732b739 for instance with vm_state building and task_state spawning.
Aug 01 14:00:50 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:00:50 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:00:50 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:00:50 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:00:50 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Auditing locally available compute resources for user (node: user) {{(pid=72129) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 14:00:50 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 14:00:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:00:50 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:50 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:00:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:00:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:00:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53b76ca4-30f0-4fd4-9928-714c7073a490/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:00:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53b76ca4-30f0-4fd4-9928-714c7073a490/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:00:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53b76ca4-30f0-4fd4-9928-714c7073a490/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:00:50 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53b76ca4-30f0-4fd4-9928-714c7073a490/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:00:50 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 14:00:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:00:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:00:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:00:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:00:51 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 14:00:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cf5877-55dd-44ce-9b58-b662afe8e62e/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:00:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cf5877-55dd-44ce-9b58-b662afe8e62e/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:00:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cf5877-55dd-44ce-9b58-b662afe8e62e/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:00:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cf5877-55dd-44ce-9b58-b662afe8e62e/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:00:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3891b9d3-832d-4ef7-8ebb-970ddd0a387a/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:00:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3891b9d3-832d-4ef7-8ebb-970ddd0a387a/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:00:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3891b9d3-832d-4ef7-8ebb-970ddd0a387a/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:00:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3891b9d3-832d-4ef7-8ebb-970ddd0a387a/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:00:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea050cd6-60e9-41fd-a35c-05fe63d60e57/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:00:51 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898451.7897491, 954db8d6-4806-43e6-8310-5d7f3437dc71 => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:00:51 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] VM Resumed (Lifecycle Event)
Aug 01 14:00:51 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] Instance event wait completed in 0 seconds for  {{(pid=72129) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 14:00:51 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] Guest created on hypervisor {{(pid=72129) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 14:00:51 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] Instance spawned successfully.
Aug 01 14:00:51 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 14:00:51 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:00:51 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:00:51 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] Found default for hw_cdrom_bus of ide {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:00:51 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] Found default for hw_disk_bus of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:00:51 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] Found default for hw_input_bus of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:00:51 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] Found default for hw_pointer_model of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:00:51 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] Found default for hw_video_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:00:51 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] Found default for hw_vif_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:00:51 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 14:00:51 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898451.7913678, 954db8d6-4806-43e6-8310-5d7f3437dc71 => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:00:51 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] VM Started (Lifecycle Event)
Aug 01 14:00:51 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:00:51 user nova-compute[72129]: DEBUG nova.compute.manager [req-8b10eb55-7f16-474b-ad8f-accdc241334a req-a061dddb-67fd-4d02-afab-b062ef867770 service nova] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] Received event network-vif-plugged-f6944a05-0ad8-4f1a-b849-0dbb7732b739 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:00:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-8b10eb55-7f16-474b-ad8f-accdc241334a req-a061dddb-67fd-4d02-afab-b062ef867770 service nova] Acquiring lock "954db8d6-4806-43e6-8310-5d7f3437dc71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:00:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-8b10eb55-7f16-474b-ad8f-accdc241334a req-a061dddb-67fd-4d02-afab-b062ef867770 service nova] Lock "954db8d6-4806-43e6-8310-5d7f3437dc71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:00:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-8b10eb55-7f16-474b-ad8f-accdc241334a req-a061dddb-67fd-4d02-afab-b062ef867770 service nova] Lock "954db8d6-4806-43e6-8310-5d7f3437dc71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:00:51 user nova-compute[72129]: DEBUG nova.compute.manager [req-8b10eb55-7f16-474b-ad8f-accdc241334a req-a061dddb-67fd-4d02-afab-b062ef867770 service nova] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] No waiting events found dispatching network-vif-plugged-f6944a05-0ad8-4f1a-b849-0dbb7732b739 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:00:51 user nova-compute[72129]: WARNING nova.compute.manager [req-8b10eb55-7f16-474b-ad8f-accdc241334a req-a061dddb-67fd-4d02-afab-b062ef867770 service nova] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] Received unexpected event network-vif-plugged-f6944a05-0ad8-4f1a-b849-0dbb7732b739 for instance with vm_state building and task_state spawning.
Aug 01 14:00:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea050cd6-60e9-41fd-a35c-05fe63d60e57/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:00:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea050cd6-60e9-41fd-a35c-05fe63d60e57/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:00:51 user nova-compute[72129]: INFO nova.compute.manager [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] Took 5.12 seconds to spawn the instance on the hypervisor.
Aug 01 14:00:51 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:00:51 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:00:52 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 14:00:52 user nova-compute[72129]: INFO nova.compute.manager [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] Took 14.64 seconds to build instance.
Aug 01 14:00:52 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea050cd6-60e9-41fd-a35c-05fe63d60e57/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:00:52 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9c9db6fd-aea0-46eb-baa1-e15a6d1028bc tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "954db8d6-4806-43e6-8310-5d7f3437dc71" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.735s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:00:52 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:00:52 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:00:52 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Hypervisor/Node resource view: name=user free_ram=7775MB free_disk=25.31005096435547GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72129) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 14:00:52 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:00:52 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:00:52 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 97a5dccf-b499-443a-b332-cfa293a16047 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:00:52 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:00:52 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance d031973f-8f48-43b3-a338-040950103e4c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:00:52 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 53b76ca4-30f0-4fd4-9928-714c7073a490 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:00:52 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 3891b9d3-832d-4ef7-8ebb-970ddd0a387a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:00:52 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance ea050cd6-60e9-41fd-a35c-05fe63d60e57 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:00:52 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance e2cf5877-55dd-44ce-9b58-b662afe8e62e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:00:52 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 954db8d6-4806-43e6-8310-5d7f3437dc71 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:00:52 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 14:00:52 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 14:00:52 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:00:52 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:00:53 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Compute_service record updated for user:user {{(pid=72129) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 14:00:53 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.415s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:00:53 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:00:53 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:57 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:00:57 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Cleaning up deleted instances {{(pid=72129) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 14:00:57 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] There are 0 instances to clean {{(pid=72129) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 14:00:58 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:00:59 user nova-compute[72129]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690898444.1004677, 133076de-14b5-4ceb-aa41-d9acef8506c5 => Stopped> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:00:59 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] VM Stopped (Lifecycle Event)
Aug 01 14:00:59 user nova-compute[72129]: DEBUG nova.compute.manager [None req-a37ccda4-76ab-4774-8782-fd45bd9edd37 None None] [instance: 133076de-14b5-4ceb-aa41-d9acef8506c5] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:01:03 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:01:03 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:01:03 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72129) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 14:01:03 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:01:03 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:01:03 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:01:08 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:01:10 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:01:13 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:01:15 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:01:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:01:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:01:22 user nova-compute[72129]: DEBUG nova.objects.instance [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lazy-loading 'flavor' on Instance uuid 53b76ca4-30f0-4fd4-9928-714c7073a490 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:01:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Acquiring lock "refresh_cache-53b76ca4-30f0-4fd4-9928-714c7073a490" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:01:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Acquired lock "refresh_cache-53b76ca4-30f0-4fd4-9928-714c7073a490" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:01:22 user nova-compute[72129]: DEBUG nova.network.neutron [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 14:01:22 user nova-compute[72129]: DEBUG nova.objects.instance [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lazy-loading 'info_cache' on Instance uuid 53b76ca4-30f0-4fd4-9928-714c7073a490 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:01:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:01:23 user nova-compute[72129]: DEBUG nova.network.neutron [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Updating instance_info_cache with network_info: [{"id": "b7271bae-a440-4d06-87d0-cece38122deb", "address": "fa:16:3e:6b:eb:be", "network": {"id": "b0eb2211-5a6a-4b7e-a119-92a0f0deb947", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1159988670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6120989bad342a4a6fa2a8975f5932f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7271bae-a4", "ovs_interfaceid": "b7271bae-a440-4d06-87d0-cece38122deb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:01:23 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Releasing lock "refresh_cache-53b76ca4-30f0-4fd4-9928-714c7073a490" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:01:23 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Instance destroyed successfully.
Aug 01 14:01:23 user nova-compute[72129]: DEBUG nova.objects.instance [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lazy-loading 'resources' on Instance uuid 53b76ca4-30f0-4fd4-9928-714c7073a490 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:01:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:57:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-850515568',display_name='tempest-AttachVolumeTestJSON-server-850515568',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-850515568',id=20,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMYJypdJqmxJKXNm404Q0Cl0WuuC4kkdldjTIBUyN/EtYQvDQbUuKBkqlwMSJuSlO9CdP4jtMdwoobiqIkSyVtZDYG9OaB7GLwJQRR3hShHH6YafWHv11ydfwe0fTFZOZw==',key_name='tempest-keypair-1711923464',keypairs=<?>,launch_index=0,launched_at=2023-08-01T13:57:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a6120989bad342a4a6fa2a8975f5932f',ramdisk_id='',reservation_id='r-84r01nk5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-55653475',owner_user_name='tempest-AttachVolumeTestJSON-55653475-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T13:59:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13a3c19bbcbb4833abbb2997944a6564',uuid=53b76ca4-30f0-4fd4-9928-714c7073a490,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "b7271bae-a440-4d06-87d0-cece38122deb", "address": "fa:16:3e:6b:eb:be", "network": {"id": "b0eb2211-5a6a-4b7e-a119-92a0f0deb947", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1159988670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6120989bad342a4a6fa2a8975f5932f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7271bae-a4", "ovs_interfaceid": "b7271bae-a440-4d06-87d0-cece38122deb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 14:01:23 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Converting VIF {"id": "b7271bae-a440-4d06-87d0-cece38122deb", "address": "fa:16:3e:6b:eb:be", "network": {"id": "b0eb2211-5a6a-4b7e-a119-92a0f0deb947", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1159988670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6120989bad342a4a6fa2a8975f5932f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7271bae-a4", "ovs_interfaceid": "b7271bae-a440-4d06-87d0-cece38122deb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:01:23 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:eb:be,bridge_name='br-int',has_traffic_filtering=True,id=b7271bae-a440-4d06-87d0-cece38122deb,network=Network(b0eb2211-5a6a-4b7e-a119-92a0f0deb947),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7271bae-a4') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:01:23 user nova-compute[72129]: DEBUG os_vif [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:eb:be,bridge_name='br-int',has_traffic_filtering=True,id=b7271bae-a440-4d06-87d0-cece38122deb,network=Network(b0eb2211-5a6a-4b7e-a119-92a0f0deb947),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7271bae-a4') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 14:01:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:01:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb7271bae-a4, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:01:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:01:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:01:23 user nova-compute[72129]: INFO os_vif [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:eb:be,bridge_name='br-int',has_traffic_filtering=True,id=b7271bae-a440-4d06-87d0-cece38122deb,network=Network(b0eb2211-5a6a-4b7e-a119-92a0f0deb947),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7271bae-a4')
Aug 01 14:01:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] calling os-brick to detach iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 14:01:23 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, {'target_iqns': ['iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ruipGBEm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:01:23 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:01:23 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:01:23 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:01:23 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4', 0)] {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 14:01:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:01:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:01:23 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4b8cb8-1fa9-4f94-8f02-88d907ef43ea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:01:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:01:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:01:23 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7dbadf-735b-4a61-8761-7b88a5868d16]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:01:23 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:01:23 user nova-compute[72129]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 (non-flash)
Aug 01 14:01:23 user nova-compute[72129]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)
Aug 01 14:01:23 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:01:23 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:01:23 user nova-compute[72129]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 (non-flash)
Aug 01 14:01:23 user nova-compute[72129]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)
Aug 01 14:01:23 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:01:23 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f282812ae60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4'): ({'sdb'}, set())}) {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 14:01:23 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Removing single pathed devices sdb {{(pid=72129) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 14:01:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39e1fe9-ab2a-48d7-a835-f5787d3e0ee4]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d833e495-98b6-4295-b8da-5e9257e419c2]: (4, ('ok\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Flushing IO for device /dev/sdb {{(pid=72129) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[788dab11-f245-43f4-ab4f-531daa8b687f]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72129) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0d0038-0f3f-4a81-8a4b-817fb19533ee]: (4, ('1', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] SCSI volumes sdb have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4')] {{(pid=72129) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8723d16-ee7a-440b-b8d1-c773a831cf05]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 -p 172.16.0.220:3260 --logout {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa024f0-090d-4770-96bc-abf467a008b5]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4, portal: 172.16.0.220,3260]
Aug 01 14:01:24 user nova-compute[72129]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4, portal: 172.16.0.220,3260] successful.
Aug 01 14:01:24 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 -p 172.16.0.220:3260 --op delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d0c2b15-430b-451b-9ffd-97f41b55b3e9]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.272s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] <== disconnect_volume: return (273ms) None {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Disconnected iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Start _get_guest_xml network_info=[{"id": "b7271bae-a440-4d06-87d0-cece38122deb", "address": "fa:16:3e:6b:eb:be", "network": {"id": "b0eb2211-5a6a-4b7e-a119-92a0f0deb947", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1159988670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6120989bad342a4a6fa2a8975f5932f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7271bae-a4", "ovs_interfaceid": "b7271bae-a440-4d06-87d0-cece38122deb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'image_id': 'b6472c34-1b0f-4034-ba3a-7e8eb5103715'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'attachment_id': '56f43f6a-0d10-4831-8c20-8a4a6883ca19', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ruipGBEm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '53b76ca4-30f0-4fd4-9928-714c7073a490', 'attached_at': '', 'detached_at': '', 'volume_id': '00288fea-1b8e-4835-8b92-614365fa2be4', 'serial': '00288fea-1b8e-4835-8b92-614365fa2be4'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG nova.objects.instance [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lazy-loading 'numa_topology' on Instance uuid 53b76ca4-30f0-4fd4-9928-714c7073a490 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:01:24 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:01:24 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:01:24 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] CPU controller missing on host. {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] CPU controller found on host. {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72129) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T13:45:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Flavor limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Image limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Flavor pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Image pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Got 1 possible topologies {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG nova.objects.instance [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lazy-loading 'vcpu_model' on Instance uuid 53b76ca4-30f0-4fd4-9928-714c7073a490 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Calling os-brick to attach iSCSI Volume {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ruipGBEm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:01:24 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:01:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:01:24 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:01:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:01:24 user nova-compute[72129]: INFO os_brick.initiator.connectors.iscsi [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 14:01:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 -p 172.16.0.220:3260 {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c3c20c-8229-48cc-adc7-4c0b0b015ca1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 14:01:24 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 -p 172.16.0.220:3260 --interface default --op new {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17b0bcc-7b1a-4819-8dc9-905888efc714]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4] added\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4] added
Aug 01 14:01:24 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f8f120-71f5-4604-b94a-5e935b8fb7a3]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a11a6ab-46ac-4e28-adc8-45f4186349cf]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ruipGBEm {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ruipGBEm" returned: 0 in 0.023s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb656e2-9747-479f-91c1-56881b42f997]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ruipGBEm'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d10ab338-2b84-4fab-a85e-a1cbd525af0c]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a04717-264c-4f92-bf59-b339f9459b76]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:01:24 user nova-compute[72129]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)
Aug 01 14:01:24 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:01:24 user nova-compute[72129]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)
Aug 01 14:01:24 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 -p 172.16.0.220:3260 --login {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ea83e2-5609-41d6-8470-4f39b8a04390]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4, portal: 172.16.0.220,3260]
Aug 01 14:01:24 user nova-compute[72129]: Login to [iface: default, target: iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4, portal: 172.16.0.220,3260] successful.
Aug 01 14:01:24 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[64fbff6c-4696-4a23-9f40-417f979439ab]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[98156bb8-2407-41c5-af17-2f610ce651b9]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:01:24 user nova-compute[72129]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)
Aug 01 14:01:24 user nova-compute[72129]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 (non-flash)
Aug 01 14:01:24 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:01:24 user nova-compute[72129]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)
Aug 01 14:01:24 user nova-compute[72129]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 (non-flash)
Aug 01 14:01:24 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Connected to 172.16.0.220:3260 {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] HCTL ('33', '-', '-', 0) found on session 31 with lun 0 {{(pid=72129) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72129) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1cea5cc-57bc-404c-9119-cb045f4c4350]: (4, ('- - 0', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:01:24 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Searching for a device in session 31 and hctl ['33', '*', '*', 0] yield: None {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 14:01:25 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Searching for a device in session 31 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 14:01:25 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ruipGBEm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 14:01:25 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:01:25 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '26430346237396439', 'path': '/dev/sdb'} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:01:25 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430346237396439', 'path': '/dev/sdb'} {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 14:01:25 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:57:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-850515568',display_name='tempest-AttachVolumeTestJSON-server-850515568',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-850515568',id=20,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMYJypdJqmxJKXNm404Q0Cl0WuuC4kkdldjTIBUyN/EtYQvDQbUuKBkqlwMSJuSlO9CdP4jtMdwoobiqIkSyVtZDYG9OaB7GLwJQRR3hShHH6YafWHv11ydfwe0fTFZOZw==',key_name='tempest-keypair-1711923464',keypairs=<?>,launch_index=0,launched_at=2023-08-01T13:57:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a6120989bad342a4a6fa2a8975f5932f',ramdisk_id='',reservation_id='r-84r01nk5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-55653475',owner_user_name='tempest-AttachVolumeTestJSON-55653475-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T13:59:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13a3c19bbcbb4833abbb2997944a6564',uuid=53b76ca4-30f0-4fd4-9928-714c7073a490,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "b7271bae-a440-4d06-87d0-cece38122deb", "address": "fa:16:3e:6b:eb:be", "network": {"id": "b0eb2211-5a6a-4b7e-a119-92a0f0deb947", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1159988670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6120989bad342a4a6fa2a8975f5932f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7271bae-a4", "ovs_interfaceid": "b7271bae-a440-4d06-87d0-cece38122deb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 14:01:25 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Converting VIF {"id": "b7271bae-a440-4d06-87d0-cece38122deb", "address": "fa:16:3e:6b:eb:be", "network": {"id": "b0eb2211-5a6a-4b7e-a119-92a0f0deb947", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1159988670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6120989bad342a4a6fa2a8975f5932f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7271bae-a4", "ovs_interfaceid": "b7271bae-a440-4d06-87d0-cece38122deb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:01:25 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:eb:be,bridge_name='br-int',has_traffic_filtering=True,id=b7271bae-a440-4d06-87d0-cece38122deb,network=Network(b0eb2211-5a6a-4b7e-a119-92a0f0deb947),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7271bae-a4') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:01:25 user nova-compute[72129]: DEBUG nova.objects.instance [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lazy-loading 'pci_devices' on Instance uuid 53b76ca4-30f0-4fd4-9928-714c7073a490 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:01:25 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] End _get_guest_xml xml=<domain type="kvm">
Aug 01 14:01:25 user nova-compute[72129]:   <uuid>53b76ca4-30f0-4fd4-9928-714c7073a490</uuid>
Aug 01 14:01:25 user nova-compute[72129]:   <name>instance-00000014</name>
Aug 01 14:01:25 user nova-compute[72129]:   <memory>524288</memory>
Aug 01 14:01:25 user nova-compute[72129]:   <vcpu>1</vcpu>
Aug 01 14:01:25 user nova-compute[72129]:   <metadata>
Aug 01 14:01:25 user nova-compute[72129]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 14:01:25 user nova-compute[72129]:       <nova:package version="0.0.0"/>
Aug 01 14:01:25 user nova-compute[72129]:       <nova:name>tempest-AttachVolumeTestJSON-server-850515568</nova:name>
Aug 01 14:01:25 user nova-compute[72129]:       <nova:creationTime>2023-08-01 14:01:24</nova:creationTime>
Aug 01 14:01:25 user nova-compute[72129]:       <nova:flavor name="m1.tiny">
Aug 01 14:01:25 user nova-compute[72129]:         <nova:memory>512</nova:memory>
Aug 01 14:01:25 user nova-compute[72129]:         <nova:disk>1</nova:disk>
Aug 01 14:01:25 user nova-compute[72129]:         <nova:swap>0</nova:swap>
Aug 01 14:01:25 user nova-compute[72129]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 14:01:25 user nova-compute[72129]:         <nova:vcpus>1</nova:vcpus>
Aug 01 14:01:25 user nova-compute[72129]:       </nova:flavor>
Aug 01 14:01:25 user nova-compute[72129]:       <nova:owner>
Aug 01 14:01:25 user nova-compute[72129]:         <nova:user uuid="13a3c19bbcbb4833abbb2997944a6564">tempest-AttachVolumeTestJSON-55653475-project-member</nova:user>
Aug 01 14:01:25 user nova-compute[72129]:         <nova:project uuid="a6120989bad342a4a6fa2a8975f5932f">tempest-AttachVolumeTestJSON-55653475</nova:project>
Aug 01 14:01:25 user nova-compute[72129]:       </nova:owner>
Aug 01 14:01:25 user nova-compute[72129]:       <nova:root type="image" uuid="b6472c34-1b0f-4034-ba3a-7e8eb5103715"/>
Aug 01 14:01:25 user nova-compute[72129]:       <nova:ports>
Aug 01 14:01:25 user nova-compute[72129]:         <nova:port uuid="b7271bae-a440-4d06-87d0-cece38122deb">
Aug 01 14:01:25 user nova-compute[72129]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 01 14:01:25 user nova-compute[72129]:         </nova:port>
Aug 01 14:01:25 user nova-compute[72129]:       </nova:ports>
Aug 01 14:01:25 user nova-compute[72129]:     </nova:instance>
Aug 01 14:01:25 user nova-compute[72129]:   </metadata>
Aug 01 14:01:25 user nova-compute[72129]:   <sysinfo type="smbios">
Aug 01 14:01:25 user nova-compute[72129]:     <system>
Aug 01 14:01:25 user nova-compute[72129]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 14:01:25 user nova-compute[72129]:       <entry name="product">OpenStack Nova</entry>
Aug 01 14:01:25 user nova-compute[72129]:       <entry name="version">0.0.0</entry>
Aug 01 14:01:25 user nova-compute[72129]:       <entry name="serial">53b76ca4-30f0-4fd4-9928-714c7073a490</entry>
Aug 01 14:01:25 user nova-compute[72129]:       <entry name="uuid">53b76ca4-30f0-4fd4-9928-714c7073a490</entry>
Aug 01 14:01:25 user nova-compute[72129]:       <entry name="family">Virtual Machine</entry>
Aug 01 14:01:25 user nova-compute[72129]:     </system>
Aug 01 14:01:25 user nova-compute[72129]:   </sysinfo>
Aug 01 14:01:25 user nova-compute[72129]:   <os>
Aug 01 14:01:25 user nova-compute[72129]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 14:01:25 user nova-compute[72129]:     <boot dev="hd"/>
Aug 01 14:01:25 user nova-compute[72129]:     <smbios mode="sysinfo"/>
Aug 01 14:01:25 user nova-compute[72129]:   </os>
Aug 01 14:01:25 user nova-compute[72129]:   <features>
Aug 01 14:01:25 user nova-compute[72129]:     <acpi/>
Aug 01 14:01:25 user nova-compute[72129]:     <apic/>
Aug 01 14:01:25 user nova-compute[72129]:     <vmcoreinfo/>
Aug 01 14:01:25 user nova-compute[72129]:   </features>
Aug 01 14:01:25 user nova-compute[72129]:   <clock offset="utc">
Aug 01 14:01:25 user nova-compute[72129]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 14:01:25 user nova-compute[72129]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 14:01:25 user nova-compute[72129]:     <timer name="hpet" present="no"/>
Aug 01 14:01:25 user nova-compute[72129]:   </clock>
Aug 01 14:01:25 user nova-compute[72129]:   <cpu mode="custom" match="exact">
Aug 01 14:01:25 user nova-compute[72129]:     <model>Nehalem</model>
Aug 01 14:01:25 user nova-compute[72129]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 14:01:25 user nova-compute[72129]:   </cpu>
Aug 01 14:01:25 user nova-compute[72129]:   <devices>
Aug 01 14:01:25 user nova-compute[72129]:     <disk type="file" device="disk">
Aug 01 14:01:25 user nova-compute[72129]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 14:01:25 user nova-compute[72129]:       <source file="/opt/stack/data/nova/instances/53b76ca4-30f0-4fd4-9928-714c7073a490/disk"/>
Aug 01 14:01:25 user nova-compute[72129]:       <target dev="vda" bus="virtio"/>
Aug 01 14:01:25 user nova-compute[72129]:     </disk>
Aug 01 14:01:25 user nova-compute[72129]:     <disk type="block" device="disk">
Aug 01 14:01:25 user nova-compute[72129]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:01:25 user nova-compute[72129]:       <source dev="/dev/sdb"/>
Aug 01 14:01:25 user nova-compute[72129]:       <target dev="vdb" bus="virtio"/>
Aug 01 14:01:25 user nova-compute[72129]:       <serial>00288fea-1b8e-4835-8b92-614365fa2be4</serial>
Aug 01 14:01:25 user nova-compute[72129]:     </disk>
Aug 01 14:01:25 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 14:01:25 user nova-compute[72129]:       <mac address="fa:16:3e:6b:eb:be"/>
Aug 01 14:01:25 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:01:25 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 14:01:25 user nova-compute[72129]:       <target dev="tapb7271bae-a4"/>
Aug 01 14:01:25 user nova-compute[72129]:     </interface>
Aug 01 14:01:25 user nova-compute[72129]:     <serial type="pty">
Aug 01 14:01:25 user nova-compute[72129]:       <log file="/opt/stack/data/nova/instances/53b76ca4-30f0-4fd4-9928-714c7073a490/console.log" append="off"/>
Aug 01 14:01:25 user nova-compute[72129]:     </serial>
Aug 01 14:01:25 user nova-compute[72129]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 14:01:25 user nova-compute[72129]:     <video>
Aug 01 14:01:25 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:01:25 user nova-compute[72129]:     </video>
Aug 01 14:01:25 user nova-compute[72129]:     <rng model="virtio">
Aug 01 14:01:25 user nova-compute[72129]:       <backend model="random">/dev/urandom</backend>
Aug 01 14:01:25 user nova-compute[72129]:     </rng>
Aug 01 14:01:25 user nova-compute[72129]:     <controller type="usb" index="0" model="none"/>
Aug 01 14:01:25 user nova-compute[72129]:     <memballoon model="virtio">
Aug 01 14:01:25 user nova-compute[72129]:       <stats period="10"/>
Aug 01 14:01:25 user nova-compute[72129]:     </memballoon>
Aug 01 14:01:25 user nova-compute[72129]:   </devices>
Aug 01 14:01:25 user nova-compute[72129]: </domain>
Aug 01 14:01:25 user nova-compute[72129]:  {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 14:01:25 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53b76ca4-30f0-4fd4-9928-714c7073a490/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:01:25 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53b76ca4-30f0-4fd4-9928-714c7073a490/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:01:25 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53b76ca4-30f0-4fd4-9928-714c7073a490/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:01:25 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53b76ca4-30f0-4fd4-9928-714c7073a490/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:01:25 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 14:01:25 user nova-compute[72129]: DEBUG nova.objects.instance [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lazy-loading 'trusted_certs' on Instance uuid 53b76ca4-30f0-4fd4-9928-714c7073a490 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:01:25 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:01:26 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.136s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:01:26 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Checking if we can resize image /opt/stack/data/nova/instances/53b76ca4-30f0-4fd4-9928-714c7073a490/disk. size=1073741824 {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 14:01:26 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53b76ca4-30f0-4fd4-9928-714c7073a490/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:01:26 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53b76ca4-30f0-4fd4-9928-714c7073a490/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:01:26 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Cannot resize image /opt/stack/data/nova/instances/53b76ca4-30f0-4fd4-9928-714c7073a490/disk to a smaller size. {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 14:01:26 user nova-compute[72129]: DEBUG nova.objects.instance [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lazy-loading 'migration_context' on Instance uuid 53b76ca4-30f0-4fd4-9928-714c7073a490 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:01:26 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:57:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-850515568',display_name='tempest-AttachVolumeTestJSON-server-850515568',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-850515568',id=20,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMYJypdJqmxJKXNm404Q0Cl0WuuC4kkdldjTIBUyN/EtYQvDQbUuKBkqlwMSJuSlO9CdP4jtMdwoobiqIkSyVtZDYG9OaB7GLwJQRR3hShHH6YafWHv11ydfwe0fTFZOZw==',key_name='tempest-keypair-1711923464',keypairs=<?>,launch_index=0,launched_at=2023-08-01T13:57:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='a6120989bad342a4a6fa2a8975f5932f',ramdisk_id='',reservation_id='r-84r01nk5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-55653475',owner_user_name='tempest-AttachVolumeTestJSON-55653475-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T13:59:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13a3c19bbcbb4833abbb2997944a6564',uuid=53b76ca4-30f0-4fd4-9928-714c7073a490,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "b7271bae-a440-4d06-87d0-cece38122deb", "address": "fa:16:3e:6b:eb:be", "network": {"id": "b0eb2211-5a6a-4b7e-a119-92a0f0deb947", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1159988670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6120989bad342a4a6fa2a8975f5932f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7271bae-a4", "ovs_interfaceid": "b7271bae-a440-4d06-87d0-cece38122deb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 14:01:26 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Converting VIF {"id": "b7271bae-a440-4d06-87d0-cece38122deb", "address": "fa:16:3e:6b:eb:be", "network": {"id": "b0eb2211-5a6a-4b7e-a119-92a0f0deb947", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1159988670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6120989bad342a4a6fa2a8975f5932f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7271bae-a4", "ovs_interfaceid": "b7271bae-a440-4d06-87d0-cece38122deb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:01:26 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:eb:be,bridge_name='br-int',has_traffic_filtering=True,id=b7271bae-a440-4d06-87d0-cece38122deb,network=Network(b0eb2211-5a6a-4b7e-a119-92a0f0deb947),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7271bae-a4') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:01:26 user nova-compute[72129]: DEBUG os_vif [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:eb:be,bridge_name='br-int',has_traffic_filtering=True,id=b7271bae-a440-4d06-87d0-cece38122deb,network=Network(b0eb2211-5a6a-4b7e-a119-92a0f0deb947),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7271bae-a4') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 14:01:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:01:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:01:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 14:01:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:01:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb7271bae-a4, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:01:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb7271bae-a4, col_values=(('external_ids', {'iface-id': 'b7271bae-a440-4d06-87d0-cece38122deb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:eb:be', 'vm-uuid': '53b76ca4-30f0-4fd4-9928-714c7073a490'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:01:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:01:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:01:26 user nova-compute[72129]: INFO os_vif [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:eb:be,bridge_name='br-int',has_traffic_filtering=True,id=b7271bae-a440-4d06-87d0-cece38122deb,network=Network(b0eb2211-5a6a-4b7e-a119-92a0f0deb947),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7271bae-a4')
Aug 01 14:01:27 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:01:27 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:01:27 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:01:27 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:01:27 user nova-compute[72129]: DEBUG nova.compute.manager [req-c3c9cc29-71eb-4e7f-acdc-1d3cef5ed3b6 req-239c683f-55fd-4bff-af14-2ff3ee2da1f5 service nova] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Received event network-vif-plugged-b7271bae-a440-4d06-87d0-cece38122deb {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:01:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-c3c9cc29-71eb-4e7f-acdc-1d3cef5ed3b6 req-239c683f-55fd-4bff-af14-2ff3ee2da1f5 service nova] Acquiring lock "53b76ca4-30f0-4fd4-9928-714c7073a490-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:01:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-c3c9cc29-71eb-4e7f-acdc-1d3cef5ed3b6 req-239c683f-55fd-4bff-af14-2ff3ee2da1f5 service nova] Lock "53b76ca4-30f0-4fd4-9928-714c7073a490-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:01:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-c3c9cc29-71eb-4e7f-acdc-1d3cef5ed3b6 req-239c683f-55fd-4bff-af14-2ff3ee2da1f5 service nova] Lock "53b76ca4-30f0-4fd4-9928-714c7073a490-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:01:27 user nova-compute[72129]: DEBUG nova.compute.manager [req-c3c9cc29-71eb-4e7f-acdc-1d3cef5ed3b6 req-239c683f-55fd-4bff-af14-2ff3ee2da1f5 service nova] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] No waiting events found dispatching network-vif-plugged-b7271bae-a440-4d06-87d0-cece38122deb {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:01:27 user nova-compute[72129]: WARNING nova.compute.manager [req-c3c9cc29-71eb-4e7f-acdc-1d3cef5ed3b6 req-239c683f-55fd-4bff-af14-2ff3ee2da1f5 service nova] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Received unexpected event network-vif-plugged-b7271bae-a440-4d06-87d0-cece38122deb for instance with vm_state stopped and task_state powering-on.
Aug 01 14:01:28 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:01:28 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:01:28 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:01:28 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:01:29 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898489.785381, 53b76ca4-30f0-4fd4-9928-714c7073a490 => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:01:29 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] VM Resumed (Lifecycle Event)
Aug 01 14:01:29 user nova-compute[72129]: DEBUG nova.compute.manager [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Instance event wait completed in 0 seconds for  {{(pid=72129) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 14:01:29 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Instance rebooted successfully.
Aug 01 14:01:29 user nova-compute[72129]: DEBUG nova.compute.manager [None req-160a3f46-da87-4ced-8d70-5ad9e72f0942 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:01:29 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:01:29 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:01:29 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 01 14:01:29 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898489.786808, 53b76ca4-30f0-4fd4-9928-714c7073a490 => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:01:29 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] VM Started (Lifecycle Event)
Aug 01 14:01:29 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:01:29 user nova-compute[72129]: DEBUG nova.compute.manager [req-5a500bd0-8c6a-4b8c-93cc-a1b77a54fa3f req-2e2cc3ae-a2d7-469e-b1f1-e1f34a4ff8f5 service nova] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Received event network-vif-plugged-b7271bae-a440-4d06-87d0-cece38122deb {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:01:29 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-5a500bd0-8c6a-4b8c-93cc-a1b77a54fa3f req-2e2cc3ae-a2d7-469e-b1f1-e1f34a4ff8f5 service nova] Acquiring lock "53b76ca4-30f0-4fd4-9928-714c7073a490-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:01:29 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-5a500bd0-8c6a-4b8c-93cc-a1b77a54fa3f req-2e2cc3ae-a2d7-469e-b1f1-e1f34a4ff8f5 service nova] Lock "53b76ca4-30f0-4fd4-9928-714c7073a490-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:01:29 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-5a500bd0-8c6a-4b8c-93cc-a1b77a54fa3f req-2e2cc3ae-a2d7-469e-b1f1-e1f34a4ff8f5 service nova] Lock "53b76ca4-30f0-4fd4-9928-714c7073a490-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:01:29 user nova-compute[72129]: DEBUG nova.compute.manager [req-5a500bd0-8c6a-4b8c-93cc-a1b77a54fa3f req-2e2cc3ae-a2d7-469e-b1f1-e1f34a4ff8f5 service nova] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] No waiting events found dispatching network-vif-plugged-b7271bae-a440-4d06-87d0-cece38122deb {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:01:29 user nova-compute[72129]: WARNING nova.compute.manager [req-5a500bd0-8c6a-4b8c-93cc-a1b77a54fa3f req-2e2cc3ae-a2d7-469e-b1f1-e1f34a4ff8f5 service nova] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Received unexpected event network-vif-plugged-b7271bae-a440-4d06-87d0-cece38122deb for instance with vm_state stopped and task_state powering-on.
Aug 01 14:01:29 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:01:30 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:01:31 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:01:31 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Acquiring lock "8e5e94dd-b575-48f1-a617-1bd917567220" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:01:31 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Lock "8e5e94dd-b575-48f1-a617-1bd917567220" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:01:31 user nova-compute[72129]: INFO nova.compute.manager [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Unshelving
Aug 01 14:01:31 user nova-compute[72129]: INFO nova.virt.block_device [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Booting with volume 9e4d6571-fba3-42fe-9abd-cddd72d2c46d at /dev/vda
Aug 01 14:01:31 user nova-compute[72129]: DEBUG os_brick.utils [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:01:31 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:01:31 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:01:31 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b8b818-a3df-4c05-8268-e6fdc1d01d32]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f9b449c2cd3d\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:01:31 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:01:31 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:01:31 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b00152-3aa0-4460-9a24-1bc247ecf88d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:01:31 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:01:31 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:01:31 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[6481fc05-90a9-4e55-bee8-3c33b09e0261]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:01:31 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa84f49d-965f-48cb-82ab-b556d6b70669]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:01:31 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Running cmd (subprocess): nvme version {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:01:31 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] 'nvme version' failed. Not Retrying. {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 14:01:31 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] nvme not present on system {{(pid=72129) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 14:01:31 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:01:31 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 14:01:31 user nova-compute[72129]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 14:01:31 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea3783c-6142-4a4d-b8f1-2fba2f30ebfe]: (4, '') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:01:31 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72129) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 14:01:31 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 14:01:31 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] LIGHTOS: no hostnqn found. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 14:01:31 user nova-compute[72129]: DEBUG os_brick.utils [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f9b449c2cd3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:01:31 user nova-compute[72129]: DEBUG nova.virt.block_device [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Updating existing volume attachment record: b1bea8ea-61eb-4223-b4c8-0d431684720e {{(pid=72129) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 14:01:36 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:01:36 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:01:37 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Acquiring lock "85062e35-e302-46f7-8d66-24cf9e7199f7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:01:37 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lock "85062e35-e302-46f7-8d66-24cf9e7199f7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:01:37 user nova-compute[72129]: DEBUG nova.compute.manager [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Starting instance... {{(pid=72129) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 14:01:37 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:01:37 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:01:37 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72129) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 14:01:37 user nova-compute[72129]: INFO nova.compute.claims [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Claim successful on node user
Aug 01 14:01:37 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:01:37 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:01:37 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.485s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:01:37 user nova-compute[72129]: DEBUG nova.compute.manager [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Start building networks asynchronously for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 14:01:37 user nova-compute[72129]: DEBUG nova.compute.manager [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Allocating IP information in the background. {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 14:01:37 user nova-compute[72129]: DEBUG nova.network.neutron [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] allocate_for_instance() {{(pid=72129) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 14:01:37 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 14:01:38 user nova-compute[72129]: DEBUG nova.compute.manager [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Start building block device mappings for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 14:01:38 user nova-compute[72129]: DEBUG nova.policy [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8acae20eb69f40c08bbe0799513b95e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43253b37caa747b090b14c707abf96cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72129) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 14:01:38 user nova-compute[72129]: DEBUG nova.compute.manager [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Start spawning the instance on the hypervisor. {{(pid=72129) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 14:01:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Creating instance directory {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 14:01:38 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Creating image(s)
Aug 01 14:01:38 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Acquiring lock "/opt/stack/data/nova/instances/85062e35-e302-46f7-8d66-24cf9e7199f7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:01:38 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lock "/opt/stack/data/nova/instances/85062e35-e302-46f7-8d66-24cf9e7199f7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:01:38 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lock "/opt/stack/data/nova/instances/85062e35-e302-46f7-8d66-24cf9e7199f7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:01:38 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Acquiring lock "e136e20e57a97cc62c58928a0768dc9d375f01f6" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:01:38 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lock "e136e20e57a97cc62c58928a0768dc9d375f01f6" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:01:38 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e136e20e57a97cc62c58928a0768dc9d375f01f6.part --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:01:38 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e136e20e57a97cc62c58928a0768dc9d375f01f6.part --force-share --output=json" returned: 0 in 0.180s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:01:38 user nova-compute[72129]: DEBUG nova.virt.images [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] 0ffa7332-fe08-47e4-9715-9a8035cfdf9d was qcow2, converting to raw {{(pid=72129) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 14:01:38 user nova-compute[72129]: DEBUG nova.privsep.utils [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72129) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 14:01:38 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e136e20e57a97cc62c58928a0768dc9d375f01f6.part /opt/stack/data/nova/instances/_base/e136e20e57a97cc62c58928a0768dc9d375f01f6.converted {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:01:38 user nova-compute[72129]: DEBUG nova.network.neutron [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Successfully created port: b5a06a08-bb00-4551-afd4-09ad16fe0837 {{(pid=72129) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 14:01:38 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e136e20e57a97cc62c58928a0768dc9d375f01f6.part /opt/stack/data/nova/instances/_base/e136e20e57a97cc62c58928a0768dc9d375f01f6.converted" returned: 0 in 0.190s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:01:38 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e136e20e57a97cc62c58928a0768dc9d375f01f6.converted --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:01:39 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e136e20e57a97cc62c58928a0768dc9d375f01f6.converted --force-share --output=json" returned: 0 in 0.143s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:01:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lock "e136e20e57a97cc62c58928a0768dc9d375f01f6" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.934s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:01:39 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e136e20e57a97cc62c58928a0768dc9d375f01f6 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:01:39 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e136e20e57a97cc62c58928a0768dc9d375f01f6 --force-share --output=json" returned: 0 in 0.135s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:01:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Acquiring lock "e136e20e57a97cc62c58928a0768dc9d375f01f6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:01:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lock "e136e20e57a97cc62c58928a0768dc9d375f01f6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:01:39 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e136e20e57a97cc62c58928a0768dc9d375f01f6 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:01:39 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e136e20e57a97cc62c58928a0768dc9d375f01f6 --force-share --output=json" returned: 0 in 0.152s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:01:39 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e136e20e57a97cc62c58928a0768dc9d375f01f6,backing_fmt=raw /opt/stack/data/nova/instances/85062e35-e302-46f7-8d66-24cf9e7199f7/disk 1073741824 {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:01:39 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e136e20e57a97cc62c58928a0768dc9d375f01f6,backing_fmt=raw /opt/stack/data/nova/instances/85062e35-e302-46f7-8d66-24cf9e7199f7/disk 1073741824" returned: 0 in 0.061s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:01:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lock "e136e20e57a97cc62c58928a0768dc9d375f01f6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.221s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:01:39 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e136e20e57a97cc62c58928a0768dc9d375f01f6 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:01:39 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e136e20e57a97cc62c58928a0768dc9d375f01f6 --force-share --output=json" returned: 0 in 0.141s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:01:39 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Checking if we can resize image /opt/stack/data/nova/instances/85062e35-e302-46f7-8d66-24cf9e7199f7/disk. size=1073741824 {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 14:01:39 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85062e35-e302-46f7-8d66-24cf9e7199f7/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:01:39 user nova-compute[72129]: DEBUG nova.network.neutron [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Successfully updated port: b5a06a08-bb00-4551-afd4-09ad16fe0837 {{(pid=72129) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 14:01:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Acquiring lock "refresh_cache-85062e35-e302-46f7-8d66-24cf9e7199f7" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:01:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Acquired lock "refresh_cache-85062e35-e302-46f7-8d66-24cf9e7199f7" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:01:39 user nova-compute[72129]: DEBUG nova.network.neutron [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 14:01:39 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85062e35-e302-46f7-8d66-24cf9e7199f7/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:01:39 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Cannot resize image /opt/stack/data/nova/instances/85062e35-e302-46f7-8d66-24cf9e7199f7/disk to a smaller size. {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 14:01:39 user nova-compute[72129]: DEBUG nova.objects.instance [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lazy-loading 'migration_context' on Instance uuid 85062e35-e302-46f7-8d66-24cf9e7199f7 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:01:39 user nova-compute[72129]: DEBUG nova.compute.manager [req-e1c0e0eb-26d9-464a-b6e4-4b2a96aae211 req-605fa0ed-12d3-4f32-a46a-6cc1caff43e0 service nova] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Received event network-changed-b5a06a08-bb00-4551-afd4-09ad16fe0837 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:01:39 user nova-compute[72129]: DEBUG nova.compute.manager [req-e1c0e0eb-26d9-464a-b6e4-4b2a96aae211 req-605fa0ed-12d3-4f32-a46a-6cc1caff43e0 service nova] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Refreshing instance network info cache due to event network-changed-b5a06a08-bb00-4551-afd4-09ad16fe0837. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 14:01:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-e1c0e0eb-26d9-464a-b6e4-4b2a96aae211 req-605fa0ed-12d3-4f32-a46a-6cc1caff43e0 service nova] Acquiring lock "refresh_cache-85062e35-e302-46f7-8d66-24cf9e7199f7" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:01:39 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Created local disks {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 14:01:39 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Ensure instance console log exists: /opt/stack/data/nova/instances/85062e35-e302-46f7-8d66-24cf9e7199f7/console.log {{(pid=72129) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 14:01:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:01:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:01:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:01:39 user nova-compute[72129]: DEBUG nova.network.neutron [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Instance cache missing network info. {{(pid=72129) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 14:01:40 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:01:40 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:01:40 user nova-compute[72129]: DEBUG nova.objects.instance [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Lazy-loading 'pci_requests' on Instance uuid 8e5e94dd-b575-48f1-a617-1bd917567220 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:01:40 user nova-compute[72129]: DEBUG nova.objects.instance [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Lazy-loading 'numa_topology' on Instance uuid 8e5e94dd-b575-48f1-a617-1bd917567220 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:01:40 user nova-compute[72129]: DEBUG nova.network.neutron [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Updating instance_info_cache with network_info: [{"id": "b5a06a08-bb00-4551-afd4-09ad16fe0837", "address": "fa:16:3e:9d:bc:ca", "network": {"id": "a7ec6cc0-140b-446b-ae97-d4aafbc42693", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-397303278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43253b37caa747b090b14c707abf96cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5a06a08-bb", "ovs_interfaceid": "b5a06a08-bb00-4551-afd4-09ad16fe0837", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:01:40 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72129) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 14:01:40 user nova-compute[72129]: INFO nova.compute.claims [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Claim successful on node user
Aug 01 14:01:40 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Releasing lock "refresh_cache-85062e35-e302-46f7-8d66-24cf9e7199f7" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:01:40 user nova-compute[72129]: DEBUG nova.compute.manager [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Instance network_info: |[{"id": "b5a06a08-bb00-4551-afd4-09ad16fe0837", "address": "fa:16:3e:9d:bc:ca", "network": {"id": "a7ec6cc0-140b-446b-ae97-d4aafbc42693", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-397303278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43253b37caa747b090b14c707abf96cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5a06a08-bb", "ovs_interfaceid": "b5a06a08-bb00-4551-afd4-09ad16fe0837", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 14:01:40 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-e1c0e0eb-26d9-464a-b6e4-4b2a96aae211 req-605fa0ed-12d3-4f32-a46a-6cc1caff43e0 service nova] Acquired lock "refresh_cache-85062e35-e302-46f7-8d66-24cf9e7199f7" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:01:40 user nova-compute[72129]: DEBUG nova.network.neutron [req-e1c0e0eb-26d9-464a-b6e4-4b2a96aae211 req-605fa0ed-12d3-4f32-a46a-6cc1caff43e0 service nova] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Refreshing network info cache for port b5a06a08-bb00-4551-afd4-09ad16fe0837 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 14:01:40 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Start _get_guest_xml network_info=[{"id": "b5a06a08-bb00-4551-afd4-09ad16fe0837", "address": "fa:16:3e:9d:bc:ca", "network": {"id": "a7ec6cc0-140b-446b-ae97-d4aafbc42693", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-397303278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43253b37caa747b090b14c707abf96cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5a06a08-bb", "ovs_interfaceid": "b5a06a08-bb00-4551-afd4-09ad16fe0837", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T14:01:34Z,direct_url=<?>,disk_format='qcow2',id=0ffa7332-fe08-47e4-9715-9a8035cfdf9d,min_disk=0,min_ram=0,name='tempest-scenario-img--659313940',owner='43253b37caa747b090b14c707abf96cf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T14:01:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'image_id': '0ffa7332-fe08-47e4-9715-9a8035cfdf9d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 14:01:40 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:01:40 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:01:40 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 14:01:40 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] CPU controller missing on host. {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 14:01:40 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 14:01:40 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] CPU controller found on host. {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 14:01:40 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72129) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 14:01:40 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T13:45:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T14:01:34Z,direct_url=<?>,disk_format='qcow2',id=0ffa7332-fe08-47e4-9715-9a8035cfdf9d,min_disk=0,min_ram=0,name='tempest-scenario-img--659313940',owner='43253b37caa747b090b14c707abf96cf',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T14:01:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 14:01:40 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Flavor limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 14:01:40 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Image limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 14:01:40 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Flavor pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 14:01:40 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Image pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 14:01:40 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 14:01:40 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 14:01:40 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 14:01:40 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Got 1 possible topologies {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 14:01:40 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 14:01:40 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 14:01:40 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:01:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1815756546',display_name='tempest-TestMinimumBasicScenario-server-1815756546',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1815756546',id=27,image_ref='0ffa7332-fe08-47e4-9715-9a8035cfdf9d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPLimLyDA0xdO+mEA2DIQ2NJZ1dYA9kFGcV/3bF0IImHB8xaljK7Jn2z2l098SgZ7DcycdVj15PtLrYlN6satpgWup62s4m5PkQI7r4Vb5rFD2JUNyQuhZ7GwdzOMfUOw==',key_name='tempest-TestMinimumBasicScenario-366479569',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='43253b37caa747b090b14c707abf96cf',ramdisk_id='',reservation_id='r-bafc57et',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ffa7332-fe08-47e4-9715-9a8035cfdf9d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-833844079',owner_user_name='tempest-TestMinimumBasicScenario-833844079-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T14:01:38Z,user_data=None,user_id='8acae20eb69f40c08bbe0799513b95e1',uuid=85062e35-e302-46f7-8d66-24cf9e7199f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b5a06a08-bb00-4551-afd4-09ad16fe0837", "address": "fa:16:3e:9d:bc:ca", "network": {"id": "a7ec6cc0-140b-446b-ae97-d4aafbc42693", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-397303278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43253b37caa747b090b14c707abf96cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5a06a08-bb", "ovs_interfaceid": "b5a06a08-bb00-4551-afd4-09ad16fe0837", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 14:01:40 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Converting VIF {"id": "b5a06a08-bb00-4551-afd4-09ad16fe0837", "address": "fa:16:3e:9d:bc:ca", "network": {"id": "a7ec6cc0-140b-446b-ae97-d4aafbc42693", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-397303278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43253b37caa747b090b14c707abf96cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5a06a08-bb", "ovs_interfaceid": "b5a06a08-bb00-4551-afd4-09ad16fe0837", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:01:40 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:bc:ca,bridge_name='br-int',has_traffic_filtering=True,id=b5a06a08-bb00-4551-afd4-09ad16fe0837,network=Network(a7ec6cc0-140b-446b-ae97-d4aafbc42693),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5a06a08-bb') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:01:40 user nova-compute[72129]: DEBUG nova.objects.instance [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lazy-loading 'pci_devices' on Instance uuid 85062e35-e302-46f7-8d66-24cf9e7199f7 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:01:40 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] End _get_guest_xml xml=<domain type="kvm">
Aug 01 14:01:40 user nova-compute[72129]:   <uuid>85062e35-e302-46f7-8d66-24cf9e7199f7</uuid>
Aug 01 14:01:40 user nova-compute[72129]:   <name>instance-0000001b</name>
Aug 01 14:01:40 user nova-compute[72129]:   <memory>524288</memory>
Aug 01 14:01:40 user nova-compute[72129]:   <vcpu>1</vcpu>
Aug 01 14:01:40 user nova-compute[72129]:   <metadata>
Aug 01 14:01:40 user nova-compute[72129]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 14:01:40 user nova-compute[72129]:       <nova:package version="0.0.0"/>
Aug 01 14:01:40 user nova-compute[72129]:       <nova:name>tempest-TestMinimumBasicScenario-server-1815756546</nova:name>
Aug 01 14:01:40 user nova-compute[72129]:       <nova:creationTime>2023-08-01 14:01:40</nova:creationTime>
Aug 01 14:01:40 user nova-compute[72129]:       <nova:flavor name="m1.tiny">
Aug 01 14:01:40 user nova-compute[72129]:         <nova:memory>512</nova:memory>
Aug 01 14:01:40 user nova-compute[72129]:         <nova:disk>1</nova:disk>
Aug 01 14:01:40 user nova-compute[72129]:         <nova:swap>0</nova:swap>
Aug 01 14:01:40 user nova-compute[72129]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 14:01:40 user nova-compute[72129]:         <nova:vcpus>1</nova:vcpus>
Aug 01 14:01:40 user nova-compute[72129]:       </nova:flavor>
Aug 01 14:01:40 user nova-compute[72129]:       <nova:owner>
Aug 01 14:01:40 user nova-compute[72129]:         <nova:user uuid="8acae20eb69f40c08bbe0799513b95e1">tempest-TestMinimumBasicScenario-833844079-project-member</nova:user>
Aug 01 14:01:40 user nova-compute[72129]:         <nova:project uuid="43253b37caa747b090b14c707abf96cf">tempest-TestMinimumBasicScenario-833844079</nova:project>
Aug 01 14:01:40 user nova-compute[72129]:       </nova:owner>
Aug 01 14:01:40 user nova-compute[72129]:       <nova:root type="image" uuid="0ffa7332-fe08-47e4-9715-9a8035cfdf9d"/>
Aug 01 14:01:40 user nova-compute[72129]:       <nova:ports>
Aug 01 14:01:40 user nova-compute[72129]:         <nova:port uuid="b5a06a08-bb00-4551-afd4-09ad16fe0837">
Aug 01 14:01:40 user nova-compute[72129]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 01 14:01:40 user nova-compute[72129]:         </nova:port>
Aug 01 14:01:40 user nova-compute[72129]:       </nova:ports>
Aug 01 14:01:40 user nova-compute[72129]:     </nova:instance>
Aug 01 14:01:40 user nova-compute[72129]:   </metadata>
Aug 01 14:01:40 user nova-compute[72129]:   <sysinfo type="smbios">
Aug 01 14:01:40 user nova-compute[72129]:     <system>
Aug 01 14:01:40 user nova-compute[72129]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 14:01:40 user nova-compute[72129]:       <entry name="product">OpenStack Nova</entry>
Aug 01 14:01:40 user nova-compute[72129]:       <entry name="version">0.0.0</entry>
Aug 01 14:01:40 user nova-compute[72129]:       <entry name="serial">85062e35-e302-46f7-8d66-24cf9e7199f7</entry>
Aug 01 14:01:40 user nova-compute[72129]:       <entry name="uuid">85062e35-e302-46f7-8d66-24cf9e7199f7</entry>
Aug 01 14:01:40 user nova-compute[72129]:       <entry name="family">Virtual Machine</entry>
Aug 01 14:01:40 user nova-compute[72129]:     </system>
Aug 01 14:01:40 user nova-compute[72129]:   </sysinfo>
Aug 01 14:01:40 user nova-compute[72129]:   <os>
Aug 01 14:01:40 user nova-compute[72129]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 14:01:40 user nova-compute[72129]:     <boot dev="hd"/>
Aug 01 14:01:40 user nova-compute[72129]:     <smbios mode="sysinfo"/>
Aug 01 14:01:40 user nova-compute[72129]:   </os>
Aug 01 14:01:40 user nova-compute[72129]:   <features>
Aug 01 14:01:40 user nova-compute[72129]:     <acpi/>
Aug 01 14:01:40 user nova-compute[72129]:     <apic/>
Aug 01 14:01:40 user nova-compute[72129]:     <vmcoreinfo/>
Aug 01 14:01:40 user nova-compute[72129]:   </features>
Aug 01 14:01:40 user nova-compute[72129]:   <clock offset="utc">
Aug 01 14:01:40 user nova-compute[72129]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 14:01:40 user nova-compute[72129]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 14:01:40 user nova-compute[72129]:     <timer name="hpet" present="no"/>
Aug 01 14:01:40 user nova-compute[72129]:   </clock>
Aug 01 14:01:40 user nova-compute[72129]:   <cpu mode="custom" match="exact">
Aug 01 14:01:40 user nova-compute[72129]:     <model>Nehalem</model>
Aug 01 14:01:40 user nova-compute[72129]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 14:01:40 user nova-compute[72129]:   </cpu>
Aug 01 14:01:40 user nova-compute[72129]:   <devices>
Aug 01 14:01:40 user nova-compute[72129]:     <disk type="file" device="disk">
Aug 01 14:01:40 user nova-compute[72129]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 14:01:40 user nova-compute[72129]:       <source file="/opt/stack/data/nova/instances/85062e35-e302-46f7-8d66-24cf9e7199f7/disk"/>
Aug 01 14:01:40 user nova-compute[72129]:       <target dev="vda" bus="virtio"/>
Aug 01 14:01:40 user nova-compute[72129]:     </disk>
Aug 01 14:01:40 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 14:01:40 user nova-compute[72129]:       <mac address="fa:16:3e:9d:bc:ca"/>
Aug 01 14:01:40 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:01:40 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 14:01:40 user nova-compute[72129]:       <target dev="tapb5a06a08-bb"/>
Aug 01 14:01:40 user nova-compute[72129]:     </interface>
Aug 01 14:01:40 user nova-compute[72129]:     <serial type="pty">
Aug 01 14:01:40 user nova-compute[72129]:       <log file="/opt/stack/data/nova/instances/85062e35-e302-46f7-8d66-24cf9e7199f7/console.log" append="off"/>
Aug 01 14:01:40 user nova-compute[72129]:     </serial>
Aug 01 14:01:40 user nova-compute[72129]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 14:01:40 user nova-compute[72129]:     <video>
Aug 01 14:01:40 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:01:40 user nova-compute[72129]:     </video>
Aug 01 14:01:40 user nova-compute[72129]:     <rng model="virtio">
Aug 01 14:01:40 user nova-compute[72129]:       <backend model="random">/dev/urandom</backend>
Aug 01 14:01:40 user nova-compute[72129]:     </rng>
Aug 01 14:01:40 user nova-compute[72129]:     <controller type="usb" index="0" model="none"/>
Aug 01 14:01:40 user nova-compute[72129]:     <memballoon model="virtio">
Aug 01 14:01:40 user nova-compute[72129]:       <stats period="10"/>
Aug 01 14:01:40 user nova-compute[72129]:     </memballoon>
Aug 01 14:01:40 user nova-compute[72129]:   </devices>
Aug 01 14:01:40 user nova-compute[72129]: </domain>
Aug 01 14:01:40 user nova-compute[72129]:  {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 14:01:40 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:01:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1815756546',display_name='tempest-TestMinimumBasicScenario-server-1815756546',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1815756546',id=27,image_ref='0ffa7332-fe08-47e4-9715-9a8035cfdf9d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPLimLyDA0xdO+mEA2DIQ2NJZ1dYA9kFGcV/3bF0IImHB8xaljK7Jn2z2l098SgZ7DcycdVj15PtLrYlN6satpgWup62s4m5PkQI7r4Vb5rFD2JUNyQuhZ7GwdzOMfUOw==',key_name='tempest-TestMinimumBasicScenario-366479569',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='43253b37caa747b090b14c707abf96cf',ramdisk_id='',reservation_id='r-bafc57et',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ffa7332-fe08-47e4-9715-9a8035cfdf9d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-833844079',owner_user_name='tempest-TestMinimumBasicScenario-833844079-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T14:01:38Z,user_data=None,user_id='8acae20eb69f40c08bbe0799513b95e1',uuid=85062e35-e302-46f7-8d66-24cf9e7199f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b5a06a08-bb00-4551-afd4-09ad16fe0837", "address": "fa:16:3e:9d:bc:ca", "network": {"id": "a7ec6cc0-140b-446b-ae97-d4aafbc42693", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-397303278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43253b37caa747b090b14c707abf96cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5a06a08-bb", "ovs_interfaceid": "b5a06a08-bb00-4551-afd4-09ad16fe0837", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 14:01:40 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Converting VIF {"id": "b5a06a08-bb00-4551-afd4-09ad16fe0837", "address": "fa:16:3e:9d:bc:ca", "network": {"id": "a7ec6cc0-140b-446b-ae97-d4aafbc42693", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-397303278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43253b37caa747b090b14c707abf96cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5a06a08-bb", "ovs_interfaceid": "b5a06a08-bb00-4551-afd4-09ad16fe0837", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:01:40 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:bc:ca,bridge_name='br-int',has_traffic_filtering=True,id=b5a06a08-bb00-4551-afd4-09ad16fe0837,network=Network(a7ec6cc0-140b-446b-ae97-d4aafbc42693),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5a06a08-bb') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:01:40 user nova-compute[72129]: DEBUG os_vif [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:bc:ca,bridge_name='br-int',has_traffic_filtering=True,id=b5a06a08-bb00-4551-afd4-09ad16fe0837,network=Network(a7ec6cc0-140b-446b-ae97-d4aafbc42693),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5a06a08-bb') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 14:01:40 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:01:40 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:01:40 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 14:01:40 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:01:40 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb5a06a08-bb, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:01:40 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb5a06a08-bb, col_values=(('external_ids', {'iface-id': 'b5a06a08-bb00-4551-afd4-09ad16fe0837', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:bc:ca', 'vm-uuid': '85062e35-e302-46f7-8d66-24cf9e7199f7'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:01:40 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:01:40 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:01:40 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:01:40 user nova-compute[72129]: INFO os_vif [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:bc:ca,bridge_name='br-int',has_traffic_filtering=True,id=b5a06a08-bb00-4551-afd4-09ad16fe0837,network=Network(a7ec6cc0-140b-446b-ae97-d4aafbc42693),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5a06a08-bb')
Aug 01 14:01:40 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:01:40 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] No VIF found with MAC fa:16:3e:9d:bc:ca, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 14:01:40 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:01:40 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:01:40 user nova-compute[72129]: DEBUG nova.network.neutron [req-e1c0e0eb-26d9-464a-b6e4-4b2a96aae211 req-605fa0ed-12d3-4f32-a46a-6cc1caff43e0 service nova] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Updated VIF entry in instance network info cache for port b5a06a08-bb00-4551-afd4-09ad16fe0837. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 14:01:40 user nova-compute[72129]: DEBUG nova.network.neutron [req-e1c0e0eb-26d9-464a-b6e4-4b2a96aae211 req-605fa0ed-12d3-4f32-a46a-6cc1caff43e0 service nova] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Updating instance_info_cache with network_info: [{"id": "b5a06a08-bb00-4551-afd4-09ad16fe0837", "address": "fa:16:3e:9d:bc:ca", "network": {"id": "a7ec6cc0-140b-446b-ae97-d4aafbc42693", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-397303278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43253b37caa747b090b14c707abf96cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5a06a08-bb", "ovs_interfaceid": "b5a06a08-bb00-4551-afd4-09ad16fe0837", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:01:40 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.504s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:01:40 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-e1c0e0eb-26d9-464a-b6e4-4b2a96aae211 req-605fa0ed-12d3-4f32-a46a-6cc1caff43e0 service nova] Releasing lock "refresh_cache-85062e35-e302-46f7-8d66-24cf9e7199f7" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:01:40 user nova-compute[72129]: INFO nova.network.neutron [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Updating port 04bc1afa-2e8a-4dd9-961f-e695f43e3061 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 01 14:01:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Acquiring lock "refresh_cache-8e5e94dd-b575-48f1-a617-1bd917567220" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:01:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Acquired lock "refresh_cache-8e5e94dd-b575-48f1-a617-1bd917567220" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:01:41 user nova-compute[72129]: DEBUG nova.network.neutron [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 14:01:41 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:01:41 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:01:41 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:01:41 user nova-compute[72129]: DEBUG nova.compute.manager [req-6d0fd3bc-b907-4473-b8c9-ffae2aa8c857 req-dfca4021-b728-4623-9dc9-4a00b47ddb3f service nova] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Received event network-changed-04bc1afa-2e8a-4dd9-961f-e695f43e3061 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:01:41 user nova-compute[72129]: DEBUG nova.compute.manager [req-6d0fd3bc-b907-4473-b8c9-ffae2aa8c857 req-dfca4021-b728-4623-9dc9-4a00b47ddb3f service nova] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Refreshing instance network info cache due to event network-changed-04bc1afa-2e8a-4dd9-961f-e695f43e3061. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 14:01:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-6d0fd3bc-b907-4473-b8c9-ffae2aa8c857 req-dfca4021-b728-4623-9dc9-4a00b47ddb3f service nova] Acquiring lock "refresh_cache-8e5e94dd-b575-48f1-a617-1bd917567220" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:01:41 user nova-compute[72129]: DEBUG nova.network.neutron [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Updating instance_info_cache with network_info: [{"id": "04bc1afa-2e8a-4dd9-961f-e695f43e3061", "address": "fa:16:3e:69:a4:f0", "network": {"id": "567d2893-d3e8-41e1-a0fe-4414df317d0c", "bridge": "br-int", "label": "tempest-TestShelveInstance-887577340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e0c65958662420fa6d8d73c5e9fdc25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04bc1afa-2e", "ovs_interfaceid": "04bc1afa-2e8a-4dd9-961f-e695f43e3061", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:01:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Releasing lock "refresh_cache-8e5e94dd-b575-48f1-a617-1bd917567220" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:01:41 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Creating instance directory {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 14:01:41 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Creating image(s)
Aug 01 14:01:41 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Did not create local disks {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 14:01:41 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Ensure instance console log exists: /opt/stack/data/nova/instances/8e5e94dd-b575-48f1-a617-1bd917567220/console.log {{(pid=72129) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 14:01:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:01:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:01:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:01:41 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Start _get_guest_xml network_info=[{"id": "04bc1afa-2e8a-4dd9-961f-e695f43e3061", "address": "fa:16:3e:69:a4:f0", "network": {"id": "567d2893-d3e8-41e1-a0fe-4414df317d0c", "bridge": "br-int", "label": "tempest-TestShelveInstance-887577340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e0c65958662420fa6d8d73c5e9fdc25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04bc1afa-2e", "ovs_interfaceid": "04bc1afa-2e8a-4dd9-961f-e695f43e3061", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': 'b1bea8ea-61eb-4223-b4c8-0d431684720e', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'anVDsYRG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8e5e94dd-b575-48f1-a617-1bd917567220', 'attached_at': '', 'detached_at': '', 'volume_id': '9e4d6571-fba3-42fe-9abd-cddd72d2c46d', 'serial': '9e4d6571-fba3-42fe-9abd-cddd72d2c46d'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 14:01:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-6d0fd3bc-b907-4473-b8c9-ffae2aa8c857 req-dfca4021-b728-4623-9dc9-4a00b47ddb3f service nova] Acquired lock "refresh_cache-8e5e94dd-b575-48f1-a617-1bd917567220" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:01:41 user nova-compute[72129]: DEBUG nova.network.neutron [req-6d0fd3bc-b907-4473-b8c9-ffae2aa8c857 req-dfca4021-b728-4623-9dc9-4a00b47ddb3f service nova] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Refreshing network info cache for port 04bc1afa-2e8a-4dd9-961f-e695f43e3061 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 14:01:41 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:01:41 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:01:41 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 14:01:41 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] CPU controller missing on host. {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 14:01:41 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 14:01:41 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] CPU controller found on host. {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 14:01:41 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72129) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 14:01:41 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T13:45:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 14:01:41 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Flavor limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 14:01:41 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Image limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 14:01:41 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Flavor pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 14:01:41 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Image pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 14:01:41 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 14:01:41 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 14:01:41 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 14:01:41 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Got 1 possible topologies {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 14:01:41 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 14:01:41 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 14:01:41 user nova-compute[72129]: DEBUG nova.objects.instance [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8e5e94dd-b575-48f1-a617-1bd917567220 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:01:41 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Calling os-brick to attach iSCSI Volume {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 14:01:41 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'anVDsYRG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:01:41 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:01:41 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:01:41 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:01:41 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:01:41 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:01:41 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:01:41 user nova-compute[72129]: INFO os_brick.initiator.connectors.iscsi [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 14:01:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d -p 172.16.0.220:3260 {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:01:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:01:42 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d12c6fe-ab87-4215-9c71-014bf418a51b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:01:42 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 14:01:42 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:01:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d -p 172.16.0.220:3260 --interface default --op new {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:01:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:01:42 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1b8887-c2c6-4ff8-aaf4-28472bf87219]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d] added\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:01:42 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d] added
Aug 01 14:01:42 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:01:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:01:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:01:42 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6adc02-abbc-4bd7-bb8d-526a85a9bd5a]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:01:42 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:01:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:01:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:01:42 user nova-compute[72129]: DEBUG nova.compute.manager [req-55264ce5-3e16-4240-b6f7-1ac666fa4fa9 req-9d92536b-d434-4d37-8dab-fe7ac557b660 service nova] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Received event network-vif-plugged-b5a06a08-bb00-4551-afd4-09ad16fe0837 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:01:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-55264ce5-3e16-4240-b6f7-1ac666fa4fa9 req-9d92536b-d434-4d37-8dab-fe7ac557b660 service nova] Acquiring lock "85062e35-e302-46f7-8d66-24cf9e7199f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:01:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-55264ce5-3e16-4240-b6f7-1ac666fa4fa9 req-9d92536b-d434-4d37-8dab-fe7ac557b660 service nova] Lock "85062e35-e302-46f7-8d66-24cf9e7199f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:01:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-55264ce5-3e16-4240-b6f7-1ac666fa4fa9 req-9d92536b-d434-4d37-8dab-fe7ac557b660 service nova] Lock "85062e35-e302-46f7-8d66-24cf9e7199f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:01:42 user nova-compute[72129]: DEBUG nova.compute.manager [req-55264ce5-3e16-4240-b6f7-1ac666fa4fa9 req-9d92536b-d434-4d37-8dab-fe7ac557b660 service nova] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] No waiting events found dispatching network-vif-plugged-b5a06a08-bb00-4551-afd4-09ad16fe0837 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:01:42 user nova-compute[72129]: WARNING nova.compute.manager [req-55264ce5-3e16-4240-b6f7-1ac666fa4fa9 req-9d92536b-d434-4d37-8dab-fe7ac557b660 service nova] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Received unexpected event network-vif-plugged-b5a06a08-bb00-4551-afd4-09ad16fe0837 for instance with vm_state building and task_state spawning.
Aug 01 14:01:42 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6afe740-6bba-43bd-b494-d6bf8e76c853]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:01:42 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:01:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v anVDsYRG {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:01:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v anVDsYRG" returned: 0 in 0.023s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:01:42 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d086e4a4-55e1-488d-a03a-b5ad4d455464]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:01:42 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'anVDsYRG'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:01:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:01:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:01:42 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a22168-5ca9-422f-830c-25de61f11ef2]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:01:42 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:01:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:01:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:01:42 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[3322e8c4-5dbc-45d7-86a3-0acc231f1610]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:01:42 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:01:42 user nova-compute[72129]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)
Aug 01 14:01:42 user nova-compute[72129]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 (non-flash)
Aug 01 14:01:42 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:01:42 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:01:42 user nova-compute[72129]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)
Aug 01 14:01:42 user nova-compute[72129]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 (non-flash)
Aug 01 14:01:42 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:01:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d -p 172.16.0.220:3260 --login {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:01:42 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:01:42 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:01:42 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:01:42 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:01:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:01:42 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[038d74cf-3fca-486a-94d2-9346179424ea]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:01:42 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d, portal: 172.16.0.220,3260]
Aug 01 14:01:42 user nova-compute[72129]: Login to [iface: default, target: iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d, portal: 172.16.0.220,3260] successful.
Aug 01 14:01:42 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:01:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:01:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:01:42 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde6b6cd-0ad9-4beb-a22d-d49ed756c519]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:01:42 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:01:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:01:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:01:42 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a2de4c-6087-4290-aacf-3dccc816e53a]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:01:42 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:01:42 user nova-compute[72129]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)
Aug 01 14:01:42 user nova-compute[72129]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 (non-flash)
Aug 01 14:01:42 user nova-compute[72129]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d (non-flash)
Aug 01 14:01:42 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:01:42 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:01:42 user nova-compute[72129]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)
Aug 01 14:01:42 user nova-compute[72129]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 (non-flash)
Aug 01 14:01:42 user nova-compute[72129]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d (non-flash)
Aug 01 14:01:42 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:01:42 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.383s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:01:42 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Connected to 172.16.0.220:3260 {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 14:01:42 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] HCTL ('36', '-', '-', 0) found on session 32 with lun 0 {{(pid=72129) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 14:01:42 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72129) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 14:01:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:01:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:01:42 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[86da8286-1f6b-49bf-9b54-3ec25294d911]: (4, ('- - 0', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:01:42 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Searching for a device in session 32 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 14:01:42 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'anVDsYRG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 14:01:42 user nova-compute[72129]: DEBUG nova.network.neutron [req-6d0fd3bc-b907-4473-b8c9-ffae2aa8c857 req-dfca4021-b728-4623-9dc9-4a00b47ddb3f service nova] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Updated VIF entry in instance network info cache for port 04bc1afa-2e8a-4dd9-961f-e695f43e3061. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 14:01:42 user nova-compute[72129]: DEBUG nova.network.neutron [req-6d0fd3bc-b907-4473-b8c9-ffae2aa8c857 req-dfca4021-b728-4623-9dc9-4a00b47ddb3f service nova] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Updating instance_info_cache with network_info: [{"id": "04bc1afa-2e8a-4dd9-961f-e695f43e3061", "address": "fa:16:3e:69:a4:f0", "network": {"id": "567d2893-d3e8-41e1-a0fe-4414df317d0c", "bridge": "br-int", "label": "tempest-TestShelveInstance-887577340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e0c65958662420fa6d8d73c5e9fdc25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04bc1afa-2e", "ovs_interfaceid": "04bc1afa-2e8a-4dd9-961f-e695f43e3061", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:01:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-6d0fd3bc-b907-4473-b8c9-ffae2aa8c857 req-dfca4021-b728-4623-9dc9-4a00b47ddb3f service nova] Releasing lock "refresh_cache-8e5e94dd-b575-48f1-a617-1bd917567220" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:01:43 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:01:43 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.419s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:01:43 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] <== connect_volume: return (1421ms) {'type': 'block', 'scsi_wwn': '23366656332633462', 'path': '/dev/sde'} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:01:43 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366656332633462', 'path': '/dev/sde'} {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 14:01:43 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T13:57:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1168215618',display_name='tempest-TestShelveInstance-server-1168215618',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1168215618',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-909637078',keypairs=<?>,launch_index=0,launched_at=2023-08-01T13:58:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='4e0c65958662420fa6d8d73c5e9fdc25',ramdisk_id='',reservation_id='r-xsrkrpme',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-419749450',owner_user_name='tempest-TestShelveInstance-419749450-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T14:01:32Z,user_data=None,user_id='fde5b0e7d7664dfe9f4d9ce0dc20a8e4',uuid=8e5e94dd-b575-48f1-a617-1bd917567220,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "04bc1afa-2e8a-4dd9-961f-e695f43e3061", "address": "fa:16:3e:69:a4:f0", "network": {"id": "567d2893-d3e8-41e1-a0fe-4414df317d0c", "bridge": "br-int", "label": "tempest-TestShelveInstance-887577340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e0c65958662420fa6d8d73c5e9fdc25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04bc1afa-2e", "ovs_interfaceid": "04bc1afa-2e8a-4dd9-961f-e695f43e3061", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 14:01:43 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Converting VIF {"id": "04bc1afa-2e8a-4dd9-961f-e695f43e3061", "address": "fa:16:3e:69:a4:f0", "network": {"id": "567d2893-d3e8-41e1-a0fe-4414df317d0c", "bridge": "br-int", "label": "tempest-TestShelveInstance-887577340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e0c65958662420fa6d8d73c5e9fdc25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04bc1afa-2e", "ovs_interfaceid": "04bc1afa-2e8a-4dd9-961f-e695f43e3061", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:01:43 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:a4:f0,bridge_name='br-int',has_traffic_filtering=True,id=04bc1afa-2e8a-4dd9-961f-e695f43e3061,network=Network(567d2893-d3e8-41e1-a0fe-4414df317d0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04bc1afa-2e') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:01:43 user nova-compute[72129]: DEBUG nova.objects.instance [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Lazy-loading 'pci_devices' on Instance uuid 8e5e94dd-b575-48f1-a617-1bd917567220 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:01:43 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] End _get_guest_xml xml=<domain type="kvm">
Aug 01 14:01:43 user nova-compute[72129]:   <uuid>8e5e94dd-b575-48f1-a617-1bd917567220</uuid>
Aug 01 14:01:43 user nova-compute[72129]:   <name>instance-00000016</name>
Aug 01 14:01:43 user nova-compute[72129]:   <memory>524288</memory>
Aug 01 14:01:43 user nova-compute[72129]:   <vcpu>1</vcpu>
Aug 01 14:01:43 user nova-compute[72129]:   <metadata>
Aug 01 14:01:43 user nova-compute[72129]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 14:01:43 user nova-compute[72129]:       <nova:package version="0.0.0"/>
Aug 01 14:01:43 user nova-compute[72129]:       <nova:name>tempest-TestShelveInstance-server-1168215618</nova:name>
Aug 01 14:01:43 user nova-compute[72129]:       <nova:creationTime>2023-08-01 14:01:41</nova:creationTime>
Aug 01 14:01:43 user nova-compute[72129]:       <nova:flavor name="m1.tiny">
Aug 01 14:01:43 user nova-compute[72129]:         <nova:memory>512</nova:memory>
Aug 01 14:01:43 user nova-compute[72129]:         <nova:disk>1</nova:disk>
Aug 01 14:01:43 user nova-compute[72129]:         <nova:swap>0</nova:swap>
Aug 01 14:01:43 user nova-compute[72129]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 14:01:43 user nova-compute[72129]:         <nova:vcpus>1</nova:vcpus>
Aug 01 14:01:43 user nova-compute[72129]:       </nova:flavor>
Aug 01 14:01:43 user nova-compute[72129]:       <nova:owner>
Aug 01 14:01:43 user nova-compute[72129]:         <nova:user uuid="fde5b0e7d7664dfe9f4d9ce0dc20a8e4">tempest-TestShelveInstance-419749450-project-member</nova:user>
Aug 01 14:01:43 user nova-compute[72129]:         <nova:project uuid="4e0c65958662420fa6d8d73c5e9fdc25">tempest-TestShelveInstance-419749450</nova:project>
Aug 01 14:01:43 user nova-compute[72129]:       </nova:owner>
Aug 01 14:01:43 user nova-compute[72129]:       <nova:ports>
Aug 01 14:01:43 user nova-compute[72129]:         <nova:port uuid="04bc1afa-2e8a-4dd9-961f-e695f43e3061">
Aug 01 14:01:43 user nova-compute[72129]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 01 14:01:43 user nova-compute[72129]:         </nova:port>
Aug 01 14:01:43 user nova-compute[72129]:       </nova:ports>
Aug 01 14:01:43 user nova-compute[72129]:     </nova:instance>
Aug 01 14:01:43 user nova-compute[72129]:   </metadata>
Aug 01 14:01:43 user nova-compute[72129]:   <sysinfo type="smbios">
Aug 01 14:01:43 user nova-compute[72129]:     <system>
Aug 01 14:01:43 user nova-compute[72129]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 14:01:43 user nova-compute[72129]:       <entry name="product">OpenStack Nova</entry>
Aug 01 14:01:43 user nova-compute[72129]:       <entry name="version">0.0.0</entry>
Aug 01 14:01:43 user nova-compute[72129]:       <entry name="serial">8e5e94dd-b575-48f1-a617-1bd917567220</entry>
Aug 01 14:01:43 user nova-compute[72129]:       <entry name="uuid">8e5e94dd-b575-48f1-a617-1bd917567220</entry>
Aug 01 14:01:43 user nova-compute[72129]:       <entry name="family">Virtual Machine</entry>
Aug 01 14:01:43 user nova-compute[72129]:     </system>
Aug 01 14:01:43 user nova-compute[72129]:   </sysinfo>
Aug 01 14:01:43 user nova-compute[72129]:   <os>
Aug 01 14:01:43 user nova-compute[72129]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 14:01:43 user nova-compute[72129]:     <boot dev="hd"/>
Aug 01 14:01:43 user nova-compute[72129]:     <smbios mode="sysinfo"/>
Aug 01 14:01:43 user nova-compute[72129]:   </os>
Aug 01 14:01:43 user nova-compute[72129]:   <features>
Aug 01 14:01:43 user nova-compute[72129]:     <acpi/>
Aug 01 14:01:43 user nova-compute[72129]:     <apic/>
Aug 01 14:01:43 user nova-compute[72129]:     <vmcoreinfo/>
Aug 01 14:01:43 user nova-compute[72129]:   </features>
Aug 01 14:01:43 user nova-compute[72129]:   <clock offset="utc">
Aug 01 14:01:43 user nova-compute[72129]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 14:01:43 user nova-compute[72129]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 14:01:43 user nova-compute[72129]:     <timer name="hpet" present="no"/>
Aug 01 14:01:43 user nova-compute[72129]:   </clock>
Aug 01 14:01:43 user nova-compute[72129]:   <cpu mode="custom" match="exact">
Aug 01 14:01:43 user nova-compute[72129]:     <model>Nehalem</model>
Aug 01 14:01:43 user nova-compute[72129]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 14:01:43 user nova-compute[72129]:   </cpu>
Aug 01 14:01:43 user nova-compute[72129]:   <devices>
Aug 01 14:01:43 user nova-compute[72129]:     <disk type="block" device="disk">
Aug 01 14:01:43 user nova-compute[72129]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:01:43 user nova-compute[72129]:       <source dev="/dev/sde"/>
Aug 01 14:01:43 user nova-compute[72129]:       <target dev="vda" bus="virtio"/>
Aug 01 14:01:43 user nova-compute[72129]:       <serial>9e4d6571-fba3-42fe-9abd-cddd72d2c46d</serial>
Aug 01 14:01:43 user nova-compute[72129]:     </disk>
Aug 01 14:01:43 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 14:01:43 user nova-compute[72129]:       <mac address="fa:16:3e:69:a4:f0"/>
Aug 01 14:01:43 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:01:43 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 14:01:43 user nova-compute[72129]:       <target dev="tap04bc1afa-2e"/>
Aug 01 14:01:43 user nova-compute[72129]:     </interface>
Aug 01 14:01:43 user nova-compute[72129]:     <serial type="pty">
Aug 01 14:01:43 user nova-compute[72129]:       <log file="/opt/stack/data/nova/instances/8e5e94dd-b575-48f1-a617-1bd917567220/console.log" append="off"/>
Aug 01 14:01:43 user nova-compute[72129]:     </serial>
Aug 01 14:01:43 user nova-compute[72129]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 14:01:43 user nova-compute[72129]:     <video>
Aug 01 14:01:43 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:01:43 user nova-compute[72129]:     </video>
Aug 01 14:01:43 user nova-compute[72129]:     <rng model="virtio">
Aug 01 14:01:43 user nova-compute[72129]:       <backend model="random">/dev/urandom</backend>
Aug 01 14:01:43 user nova-compute[72129]:     </rng>
Aug 01 14:01:43 user nova-compute[72129]:     <controller type="usb" index="0" model="none"/>
Aug 01 14:01:43 user nova-compute[72129]:     <memballoon model="virtio">
Aug 01 14:01:43 user nova-compute[72129]:       <stats period="10"/>
Aug 01 14:01:43 user nova-compute[72129]:     </memballoon>
Aug 01 14:01:43 user nova-compute[72129]:   </devices>
Aug 01 14:01:43 user nova-compute[72129]: </domain>
Aug 01 14:01:43 user nova-compute[72129]:  {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 14:01:43 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T13:57:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1168215618',display_name='tempest-TestShelveInstance-server-1168215618',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1168215618',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-909637078',keypairs=<?>,launch_index=0,launched_at=2023-08-01T13:58:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='4e0c65958662420fa6d8d73c5e9fdc25',ramdisk_id='',reservation_id='r-xsrkrpme',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-419749450',owner_user_name='tempest-TestShelveInstance-419749450-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T14:01:32Z,user_data=None,user_id='fde5b0e7d7664dfe9f4d9ce0dc20a8e4',uuid=8e5e94dd-b575-48f1-a617-1bd917567220,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "04bc1afa-2e8a-4dd9-961f-e695f43e3061", "address": "fa:16:3e:69:a4:f0", "network": {"id": "567d2893-d3e8-41e1-a0fe-4414df317d0c", "bridge": "br-int", "label": "tempest-TestShelveInstance-887577340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e0c65958662420fa6d8d73c5e9fdc25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04bc1afa-2e", "ovs_interfaceid": "04bc1afa-2e8a-4dd9-961f-e695f43e3061", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 14:01:43 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Converting VIF {"id": "04bc1afa-2e8a-4dd9-961f-e695f43e3061", "address": "fa:16:3e:69:a4:f0", "network": {"id": "567d2893-d3e8-41e1-a0fe-4414df317d0c", "bridge": "br-int", "label": "tempest-TestShelveInstance-887577340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e0c65958662420fa6d8d73c5e9fdc25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04bc1afa-2e", "ovs_interfaceid": "04bc1afa-2e8a-4dd9-961f-e695f43e3061", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:01:43 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:a4:f0,bridge_name='br-int',has_traffic_filtering=True,id=04bc1afa-2e8a-4dd9-961f-e695f43e3061,network=Network(567d2893-d3e8-41e1-a0fe-4414df317d0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04bc1afa-2e') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:01:43 user nova-compute[72129]: DEBUG os_vif [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:a4:f0,bridge_name='br-int',has_traffic_filtering=True,id=04bc1afa-2e8a-4dd9-961f-e695f43e3061,network=Network(567d2893-d3e8-41e1-a0fe-4414df317d0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04bc1afa-2e') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 14:01:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:01:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:01:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 14:01:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:01:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap04bc1afa-2e, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:01:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap04bc1afa-2e, col_values=(('external_ids', {'iface-id': '04bc1afa-2e8a-4dd9-961f-e695f43e3061', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:a4:f0', 'vm-uuid': '8e5e94dd-b575-48f1-a617-1bd917567220'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:01:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:01:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:01:43 user nova-compute[72129]: INFO os_vif [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:a4:f0,bridge_name='br-int',has_traffic_filtering=True,id=04bc1afa-2e8a-4dd9-961f-e695f43e3061,network=Network(567d2893-d3e8-41e1-a0fe-4414df317d0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04bc1afa-2e')
Aug 01 14:01:43 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:01:43 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] No VIF found with MAC fa:16:3e:69:a4:f0, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 14:01:43 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898503.9882622, 85062e35-e302-46f7-8d66-24cf9e7199f7 => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:01:43 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] VM Resumed (Lifecycle Event)
Aug 01 14:01:43 user nova-compute[72129]: DEBUG nova.compute.manager [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Instance event wait completed in 0 seconds for  {{(pid=72129) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 14:01:43 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Guest created on hypervisor {{(pid=72129) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 14:01:43 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Instance spawned successfully.
Aug 01 14:01:44 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 14:01:44 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:01:44 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:01:44 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:01:44 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Found default for hw_cdrom_bus of ide {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:01:44 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Found default for hw_disk_bus of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:01:44 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Found default for hw_input_bus of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:01:44 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Found default for hw_pointer_model of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:01:44 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Found default for hw_video_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:01:44 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Found default for hw_vif_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:01:44 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 14:01:44 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898503.991872, 85062e35-e302-46f7-8d66-24cf9e7199f7 => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:01:44 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] VM Started (Lifecycle Event)
Aug 01 14:01:44 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:01:44 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:01:44 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 14:01:44 user nova-compute[72129]: INFO nova.compute.manager [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Took 5.94 seconds to spawn the instance on the hypervisor.
Aug 01 14:01:44 user nova-compute[72129]: DEBUG nova.compute.manager [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:01:44 user nova-compute[72129]: DEBUG nova.compute.manager [req-b38063a9-1bbc-4ec0-8802-02b0fff34ca1 req-9f04cd3e-6b33-4434-9d1f-8e54a12b80a8 service nova] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Received event network-vif-plugged-b5a06a08-bb00-4551-afd4-09ad16fe0837 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:01:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-b38063a9-1bbc-4ec0-8802-02b0fff34ca1 req-9f04cd3e-6b33-4434-9d1f-8e54a12b80a8 service nova] Acquiring lock "85062e35-e302-46f7-8d66-24cf9e7199f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:01:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-b38063a9-1bbc-4ec0-8802-02b0fff34ca1 req-9f04cd3e-6b33-4434-9d1f-8e54a12b80a8 service nova] Lock "85062e35-e302-46f7-8d66-24cf9e7199f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:01:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-b38063a9-1bbc-4ec0-8802-02b0fff34ca1 req-9f04cd3e-6b33-4434-9d1f-8e54a12b80a8 service nova] Lock "85062e35-e302-46f7-8d66-24cf9e7199f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:01:44 user nova-compute[72129]: DEBUG nova.compute.manager [req-b38063a9-1bbc-4ec0-8802-02b0fff34ca1 req-9f04cd3e-6b33-4434-9d1f-8e54a12b80a8 service nova] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] No waiting events found dispatching network-vif-plugged-b5a06a08-bb00-4551-afd4-09ad16fe0837 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:01:44 user nova-compute[72129]: WARNING nova.compute.manager [req-b38063a9-1bbc-4ec0-8802-02b0fff34ca1 req-9f04cd3e-6b33-4434-9d1f-8e54a12b80a8 service nova] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Received unexpected event network-vif-plugged-b5a06a08-bb00-4551-afd4-09ad16fe0837 for instance with vm_state building and task_state spawning.
Aug 01 14:01:44 user nova-compute[72129]: DEBUG nova.compute.manager [req-b38063a9-1bbc-4ec0-8802-02b0fff34ca1 req-9f04cd3e-6b33-4434-9d1f-8e54a12b80a8 service nova] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Received event network-changed-acb5d1d2-f038-4111-90e1-00bf99a2a7bb {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:01:44 user nova-compute[72129]: DEBUG nova.compute.manager [req-b38063a9-1bbc-4ec0-8802-02b0fff34ca1 req-9f04cd3e-6b33-4434-9d1f-8e54a12b80a8 service nova] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Refreshing instance network info cache due to event network-changed-acb5d1d2-f038-4111-90e1-00bf99a2a7bb. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 14:01:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-b38063a9-1bbc-4ec0-8802-02b0fff34ca1 req-9f04cd3e-6b33-4434-9d1f-8e54a12b80a8 service nova] Acquiring lock "refresh_cache-3891b9d3-832d-4ef7-8ebb-970ddd0a387a" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:01:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-b38063a9-1bbc-4ec0-8802-02b0fff34ca1 req-9f04cd3e-6b33-4434-9d1f-8e54a12b80a8 service nova] Acquired lock "refresh_cache-3891b9d3-832d-4ef7-8ebb-970ddd0a387a" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:01:44 user nova-compute[72129]: DEBUG nova.network.neutron [req-b38063a9-1bbc-4ec0-8802-02b0fff34ca1 req-9f04cd3e-6b33-4434-9d1f-8e54a12b80a8 service nova] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Refreshing network info cache for port acb5d1d2-f038-4111-90e1-00bf99a2a7bb {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 14:01:44 user nova-compute[72129]: INFO nova.compute.manager [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Took 6.82 seconds to build instance.
Aug 01 14:01:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-4ac19de2-bf54-4aa0-be82-5b7d899036a0 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lock "85062e35-e302-46f7-8d66-24cf9e7199f7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.937s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:01:44 user nova-compute[72129]: DEBUG nova.network.neutron [req-b38063a9-1bbc-4ec0-8802-02b0fff34ca1 req-9f04cd3e-6b33-4434-9d1f-8e54a12b80a8 service nova] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Updated VIF entry in instance network info cache for port acb5d1d2-f038-4111-90e1-00bf99a2a7bb. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 14:01:44 user nova-compute[72129]: DEBUG nova.network.neutron [req-b38063a9-1bbc-4ec0-8802-02b0fff34ca1 req-9f04cd3e-6b33-4434-9d1f-8e54a12b80a8 service nova] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Updating instance_info_cache with network_info: [{"id": "acb5d1d2-f038-4111-90e1-00bf99a2a7bb", "address": "fa:16:3e:ec:4a:5e", "network": {"id": "ce10dac7-17d0-425a-bfee-70b8220d7871", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1288141476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b724093fa43c4afb9130efa2cfc713d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacb5d1d2-f0", "ovs_interfaceid": "acb5d1d2-f038-4111-90e1-00bf99a2a7bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:01:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-b38063a9-1bbc-4ec0-8802-02b0fff34ca1 req-9f04cd3e-6b33-4434-9d1f-8e54a12b80a8 service nova] Releasing lock "refresh_cache-3891b9d3-832d-4ef7-8ebb-970ddd0a387a" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:01:44 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:01:44 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:01:44 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:01:45 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:01:45 user nova-compute[72129]: DEBUG nova.compute.manager [req-a1150ac1-daa5-4f9d-8413-addd36960684 req-485d5304-5130-48c5-b0b2-835f45f1d9c9 service nova] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Received event network-vif-plugged-04bc1afa-2e8a-4dd9-961f-e695f43e3061 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:01:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-a1150ac1-daa5-4f9d-8413-addd36960684 req-485d5304-5130-48c5-b0b2-835f45f1d9c9 service nova] Acquiring lock "8e5e94dd-b575-48f1-a617-1bd917567220-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:01:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-a1150ac1-daa5-4f9d-8413-addd36960684 req-485d5304-5130-48c5-b0b2-835f45f1d9c9 service nova] Lock "8e5e94dd-b575-48f1-a617-1bd917567220-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:01:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-a1150ac1-daa5-4f9d-8413-addd36960684 req-485d5304-5130-48c5-b0b2-835f45f1d9c9 service nova] Lock "8e5e94dd-b575-48f1-a617-1bd917567220-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:01:45 user nova-compute[72129]: DEBUG nova.compute.manager [req-a1150ac1-daa5-4f9d-8413-addd36960684 req-485d5304-5130-48c5-b0b2-835f45f1d9c9 service nova] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] No waiting events found dispatching network-vif-plugged-04bc1afa-2e8a-4dd9-961f-e695f43e3061 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:01:45 user nova-compute[72129]: WARNING nova.compute.manager [req-a1150ac1-daa5-4f9d-8413-addd36960684 req-485d5304-5130-48c5-b0b2-835f45f1d9c9 service nova] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Received unexpected event network-vif-plugged-04bc1afa-2e8a-4dd9-961f-e695f43e3061 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 01 14:01:45 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:01:45 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:01:45 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:01:45 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:01:45 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:01:45 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:01:46 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:01:46 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Starting heal instance info cache {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 14:01:46 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Didn't find any instances for network info cache update. {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 14:01:46 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:01:46 user nova-compute[72129]: DEBUG nova.compute.manager [req-a3d54c68-10a6-4f3c-ab03-0856897fde4a req-2e6e5d23-12c3-4746-a0ac-1f859cead36b service nova] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Received event network-changed-fe1f3453-e3ae-494c-965a-c20868179163 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:01:46 user nova-compute[72129]: DEBUG nova.compute.manager [req-a3d54c68-10a6-4f3c-ab03-0856897fde4a req-2e6e5d23-12c3-4746-a0ac-1f859cead36b service nova] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Refreshing instance network info cache due to event network-changed-fe1f3453-e3ae-494c-965a-c20868179163. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 14:01:46 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-a3d54c68-10a6-4f3c-ab03-0856897fde4a req-2e6e5d23-12c3-4746-a0ac-1f859cead36b service nova] Acquiring lock "refresh_cache-ea050cd6-60e9-41fd-a35c-05fe63d60e57" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:01:46 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-a3d54c68-10a6-4f3c-ab03-0856897fde4a req-2e6e5d23-12c3-4746-a0ac-1f859cead36b service nova] Acquired lock "refresh_cache-ea050cd6-60e9-41fd-a35c-05fe63d60e57" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:01:46 user nova-compute[72129]: DEBUG nova.network.neutron [req-a3d54c68-10a6-4f3c-ab03-0856897fde4a req-2e6e5d23-12c3-4746-a0ac-1f859cead36b service nova] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Refreshing network info cache for port fe1f3453-e3ae-494c-965a-c20868179163 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 14:01:47 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:01:47 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72129) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 14:01:47 user nova-compute[72129]: DEBUG nova.network.neutron [req-a3d54c68-10a6-4f3c-ab03-0856897fde4a req-2e6e5d23-12c3-4746-a0ac-1f859cead36b service nova] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Updated VIF entry in instance network info cache for port fe1f3453-e3ae-494c-965a-c20868179163. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 14:01:47 user nova-compute[72129]: DEBUG nova.network.neutron [req-a3d54c68-10a6-4f3c-ab03-0856897fde4a req-2e6e5d23-12c3-4746-a0ac-1f859cead36b service nova] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Updating instance_info_cache with network_info: [{"id": "fe1f3453-e3ae-494c-965a-c20868179163", "address": "fa:16:3e:d8:46:16", "network": {"id": "ce187b11-5e3e-45a9-af0f-0be815ad0a3d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1245856112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0a13467840342f281bd8b8e115eccaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1f3453-e3", "ovs_interfaceid": "fe1f3453-e3ae-494c-965a-c20868179163", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:01:47 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-a3d54c68-10a6-4f3c-ab03-0856897fde4a req-2e6e5d23-12c3-4746-a0ac-1f859cead36b service nova] Releasing lock "refresh_cache-ea050cd6-60e9-41fd-a35c-05fe63d60e57" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:01:47 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898507.193229, 8e5e94dd-b575-48f1-a617-1bd917567220 => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:01:47 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] VM Resumed (Lifecycle Event)
Aug 01 14:01:47 user nova-compute[72129]: DEBUG nova.compute.manager [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Instance event wait completed in 0 seconds for  {{(pid=72129) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 14:01:47 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Guest created on hypervisor {{(pid=72129) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 14:01:47 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Instance spawned successfully.
Aug 01 14:01:47 user nova-compute[72129]: DEBUG nova.compute.manager [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:01:47 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:01:47 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:01:47 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 14:01:47 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898507.19476, 8e5e94dd-b575-48f1-a617-1bd917567220 => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:01:47 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] VM Started (Lifecycle Event)
Aug 01 14:01:47 user nova-compute[72129]: DEBUG nova.compute.manager [req-7bc80fe8-0c30-48d7-a07a-96ea6f3c8034 req-1514f03b-202d-4529-9460-0f9dcdfd9fc3 service nova] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Received event network-vif-plugged-04bc1afa-2e8a-4dd9-961f-e695f43e3061 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:01:47 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-7bc80fe8-0c30-48d7-a07a-96ea6f3c8034 req-1514f03b-202d-4529-9460-0f9dcdfd9fc3 service nova] Acquiring lock "8e5e94dd-b575-48f1-a617-1bd917567220-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:01:47 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-7bc80fe8-0c30-48d7-a07a-96ea6f3c8034 req-1514f03b-202d-4529-9460-0f9dcdfd9fc3 service nova] Lock "8e5e94dd-b575-48f1-a617-1bd917567220-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:01:47 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-7bc80fe8-0c30-48d7-a07a-96ea6f3c8034 req-1514f03b-202d-4529-9460-0f9dcdfd9fc3 service nova] Lock "8e5e94dd-b575-48f1-a617-1bd917567220-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:01:47 user nova-compute[72129]: DEBUG nova.compute.manager [req-7bc80fe8-0c30-48d7-a07a-96ea6f3c8034 req-1514f03b-202d-4529-9460-0f9dcdfd9fc3 service nova] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] No waiting events found dispatching network-vif-plugged-04bc1afa-2e8a-4dd9-961f-e695f43e3061 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:01:47 user nova-compute[72129]: WARNING nova.compute.manager [req-7bc80fe8-0c30-48d7-a07a-96ea6f3c8034 req-1514f03b-202d-4529-9460-0f9dcdfd9fc3 service nova] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Received unexpected event network-vif-plugged-04bc1afa-2e8a-4dd9-961f-e695f43e3061 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 01 14:01:47 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:01:47 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:01:47 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-2264f97c-d12f-420e-9576-5091bf396984 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Lock "8e5e94dd-b575-48f1-a617-1bd917567220" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 15.754s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:01:47 user nova-compute[72129]: DEBUG nova.compute.manager [None req-e82a4d7b-61eb-4560-a545-ae3904dee6bb tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:01:47 user nova-compute[72129]: INFO nova.compute.manager [None req-e82a4d7b-61eb-4560-a545-ae3904dee6bb tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] instance snapshotting
Aug 01 14:01:48 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-e82a4d7b-61eb-4560-a545-ae3904dee6bb tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Beginning live snapshot process
Aug 01 14:01:48 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-e82a4d7b-61eb-4560-a545-ae3904dee6bb tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea050cd6-60e9-41fd-a35c-05fe63d60e57/disk --force-share --output=json -f qcow2 {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:01:48 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-ebe1f661-b16e-4b25-bc11-ceff8f2f011e tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Acquiring lock "3891b9d3-832d-4ef7-8ebb-970ddd0a387a" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:01:48 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-ebe1f661-b16e-4b25-bc11-ceff8f2f011e tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lock "3891b9d3-832d-4ef7-8ebb-970ddd0a387a" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:01:48 user nova-compute[72129]: INFO nova.compute.manager [None req-ebe1f661-b16e-4b25-bc11-ceff8f2f011e tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Shelving
Aug 01 14:01:48 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-e82a4d7b-61eb-4560-a545-ae3904dee6bb tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea050cd6-60e9-41fd-a35c-05fe63d60e57/disk --force-share --output=json -f qcow2" returned: 0 in 0.158s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:01:48 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-e82a4d7b-61eb-4560-a545-ae3904dee6bb tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea050cd6-60e9-41fd-a35c-05fe63d60e57/disk --force-share --output=json -f qcow2 {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:01:48 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:01:48 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:01:48 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:01:48 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-e82a4d7b-61eb-4560-a545-ae3904dee6bb tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea050cd6-60e9-41fd-a35c-05fe63d60e57/disk --force-share --output=json -f qcow2" returned: 0 in 0.172s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:01:48 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-e82a4d7b-61eb-4560-a545-ae3904dee6bb tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:01:48 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:01:48 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:01:48 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-e82a4d7b-61eb-4560-a545-ae3904dee6bb tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.153s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:01:48 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-e82a4d7b-61eb-4560-a545-ae3904dee6bb tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpxdylz6gm/c57f523f4a2749bb9679d4994d688fce.delta 1073741824 {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:01:48 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-e82a4d7b-61eb-4560-a545-ae3904dee6bb tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpxdylz6gm/c57f523f4a2749bb9679d4994d688fce.delta 1073741824" returned: 0 in 0.059s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:01:48 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-e82a4d7b-61eb-4560-a545-ae3904dee6bb tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 01 14:01:48 user nova-compute[72129]: DEBUG nova.compute.manager [req-0dc2f04f-d414-4c1a-9739-f5a002a700f7 req-29eb319d-8a61-42e6-9ae2-80fbf96de629 service nova] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Received event network-vif-unplugged-acb5d1d2-f038-4111-90e1-00bf99a2a7bb {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:01:48 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-0dc2f04f-d414-4c1a-9739-f5a002a700f7 req-29eb319d-8a61-42e6-9ae2-80fbf96de629 service nova] Acquiring lock "3891b9d3-832d-4ef7-8ebb-970ddd0a387a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:01:48 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-0dc2f04f-d414-4c1a-9739-f5a002a700f7 req-29eb319d-8a61-42e6-9ae2-80fbf96de629 service nova] Lock "3891b9d3-832d-4ef7-8ebb-970ddd0a387a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:01:48 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-0dc2f04f-d414-4c1a-9739-f5a002a700f7 req-29eb319d-8a61-42e6-9ae2-80fbf96de629 service nova] Lock "3891b9d3-832d-4ef7-8ebb-970ddd0a387a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:01:48 user nova-compute[72129]: DEBUG nova.compute.manager [req-0dc2f04f-d414-4c1a-9739-f5a002a700f7 req-29eb319d-8a61-42e6-9ae2-80fbf96de629 service nova] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] No waiting events found dispatching network-vif-unplugged-acb5d1d2-f038-4111-90e1-00bf99a2a7bb {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:01:48 user nova-compute[72129]: WARNING nova.compute.manager [req-0dc2f04f-d414-4c1a-9739-f5a002a700f7 req-29eb319d-8a61-42e6-9ae2-80fbf96de629 service nova] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Received unexpected event network-vif-unplugged-acb5d1d2-f038-4111-90e1-00bf99a2a7bb for instance with vm_state active and task_state shelving.
Aug 01 14:01:49 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:01:49 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Instance destroyed successfully.
Aug 01 14:01:49 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-e82a4d7b-61eb-4560-a545-ae3904dee6bb tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=72129) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 14:01:49 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-ebe1f661-b16e-4b25-bc11-ceff8f2f011e tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Beginning cold snapshot process
Aug 01 14:01:50 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:01:50 user nova-compute[72129]: DEBUG nova.privsep.utils [None req-ebe1f661-b16e-4b25-bc11-ceff8f2f011e tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72129) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 14:01:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-ebe1f661-b16e-4b25-bc11-ceff8f2f011e tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/3891b9d3-832d-4ef7-8ebb-970ddd0a387a/disk /opt/stack/data/nova/instances/snapshots/tmpt4fiboni/c86766ce01b04738925f4c2e43e1f215 {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:01:50 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-e82a4d7b-61eb-4560-a545-ae3904dee6bb tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=72129) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 14:01:50 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-e82a4d7b-61eb-4560-a545-ae3904dee6bb tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 01 14:01:50 user nova-compute[72129]: DEBUG nova.privsep.utils [None req-e82a4d7b-61eb-4560-a545-ae3904dee6bb tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72129) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 14:01:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-e82a4d7b-61eb-4560-a545-ae3904dee6bb tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpxdylz6gm/c57f523f4a2749bb9679d4994d688fce.delta /opt/stack/data/nova/instances/snapshots/tmpxdylz6gm/c57f523f4a2749bb9679d4994d688fce {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:01:50 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:01:50 user nova-compute[72129]: DEBUG nova.compute.manager [req-0f08c5f8-e8d6-4a97-a115-8167e0e00dde req-4ce8d0ae-fd2a-49e0-a4cb-0076014fa4a6 service nova] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Received event network-vif-plugged-acb5d1d2-f038-4111-90e1-00bf99a2a7bb {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:01:50 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-0f08c5f8-e8d6-4a97-a115-8167e0e00dde req-4ce8d0ae-fd2a-49e0-a4cb-0076014fa4a6 service nova] Acquiring lock "3891b9d3-832d-4ef7-8ebb-970ddd0a387a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:01:50 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-0f08c5f8-e8d6-4a97-a115-8167e0e00dde req-4ce8d0ae-fd2a-49e0-a4cb-0076014fa4a6 service nova] Lock "3891b9d3-832d-4ef7-8ebb-970ddd0a387a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:01:50 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-0f08c5f8-e8d6-4a97-a115-8167e0e00dde req-4ce8d0ae-fd2a-49e0-a4cb-0076014fa4a6 service nova] Lock "3891b9d3-832d-4ef7-8ebb-970ddd0a387a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:01:50 user nova-compute[72129]: DEBUG nova.compute.manager [req-0f08c5f8-e8d6-4a97-a115-8167e0e00dde req-4ce8d0ae-fd2a-49e0-a4cb-0076014fa4a6 service nova] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] No waiting events found dispatching network-vif-plugged-acb5d1d2-f038-4111-90e1-00bf99a2a7bb {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:01:50 user nova-compute[72129]: WARNING nova.compute.manager [req-0f08c5f8-e8d6-4a97-a115-8167e0e00dde req-4ce8d0ae-fd2a-49e0-a4cb-0076014fa4a6 service nova] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Received unexpected event network-vif-plugged-acb5d1d2-f038-4111-90e1-00bf99a2a7bb for instance with vm_state active and task_state shelving_image_pending_upload.
Aug 01 14:01:51 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:01:51 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:01:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-e82a4d7b-61eb-4560-a545-ae3904dee6bb tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpxdylz6gm/c57f523f4a2749bb9679d4994d688fce.delta /opt/stack/data/nova/instances/snapshots/tmpxdylz6gm/c57f523f4a2749bb9679d4994d688fce" returned: 0 in 0.660s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:01:51 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-e82a4d7b-61eb-4560-a545-ae3904dee6bb tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Snapshot extracted, beginning image upload
Aug 01 14:01:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:01:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:01:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:01:51 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Auditing locally available compute resources for user (node: user) {{(pid=72129) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 14:01:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-ebe1f661-b16e-4b25-bc11-ceff8f2f011e tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/3891b9d3-832d-4ef7-8ebb-970ddd0a387a/disk /opt/stack/data/nova/instances/snapshots/tmpt4fiboni/c86766ce01b04738925f4c2e43e1f215" returned: 0 in 1.166s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:01:51 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-ebe1f661-b16e-4b25-bc11-ceff8f2f011e tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Snapshot extracted, beginning image upload
Aug 01 14:01:51 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 14:01:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:01:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:01:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:01:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:01:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85062e35-e302-46f7-8d66-24cf9e7199f7/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:01:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85062e35-e302-46f7-8d66-24cf9e7199f7/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:01:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85062e35-e302-46f7-8d66-24cf9e7199f7/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:01:52 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85062e35-e302-46f7-8d66-24cf9e7199f7/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:01:52 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53b76ca4-30f0-4fd4-9928-714c7073a490/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:01:52 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53b76ca4-30f0-4fd4-9928-714c7073a490/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:01:52 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53b76ca4-30f0-4fd4-9928-714c7073a490/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:01:52 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53b76ca4-30f0-4fd4-9928-714c7073a490/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:01:52 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 14:01:52 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:01:52 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:01:52 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:01:52 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:01:52 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 14:01:52 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 14:01:52 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cf5877-55dd-44ce-9b58-b662afe8e62e/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:01:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cf5877-55dd-44ce-9b58-b662afe8e62e/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:01:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cf5877-55dd-44ce-9b58-b662afe8e62e/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:01:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cf5877-55dd-44ce-9b58-b662afe8e62e/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:01:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3891b9d3-832d-4ef7-8ebb-970ddd0a387a/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:01:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3891b9d3-832d-4ef7-8ebb-970ddd0a387a/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:01:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3891b9d3-832d-4ef7-8ebb-970ddd0a387a/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:01:53 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:01:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3891b9d3-832d-4ef7-8ebb-970ddd0a387a/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:01:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea050cd6-60e9-41fd-a35c-05fe63d60e57/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:01:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea050cd6-60e9-41fd-a35c-05fe63d60e57/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:01:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea050cd6-60e9-41fd-a35c-05fe63d60e57/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:01:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea050cd6-60e9-41fd-a35c-05fe63d60e57/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:01:54 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:01:54 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:01:54 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Hypervisor/Node resource view: name=user free_ram=7716MB free_disk=25.184955596923828GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72129) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 14:01:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:01:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:01:54 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-ebe1f661-b16e-4b25-bc11-ceff8f2f011e tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Snapshot image upload complete
Aug 01 14:01:54 user nova-compute[72129]: DEBUG nova.compute.manager [None req-ebe1f661-b16e-4b25-bc11-ceff8f2f011e tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:01:54 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-e82a4d7b-61eb-4560-a545-ae3904dee6bb tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Snapshot image upload complete
Aug 01 14:01:54 user nova-compute[72129]: INFO nova.compute.manager [None req-e82a4d7b-61eb-4560-a545-ae3904dee6bb tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Took 6.71 seconds to snapshot the instance on the hypervisor.
Aug 01 14:01:54 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 97a5dccf-b499-443a-b332-cfa293a16047 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:01:54 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:01:54 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance d031973f-8f48-43b3-a338-040950103e4c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:01:54 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 53b76ca4-30f0-4fd4-9928-714c7073a490 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:01:54 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 3891b9d3-832d-4ef7-8ebb-970ddd0a387a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:01:54 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance ea050cd6-60e9-41fd-a35c-05fe63d60e57 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:01:54 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance e2cf5877-55dd-44ce-9b58-b662afe8e62e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:01:54 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 954db8d6-4806-43e6-8310-5d7f3437dc71 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:01:54 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 8e5e94dd-b575-48f1-a617-1bd917567220 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:01:54 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 85062e35-e302-46f7-8d66-24cf9e7199f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:01:54 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 14:01:54 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 14:01:54 user nova-compute[72129]: INFO nova.compute.manager [None req-ebe1f661-b16e-4b25-bc11-ceff8f2f011e tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Shelve offloading
Aug 01 14:01:54 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Instance destroyed successfully.
Aug 01 14:01:54 user nova-compute[72129]: DEBUG nova.compute.manager [None req-ebe1f661-b16e-4b25-bc11-ceff8f2f011e tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:01:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-ebe1f661-b16e-4b25-bc11-ceff8f2f011e tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Acquiring lock "refresh_cache-3891b9d3-832d-4ef7-8ebb-970ddd0a387a" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:01:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-ebe1f661-b16e-4b25-bc11-ceff8f2f011e tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Acquired lock "refresh_cache-3891b9d3-832d-4ef7-8ebb-970ddd0a387a" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:01:54 user nova-compute[72129]: DEBUG nova.network.neutron [None req-ebe1f661-b16e-4b25-bc11-ceff8f2f011e tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 14:01:55 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:01:55 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:01:55 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Compute_service record updated for user:user {{(pid=72129) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 14:01:55 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.580s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:01:55 user nova-compute[72129]: DEBUG nova.network.neutron [None req-ebe1f661-b16e-4b25-bc11-ceff8f2f011e tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Updating instance_info_cache with network_info: [{"id": "acb5d1d2-f038-4111-90e1-00bf99a2a7bb", "address": "fa:16:3e:ec:4a:5e", "network": {"id": "ce10dac7-17d0-425a-bfee-70b8220d7871", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1288141476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b724093fa43c4afb9130efa2cfc713d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacb5d1d2-f0", "ovs_interfaceid": "acb5d1d2-f038-4111-90e1-00bf99a2a7bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:01:55 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-ebe1f661-b16e-4b25-bc11-ceff8f2f011e tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Releasing lock "refresh_cache-3891b9d3-832d-4ef7-8ebb-970ddd0a387a" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:01:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:01:56 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Instance destroyed successfully.
Aug 01 14:01:56 user nova-compute[72129]: DEBUG nova.objects.instance [None req-ebe1f661-b16e-4b25-bc11-ceff8f2f011e tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lazy-loading 'resources' on Instance uuid 3891b9d3-832d-4ef7-8ebb-970ddd0a387a {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:01:56 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-ebe1f661-b16e-4b25-bc11-ceff8f2f011e tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:59:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-331489091',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-331489091',id=23,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKNwLt9cG/6UYIO5eEhR/1sQRqxswPW3s3IV/zKywgy3aWV4brDlp6I18ZlFxAhUiEoZChgO4LCEJ1KG2zNJDnYs8CHJgeupzFEtMFvJdCyWU9LKgI89N0dlz92eDVpGtw==',key_name='tempest-keypair-2118933419',keypairs=<?>,launch_index=0,launched_at=2023-08-01T13:59:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b724093fa43c4afb9130efa2cfc713d9',ramdisk_id='',reservation_id='r-ynze9bkr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1864942034',owner_user_name='tempest-AttachVolumeShelveTestJSON-1864942034-project-member',shelved_at='2023-08-01T14:01:54.663766',shelved_host='user',shelved_image_id='cc83affc-7464-465f-821c-002a21f41dc6'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T14:01:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e5630ede467c4c99915b1b2f455ca0fb',uuid=3891b9d3-832d-4ef7-8ebb-970ddd0a387a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "acb5d1d2-f038-4111-90e1-00bf99a2a7bb", "address": "fa:16:3e:ec:4a:5e", "network": {"id": "ce10dac7-17d0-425a-bfee-70b8220d7871", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1288141476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b724093fa43c4afb9130efa2cfc713d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacb5d1d2-f0", "ovs_interfaceid": "acb5d1d2-f038-4111-90e1-00bf99a2a7bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 14:01:56 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-ebe1f661-b16e-4b25-bc11-ceff8f2f011e tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Converting VIF {"id": "acb5d1d2-f038-4111-90e1-00bf99a2a7bb", "address": "fa:16:3e:ec:4a:5e", "network": {"id": "ce10dac7-17d0-425a-bfee-70b8220d7871", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1288141476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b724093fa43c4afb9130efa2cfc713d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacb5d1d2-f0", "ovs_interfaceid": "acb5d1d2-f038-4111-90e1-00bf99a2a7bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:01:56 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-ebe1f661-b16e-4b25-bc11-ceff8f2f011e tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:4a:5e,bridge_name='br-int',has_traffic_filtering=True,id=acb5d1d2-f038-4111-90e1-00bf99a2a7bb,network=Network(ce10dac7-17d0-425a-bfee-70b8220d7871),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacb5d1d2-f0') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:01:56 user nova-compute[72129]: DEBUG os_vif [None req-ebe1f661-b16e-4b25-bc11-ceff8f2f011e tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:4a:5e,bridge_name='br-int',has_traffic_filtering=True,id=acb5d1d2-f038-4111-90e1-00bf99a2a7bb,network=Network(ce10dac7-17d0-425a-bfee-70b8220d7871),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacb5d1d2-f0') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 14:01:56 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:01:56 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapacb5d1d2-f0, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:01:56 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:01:56 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:01:56 user nova-compute[72129]: INFO os_vif [None req-ebe1f661-b16e-4b25-bc11-ceff8f2f011e tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:4a:5e,bridge_name='br-int',has_traffic_filtering=True,id=acb5d1d2-f038-4111-90e1-00bf99a2a7bb,network=Network(ce10dac7-17d0-425a-bfee-70b8220d7871),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacb5d1d2-f0')
Aug 01 14:01:56 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-ebe1f661-b16e-4b25-bc11-ceff8f2f011e tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Deleting instance files /opt/stack/data/nova/instances/3891b9d3-832d-4ef7-8ebb-970ddd0a387a_del
Aug 01 14:01:56 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-ebe1f661-b16e-4b25-bc11-ceff8f2f011e tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Deletion of /opt/stack/data/nova/instances/3891b9d3-832d-4ef7-8ebb-970ddd0a387a_del complete
Aug 01 14:01:56 user nova-compute[72129]: DEBUG nova.compute.manager [req-412141bf-225c-455e-a09f-8f00977427e2 req-5df375a7-58cb-498a-b85c-42f1b8c2c5a2 service nova] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Received event network-changed-acb5d1d2-f038-4111-90e1-00bf99a2a7bb {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:01:56 user nova-compute[72129]: DEBUG nova.compute.manager [req-412141bf-225c-455e-a09f-8f00977427e2 req-5df375a7-58cb-498a-b85c-42f1b8c2c5a2 service nova] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Refreshing instance network info cache due to event network-changed-acb5d1d2-f038-4111-90e1-00bf99a2a7bb. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 14:01:56 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-412141bf-225c-455e-a09f-8f00977427e2 req-5df375a7-58cb-498a-b85c-42f1b8c2c5a2 service nova] Acquiring lock "refresh_cache-3891b9d3-832d-4ef7-8ebb-970ddd0a387a" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:01:56 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-412141bf-225c-455e-a09f-8f00977427e2 req-5df375a7-58cb-498a-b85c-42f1b8c2c5a2 service nova] Acquired lock "refresh_cache-3891b9d3-832d-4ef7-8ebb-970ddd0a387a" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:01:56 user nova-compute[72129]: DEBUG nova.network.neutron [req-412141bf-225c-455e-a09f-8f00977427e2 req-5df375a7-58cb-498a-b85c-42f1b8c2c5a2 service nova] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Refreshing network info cache for port acb5d1d2-f038-4111-90e1-00bf99a2a7bb {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 14:01:56 user nova-compute[72129]: INFO nova.scheduler.client.report [None req-ebe1f661-b16e-4b25-bc11-ceff8f2f011e tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Deleted allocations for instance 3891b9d3-832d-4ef7-8ebb-970ddd0a387a
Aug 01 14:01:56 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-ebe1f661-b16e-4b25-bc11-ceff8f2f011e tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:01:56 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-ebe1f661-b16e-4b25-bc11-ceff8f2f011e tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:01:56 user nova-compute[72129]: DEBUG nova.objects.instance [None req-ebe1f661-b16e-4b25-bc11-ceff8f2f011e tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lazy-loading 'numa_topology' on Instance uuid 3891b9d3-832d-4ef7-8ebb-970ddd0a387a {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:01:56 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-ebe1f661-b16e-4b25-bc11-ceff8f2f011e tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:01:56 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-ebe1f661-b16e-4b25-bc11-ceff8f2f011e tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:01:57 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-ebe1f661-b16e-4b25-bc11-ceff8f2f011e tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.366s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:01:57 user nova-compute[72129]: DEBUG nova.network.neutron [req-412141bf-225c-455e-a09f-8f00977427e2 req-5df375a7-58cb-498a-b85c-42f1b8c2c5a2 service nova] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Updated VIF entry in instance network info cache for port acb5d1d2-f038-4111-90e1-00bf99a2a7bb. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 14:01:57 user nova-compute[72129]: DEBUG nova.network.neutron [req-412141bf-225c-455e-a09f-8f00977427e2 req-5df375a7-58cb-498a-b85c-42f1b8c2c5a2 service nova] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Updating instance_info_cache with network_info: [{"id": "acb5d1d2-f038-4111-90e1-00bf99a2a7bb", "address": "fa:16:3e:ec:4a:5e", "network": {"id": "ce10dac7-17d0-425a-bfee-70b8220d7871", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1288141476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b724093fa43c4afb9130efa2cfc713d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapacb5d1d2-f0", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:01:57 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-ebe1f661-b16e-4b25-bc11-ceff8f2f011e tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lock "3891b9d3-832d-4ef7-8ebb-970ddd0a387a" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 8.683s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:01:57 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-412141bf-225c-455e-a09f-8f00977427e2 req-5df375a7-58cb-498a-b85c-42f1b8c2c5a2 service nova] Releasing lock "refresh_cache-3891b9d3-832d-4ef7-8ebb-970ddd0a387a" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:01:57 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Acquiring lock "e4a13a50-fe03-41aa-94f4-3431805ff481" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:01:57 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "e4a13a50-fe03-41aa-94f4-3431805ff481" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:01:57 user nova-compute[72129]: DEBUG nova.compute.manager [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Starting instance... {{(pid=72129) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 14:01:57 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:01:57 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:01:57 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72129) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 14:01:57 user nova-compute[72129]: INFO nova.compute.claims [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Claim successful on node user
Aug 01 14:01:57 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:01:57 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:01:58 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.387s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:01:58 user nova-compute[72129]: DEBUG nova.compute.manager [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Start building networks asynchronously for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 14:01:58 user nova-compute[72129]: DEBUG nova.compute.manager [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Allocating IP information in the background. {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 14:01:58 user nova-compute[72129]: DEBUG nova.network.neutron [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] allocate_for_instance() {{(pid=72129) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 14:01:58 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 14:01:58 user nova-compute[72129]: DEBUG nova.compute.manager [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Start building block device mappings for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 14:01:58 user nova-compute[72129]: INFO nova.virt.block_device [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Booting with volume 58507a4b-e017-48d8-aeb1-8036a2a2a0a8 at /dev/vda
Aug 01 14:01:58 user nova-compute[72129]: DEBUG nova.policy [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1f35620862694e7295f782ab15e290a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e85d9b73a546dc95e0ace26233f2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72129) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 14:01:58 user nova-compute[72129]: DEBUG os_brick.utils [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:01:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:01:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:01:58 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[906bf804-7b99-4dba-9fc4-a7daf7a6fd27]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f9b449c2cd3d\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:01:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:01:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:01:58 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc4d4da-d7a6-4906-a305-3f8c4fdc79a6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:01:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:01:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:01:58 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcbc3916-0bff-442a-be16-d51bf41eabec]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:01:58 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[36af87c4-e514-491b-bde5-751de9f6d2af]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:01:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Running cmd (subprocess): nvme version {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:01:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] 'nvme version' failed. Not Retrying. {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 14:01:58 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] nvme not present on system {{(pid=72129) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 14:01:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:01:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 14:01:58 user nova-compute[72129]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 14:01:58 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd53fc2-8515-4a11-a792-253cf9ea3217]: (4, '') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:01:58 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72129) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 14:01:58 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 14:01:58 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] LIGHTOS: no hostnqn found. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 14:01:58 user nova-compute[72129]: DEBUG os_brick.utils [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f9b449c2cd3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:01:58 user nova-compute[72129]: DEBUG nova.virt.block_device [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Updating existing volume attachment record: 07f953ef-c742-4232-9b3f-f96ccd736c6d {{(pid=72129) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 14:01:59 user nova-compute[72129]: DEBUG nova.network.neutron [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Successfully created port: a36283e1-929d-4806-ba5f-175f99f44e98 {{(pid=72129) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 14:01:59 user nova-compute[72129]: DEBUG nova.network.neutron [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Successfully updated port: a36283e1-929d-4806-ba5f-175f99f44e98 {{(pid=72129) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 14:01:59 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Acquiring lock "refresh_cache-e4a13a50-fe03-41aa-94f4-3431805ff481" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:01:59 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Acquired lock "refresh_cache-e4a13a50-fe03-41aa-94f4-3431805ff481" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:01:59 user nova-compute[72129]: DEBUG nova.network.neutron [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 14:01:59 user nova-compute[72129]: DEBUG nova.compute.manager [req-3a6bcfec-9342-4101-8688-5825f556e321 req-a455658f-d8a1-4729-b803-c4b7922399ec service nova] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Received event network-changed-a36283e1-929d-4806-ba5f-175f99f44e98 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:01:59 user nova-compute[72129]: DEBUG nova.compute.manager [req-3a6bcfec-9342-4101-8688-5825f556e321 req-a455658f-d8a1-4729-b803-c4b7922399ec service nova] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Refreshing instance network info cache due to event network-changed-a36283e1-929d-4806-ba5f-175f99f44e98. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 14:01:59 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-3a6bcfec-9342-4101-8688-5825f556e321 req-a455658f-d8a1-4729-b803-c4b7922399ec service nova] Acquiring lock "refresh_cache-e4a13a50-fe03-41aa-94f4-3431805ff481" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:01:59 user nova-compute[72129]: DEBUG nova.network.neutron [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Instance cache missing network info. {{(pid=72129) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 14:02:00 user nova-compute[72129]: DEBUG nova.network.neutron [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Updating instance_info_cache with network_info: [{"id": "a36283e1-929d-4806-ba5f-175f99f44e98", "address": "fa:16:3e:28:9b:e7", "network": {"id": "4b93ad92-9a3a-4472-ba6c-d215329da98b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-734108983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0e85d9b73a546dc95e0ace26233f2a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36283e1-92", "ovs_interfaceid": "a36283e1-929d-4806-ba5f-175f99f44e98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:02:00 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Releasing lock "refresh_cache-e4a13a50-fe03-41aa-94f4-3431805ff481" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:02:00 user nova-compute[72129]: DEBUG nova.compute.manager [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Instance network_info: |[{"id": "a36283e1-929d-4806-ba5f-175f99f44e98", "address": "fa:16:3e:28:9b:e7", "network": {"id": "4b93ad92-9a3a-4472-ba6c-d215329da98b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-734108983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0e85d9b73a546dc95e0ace26233f2a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36283e1-92", "ovs_interfaceid": "a36283e1-929d-4806-ba5f-175f99f44e98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 14:02:00 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-3a6bcfec-9342-4101-8688-5825f556e321 req-a455658f-d8a1-4729-b803-c4b7922399ec service nova] Acquired lock "refresh_cache-e4a13a50-fe03-41aa-94f4-3431805ff481" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:02:00 user nova-compute[72129]: DEBUG nova.network.neutron [req-3a6bcfec-9342-4101-8688-5825f556e321 req-a455658f-d8a1-4729-b803-c4b7922399ec service nova] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Refreshing network info cache for port a36283e1-929d-4806-ba5f-175f99f44e98 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 14:02:00 user nova-compute[72129]: DEBUG nova.network.neutron [req-3a6bcfec-9342-4101-8688-5825f556e321 req-a455658f-d8a1-4729-b803-c4b7922399ec service nova] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Updated VIF entry in instance network info cache for port a36283e1-929d-4806-ba5f-175f99f44e98. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 14:02:00 user nova-compute[72129]: DEBUG nova.network.neutron [req-3a6bcfec-9342-4101-8688-5825f556e321 req-a455658f-d8a1-4729-b803-c4b7922399ec service nova] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Updating instance_info_cache with network_info: [{"id": "a36283e1-929d-4806-ba5f-175f99f44e98", "address": "fa:16:3e:28:9b:e7", "network": {"id": "4b93ad92-9a3a-4472-ba6c-d215329da98b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-734108983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0e85d9b73a546dc95e0ace26233f2a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36283e1-92", "ovs_interfaceid": "a36283e1-929d-4806-ba5f-175f99f44e98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:02:00 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-3a6bcfec-9342-4101-8688-5825f556e321 req-a455658f-d8a1-4729-b803-c4b7922399ec service nova] Releasing lock "refresh_cache-e4a13a50-fe03-41aa-94f4-3431805ff481" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:02:00 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:02:01 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:02:04 user nova-compute[72129]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690898509.7090535, 3891b9d3-832d-4ef7-8ebb-970ddd0a387a => Stopped> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:02:04 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] VM Stopped (Lifecycle Event)
Aug 01 14:02:04 user nova-compute[72129]: DEBUG nova.compute.manager [None req-cc94fea5-3d88-4a38-90c0-89586b02e35b None None] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:02:05 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG nova.compute.manager [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Start spawning the instance on the hypervisor. {{(pid=72129) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Creating instance directory {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 14:02:06 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Creating image(s)
Aug 01 14:02:06 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Did not create local disks {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Ensure instance console log exists: /opt/stack/data/nova/instances/e4a13a50-fe03-41aa-94f4-3431805ff481/console.log {{(pid=72129) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Start _get_guest_xml network_info=[{"id": "a36283e1-929d-4806-ba5f-175f99f44e98", "address": "fa:16:3e:28:9b:e7", "network": {"id": "4b93ad92-9a3a-4472-ba6c-d215329da98b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-734108983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0e85d9b73a546dc95e0ace26233f2a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36283e1-92", "ovs_interfaceid": "a36283e1-929d-4806-ba5f-175f99f44e98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '07f953ef-c742-4232-9b3f-f96ccd736c6d', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jnqFwdQU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e4a13a50-fe03-41aa-94f4-3431805ff481', 'attached_at': '', 'detached_at': '', 'volume_id': '58507a4b-e017-48d8-aeb1-8036a2a2a0a8', 'serial': '58507a4b-e017-48d8-aeb1-8036a2a2a0a8'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 14:02:06 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:02:06 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:02:06 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] CPU controller missing on host. {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] CPU controller found on host. {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72129) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T13:45:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Flavor limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Image limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Flavor pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Image pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Got 1 possible topologies {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Calling os-brick to attach iSCSI Volume {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jnqFwdQU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:02:06 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:02:06 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:02:06 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:02:06 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:02:06 user nova-compute[72129]: INFO os_brick.initiator.connectors.iscsi [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 14:02:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 -p 172.16.0.220:3260 {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d64e9d0-dc7a-4e24-b0ba-5bd63ecfe1c2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 14:02:06 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 -p 172.16.0.220:3260 --interface default --op new {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[e726e687-e0a6-4d6f-a4fa-edfe019b3853]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8] added\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8] added
Aug 01 14:02:06 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[3915d0c5-ffcf-44f8-aa2d-3eaafd17a371]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e64b517-c6d7-4482-b70a-93c090869f42]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jnqFwdQU {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jnqFwdQU" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7a8ff4-0359-4b0f-a826-93f6c3aa6373]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jnqFwdQU'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[473ce7d1-4d91-4fc4-817c-f849a3c13d18]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[47136abd-526c-48df-9e7e-550a560006c9]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:02:06 user nova-compute[72129]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)
Aug 01 14:02:06 user nova-compute[72129]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 (non-flash)
Aug 01 14:02:06 user nova-compute[72129]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d (non-flash)
Aug 01 14:02:06 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:02:06 user nova-compute[72129]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)
Aug 01 14:02:06 user nova-compute[72129]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 (non-flash)
Aug 01 14:02:06 user nova-compute[72129]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d (non-flash)
Aug 01 14:02:06 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 -p 172.16.0.220:3260 --login {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e172249-9d77-4fc1-819d-73f7aeeafbb5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8, portal: 172.16.0.220,3260]
Aug 01 14:02:06 user nova-compute[72129]: Login to [iface: default, target: iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8, portal: 172.16.0.220,3260] successful.
Aug 01 14:02:06 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[1840d06e-9632-4862-8cf7-8fb4603fb9cd]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c60ba2-dc69-4d4f-a6b5-4905dde2bbb5]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:02:06 user nova-compute[72129]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)
Aug 01 14:02:06 user nova-compute[72129]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 (non-flash)
Aug 01 14:02:06 user nova-compute[72129]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d (non-flash)
Aug 01 14:02:06 user nova-compute[72129]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)
Aug 01 14:02:06 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:02:06 user nova-compute[72129]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)
Aug 01 14:02:06 user nova-compute[72129]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 (non-flash)
Aug 01 14:02:06 user nova-compute[72129]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d (non-flash)
Aug 01 14:02:06 user nova-compute[72129]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)
Aug 01 14:02:06 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Connected to 172.16.0.220:3260 {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] HCTL ('37', '-', '-', 0) found on session 33 with lun 0 {{(pid=72129) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72129) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7ae1f2-0932-4257-9dfc-1fbe713bcbe3]: (4, ('- - 0', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Searching for a device in session 33 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 14:02:06 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jnqFwdQU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 14:02:07 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:02:07 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '23638393534323266', 'path': '/dev/sdf'} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:02:07 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23638393534323266', 'path': '/dev/sdf'} {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 14:02:07 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:01:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-320688111',display_name='tempest-ServerActionsTestOtherA-server-320688111',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-320688111',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMKxgVYWQdVKRLV+QIEDxsF4RC9I5wENeCwXhryJ2sr+8oNRgK2W8XmwhDYsUxLBCXzQXdaopDtUa2pfT9PfB2oRmI83WPjT6V3uSmwDrvE9fHgGK0Xxc5yPsVieUvlqoA==',key_name='tempest-keypair-1687158208',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b0e85d9b73a546dc95e0ace26233f2a7',ramdisk_id='',reservation_id='r-t03cme4n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1440097443',owner_user_name='tempest-ServerActionsTestOtherA-1440097443-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T14:01:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f35620862694e7295f782ab15e290a8',uuid=e4a13a50-fe03-41aa-94f4-3431805ff481,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a36283e1-929d-4806-ba5f-175f99f44e98", "address": "fa:16:3e:28:9b:e7", "network": {"id": "4b93ad92-9a3a-4472-ba6c-d215329da98b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-734108983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0e85d9b73a546dc95e0ace26233f2a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36283e1-92", "ovs_interfaceid": "a36283e1-929d-4806-ba5f-175f99f44e98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 14:02:07 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Converting VIF {"id": "a36283e1-929d-4806-ba5f-175f99f44e98", "address": "fa:16:3e:28:9b:e7", "network": {"id": "4b93ad92-9a3a-4472-ba6c-d215329da98b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-734108983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0e85d9b73a546dc95e0ace26233f2a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36283e1-92", "ovs_interfaceid": "a36283e1-929d-4806-ba5f-175f99f44e98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:02:07 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:9b:e7,bridge_name='br-int',has_traffic_filtering=True,id=a36283e1-929d-4806-ba5f-175f99f44e98,network=Network(4b93ad92-9a3a-4472-ba6c-d215329da98b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa36283e1-92') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:02:07 user nova-compute[72129]: DEBUG nova.objects.instance [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lazy-loading 'pci_devices' on Instance uuid e4a13a50-fe03-41aa-94f4-3431805ff481 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:02:07 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] End _get_guest_xml xml=<domain type="kvm">
Aug 01 14:02:07 user nova-compute[72129]:   <uuid>e4a13a50-fe03-41aa-94f4-3431805ff481</uuid>
Aug 01 14:02:07 user nova-compute[72129]:   <name>instance-0000001c</name>
Aug 01 14:02:07 user nova-compute[72129]:   <memory>524288</memory>
Aug 01 14:02:07 user nova-compute[72129]:   <vcpu>1</vcpu>
Aug 01 14:02:07 user nova-compute[72129]:   <metadata>
Aug 01 14:02:07 user nova-compute[72129]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 14:02:07 user nova-compute[72129]:       <nova:package version="0.0.0"/>
Aug 01 14:02:07 user nova-compute[72129]:       <nova:name>tempest-ServerActionsTestOtherA-server-320688111</nova:name>
Aug 01 14:02:07 user nova-compute[72129]:       <nova:creationTime>2023-08-01 14:02:06</nova:creationTime>
Aug 01 14:02:07 user nova-compute[72129]:       <nova:flavor name="m1.tiny">
Aug 01 14:02:07 user nova-compute[72129]:         <nova:memory>512</nova:memory>
Aug 01 14:02:07 user nova-compute[72129]:         <nova:disk>1</nova:disk>
Aug 01 14:02:07 user nova-compute[72129]:         <nova:swap>0</nova:swap>
Aug 01 14:02:07 user nova-compute[72129]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 14:02:07 user nova-compute[72129]:         <nova:vcpus>1</nova:vcpus>
Aug 01 14:02:07 user nova-compute[72129]:       </nova:flavor>
Aug 01 14:02:07 user nova-compute[72129]:       <nova:owner>
Aug 01 14:02:07 user nova-compute[72129]:         <nova:user uuid="1f35620862694e7295f782ab15e290a8">tempest-ServerActionsTestOtherA-1440097443-project-member</nova:user>
Aug 01 14:02:07 user nova-compute[72129]:         <nova:project uuid="b0e85d9b73a546dc95e0ace26233f2a7">tempest-ServerActionsTestOtherA-1440097443</nova:project>
Aug 01 14:02:07 user nova-compute[72129]:       </nova:owner>
Aug 01 14:02:07 user nova-compute[72129]:       <nova:ports>
Aug 01 14:02:07 user nova-compute[72129]:         <nova:port uuid="a36283e1-929d-4806-ba5f-175f99f44e98">
Aug 01 14:02:07 user nova-compute[72129]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 01 14:02:07 user nova-compute[72129]:         </nova:port>
Aug 01 14:02:07 user nova-compute[72129]:       </nova:ports>
Aug 01 14:02:07 user nova-compute[72129]:     </nova:instance>
Aug 01 14:02:07 user nova-compute[72129]:   </metadata>
Aug 01 14:02:07 user nova-compute[72129]:   <sysinfo type="smbios">
Aug 01 14:02:07 user nova-compute[72129]:     <system>
Aug 01 14:02:07 user nova-compute[72129]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 14:02:07 user nova-compute[72129]:       <entry name="product">OpenStack Nova</entry>
Aug 01 14:02:07 user nova-compute[72129]:       <entry name="version">0.0.0</entry>
Aug 01 14:02:07 user nova-compute[72129]:       <entry name="serial">e4a13a50-fe03-41aa-94f4-3431805ff481</entry>
Aug 01 14:02:07 user nova-compute[72129]:       <entry name="uuid">e4a13a50-fe03-41aa-94f4-3431805ff481</entry>
Aug 01 14:02:07 user nova-compute[72129]:       <entry name="family">Virtual Machine</entry>
Aug 01 14:02:07 user nova-compute[72129]:     </system>
Aug 01 14:02:07 user nova-compute[72129]:   </sysinfo>
Aug 01 14:02:07 user nova-compute[72129]:   <os>
Aug 01 14:02:07 user nova-compute[72129]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 14:02:07 user nova-compute[72129]:     <boot dev="hd"/>
Aug 01 14:02:07 user nova-compute[72129]:     <smbios mode="sysinfo"/>
Aug 01 14:02:07 user nova-compute[72129]:   </os>
Aug 01 14:02:07 user nova-compute[72129]:   <features>
Aug 01 14:02:07 user nova-compute[72129]:     <acpi/>
Aug 01 14:02:07 user nova-compute[72129]:     <apic/>
Aug 01 14:02:07 user nova-compute[72129]:     <vmcoreinfo/>
Aug 01 14:02:07 user nova-compute[72129]:   </features>
Aug 01 14:02:07 user nova-compute[72129]:   <clock offset="utc">
Aug 01 14:02:07 user nova-compute[72129]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 14:02:07 user nova-compute[72129]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 14:02:07 user nova-compute[72129]:     <timer name="hpet" present="no"/>
Aug 01 14:02:07 user nova-compute[72129]:   </clock>
Aug 01 14:02:07 user nova-compute[72129]:   <cpu mode="custom" match="exact">
Aug 01 14:02:07 user nova-compute[72129]:     <model>Nehalem</model>
Aug 01 14:02:07 user nova-compute[72129]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 14:02:07 user nova-compute[72129]:   </cpu>
Aug 01 14:02:07 user nova-compute[72129]:   <devices>
Aug 01 14:02:07 user nova-compute[72129]:     <disk type="block" device="disk">
Aug 01 14:02:07 user nova-compute[72129]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:02:07 user nova-compute[72129]:       <source dev="/dev/sdf"/>
Aug 01 14:02:07 user nova-compute[72129]:       <target dev="vda" bus="virtio"/>
Aug 01 14:02:07 user nova-compute[72129]:       <serial>58507a4b-e017-48d8-aeb1-8036a2a2a0a8</serial>
Aug 01 14:02:07 user nova-compute[72129]:     </disk>
Aug 01 14:02:07 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 14:02:07 user nova-compute[72129]:       <mac address="fa:16:3e:28:9b:e7"/>
Aug 01 14:02:07 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:02:07 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 14:02:07 user nova-compute[72129]:       <target dev="tapa36283e1-92"/>
Aug 01 14:02:07 user nova-compute[72129]:     </interface>
Aug 01 14:02:07 user nova-compute[72129]:     <serial type="pty">
Aug 01 14:02:07 user nova-compute[72129]:       <log file="/opt/stack/data/nova/instances/e4a13a50-fe03-41aa-94f4-3431805ff481/console.log" append="off"/>
Aug 01 14:02:07 user nova-compute[72129]:     </serial>
Aug 01 14:02:07 user nova-compute[72129]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 14:02:07 user nova-compute[72129]:     <video>
Aug 01 14:02:07 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:02:07 user nova-compute[72129]:     </video>
Aug 01 14:02:07 user nova-compute[72129]:     <rng model="virtio">
Aug 01 14:02:07 user nova-compute[72129]:       <backend model="random">/dev/urandom</backend>
Aug 01 14:02:07 user nova-compute[72129]:     </rng>
Aug 01 14:02:07 user nova-compute[72129]:     <controller type="usb" index="0" model="none"/>
Aug 01 14:02:07 user nova-compute[72129]:     <memballoon model="virtio">
Aug 01 14:02:07 user nova-compute[72129]:       <stats period="10"/>
Aug 01 14:02:07 user nova-compute[72129]:     </memballoon>
Aug 01 14:02:07 user nova-compute[72129]:   </devices>
Aug 01 14:02:07 user nova-compute[72129]: </domain>
Aug 01 14:02:07 user nova-compute[72129]:  {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 14:02:07 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:01:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-320688111',display_name='tempest-ServerActionsTestOtherA-server-320688111',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-320688111',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMKxgVYWQdVKRLV+QIEDxsF4RC9I5wENeCwXhryJ2sr+8oNRgK2W8XmwhDYsUxLBCXzQXdaopDtUa2pfT9PfB2oRmI83WPjT6V3uSmwDrvE9fHgGK0Xxc5yPsVieUvlqoA==',key_name='tempest-keypair-1687158208',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b0e85d9b73a546dc95e0ace26233f2a7',ramdisk_id='',reservation_id='r-t03cme4n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1440097443',owner_user_name='tempest-ServerActionsTestOtherA-1440097443-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T14:01:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f35620862694e7295f782ab15e290a8',uuid=e4a13a50-fe03-41aa-94f4-3431805ff481,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a36283e1-929d-4806-ba5f-175f99f44e98", "address": "fa:16:3e:28:9b:e7", "network": {"id": "4b93ad92-9a3a-4472-ba6c-d215329da98b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-734108983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0e85d9b73a546dc95e0ace26233f2a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36283e1-92", "ovs_interfaceid": "a36283e1-929d-4806-ba5f-175f99f44e98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 14:02:07 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Converting VIF {"id": "a36283e1-929d-4806-ba5f-175f99f44e98", "address": "fa:16:3e:28:9b:e7", "network": {"id": "4b93ad92-9a3a-4472-ba6c-d215329da98b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-734108983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0e85d9b73a546dc95e0ace26233f2a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36283e1-92", "ovs_interfaceid": "a36283e1-929d-4806-ba5f-175f99f44e98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:02:07 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:9b:e7,bridge_name='br-int',has_traffic_filtering=True,id=a36283e1-929d-4806-ba5f-175f99f44e98,network=Network(4b93ad92-9a3a-4472-ba6c-d215329da98b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa36283e1-92') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:02:07 user nova-compute[72129]: DEBUG os_vif [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:9b:e7,bridge_name='br-int',has_traffic_filtering=True,id=a36283e1-929d-4806-ba5f-175f99f44e98,network=Network(4b93ad92-9a3a-4472-ba6c-d215329da98b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa36283e1-92') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 14:02:07 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:02:07 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:02:07 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 14:02:07 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:02:07 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa36283e1-92, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:02:07 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa36283e1-92, col_values=(('external_ids', {'iface-id': 'a36283e1-929d-4806-ba5f-175f99f44e98', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:9b:e7', 'vm-uuid': 'e4a13a50-fe03-41aa-94f4-3431805ff481'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:02:07 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:02:07 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:02:07 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:02:07 user nova-compute[72129]: INFO os_vif [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:9b:e7,bridge_name='br-int',has_traffic_filtering=True,id=a36283e1-929d-4806-ba5f-175f99f44e98,network=Network(4b93ad92-9a3a-4472-ba6c-d215329da98b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa36283e1-92')
Aug 01 14:02:07 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:02:07 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] No VIF found with MAC fa:16:3e:28:9b:e7, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 14:02:08 user nova-compute[72129]: DEBUG nova.compute.manager [req-f38c5939-e1ba-4f85-a876-4e8c00631f3e req-2d6f468f-f817-41f6-ada4-0f71e4074de6 service nova] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Received event network-changed-ed105f30-6ea8-4e9d-aedc-44a11f2ae5d5 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:02:08 user nova-compute[72129]: DEBUG nova.compute.manager [req-f38c5939-e1ba-4f85-a876-4e8c00631f3e req-2d6f468f-f817-41f6-ada4-0f71e4074de6 service nova] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Refreshing instance network info cache due to event network-changed-ed105f30-6ea8-4e9d-aedc-44a11f2ae5d5. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 14:02:08 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f38c5939-e1ba-4f85-a876-4e8c00631f3e req-2d6f468f-f817-41f6-ada4-0f71e4074de6 service nova] Acquiring lock "refresh_cache-e2cf5877-55dd-44ce-9b58-b662afe8e62e" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:02:08 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f38c5939-e1ba-4f85-a876-4e8c00631f3e req-2d6f468f-f817-41f6-ada4-0f71e4074de6 service nova] Acquired lock "refresh_cache-e2cf5877-55dd-44ce-9b58-b662afe8e62e" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:02:08 user nova-compute[72129]: DEBUG nova.network.neutron [req-f38c5939-e1ba-4f85-a876-4e8c00631f3e req-2d6f468f-f817-41f6-ada4-0f71e4074de6 service nova] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Refreshing network info cache for port ed105f30-6ea8-4e9d-aedc-44a11f2ae5d5 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 14:02:08 user nova-compute[72129]: DEBUG nova.network.neutron [req-f38c5939-e1ba-4f85-a876-4e8c00631f3e req-2d6f468f-f817-41f6-ada4-0f71e4074de6 service nova] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Updated VIF entry in instance network info cache for port ed105f30-6ea8-4e9d-aedc-44a11f2ae5d5. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 14:02:08 user nova-compute[72129]: DEBUG nova.network.neutron [req-f38c5939-e1ba-4f85-a876-4e8c00631f3e req-2d6f468f-f817-41f6-ada4-0f71e4074de6 service nova] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Updating instance_info_cache with network_info: [{"id": "ed105f30-6ea8-4e9d-aedc-44a11f2ae5d5", "address": "fa:16:3e:18:48:0e", "network": {"id": "c31f34d8-03c6-40d0-868b-d82fdc9c5169", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1378125554-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "822d8992f146492cb98e0f57d42e0571", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped105f30-6e", "ovs_interfaceid": "ed105f30-6ea8-4e9d-aedc-44a11f2ae5d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:02:08 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f38c5939-e1ba-4f85-a876-4e8c00631f3e req-2d6f468f-f817-41f6-ada4-0f71e4074de6 service nova] Releasing lock "refresh_cache-e2cf5877-55dd-44ce-9b58-b662afe8e62e" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:02:09 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:02:09 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:02:09 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:02:09 user nova-compute[72129]: DEBUG nova.compute.manager [req-87a29782-ae5c-4cb8-b416-356797122957 req-b9cd5f65-37ba-4bb1-9085-ff71ae06476f service nova] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Received event network-vif-plugged-a36283e1-929d-4806-ba5f-175f99f44e98 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:02:09 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-87a29782-ae5c-4cb8-b416-356797122957 req-b9cd5f65-37ba-4bb1-9085-ff71ae06476f service nova] Acquiring lock "e4a13a50-fe03-41aa-94f4-3431805ff481-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:02:09 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-87a29782-ae5c-4cb8-b416-356797122957 req-b9cd5f65-37ba-4bb1-9085-ff71ae06476f service nova] Lock "e4a13a50-fe03-41aa-94f4-3431805ff481-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:02:09 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-87a29782-ae5c-4cb8-b416-356797122957 req-b9cd5f65-37ba-4bb1-9085-ff71ae06476f service nova] Lock "e4a13a50-fe03-41aa-94f4-3431805ff481-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:02:09 user nova-compute[72129]: DEBUG nova.compute.manager [req-87a29782-ae5c-4cb8-b416-356797122957 req-b9cd5f65-37ba-4bb1-9085-ff71ae06476f service nova] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] No waiting events found dispatching network-vif-plugged-a36283e1-929d-4806-ba5f-175f99f44e98 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:02:09 user nova-compute[72129]: WARNING nova.compute.manager [req-87a29782-ae5c-4cb8-b416-356797122957 req-b9cd5f65-37ba-4bb1-9085-ff71ae06476f service nova] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Received unexpected event network-vif-plugged-a36283e1-929d-4806-ba5f-175f99f44e98 for instance with vm_state building and task_state spawning.
Aug 01 14:02:09 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:02:09 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:02:10 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:02:11 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898531.2924201, e4a13a50-fe03-41aa-94f4-3431805ff481 => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:02:11 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] VM Resumed (Lifecycle Event)
Aug 01 14:02:11 user nova-compute[72129]: DEBUG nova.compute.manager [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Instance event wait completed in 0 seconds for  {{(pid=72129) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 14:02:11 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Guest created on hypervisor {{(pid=72129) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 14:02:11 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Instance spawned successfully.
Aug 01 14:02:11 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 14:02:11 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:02:11 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:02:11 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Found default for hw_cdrom_bus of ide {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:02:11 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Found default for hw_disk_bus of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:02:11 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Found default for hw_input_bus of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:02:11 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Found default for hw_pointer_model of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:02:11 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Found default for hw_video_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:02:11 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Found default for hw_vif_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:02:11 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 14:02:11 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898531.2936592, e4a13a50-fe03-41aa-94f4-3431805ff481 => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:02:11 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] VM Started (Lifecycle Event)
Aug 01 14:02:11 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:02:11 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:02:11 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 14:02:11 user nova-compute[72129]: INFO nova.compute.manager [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Took 5.00 seconds to spawn the instance on the hypervisor.
Aug 01 14:02:11 user nova-compute[72129]: DEBUG nova.compute.manager [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:02:11 user nova-compute[72129]: DEBUG nova.compute.manager [req-231d54a4-08ad-4d27-975d-e36dfb7b17ef req-2a01ac6f-73b8-4bf0-89a9-7ec3aadb154b service nova] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Received event network-vif-plugged-a36283e1-929d-4806-ba5f-175f99f44e98 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:02:11 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-231d54a4-08ad-4d27-975d-e36dfb7b17ef req-2a01ac6f-73b8-4bf0-89a9-7ec3aadb154b service nova] Acquiring lock "e4a13a50-fe03-41aa-94f4-3431805ff481-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:02:11 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-231d54a4-08ad-4d27-975d-e36dfb7b17ef req-2a01ac6f-73b8-4bf0-89a9-7ec3aadb154b service nova] Lock "e4a13a50-fe03-41aa-94f4-3431805ff481-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:02:11 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-231d54a4-08ad-4d27-975d-e36dfb7b17ef req-2a01ac6f-73b8-4bf0-89a9-7ec3aadb154b service nova] Lock "e4a13a50-fe03-41aa-94f4-3431805ff481-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:02:11 user nova-compute[72129]: DEBUG nova.compute.manager [req-231d54a4-08ad-4d27-975d-e36dfb7b17ef req-2a01ac6f-73b8-4bf0-89a9-7ec3aadb154b service nova] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] No waiting events found dispatching network-vif-plugged-a36283e1-929d-4806-ba5f-175f99f44e98 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:02:11 user nova-compute[72129]: WARNING nova.compute.manager [req-231d54a4-08ad-4d27-975d-e36dfb7b17ef req-2a01ac6f-73b8-4bf0-89a9-7ec3aadb154b service nova] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Received unexpected event network-vif-plugged-a36283e1-929d-4806-ba5f-175f99f44e98 for instance with vm_state building and task_state spawning.
Aug 01 14:02:11 user nova-compute[72129]: INFO nova.compute.manager [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Took 13.89 seconds to build instance.
Aug 01 14:02:11 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-6ce8e051-1935-4469-a35a-b68a36877d4f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "e4a13a50-fe03-41aa-94f4-3431805ff481" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:02:12 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-dcffa539-5ac3-4bfe-b2cb-e4105abeaf1d tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Acquiring lock "e2cf5877-55dd-44ce-9b58-b662afe8e62e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:02:12 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-dcffa539-5ac3-4bfe-b2cb-e4105abeaf1d tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lock "e2cf5877-55dd-44ce-9b58-b662afe8e62e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:02:12 user nova-compute[72129]: DEBUG nova.objects.instance [None req-dcffa539-5ac3-4bfe-b2cb-e4105abeaf1d tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lazy-loading 'flavor' on Instance uuid e2cf5877-55dd-44ce-9b58-b662afe8e62e {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:02:12 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:02:12 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-dcffa539-5ac3-4bfe-b2cb-e4105abeaf1d tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lock "e2cf5877-55dd-44ce-9b58-b662afe8e62e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:02:13 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-dcffa539-5ac3-4bfe-b2cb-e4105abeaf1d tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Acquiring lock "e2cf5877-55dd-44ce-9b58-b662afe8e62e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:02:13 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-dcffa539-5ac3-4bfe-b2cb-e4105abeaf1d tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lock "e2cf5877-55dd-44ce-9b58-b662afe8e62e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:02:13 user nova-compute[72129]: INFO nova.compute.manager [None req-dcffa539-5ac3-4bfe-b2cb-e4105abeaf1d tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Attaching volume 93cdeb70-e129-4049-8af2-7f89bbf4d853 to /dev/vdb
Aug 01 14:02:13 user nova-compute[72129]: DEBUG os_brick.utils [None req-dcffa539-5ac3-4bfe-b2cb-e4105abeaf1d tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:02:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:02:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:02:13 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d5408e-737a-4e93-b57f-369e15831819]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f9b449c2cd3d\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:02:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:02:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:02:13 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[110e195a-4d19-4d95-8096-1d5ee2f54c37]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:02:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:02:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:02:13 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57dcd9e-d8e3-4546-ba71-b7981ad7d2a5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:02:13 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6436b8b-0c74-4631-9ff9-78d08a52443a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:02:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-dcffa539-5ac3-4bfe-b2cb-e4105abeaf1d tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Running cmd (subprocess): nvme version {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:02:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-dcffa539-5ac3-4bfe-b2cb-e4105abeaf1d tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] 'nvme version' failed. Not Retrying. {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 14:02:13 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dcffa539-5ac3-4bfe-b2cb-e4105abeaf1d tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] nvme not present on system {{(pid=72129) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 14:02:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:02:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 14:02:13 user nova-compute[72129]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 14:02:13 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2745d8-f9ad-4bc7-baac-2e7aa2195285]: (4, '') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:02:13 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-dcffa539-5ac3-4bfe-b2cb-e4105abeaf1d tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72129) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 14:02:13 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-dcffa539-5ac3-4bfe-b2cb-e4105abeaf1d tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 14:02:13 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-dcffa539-5ac3-4bfe-b2cb-e4105abeaf1d tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] LIGHTOS: no hostnqn found. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 14:02:13 user nova-compute[72129]: DEBUG os_brick.utils [None req-dcffa539-5ac3-4bfe-b2cb-e4105abeaf1d tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f9b449c2cd3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:02:13 user nova-compute[72129]: DEBUG nova.virt.block_device [None req-dcffa539-5ac3-4bfe-b2cb-e4105abeaf1d tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Updating existing volume attachment record: bb5f4a9e-60eb-41b8-bb0e-b8f55c5230fb {{(pid=72129) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 14:02:15 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:02:17 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:02:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:02:20 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcffa539-5ac3-4bfe-b2cb-e4105abeaf1d tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Calling os-brick to attach iSCSI Volume {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 14:02:20 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcffa539-5ac3-4bfe-b2cb-e4105abeaf1d tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:93cdeb70-e129-4049-8af2-7f89bbf4d853'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aPSYqDMk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:02:20 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-dcffa539-5ac3-4bfe-b2cb-e4105abeaf1d tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:02:20 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-dcffa539-5ac3-4bfe-b2cb-e4105abeaf1d tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:02:20 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-dcffa539-5ac3-4bfe-b2cb-e4105abeaf1d tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:02:20 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-dcffa539-5ac3-4bfe-b2cb-e4105abeaf1d tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:02:20 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-dcffa539-5ac3-4bfe-b2cb-e4105abeaf1d tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93cdeb70-e129-4049-8af2-7f89bbf4d853" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:02:20 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-dcffa539-5ac3-4bfe-b2cb-e4105abeaf1d tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93cdeb70-e129-4049-8af2-7f89bbf4d853" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:02:20 user nova-compute[72129]: INFO os_brick.initiator.connectors.iscsi [None req-dcffa539-5ac3-4bfe-b2cb-e4105abeaf1d tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 14:02:20 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93cdeb70-e129-4049-8af2-7f89bbf4d853 -p 172.16.0.220:3260 {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:02:21 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93cdeb70-e129-4049-8af2-7f89bbf4d853 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:02:21 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[0695d8df-71b7-4b17-b1ac-e66ec7257cbc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:02:21 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcffa539-5ac3-4bfe-b2cb-e4105abeaf1d tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 14:02:21 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:02:21 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93cdeb70-e129-4049-8af2-7f89bbf4d853 -p 172.16.0.220:3260 --interface default --op new {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:02:21 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93cdeb70-e129-4049-8af2-7f89bbf4d853 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:02:21 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad51191-fd24-47ec-b046-40d69e6d00a9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:93cdeb70-e129-4049-8af2-7f89bbf4d853] added\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:02:21 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcffa539-5ac3-4bfe-b2cb-e4105abeaf1d tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:93cdeb70-e129-4049-8af2-7f89bbf4d853] added
Aug 01 14:02:21 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:02:21 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93cdeb70-e129-4049-8af2-7f89bbf4d853 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:02:21 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93cdeb70-e129-4049-8af2-7f89bbf4d853 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:02:21 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab3f0b8-de7b-44f7-bef4-49f01d24193d]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:02:21 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcffa539-5ac3-4bfe-b2cb-e4105abeaf1d tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:02:21 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93cdeb70-e129-4049-8af2-7f89bbf4d853 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:02:21 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93cdeb70-e129-4049-8af2-7f89bbf4d853 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.072s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:02:21 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a3d384-28dd-44cd-b20e-6c91c37bb59f]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:02:21 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcffa539-5ac3-4bfe-b2cb-e4105abeaf1d tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:02:21 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93cdeb70-e129-4049-8af2-7f89bbf4d853 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aPSYqDMk {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:02:21 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93cdeb70-e129-4049-8af2-7f89bbf4d853 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aPSYqDMk" returned: 0 in 0.027s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:02:21 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[e976033b-b8f0-4c16-8b0b-44a5907f0edc]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:02:21 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcffa539-5ac3-4bfe-b2cb-e4105abeaf1d tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aPSYqDMk'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:02:21 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93cdeb70-e129-4049-8af2-7f89bbf4d853 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:02:21 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93cdeb70-e129-4049-8af2-7f89bbf4d853 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:02:21 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf97a34c-b173-49e6-afd1-8ad80cd509fa]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:02:21 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcffa539-5ac3-4bfe-b2cb-e4105abeaf1d tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:02:21 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:02:21 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:02:21 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[440ab819-462b-45e5-96d3-53c9a166a5d4]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:02:21 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcffa539-5ac3-4bfe-b2cb-e4105abeaf1d tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:02:21 user nova-compute[72129]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)
Aug 01 14:02:21 user nova-compute[72129]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 (non-flash)
Aug 01 14:02:21 user nova-compute[72129]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d (non-flash)
Aug 01 14:02:21 user nova-compute[72129]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)
Aug 01 14:02:21 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:02:21 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcffa539-5ac3-4bfe-b2cb-e4105abeaf1d tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:02:21 user nova-compute[72129]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)
Aug 01 14:02:21 user nova-compute[72129]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 (non-flash)
Aug 01 14:02:21 user nova-compute[72129]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d (non-flash)
Aug 01 14:02:21 user nova-compute[72129]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)
Aug 01 14:02:21 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:02:21 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93cdeb70-e129-4049-8af2-7f89bbf4d853 -p 172.16.0.220:3260 --login {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:02:21 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93cdeb70-e129-4049-8af2-7f89bbf4d853 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:02:21 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[186bd26e-31cb-47dc-9f21-31bd3a408c89]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:93cdeb70-e129-4049-8af2-7f89bbf4d853, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:93cdeb70-e129-4049-8af2-7f89bbf4d853, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:02:21 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcffa539-5ac3-4bfe-b2cb-e4105abeaf1d tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:93cdeb70-e129-4049-8af2-7f89bbf4d853, portal: 172.16.0.220,3260]
Aug 01 14:02:21 user nova-compute[72129]: Login to [iface: default, target: iqn.2010-10.org.openstack:93cdeb70-e129-4049-8af2-7f89bbf4d853, portal: 172.16.0.220,3260] successful.
Aug 01 14:02:21 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:02:21 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93cdeb70-e129-4049-8af2-7f89bbf4d853 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:02:21 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93cdeb70-e129-4049-8af2-7f89bbf4d853 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:02:21 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[548da351-47af-4fbe-a91c-b6581cce33e4]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:02:21 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcffa539-5ac3-4bfe-b2cb-e4105abeaf1d tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:02:21 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:02:21 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:02:21 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5748cae-dd28-428f-82b6-95d524de49e9]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93cdeb70-e129-4049-8af2-7f89bbf4d853 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:02:21 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcffa539-5ac3-4bfe-b2cb-e4105abeaf1d tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:02:21 user nova-compute[72129]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)
Aug 01 14:02:21 user nova-compute[72129]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 (non-flash)
Aug 01 14:02:21 user nova-compute[72129]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d (non-flash)
Aug 01 14:02:21 user nova-compute[72129]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)
Aug 01 14:02:21 user nova-compute[72129]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93cdeb70-e129-4049-8af2-7f89bbf4d853 (non-flash)
Aug 01 14:02:21 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:02:21 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcffa539-5ac3-4bfe-b2cb-e4105abeaf1d tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:02:21 user nova-compute[72129]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)
Aug 01 14:02:21 user nova-compute[72129]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 (non-flash)
Aug 01 14:02:21 user nova-compute[72129]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d (non-flash)
Aug 01 14:02:21 user nova-compute[72129]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)
Aug 01 14:02:21 user nova-compute[72129]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93cdeb70-e129-4049-8af2-7f89bbf4d853 (non-flash)
Aug 01 14:02:21 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:02:21 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-dcffa539-5ac3-4bfe-b2cb-e4105abeaf1d tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93cdeb70-e129-4049-8af2-7f89bbf4d853" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.364s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:02:21 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcffa539-5ac3-4bfe-b2cb-e4105abeaf1d tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Connected to 172.16.0.220:3260 {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 14:02:21 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-dcffa539-5ac3-4bfe-b2cb-e4105abeaf1d tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] HCTL ('38', '-', '-', 0) found on session 34 with lun 0 {{(pid=72129) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 14:02:21 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-dcffa539-5ac3-4bfe-b2cb-e4105abeaf1d tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72129) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 14:02:21 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:02:21 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:02:21 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2579b2b-a834-4932-9238-0b5c58901862]: (4, ('- - 0', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:02:21 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-dcffa539-5ac3-4bfe-b2cb-e4105abeaf1d tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Searching for a device in session 34 and hctl ['38', '*', '*', 0] yield: None {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 14:02:22 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-dcffa539-5ac3-4bfe-b2cb-e4105abeaf1d tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Searching for a device in session 34 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 14:02:22 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcffa539-5ac3-4bfe-b2cb-e4105abeaf1d tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aPSYqDMk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 14:02:22 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-dcffa539-5ac3-4bfe-b2cb-e4105abeaf1d tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.396s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:02:22 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcffa539-5ac3-4bfe-b2cb-e4105abeaf1d tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] <== connect_volume: return (1398ms) {'type': 'block', 'scsi_wwn': '23835353261303666', 'path': '/dev/sdg'} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:02:22 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcffa539-5ac3-4bfe-b2cb-e4105abeaf1d tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23835353261303666', 'path': '/dev/sdg'} {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 14:02:22 user nova-compute[72129]: DEBUG nova.objects.instance [None req-dcffa539-5ac3-4bfe-b2cb-e4105abeaf1d tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lazy-loading 'flavor' on Instance uuid e2cf5877-55dd-44ce-9b58-b662afe8e62e {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:02:22 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-dcffa539-5ac3-4bfe-b2cb-e4105abeaf1d tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 14:02:22 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:02:22 user nova-compute[72129]:   <source dev="/dev/sdg"/>
Aug 01 14:02:22 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 14:02:22 user nova-compute[72129]:   <serial>93cdeb70-e129-4049-8af2-7f89bbf4d853</serial>
Aug 01 14:02:22 user nova-compute[72129]: </disk>
Aug 01 14:02:22 user nova-compute[72129]:  {{(pid=72129) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 14:02:22 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-dcffa539-5ac3-4bfe-b2cb-e4105abeaf1d tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:02:22 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-dcffa539-5ac3-4bfe-b2cb-e4105abeaf1d tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:02:22 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-dcffa539-5ac3-4bfe-b2cb-e4105abeaf1d tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] No VIF found with MAC fa:16:3e:18:48:0e, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 14:02:22 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:02:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-dcffa539-5ac3-4bfe-b2cb-e4105abeaf1d tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lock "e2cf5877-55dd-44ce-9b58-b662afe8e62e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.942s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:02:25 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:02:27 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:02:28 user nova-compute[72129]: DEBUG nova.compute.manager [req-0a76676b-6293-4b63-92dc-6e7f90782fcb req-d0f89a20-4e0c-4f14-8eec-5d305f9c7917 service nova] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] Received event network-changed-f6944a05-0ad8-4f1a-b849-0dbb7732b739 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:02:28 user nova-compute[72129]: DEBUG nova.compute.manager [req-0a76676b-6293-4b63-92dc-6e7f90782fcb req-d0f89a20-4e0c-4f14-8eec-5d305f9c7917 service nova] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] Refreshing instance network info cache due to event network-changed-f6944a05-0ad8-4f1a-b849-0dbb7732b739. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 14:02:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-0a76676b-6293-4b63-92dc-6e7f90782fcb req-d0f89a20-4e0c-4f14-8eec-5d305f9c7917 service nova] Acquiring lock "refresh_cache-954db8d6-4806-43e6-8310-5d7f3437dc71" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:02:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-0a76676b-6293-4b63-92dc-6e7f90782fcb req-d0f89a20-4e0c-4f14-8eec-5d305f9c7917 service nova] Acquired lock "refresh_cache-954db8d6-4806-43e6-8310-5d7f3437dc71" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:02:28 user nova-compute[72129]: DEBUG nova.network.neutron [req-0a76676b-6293-4b63-92dc-6e7f90782fcb req-d0f89a20-4e0c-4f14-8eec-5d305f9c7917 service nova] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] Refreshing network info cache for port f6944a05-0ad8-4f1a-b849-0dbb7732b739 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 14:02:29 user nova-compute[72129]: DEBUG nova.network.neutron [req-0a76676b-6293-4b63-92dc-6e7f90782fcb req-d0f89a20-4e0c-4f14-8eec-5d305f9c7917 service nova] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] Updated VIF entry in instance network info cache for port f6944a05-0ad8-4f1a-b849-0dbb7732b739. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 14:02:29 user nova-compute[72129]: DEBUG nova.network.neutron [req-0a76676b-6293-4b63-92dc-6e7f90782fcb req-d0f89a20-4e0c-4f14-8eec-5d305f9c7917 service nova] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] Updating instance_info_cache with network_info: [{"id": "f6944a05-0ad8-4f1a-b849-0dbb7732b739", "address": "fa:16:3e:b7:4f:45", "network": {"id": "a7f4226b-73fe-4265-ba2c-5d7dcdf154fd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1142462884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210837255c8148ec9b482ba3e2551362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6944a05-0a", "ovs_interfaceid": "f6944a05-0ad8-4f1a-b849-0dbb7732b739", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:02:29 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-0a76676b-6293-4b63-92dc-6e7f90782fcb req-d0f89a20-4e0c-4f14-8eec-5d305f9c7917 service nova] Releasing lock "refresh_cache-954db8d6-4806-43e6-8310-5d7f3437dc71" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:02:30 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:02:32 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:02:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Acquiring lock "0c43fda3-e098-4c3a-bcd5-14eac019db06" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:02:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "0c43fda3-e098-4c3a-bcd5-14eac019db06" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:02:34 user nova-compute[72129]: DEBUG nova.compute.manager [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Starting instance... {{(pid=72129) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 14:02:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:02:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:02:34 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72129) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 14:02:34 user nova-compute[72129]: INFO nova.compute.claims [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Claim successful on node user
Aug 01 14:02:34 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:02:34 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:02:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.421s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:02:34 user nova-compute[72129]: DEBUG nova.compute.manager [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Start building networks asynchronously for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 14:02:34 user nova-compute[72129]: DEBUG nova.compute.manager [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Allocating IP information in the background. {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 14:02:34 user nova-compute[72129]: DEBUG nova.network.neutron [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] allocate_for_instance() {{(pid=72129) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 14:02:34 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 14:02:34 user nova-compute[72129]: DEBUG nova.compute.manager [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Start building block device mappings for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 14:02:34 user nova-compute[72129]: DEBUG nova.policy [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cdb6f66592fe4cdebea02e5f5c1f4a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0929886fa54d1c8023793806f10d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72129) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 14:02:34 user nova-compute[72129]: DEBUG nova.compute.manager [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Start spawning the instance on the hypervisor. {{(pid=72129) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 14:02:34 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Creating instance directory {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 14:02:34 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Creating image(s)
Aug 01 14:02:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Acquiring lock "/opt/stack/data/nova/instances/0c43fda3-e098-4c3a-bcd5-14eac019db06/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:02:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "/opt/stack/data/nova/instances/0c43fda3-e098-4c3a-bcd5-14eac019db06/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:02:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "/opt/stack/data/nova/instances/0c43fda3-e098-4c3a-bcd5-14eac019db06/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:02:35 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:02:35 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.142s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:02:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Acquiring lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:02:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:02:35 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:02:35 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.149s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:02:35 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/0c43fda3-e098-4c3a-bcd5-14eac019db06/disk 1073741824 {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:02:35 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/0c43fda3-e098-4c3a-bcd5-14eac019db06/disk 1073741824" returned: 0 in 0.050s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:02:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.206s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:02:35 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:02:35 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.141s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:02:35 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0c43fda3-e098-4c3a-bcd5-14eac019db06/disk. size=1073741824 {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 14:02:35 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c43fda3-e098-4c3a-bcd5-14eac019db06/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:02:35 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c43fda3-e098-4c3a-bcd5-14eac019db06/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:02:35 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Cannot resize image /opt/stack/data/nova/instances/0c43fda3-e098-4c3a-bcd5-14eac019db06/disk to a smaller size. {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 14:02:35 user nova-compute[72129]: DEBUG nova.objects.instance [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lazy-loading 'migration_context' on Instance uuid 0c43fda3-e098-4c3a-bcd5-14eac019db06 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:02:35 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Created local disks {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 14:02:35 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Ensure instance console log exists: /opt/stack/data/nova/instances/0c43fda3-e098-4c3a-bcd5-14eac019db06/console.log {{(pid=72129) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 14:02:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:02:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:02:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:02:35 user nova-compute[72129]: DEBUG nova.network.neutron [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Successfully created port: 42cfd021-0c3b-4c75-8758-1cf73c652fa4 {{(pid=72129) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 14:02:35 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:02:36 user nova-compute[72129]: DEBUG nova.network.neutron [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Successfully updated port: 42cfd021-0c3b-4c75-8758-1cf73c652fa4 {{(pid=72129) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 14:02:36 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Acquiring lock "refresh_cache-0c43fda3-e098-4c3a-bcd5-14eac019db06" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:02:36 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Acquired lock "refresh_cache-0c43fda3-e098-4c3a-bcd5-14eac019db06" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:02:36 user nova-compute[72129]: DEBUG nova.network.neutron [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 14:02:36 user nova-compute[72129]: DEBUG nova.compute.manager [req-9b5e794e-7902-4703-b301-8db0d1fbcfb6 req-ec502ee7-7a73-4e99-86e1-ddf1db079f88 service nova] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Received event network-changed-42cfd021-0c3b-4c75-8758-1cf73c652fa4 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:02:36 user nova-compute[72129]: DEBUG nova.compute.manager [req-9b5e794e-7902-4703-b301-8db0d1fbcfb6 req-ec502ee7-7a73-4e99-86e1-ddf1db079f88 service nova] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Refreshing instance network info cache due to event network-changed-42cfd021-0c3b-4c75-8758-1cf73c652fa4. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 14:02:36 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-9b5e794e-7902-4703-b301-8db0d1fbcfb6 req-ec502ee7-7a73-4e99-86e1-ddf1db079f88 service nova] Acquiring lock "refresh_cache-0c43fda3-e098-4c3a-bcd5-14eac019db06" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:02:36 user nova-compute[72129]: DEBUG nova.network.neutron [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Instance cache missing network info. {{(pid=72129) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 14:02:36 user nova-compute[72129]: DEBUG nova.network.neutron [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Updating instance_info_cache with network_info: [{"id": "42cfd021-0c3b-4c75-8758-1cf73c652fa4", "address": "fa:16:3e:d5:f1:da", "network": {"id": "59b1e538-8bfe-45ce-ab7b-c5838ab25582", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1129024349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0929886fa54d1c8023793806f10d31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42cfd021-0c", "ovs_interfaceid": "42cfd021-0c3b-4c75-8758-1cf73c652fa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:02:36 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Releasing lock "refresh_cache-0c43fda3-e098-4c3a-bcd5-14eac019db06" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:02:36 user nova-compute[72129]: DEBUG nova.compute.manager [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Instance network_info: |[{"id": "42cfd021-0c3b-4c75-8758-1cf73c652fa4", "address": "fa:16:3e:d5:f1:da", "network": {"id": "59b1e538-8bfe-45ce-ab7b-c5838ab25582", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1129024349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0929886fa54d1c8023793806f10d31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42cfd021-0c", "ovs_interfaceid": "42cfd021-0c3b-4c75-8758-1cf73c652fa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 14:02:36 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-9b5e794e-7902-4703-b301-8db0d1fbcfb6 req-ec502ee7-7a73-4e99-86e1-ddf1db079f88 service nova] Acquired lock "refresh_cache-0c43fda3-e098-4c3a-bcd5-14eac019db06" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:02:36 user nova-compute[72129]: DEBUG nova.network.neutron [req-9b5e794e-7902-4703-b301-8db0d1fbcfb6 req-ec502ee7-7a73-4e99-86e1-ddf1db079f88 service nova] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Refreshing network info cache for port 42cfd021-0c3b-4c75-8758-1cf73c652fa4 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 14:02:37 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Start _get_guest_xml network_info=[{"id": "42cfd021-0c3b-4c75-8758-1cf73c652fa4", "address": "fa:16:3e:d5:f1:da", "network": {"id": "59b1e538-8bfe-45ce-ab7b-c5838ab25582", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1129024349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0929886fa54d1c8023793806f10d31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42cfd021-0c", "ovs_interfaceid": "42cfd021-0c3b-4c75-8758-1cf73c652fa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'image_id': 'b6472c34-1b0f-4034-ba3a-7e8eb5103715'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 14:02:37 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:02:37 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:02:37 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 14:02:37 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] CPU controller missing on host. {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 14:02:37 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 14:02:37 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] CPU controller found on host. {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 14:02:37 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72129) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 14:02:37 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T13:45:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 14:02:37 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Flavor limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 14:02:37 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Image limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 14:02:37 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Flavor pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 14:02:37 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Image pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 14:02:37 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 14:02:37 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 14:02:37 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 14:02:37 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Got 1 possible topologies {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 14:02:37 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 14:02:37 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 14:02:37 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:02:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-675723724',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-675723724',id=29,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e0929886fa54d1c8023793806f10d31',ramdisk_id='',reservation_id='r-si6hyw7f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1414609013',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T14:02:35Z,user_data=None,user_id='cdb6f66592fe4cdebea02e5f5c1f4a60',uuid=0c43fda3-e098-4c3a-bcd5-14eac019db06,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "42cfd021-0c3b-4c75-8758-1cf73c652fa4", "address": "fa:16:3e:d5:f1:da", "network": {"id": "59b1e538-8bfe-45ce-ab7b-c5838ab25582", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1129024349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0929886fa54d1c8023793806f10d31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42cfd021-0c", "ovs_interfaceid": "42cfd021-0c3b-4c75-8758-1cf73c652fa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 14:02:37 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Converting VIF {"id": "42cfd021-0c3b-4c75-8758-1cf73c652fa4", "address": "fa:16:3e:d5:f1:da", "network": {"id": "59b1e538-8bfe-45ce-ab7b-c5838ab25582", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1129024349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0929886fa54d1c8023793806f10d31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42cfd021-0c", "ovs_interfaceid": "42cfd021-0c3b-4c75-8758-1cf73c652fa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:02:37 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:f1:da,bridge_name='br-int',has_traffic_filtering=True,id=42cfd021-0c3b-4c75-8758-1cf73c652fa4,network=Network(59b1e538-8bfe-45ce-ab7b-c5838ab25582),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42cfd021-0c') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:02:37 user nova-compute[72129]: DEBUG nova.objects.instance [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lazy-loading 'pci_devices' on Instance uuid 0c43fda3-e098-4c3a-bcd5-14eac019db06 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:02:37 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] End _get_guest_xml xml=<domain type="kvm">
Aug 01 14:02:37 user nova-compute[72129]:   <uuid>0c43fda3-e098-4c3a-bcd5-14eac019db06</uuid>
Aug 01 14:02:37 user nova-compute[72129]:   <name>instance-0000001d</name>
Aug 01 14:02:37 user nova-compute[72129]:   <memory>524288</memory>
Aug 01 14:02:37 user nova-compute[72129]:   <vcpu>1</vcpu>
Aug 01 14:02:37 user nova-compute[72129]:   <metadata>
Aug 01 14:02:37 user nova-compute[72129]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 14:02:37 user nova-compute[72129]:       <nova:package version="0.0.0"/>
Aug 01 14:02:37 user nova-compute[72129]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-675723724</nova:name>
Aug 01 14:02:37 user nova-compute[72129]:       <nova:creationTime>2023-08-01 14:02:37</nova:creationTime>
Aug 01 14:02:37 user nova-compute[72129]:       <nova:flavor name="m1.tiny">
Aug 01 14:02:37 user nova-compute[72129]:         <nova:memory>512</nova:memory>
Aug 01 14:02:37 user nova-compute[72129]:         <nova:disk>1</nova:disk>
Aug 01 14:02:37 user nova-compute[72129]:         <nova:swap>0</nova:swap>
Aug 01 14:02:37 user nova-compute[72129]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 14:02:37 user nova-compute[72129]:         <nova:vcpus>1</nova:vcpus>
Aug 01 14:02:37 user nova-compute[72129]:       </nova:flavor>
Aug 01 14:02:37 user nova-compute[72129]:       <nova:owner>
Aug 01 14:02:37 user nova-compute[72129]:         <nova:user uuid="cdb6f66592fe4cdebea02e5f5c1f4a60">tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member</nova:user>
Aug 01 14:02:37 user nova-compute[72129]:         <nova:project uuid="1e0929886fa54d1c8023793806f10d31">tempest-ServerBootFromVolumeStableRescueTest-1414609013</nova:project>
Aug 01 14:02:37 user nova-compute[72129]:       </nova:owner>
Aug 01 14:02:37 user nova-compute[72129]:       <nova:root type="image" uuid="b6472c34-1b0f-4034-ba3a-7e8eb5103715"/>
Aug 01 14:02:37 user nova-compute[72129]:       <nova:ports>
Aug 01 14:02:37 user nova-compute[72129]:         <nova:port uuid="42cfd021-0c3b-4c75-8758-1cf73c652fa4">
Aug 01 14:02:37 user nova-compute[72129]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 01 14:02:37 user nova-compute[72129]:         </nova:port>
Aug 01 14:02:37 user nova-compute[72129]:       </nova:ports>
Aug 01 14:02:37 user nova-compute[72129]:     </nova:instance>
Aug 01 14:02:37 user nova-compute[72129]:   </metadata>
Aug 01 14:02:37 user nova-compute[72129]:   <sysinfo type="smbios">
Aug 01 14:02:37 user nova-compute[72129]:     <system>
Aug 01 14:02:37 user nova-compute[72129]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 14:02:37 user nova-compute[72129]:       <entry name="product">OpenStack Nova</entry>
Aug 01 14:02:37 user nova-compute[72129]:       <entry name="version">0.0.0</entry>
Aug 01 14:02:37 user nova-compute[72129]:       <entry name="serial">0c43fda3-e098-4c3a-bcd5-14eac019db06</entry>
Aug 01 14:02:37 user nova-compute[72129]:       <entry name="uuid">0c43fda3-e098-4c3a-bcd5-14eac019db06</entry>
Aug 01 14:02:37 user nova-compute[72129]:       <entry name="family">Virtual Machine</entry>
Aug 01 14:02:37 user nova-compute[72129]:     </system>
Aug 01 14:02:37 user nova-compute[72129]:   </sysinfo>
Aug 01 14:02:37 user nova-compute[72129]:   <os>
Aug 01 14:02:37 user nova-compute[72129]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 14:02:37 user nova-compute[72129]:     <boot dev="hd"/>
Aug 01 14:02:37 user nova-compute[72129]:     <smbios mode="sysinfo"/>
Aug 01 14:02:37 user nova-compute[72129]:   </os>
Aug 01 14:02:37 user nova-compute[72129]:   <features>
Aug 01 14:02:37 user nova-compute[72129]:     <acpi/>
Aug 01 14:02:37 user nova-compute[72129]:     <apic/>
Aug 01 14:02:37 user nova-compute[72129]:     <vmcoreinfo/>
Aug 01 14:02:37 user nova-compute[72129]:   </features>
Aug 01 14:02:37 user nova-compute[72129]:   <clock offset="utc">
Aug 01 14:02:37 user nova-compute[72129]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 14:02:37 user nova-compute[72129]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 14:02:37 user nova-compute[72129]:     <timer name="hpet" present="no"/>
Aug 01 14:02:37 user nova-compute[72129]:   </clock>
Aug 01 14:02:37 user nova-compute[72129]:   <cpu mode="custom" match="exact">
Aug 01 14:02:37 user nova-compute[72129]:     <model>Nehalem</model>
Aug 01 14:02:37 user nova-compute[72129]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 14:02:37 user nova-compute[72129]:   </cpu>
Aug 01 14:02:37 user nova-compute[72129]:   <devices>
Aug 01 14:02:37 user nova-compute[72129]:     <disk type="file" device="disk">
Aug 01 14:02:37 user nova-compute[72129]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 14:02:37 user nova-compute[72129]:       <source file="/opt/stack/data/nova/instances/0c43fda3-e098-4c3a-bcd5-14eac019db06/disk"/>
Aug 01 14:02:37 user nova-compute[72129]:       <target dev="vda" bus="virtio"/>
Aug 01 14:02:37 user nova-compute[72129]:     </disk>
Aug 01 14:02:37 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 14:02:37 user nova-compute[72129]:       <mac address="fa:16:3e:d5:f1:da"/>
Aug 01 14:02:37 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:02:37 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 14:02:37 user nova-compute[72129]:       <target dev="tap42cfd021-0c"/>
Aug 01 14:02:37 user nova-compute[72129]:     </interface>
Aug 01 14:02:37 user nova-compute[72129]:     <serial type="pty">
Aug 01 14:02:37 user nova-compute[72129]:       <log file="/opt/stack/data/nova/instances/0c43fda3-e098-4c3a-bcd5-14eac019db06/console.log" append="off"/>
Aug 01 14:02:37 user nova-compute[72129]:     </serial>
Aug 01 14:02:37 user nova-compute[72129]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 14:02:37 user nova-compute[72129]:     <video>
Aug 01 14:02:37 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:02:37 user nova-compute[72129]:     </video>
Aug 01 14:02:37 user nova-compute[72129]:     <rng model="virtio">
Aug 01 14:02:37 user nova-compute[72129]:       <backend model="random">/dev/urandom</backend>
Aug 01 14:02:37 user nova-compute[72129]:     </rng>
Aug 01 14:02:37 user nova-compute[72129]:     <controller type="usb" index="0" model="none"/>
Aug 01 14:02:37 user nova-compute[72129]:     <memballoon model="virtio">
Aug 01 14:02:37 user nova-compute[72129]:       <stats period="10"/>
Aug 01 14:02:37 user nova-compute[72129]:     </memballoon>
Aug 01 14:02:37 user nova-compute[72129]:   </devices>
Aug 01 14:02:37 user nova-compute[72129]: </domain>
Aug 01 14:02:37 user nova-compute[72129]:  {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 14:02:37 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:02:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-675723724',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-675723724',id=29,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e0929886fa54d1c8023793806f10d31',ramdisk_id='',reservation_id='r-si6hyw7f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1414609013',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T14:02:35Z,user_data=None,user_id='cdb6f66592fe4cdebea02e5f5c1f4a60',uuid=0c43fda3-e098-4c3a-bcd5-14eac019db06,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "42cfd021-0c3b-4c75-8758-1cf73c652fa4", "address": "fa:16:3e:d5:f1:da", "network": {"id": "59b1e538-8bfe-45ce-ab7b-c5838ab25582", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1129024349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0929886fa54d1c8023793806f10d31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42cfd021-0c", "ovs_interfaceid": "42cfd021-0c3b-4c75-8758-1cf73c652fa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 14:02:37 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Converting VIF {"id": "42cfd021-0c3b-4c75-8758-1cf73c652fa4", "address": "fa:16:3e:d5:f1:da", "network": {"id": "59b1e538-8bfe-45ce-ab7b-c5838ab25582", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1129024349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0929886fa54d1c8023793806f10d31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42cfd021-0c", "ovs_interfaceid": "42cfd021-0c3b-4c75-8758-1cf73c652fa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:02:37 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:f1:da,bridge_name='br-int',has_traffic_filtering=True,id=42cfd021-0c3b-4c75-8758-1cf73c652fa4,network=Network(59b1e538-8bfe-45ce-ab7b-c5838ab25582),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42cfd021-0c') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:02:37 user nova-compute[72129]: DEBUG os_vif [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:f1:da,bridge_name='br-int',has_traffic_filtering=True,id=42cfd021-0c3b-4c75-8758-1cf73c652fa4,network=Network(59b1e538-8bfe-45ce-ab7b-c5838ab25582),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42cfd021-0c') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 14:02:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:02:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:02:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 14:02:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:02:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap42cfd021-0c, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:02:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap42cfd021-0c, col_values=(('external_ids', {'iface-id': '42cfd021-0c3b-4c75-8758-1cf73c652fa4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:f1:da', 'vm-uuid': '0c43fda3-e098-4c3a-bcd5-14eac019db06'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:02:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:02:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:02:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:02:37 user nova-compute[72129]: INFO os_vif [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:f1:da,bridge_name='br-int',has_traffic_filtering=True,id=42cfd021-0c3b-4c75-8758-1cf73c652fa4,network=Network(59b1e538-8bfe-45ce-ab7b-c5838ab25582),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42cfd021-0c')
Aug 01 14:02:37 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:02:37 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] No VIF found with MAC fa:16:3e:d5:f1:da, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 14:02:37 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Acquiring lock "6dec0529-4dfb-4bc4-b8a1-b7e5f484535a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:02:37 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "6dec0529-4dfb-4bc4-b8a1-b7e5f484535a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:02:37 user nova-compute[72129]: DEBUG nova.network.neutron [req-9b5e794e-7902-4703-b301-8db0d1fbcfb6 req-ec502ee7-7a73-4e99-86e1-ddf1db079f88 service nova] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Updated VIF entry in instance network info cache for port 42cfd021-0c3b-4c75-8758-1cf73c652fa4. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 14:02:37 user nova-compute[72129]: DEBUG nova.network.neutron [req-9b5e794e-7902-4703-b301-8db0d1fbcfb6 req-ec502ee7-7a73-4e99-86e1-ddf1db079f88 service nova] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Updating instance_info_cache with network_info: [{"id": "42cfd021-0c3b-4c75-8758-1cf73c652fa4", "address": "fa:16:3e:d5:f1:da", "network": {"id": "59b1e538-8bfe-45ce-ab7b-c5838ab25582", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1129024349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0929886fa54d1c8023793806f10d31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42cfd021-0c", "ovs_interfaceid": "42cfd021-0c3b-4c75-8758-1cf73c652fa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:02:37 user nova-compute[72129]: DEBUG nova.compute.manager [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] Starting instance... {{(pid=72129) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 14:02:37 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-9b5e794e-7902-4703-b301-8db0d1fbcfb6 req-ec502ee7-7a73-4e99-86e1-ddf1db079f88 service nova] Releasing lock "refresh_cache-0c43fda3-e098-4c3a-bcd5-14eac019db06" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:02:37 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:02:37 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:02:37 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72129) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 14:02:37 user nova-compute[72129]: INFO nova.compute.claims [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] Claim successful on node user
Aug 01 14:02:37 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:02:37 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:02:38 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.445s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:02:38 user nova-compute[72129]: DEBUG nova.compute.manager [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] Start building networks asynchronously for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 14:02:38 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 14:02:38 user nova-compute[72129]: DEBUG nova.compute.manager [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] Allocating IP information in the background. {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 14:02:38 user nova-compute[72129]: DEBUG nova.network.neutron [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] allocate_for_instance() {{(pid=72129) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 14:02:38 user nova-compute[72129]: DEBUG nova.compute.manager [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] Start building block device mappings for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 14:02:38 user nova-compute[72129]: INFO nova.virt.block_device [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] Booting with volume snapshot 1d2a0b22-4ae5-498e-a47e-0b6ce18efbff at /dev/vda
Aug 01 14:02:38 user nova-compute[72129]: DEBUG nova.policy [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7c341be2816c43cfa9adb58ee84e942b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '210837255c8148ec9b482ba3e2551362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72129) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 14:02:38 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:02:38 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:02:38 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:02:38 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:02:38 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:02:38 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:02:38 user nova-compute[72129]: DEBUG nova.compute.manager [req-cfa25120-41e5-4edb-b4e9-ec5ed03f368b req-ad9c382d-6191-4df2-b88d-67be0a6ee72e service nova] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Received event network-vif-plugged-42cfd021-0c3b-4c75-8758-1cf73c652fa4 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:02:38 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-cfa25120-41e5-4edb-b4e9-ec5ed03f368b req-ad9c382d-6191-4df2-b88d-67be0a6ee72e service nova] Acquiring lock "0c43fda3-e098-4c3a-bcd5-14eac019db06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:02:38 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-cfa25120-41e5-4edb-b4e9-ec5ed03f368b req-ad9c382d-6191-4df2-b88d-67be0a6ee72e service nova] Lock "0c43fda3-e098-4c3a-bcd5-14eac019db06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:02:38 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-cfa25120-41e5-4edb-b4e9-ec5ed03f368b req-ad9c382d-6191-4df2-b88d-67be0a6ee72e service nova] Lock "0c43fda3-e098-4c3a-bcd5-14eac019db06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:02:38 user nova-compute[72129]: DEBUG nova.compute.manager [req-cfa25120-41e5-4edb-b4e9-ec5ed03f368b req-ad9c382d-6191-4df2-b88d-67be0a6ee72e service nova] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] No waiting events found dispatching network-vif-plugged-42cfd021-0c3b-4c75-8758-1cf73c652fa4 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:02:38 user nova-compute[72129]: WARNING nova.compute.manager [req-cfa25120-41e5-4edb-b4e9-ec5ed03f368b req-ad9c382d-6191-4df2-b88d-67be0a6ee72e service nova] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Received unexpected event network-vif-plugged-42cfd021-0c3b-4c75-8758-1cf73c652fa4 for instance with vm_state building and task_state spawning.
Aug 01 14:02:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:02:39 user nova-compute[72129]: DEBUG nova.network.neutron [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] Successfully created port: 7cc8c5a0-6cf1-4030-8a8b-df9a2985c8f6 {{(pid=72129) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 14:02:40 user nova-compute[72129]: DEBUG nova.network.neutron [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] Successfully updated port: 7cc8c5a0-6cf1-4030-8a8b-df9a2985c8f6 {{(pid=72129) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 14:02:40 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Acquiring lock "refresh_cache-6dec0529-4dfb-4bc4-b8a1-b7e5f484535a" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:02:40 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Acquired lock "refresh_cache-6dec0529-4dfb-4bc4-b8a1-b7e5f484535a" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:02:40 user nova-compute[72129]: DEBUG nova.network.neutron [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 14:02:40 user nova-compute[72129]: DEBUG nova.network.neutron [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] Instance cache missing network info. {{(pid=72129) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 14:02:40 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898560.8451724, 0c43fda3-e098-4c3a-bcd5-14eac019db06 => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:02:40 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] VM Resumed (Lifecycle Event)
Aug 01 14:02:40 user nova-compute[72129]: DEBUG nova.compute.manager [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Instance event wait completed in 0 seconds for  {{(pid=72129) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 14:02:40 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Guest created on hypervisor {{(pid=72129) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 14:02:40 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Instance spawned successfully.
Aug 01 14:02:40 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 14:02:40 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:02:40 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:02:40 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:02:40 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Found default for hw_cdrom_bus of ide {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:02:40 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Found default for hw_disk_bus of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:02:40 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Found default for hw_input_bus of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:02:40 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Found default for hw_pointer_model of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:02:40 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Found default for hw_video_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:02:40 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Found default for hw_vif_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:02:40 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 14:02:40 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898560.8463984, 0c43fda3-e098-4c3a-bcd5-14eac019db06 => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:02:40 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] VM Started (Lifecycle Event)
Aug 01 14:02:40 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:02:40 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:02:40 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 14:02:40 user nova-compute[72129]: INFO nova.compute.manager [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Took 5.99 seconds to spawn the instance on the hypervisor.
Aug 01 14:02:40 user nova-compute[72129]: DEBUG nova.compute.manager [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:02:41 user nova-compute[72129]: INFO nova.compute.manager [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Took 6.76 seconds to build instance.
Aug 01 14:02:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-60a78676-c064-41a4-9352-69d1da8fd87c tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "0c43fda3-e098-4c3a-bcd5-14eac019db06" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.870s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:02:41 user nova-compute[72129]: DEBUG nova.compute.manager [req-3f58c731-3a2b-46b1-9c59-c6d1af889918 req-712b2594-3204-4189-a69f-bcbd66b2ac62 service nova] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Received event network-vif-plugged-42cfd021-0c3b-4c75-8758-1cf73c652fa4 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:02:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-3f58c731-3a2b-46b1-9c59-c6d1af889918 req-712b2594-3204-4189-a69f-bcbd66b2ac62 service nova] Acquiring lock "0c43fda3-e098-4c3a-bcd5-14eac019db06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:02:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-3f58c731-3a2b-46b1-9c59-c6d1af889918 req-712b2594-3204-4189-a69f-bcbd66b2ac62 service nova] Lock "0c43fda3-e098-4c3a-bcd5-14eac019db06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:02:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-3f58c731-3a2b-46b1-9c59-c6d1af889918 req-712b2594-3204-4189-a69f-bcbd66b2ac62 service nova] Lock "0c43fda3-e098-4c3a-bcd5-14eac019db06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:02:41 user nova-compute[72129]: DEBUG nova.compute.manager [req-3f58c731-3a2b-46b1-9c59-c6d1af889918 req-712b2594-3204-4189-a69f-bcbd66b2ac62 service nova] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] No waiting events found dispatching network-vif-plugged-42cfd021-0c3b-4c75-8758-1cf73c652fa4 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:02:41 user nova-compute[72129]: WARNING nova.compute.manager [req-3f58c731-3a2b-46b1-9c59-c6d1af889918 req-712b2594-3204-4189-a69f-bcbd66b2ac62 service nova] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Received unexpected event network-vif-plugged-42cfd021-0c3b-4c75-8758-1cf73c652fa4 for instance with vm_state active and task_state None.
Aug 01 14:02:41 user nova-compute[72129]: DEBUG nova.compute.manager [req-3f58c731-3a2b-46b1-9c59-c6d1af889918 req-712b2594-3204-4189-a69f-bcbd66b2ac62 service nova] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] Received event network-changed-7cc8c5a0-6cf1-4030-8a8b-df9a2985c8f6 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:02:41 user nova-compute[72129]: DEBUG nova.compute.manager [req-3f58c731-3a2b-46b1-9c59-c6d1af889918 req-712b2594-3204-4189-a69f-bcbd66b2ac62 service nova] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] Refreshing instance network info cache due to event network-changed-7cc8c5a0-6cf1-4030-8a8b-df9a2985c8f6. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 14:02:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-3f58c731-3a2b-46b1-9c59-c6d1af889918 req-712b2594-3204-4189-a69f-bcbd66b2ac62 service nova] Acquiring lock "refresh_cache-6dec0529-4dfb-4bc4-b8a1-b7e5f484535a" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:02:41 user nova-compute[72129]: DEBUG nova.network.neutron [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] Updating instance_info_cache with network_info: [{"id": "7cc8c5a0-6cf1-4030-8a8b-df9a2985c8f6", "address": "fa:16:3e:42:c5:84", "network": {"id": "a7f4226b-73fe-4265-ba2c-5d7dcdf154fd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1142462884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210837255c8148ec9b482ba3e2551362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc8c5a0-6c", "ovs_interfaceid": "7cc8c5a0-6cf1-4030-8a8b-df9a2985c8f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:02:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Releasing lock "refresh_cache-6dec0529-4dfb-4bc4-b8a1-b7e5f484535a" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:02:41 user nova-compute[72129]: DEBUG nova.compute.manager [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] Instance network_info: |[{"id": "7cc8c5a0-6cf1-4030-8a8b-df9a2985c8f6", "address": "fa:16:3e:42:c5:84", "network": {"id": "a7f4226b-73fe-4265-ba2c-5d7dcdf154fd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1142462884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210837255c8148ec9b482ba3e2551362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc8c5a0-6c", "ovs_interfaceid": "7cc8c5a0-6cf1-4030-8a8b-df9a2985c8f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 14:02:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-3f58c731-3a2b-46b1-9c59-c6d1af889918 req-712b2594-3204-4189-a69f-bcbd66b2ac62 service nova] Acquired lock "refresh_cache-6dec0529-4dfb-4bc4-b8a1-b7e5f484535a" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:02:41 user nova-compute[72129]: DEBUG nova.network.neutron [req-3f58c731-3a2b-46b1-9c59-c6d1af889918 req-712b2594-3204-4189-a69f-bcbd66b2ac62 service nova] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] Refreshing network info cache for port 7cc8c5a0-6cf1-4030-8a8b-df9a2985c8f6 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 14:02:41 user nova-compute[72129]: DEBUG nova.network.neutron [req-3f58c731-3a2b-46b1-9c59-c6d1af889918 req-712b2594-3204-4189-a69f-bcbd66b2ac62 service nova] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] Updated VIF entry in instance network info cache for port 7cc8c5a0-6cf1-4030-8a8b-df9a2985c8f6. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 14:02:41 user nova-compute[72129]: DEBUG nova.network.neutron [req-3f58c731-3a2b-46b1-9c59-c6d1af889918 req-712b2594-3204-4189-a69f-bcbd66b2ac62 service nova] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] Updating instance_info_cache with network_info: [{"id": "7cc8c5a0-6cf1-4030-8a8b-df9a2985c8f6", "address": "fa:16:3e:42:c5:84", "network": {"id": "a7f4226b-73fe-4265-ba2c-5d7dcdf154fd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1142462884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210837255c8148ec9b482ba3e2551362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc8c5a0-6c", "ovs_interfaceid": "7cc8c5a0-6cf1-4030-8a8b-df9a2985c8f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:02:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-3f58c731-3a2b-46b1-9c59-c6d1af889918 req-712b2594-3204-4189-a69f-bcbd66b2ac62 service nova] Releasing lock "refresh_cache-6dec0529-4dfb-4bc4-b8a1-b7e5f484535a" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:02:42 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:02:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-beedfd0d-028b-446d-9bb3-c5e8074b7335 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Acquiring lock "e2cf5877-55dd-44ce-9b58-b662afe8e62e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:02:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-beedfd0d-028b-446d-9bb3-c5e8074b7335 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lock "e2cf5877-55dd-44ce-9b58-b662afe8e62e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:02:42 user nova-compute[72129]: INFO nova.compute.manager [None req-beedfd0d-028b-446d-9bb3-c5e8074b7335 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Detaching volume 93cdeb70-e129-4049-8af2-7f89bbf4d853
Aug 01 14:02:42 user nova-compute[72129]: INFO nova.virt.block_device [None req-beedfd0d-028b-446d-9bb3-c5e8074b7335 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Attempting to driver detach volume 93cdeb70-e129-4049-8af2-7f89bbf4d853 from mountpoint /dev/vdb
Aug 01 14:02:42 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-beedfd0d-028b-446d-9bb3-c5e8074b7335 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Attempting to detach device vdb from instance e2cf5877-55dd-44ce-9b58-b662afe8e62e from the persistent domain config. {{(pid=72129) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 14:02:42 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-beedfd0d-028b-446d-9bb3-c5e8074b7335 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 14:02:42 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:02:42 user nova-compute[72129]:   <source dev="/dev/sdg"/>
Aug 01 14:02:42 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 14:02:42 user nova-compute[72129]:   <serial>93cdeb70-e129-4049-8af2-7f89bbf4d853</serial>
Aug 01 14:02:42 user nova-compute[72129]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 14:02:42 user nova-compute[72129]: </disk>
Aug 01 14:02:42 user nova-compute[72129]:  {{(pid=72129) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 14:02:42 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-beedfd0d-028b-446d-9bb3-c5e8074b7335 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Successfully detached device vdb from instance e2cf5877-55dd-44ce-9b58-b662afe8e62e from the persistent domain config.
Aug 01 14:02:42 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-beedfd0d-028b-446d-9bb3-c5e8074b7335 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e2cf5877-55dd-44ce-9b58-b662afe8e62e from the live domain config. {{(pid=72129) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 14:02:42 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-beedfd0d-028b-446d-9bb3-c5e8074b7335 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 14:02:42 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:02:42 user nova-compute[72129]:   <source dev="/dev/sdg"/>
Aug 01 14:02:42 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 14:02:42 user nova-compute[72129]:   <serial>93cdeb70-e129-4049-8af2-7f89bbf4d853</serial>
Aug 01 14:02:42 user nova-compute[72129]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 14:02:42 user nova-compute[72129]: </disk>
Aug 01 14:02:42 user nova-compute[72129]:  {{(pid=72129) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 14:02:43 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Received event <DeviceRemovedEvent: 1690898563.3166645, e2cf5877-55dd-44ce-9b58-b662afe8e62e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72129) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 14:02:43 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-beedfd0d-028b-446d-9bb3-c5e8074b7335 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e2cf5877-55dd-44ce-9b58-b662afe8e62e {{(pid=72129) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 14:02:43 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-beedfd0d-028b-446d-9bb3-c5e8074b7335 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Successfully detached device vdb from instance e2cf5877-55dd-44ce-9b58-b662afe8e62e from the live domain config.
Aug 01 14:02:43 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-beedfd0d-028b-446d-9bb3-c5e8074b7335 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] calling os-brick to detach iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 14:02:43 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-beedfd0d-028b-446d-9bb3-c5e8074b7335 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, {'target_iqns': ['iqn.2010-10.org.openstack:93cdeb70-e129-4049-8af2-7f89bbf4d853'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aPSYqDMk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:02:43 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-beedfd0d-028b-446d-9bb3-c5e8074b7335 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:02:43 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-beedfd0d-028b-446d-9bb3-c5e8074b7335 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:02:43 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-beedfd0d-028b-446d-9bb3-c5e8074b7335 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:02:43 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-beedfd0d-028b-446d-9bb3-c5e8074b7335 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93cdeb70-e129-4049-8af2-7f89bbf4d853', 0)] {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 14:02:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:02:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:02:43 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[455cb04c-a71a-4644-b9bf-243c0c629206]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93cdeb70-e129-4049-8af2-7f89bbf4d853\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:02:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:02:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:02:43 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b82b1845-5c19-4282-af51-ba34faf6bc71]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93cdeb70-e129-4049-8af2-7f89bbf4d853 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:02:43 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-beedfd0d-028b-446d-9bb3-c5e8074b7335 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:02:43 user nova-compute[72129]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)
Aug 01 14:02:43 user nova-compute[72129]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 (non-flash)
Aug 01 14:02:43 user nova-compute[72129]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d (non-flash)
Aug 01 14:02:43 user nova-compute[72129]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)
Aug 01 14:02:43 user nova-compute[72129]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93cdeb70-e129-4049-8af2-7f89bbf4d853 (non-flash)
Aug 01 14:02:43 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:02:43 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-beedfd0d-028b-446d-9bb3-c5e8074b7335 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:02:43 user nova-compute[72129]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)
Aug 01 14:02:43 user nova-compute[72129]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 (non-flash)
Aug 01 14:02:43 user nova-compute[72129]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d (non-flash)
Aug 01 14:02:43 user nova-compute[72129]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)
Aug 01 14:02:43 user nova-compute[72129]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93cdeb70-e129-4049-8af2-7f89bbf4d853 (non-flash)
Aug 01 14:02:43 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:02:43 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-beedfd0d-028b-446d-9bb3-c5e8074b7335 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2820174ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93cdeb70-e129-4049-8af2-7f89bbf4d853'): ({'sdg'}, set())}) {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 14:02:43 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-beedfd0d-028b-446d-9bb3-c5e8074b7335 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Removing single pathed devices sdg {{(pid=72129) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 14:02:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:02:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:02:43 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba0560be-9204-4cc4-9fa0-4093b04b74f6]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:02:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:02:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:02:43 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e659c9a-a961-4a95-954c-636bd5a07b92]: (4, ('ok\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:02:43 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-beedfd0d-028b-446d-9bb3-c5e8074b7335 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Flushing IO for device /dev/sdg {{(pid=72129) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 14:02:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:02:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:02:43 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[33237ce7-737f-4ec0-9ee7-4667588aef39]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:02:43 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-beedfd0d-028b-446d-9bb3-c5e8074b7335 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72129) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 14:02:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:02:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.044s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:02:43 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[617cc64b-63f7-4ca1-86f5-3a3b80f848d9]: (4, ('1', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:02:43 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-beedfd0d-028b-446d-9bb3-c5e8074b7335 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 14:02:43 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-beedfd0d-028b-446d-9bb3-c5e8074b7335 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] SCSI volumes sdg have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 14:02:43 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-beedfd0d-028b-446d-9bb3-c5e8074b7335 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93cdeb70-e129-4049-8af2-7f89bbf4d853')] {{(pid=72129) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 14:02:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93cdeb70-e129-4049-8af2-7f89bbf4d853 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:02:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93cdeb70-e129-4049-8af2-7f89bbf4d853 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:02:43 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c87fdd-f8a7-4edd-a6f6-d986a80d5d50]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:02:43 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-beedfd0d-028b-446d-9bb3-c5e8074b7335 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:02:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93cdeb70-e129-4049-8af2-7f89bbf4d853 -p 172.16.0.220:3260 --logout {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:02:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93cdeb70-e129-4049-8af2-7f89bbf4d853 -p 172.16.0.220:3260 --logout" returned: 0 in 0.175s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:02:43 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b6aadb-c058-4d47-b7ed-17459fe78bb5]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:93cdeb70-e129-4049-8af2-7f89bbf4d853, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:93cdeb70-e129-4049-8af2-7f89bbf4d853, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:02:43 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-beedfd0d-028b-446d-9bb3-c5e8074b7335 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:93cdeb70-e129-4049-8af2-7f89bbf4d853, portal: 172.16.0.220,3260]
Aug 01 14:02:43 user nova-compute[72129]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:93cdeb70-e129-4049-8af2-7f89bbf4d853, portal: 172.16.0.220,3260] successful.
Aug 01 14:02:43 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:02:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93cdeb70-e129-4049-8af2-7f89bbf4d853 -p 172.16.0.220:3260 --op delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:02:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93cdeb70-e129-4049-8af2-7f89bbf4d853 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:02:43 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[813e2ba5-04bb-4d7c-b80b-c8c03a1306c1]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:02:43 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-beedfd0d-028b-446d-9bb3-c5e8074b7335 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:02:43 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-beedfd0d-028b-446d-9bb3-c5e8074b7335 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.408s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:02:43 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-beedfd0d-028b-446d-9bb3-c5e8074b7335 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] <== disconnect_volume: return (410ms) None {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:02:43 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-beedfd0d-028b-446d-9bb3-c5e8074b7335 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Disconnected iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 14:02:44 user nova-compute[72129]: DEBUG os_brick.utils [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:02:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:02:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:02:44 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[f784a3fb-8ebf-401b-a072-649a7ba59e3d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f9b449c2cd3d\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:02:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:02:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:02:44 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad79850-79cc-4559-92c8-3961661a504a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:02:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:02:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:02:44 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[206ed056-71a4-4d31-8d75-1cee9987d048]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:02:44 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d201c5-5d37-4e0b-8b5e-dd76c03a74b3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:02:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Running cmd (subprocess): nvme version {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:02:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] 'nvme version' failed. Not Retrying. {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 14:02:44 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] nvme not present on system {{(pid=72129) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 14:02:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:02:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 14:02:44 user nova-compute[72129]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 14:02:44 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[49268523-05d0-46f1-8d4f-4fd742237f27]: (4, '') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:02:44 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72129) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 14:02:44 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 14:02:44 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] LIGHTOS: no hostnqn found. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 14:02:44 user nova-compute[72129]: DEBUG os_brick.utils [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f9b449c2cd3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:02:44 user nova-compute[72129]: DEBUG nova.virt.block_device [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] Updating existing volume attachment record: f292a1f6-8b11-46bc-a974-bac0bf367fad {{(pid=72129) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 14:02:44 user nova-compute[72129]: DEBUG nova.objects.instance [None req-beedfd0d-028b-446d-9bb3-c5e8074b7335 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lazy-loading 'flavor' on Instance uuid e2cf5877-55dd-44ce-9b58-b662afe8e62e {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:02:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-beedfd0d-028b-446d-9bb3-c5e8074b7335 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lock "e2cf5877-55dd-44ce-9b58-b662afe8e62e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.853s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:02:45 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:02:47 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:02:48 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:02:48 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Starting heal instance info cache {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 14:02:48 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Rebuilding the list of instances to heal {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 14:02:48 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] Skipping network cache update for instance because it is Building. {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 01 14:02:48 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "refresh_cache-97a5dccf-b499-443a-b332-cfa293a16047" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:02:48 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquired lock "refresh_cache-97a5dccf-b499-443a-b332-cfa293a16047" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:02:48 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Forcefully refreshing network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 14:02:48 user nova-compute[72129]: DEBUG nova.objects.instance [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lazy-loading 'info_cache' on Instance uuid 97a5dccf-b499-443a-b332-cfa293a16047 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:02:48 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Updating instance_info_cache with network_info: [{"id": "4871bc74-6594-49e6-a6ef-343bc3800742", "address": "fa:16:3e:a3:52:a2", "network": {"id": "4b93ad92-9a3a-4472-ba6c-d215329da98b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-734108983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0e85d9b73a546dc95e0ace26233f2a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4871bc74-65", "ovs_interfaceid": "4871bc74-6594-49e6-a6ef-343bc3800742", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:02:48 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Releasing lock "refresh_cache-97a5dccf-b499-443a-b332-cfa293a16047" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:02:48 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Updated the network info_cache for instance {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 14:02:48 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:02:48 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:02:48 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:02:48 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:02:48 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:02:48 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72129) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 14:02:49 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:02:51 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG nova.compute.manager [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] Start spawning the instance on the hypervisor. {{(pid=72129) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] Creating instance directory {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 14:02:52 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] Creating image(s)
Aug 01 14:02:52 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] Did not create local disks {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] Ensure instance console log exists: /opt/stack/data/nova/instances/6dec0529-4dfb-4bc4-b8a1-b7e5f484535a/console.log {{(pid=72129) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] Start _get_guest_xml network_info=[{"id": "7cc8c5a0-6cf1-4030-8a8b-df9a2985c8f6", "address": "fa:16:3e:42:c5:84", "network": {"id": "a7f4226b-73fe-4265-ba2c-5d7dcdf154fd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1142462884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210837255c8148ec9b482ba3e2551362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc8c5a0-6c", "ovs_interfaceid": "7cc8c5a0-6cf1-4030-8a8b-df9a2985c8f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-01T14:02:30Z,direct_url=<?>,disk_format='qcow2',id=6c638e64-5739-4878-8a5b-2dcada441ae8,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1444499972',owner='210837255c8148ec9b482ba3e2551362',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-01T14:02:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': 'f292a1f6-8b11-46bc-a974-bac0bf367fad', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QTCelvmX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6dec0529-4dfb-4bc4-b8a1-b7e5f484535a', 'attached_at': '', 'detached_at': '', 'volume_id': 'c10553c0-6eee-471f-9316-f3f5cc71bd3f', 'serial': 'c10553c0-6eee-471f-9316-f3f5cc71bd3f'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 14:02:52 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:02:52 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:02:52 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] CPU controller missing on host. {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] CPU controller found on host. {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72129) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T13:45:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-01T14:02:30Z,direct_url=<?>,disk_format='qcow2',id=6c638e64-5739-4878-8a5b-2dcada441ae8,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1444499972',owner='210837255c8148ec9b482ba3e2551362',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-01T14:02:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Flavor limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Image limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Flavor pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Image pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Got 1 possible topologies {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] Calling os-brick to attach iSCSI Volume {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QTCelvmX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:02:52 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:02:52 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:02:52 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:02:52 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:02:52 user nova-compute[72129]: INFO os_brick.initiator.connectors.iscsi [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 14:02:52 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f -p 172.16.0.220:3260 {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6b0b86-cbf0-4f02-afda-945029227057]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 14:02:52 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f -p 172.16.0.220:3260 --interface default --op new {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a79a42-1817-4831-ad1f-3ec54dd3ffb7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f] added\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f] added
Aug 01 14:02:52 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b028428d-bfa2-49b8-a36d-c7783b134f0e]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[952500d3-7eba-43c2-a998-08b88c51df71]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QTCelvmX {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QTCelvmX" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05c49d9-95ad-4552-acec-2e27f6610c5a]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QTCelvmX'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[34198e8a-0c6f-4465-9cae-020a81652c01]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d2130a-03c9-4720-b794-cd6f350bcec0]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:02:52 user nova-compute[72129]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)
Aug 01 14:02:52 user nova-compute[72129]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 (non-flash)
Aug 01 14:02:52 user nova-compute[72129]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d (non-flash)
Aug 01 14:02:52 user nova-compute[72129]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)
Aug 01 14:02:52 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:02:52 user nova-compute[72129]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)
Aug 01 14:02:52 user nova-compute[72129]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 (non-flash)
Aug 01 14:02:52 user nova-compute[72129]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d (non-flash)
Aug 01 14:02:52 user nova-compute[72129]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)
Aug 01 14:02:52 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f -p 172.16.0.220:3260 --login {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8d388b-75be-46c7-afd0-40277331147e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f, portal: 172.16.0.220,3260]
Aug 01 14:02:52 user nova-compute[72129]: Login to [iface: default, target: iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f, portal: 172.16.0.220,3260] successful.
Aug 01 14:02:52 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02a3888-06f3-4bbd-a1a8-710a514e6e20]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b941fb-1604-4561-9fc8-2f2871134f1c]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:02:52 user nova-compute[72129]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)
Aug 01 14:02:52 user nova-compute[72129]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 (non-flash)
Aug 01 14:02:52 user nova-compute[72129]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d (non-flash)
Aug 01 14:02:52 user nova-compute[72129]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)
Aug 01 14:02:52 user nova-compute[72129]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f (non-flash)
Aug 01 14:02:52 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:02:52 user nova-compute[72129]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)
Aug 01 14:02:52 user nova-compute[72129]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 (non-flash)
Aug 01 14:02:52 user nova-compute[72129]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d (non-flash)
Aug 01 14:02:52 user nova-compute[72129]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)
Aug 01 14:02:52 user nova-compute[72129]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f (non-flash)
Aug 01 14:02:52 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Connected to 172.16.0.220:3260 {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] HCTL ('38', '-', '-', 0) found on session 35 with lun 0 {{(pid=72129) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72129) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.015s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[45508d2b-4f61-459a-874e-4d0129970078]: (4, ('- - 0', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Searching for a device in session 35 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 14:02:52 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QTCelvmX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 14:02:53 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:02:53 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:02:53 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:02:53 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:02:53 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Auditing locally available compute resources for user (node: user) {{(pid=72129) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 14:02:53 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 14:02:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:02:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:02:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:02:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:02:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c43fda3-e098-4c3a-bcd5-14eac019db06/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:02:53 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:02:53 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] <== connect_volume: return (1360ms) {'type': 'block', 'scsi_wwn': '23339623339313136', 'path': '/dev/sdg'} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:02:53 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23339623339313136', 'path': '/dev/sdg'} {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 14:02:53 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:02:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-967467479',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-967467479',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-967467479',id=30,image_ref='6c638e64-5739-4878-8a5b-2dcada441ae8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAH4n2nvVRQTPZrG39EH15KwTJd3Q7Zpidu9AS4REfe0bESUaZSUJj4UEisr+LMb2PwZ0o01AMNMGuurrSVfvD87MfKfblcUKepKuykmmOvIHu21jCyxs/zQnznziRgT3g==',key_name='tempest-keypair-1832327356',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='210837255c8148ec9b482ba3e2551362',ramdisk_id='',reservation_id='r-xpz077hp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1876154436',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1876154436-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1876154436',owner_user_name='tempest-TestVolumeBootPattern-1876154436-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T14:02:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c341be2816c43cfa9adb58ee84e942b',uuid=6dec0529-4dfb-4bc4-b8a1-b7e5f484535a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7cc8c5a0-6cf1-4030-8a8b-df9a2985c8f6", "address": "fa:16:3e:42:c5:84", "network": {"id": "a7f4226b-73fe-4265-ba2c-5d7dcdf154fd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1142462884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210837255c8148ec9b482ba3e2551362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc8c5a0-6c", "ovs_interfaceid": "7cc8c5a0-6cf1-4030-8a8b-df9a2985c8f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 14:02:53 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Converting VIF {"id": "7cc8c5a0-6cf1-4030-8a8b-df9a2985c8f6", "address": "fa:16:3e:42:c5:84", "network": {"id": "a7f4226b-73fe-4265-ba2c-5d7dcdf154fd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1142462884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210837255c8148ec9b482ba3e2551362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc8c5a0-6c", "ovs_interfaceid": "7cc8c5a0-6cf1-4030-8a8b-df9a2985c8f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:02:53 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:c5:84,bridge_name='br-int',has_traffic_filtering=True,id=7cc8c5a0-6cf1-4030-8a8b-df9a2985c8f6,network=Network(a7f4226b-73fe-4265-ba2c-5d7dcdf154fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cc8c5a0-6c') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:02:53 user nova-compute[72129]: DEBUG nova.objects.instance [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lazy-loading 'pci_devices' on Instance uuid 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:02:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c43fda3-e098-4c3a-bcd5-14eac019db06/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:02:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c43fda3-e098-4c3a-bcd5-14eac019db06/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:02:53 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] End _get_guest_xml xml=<domain type="kvm">
Aug 01 14:02:53 user nova-compute[72129]:   <uuid>6dec0529-4dfb-4bc4-b8a1-b7e5f484535a</uuid>
Aug 01 14:02:53 user nova-compute[72129]:   <name>instance-0000001e</name>
Aug 01 14:02:53 user nova-compute[72129]:   <memory>524288</memory>
Aug 01 14:02:53 user nova-compute[72129]:   <vcpu>1</vcpu>
Aug 01 14:02:53 user nova-compute[72129]:   <metadata>
Aug 01 14:02:53 user nova-compute[72129]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 14:02:53 user nova-compute[72129]:       <nova:package version="0.0.0"/>
Aug 01 14:02:53 user nova-compute[72129]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-967467479</nova:name>
Aug 01 14:02:53 user nova-compute[72129]:       <nova:creationTime>2023-08-01 14:02:52</nova:creationTime>
Aug 01 14:02:53 user nova-compute[72129]:       <nova:flavor name="m1.tiny">
Aug 01 14:02:53 user nova-compute[72129]:         <nova:memory>512</nova:memory>
Aug 01 14:02:53 user nova-compute[72129]:         <nova:disk>1</nova:disk>
Aug 01 14:02:53 user nova-compute[72129]:         <nova:swap>0</nova:swap>
Aug 01 14:02:53 user nova-compute[72129]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 14:02:53 user nova-compute[72129]:         <nova:vcpus>1</nova:vcpus>
Aug 01 14:02:53 user nova-compute[72129]:       </nova:flavor>
Aug 01 14:02:53 user nova-compute[72129]:       <nova:owner>
Aug 01 14:02:53 user nova-compute[72129]:         <nova:user uuid="7c341be2816c43cfa9adb58ee84e942b">tempest-TestVolumeBootPattern-1876154436-project-member</nova:user>
Aug 01 14:02:53 user nova-compute[72129]:         <nova:project uuid="210837255c8148ec9b482ba3e2551362">tempest-TestVolumeBootPattern-1876154436</nova:project>
Aug 01 14:02:53 user nova-compute[72129]:       </nova:owner>
Aug 01 14:02:53 user nova-compute[72129]:       <nova:root type="image" uuid="6c638e64-5739-4878-8a5b-2dcada441ae8"/>
Aug 01 14:02:53 user nova-compute[72129]:       <nova:ports>
Aug 01 14:02:53 user nova-compute[72129]:         <nova:port uuid="7cc8c5a0-6cf1-4030-8a8b-df9a2985c8f6">
Aug 01 14:02:53 user nova-compute[72129]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 01 14:02:53 user nova-compute[72129]:         </nova:port>
Aug 01 14:02:53 user nova-compute[72129]:       </nova:ports>
Aug 01 14:02:53 user nova-compute[72129]:     </nova:instance>
Aug 01 14:02:53 user nova-compute[72129]:   </metadata>
Aug 01 14:02:53 user nova-compute[72129]:   <sysinfo type="smbios">
Aug 01 14:02:53 user nova-compute[72129]:     <system>
Aug 01 14:02:53 user nova-compute[72129]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 14:02:53 user nova-compute[72129]:       <entry name="product">OpenStack Nova</entry>
Aug 01 14:02:53 user nova-compute[72129]:       <entry name="version">0.0.0</entry>
Aug 01 14:02:53 user nova-compute[72129]:       <entry name="serial">6dec0529-4dfb-4bc4-b8a1-b7e5f484535a</entry>
Aug 01 14:02:53 user nova-compute[72129]:       <entry name="uuid">6dec0529-4dfb-4bc4-b8a1-b7e5f484535a</entry>
Aug 01 14:02:53 user nova-compute[72129]:       <entry name="family">Virtual Machine</entry>
Aug 01 14:02:53 user nova-compute[72129]:     </system>
Aug 01 14:02:53 user nova-compute[72129]:   </sysinfo>
Aug 01 14:02:53 user nova-compute[72129]:   <os>
Aug 01 14:02:53 user nova-compute[72129]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 14:02:53 user nova-compute[72129]:     <boot dev="hd"/>
Aug 01 14:02:53 user nova-compute[72129]:     <smbios mode="sysinfo"/>
Aug 01 14:02:53 user nova-compute[72129]:   </os>
Aug 01 14:02:53 user nova-compute[72129]:   <features>
Aug 01 14:02:53 user nova-compute[72129]:     <acpi/>
Aug 01 14:02:53 user nova-compute[72129]:     <apic/>
Aug 01 14:02:53 user nova-compute[72129]:     <vmcoreinfo/>
Aug 01 14:02:53 user nova-compute[72129]:   </features>
Aug 01 14:02:53 user nova-compute[72129]:   <clock offset="utc">
Aug 01 14:02:53 user nova-compute[72129]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 14:02:53 user nova-compute[72129]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 14:02:53 user nova-compute[72129]:     <timer name="hpet" present="no"/>
Aug 01 14:02:53 user nova-compute[72129]:   </clock>
Aug 01 14:02:53 user nova-compute[72129]:   <cpu mode="custom" match="exact">
Aug 01 14:02:53 user nova-compute[72129]:     <model>Nehalem</model>
Aug 01 14:02:53 user nova-compute[72129]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 14:02:53 user nova-compute[72129]:   </cpu>
Aug 01 14:02:53 user nova-compute[72129]:   <devices>
Aug 01 14:02:53 user nova-compute[72129]:     <disk type="block" device="disk">
Aug 01 14:02:53 user nova-compute[72129]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:02:53 user nova-compute[72129]:       <source dev="/dev/sdg"/>
Aug 01 14:02:53 user nova-compute[72129]:       <target dev="vda" bus="virtio"/>
Aug 01 14:02:53 user nova-compute[72129]:       <serial>c10553c0-6eee-471f-9316-f3f5cc71bd3f</serial>
Aug 01 14:02:53 user nova-compute[72129]:     </disk>
Aug 01 14:02:53 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 14:02:53 user nova-compute[72129]:       <mac address="fa:16:3e:42:c5:84"/>
Aug 01 14:02:53 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:02:53 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 14:02:53 user nova-compute[72129]:       <target dev="tap7cc8c5a0-6c"/>
Aug 01 14:02:53 user nova-compute[72129]:     </interface>
Aug 01 14:02:53 user nova-compute[72129]:     <serial type="pty">
Aug 01 14:02:53 user nova-compute[72129]:       <log file="/opt/stack/data/nova/instances/6dec0529-4dfb-4bc4-b8a1-b7e5f484535a/console.log" append="off"/>
Aug 01 14:02:53 user nova-compute[72129]:     </serial>
Aug 01 14:02:53 user nova-compute[72129]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 14:02:53 user nova-compute[72129]:     <video>
Aug 01 14:02:53 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:02:53 user nova-compute[72129]:     </video>
Aug 01 14:02:53 user nova-compute[72129]:     <rng model="virtio">
Aug 01 14:02:53 user nova-compute[72129]:       <backend model="random">/dev/urandom</backend>
Aug 01 14:02:53 user nova-compute[72129]:     </rng>
Aug 01 14:02:53 user nova-compute[72129]:     <controller type="usb" index="0" model="none"/>
Aug 01 14:02:53 user nova-compute[72129]:     <memballoon model="virtio">
Aug 01 14:02:53 user nova-compute[72129]:       <stats period="10"/>
Aug 01 14:02:53 user nova-compute[72129]:     </memballoon>
Aug 01 14:02:53 user nova-compute[72129]:   </devices>
Aug 01 14:02:53 user nova-compute[72129]: </domain>
Aug 01 14:02:53 user nova-compute[72129]:  {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 14:02:53 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:02:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-967467479',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-967467479',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-967467479',id=30,image_ref='6c638e64-5739-4878-8a5b-2dcada441ae8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAH4n2nvVRQTPZrG39EH15KwTJd3Q7Zpidu9AS4REfe0bESUaZSUJj4UEisr+LMb2PwZ0o01AMNMGuurrSVfvD87MfKfblcUKepKuykmmOvIHu21jCyxs/zQnznziRgT3g==',key_name='tempest-keypair-1832327356',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='210837255c8148ec9b482ba3e2551362',ramdisk_id='',reservation_id='r-xpz077hp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1876154436',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1876154436-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1876154436',owner_user_name='tempest-TestVolumeBootPattern-1876154436-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T14:02:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c341be2816c43cfa9adb58ee84e942b',uuid=6dec0529-4dfb-4bc4-b8a1-b7e5f484535a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7cc8c5a0-6cf1-4030-8a8b-df9a2985c8f6", "address": "fa:16:3e:42:c5:84", "network": {"id": "a7f4226b-73fe-4265-ba2c-5d7dcdf154fd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1142462884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210837255c8148ec9b482ba3e2551362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc8c5a0-6c", "ovs_interfaceid": "7cc8c5a0-6cf1-4030-8a8b-df9a2985c8f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 14:02:53 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Converting VIF {"id": "7cc8c5a0-6cf1-4030-8a8b-df9a2985c8f6", "address": "fa:16:3e:42:c5:84", "network": {"id": "a7f4226b-73fe-4265-ba2c-5d7dcdf154fd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1142462884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210837255c8148ec9b482ba3e2551362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc8c5a0-6c", "ovs_interfaceid": "7cc8c5a0-6cf1-4030-8a8b-df9a2985c8f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:02:53 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:c5:84,bridge_name='br-int',has_traffic_filtering=True,id=7cc8c5a0-6cf1-4030-8a8b-df9a2985c8f6,network=Network(a7f4226b-73fe-4265-ba2c-5d7dcdf154fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cc8c5a0-6c') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:02:53 user nova-compute[72129]: DEBUG os_vif [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:c5:84,bridge_name='br-int',has_traffic_filtering=True,id=7cc8c5a0-6cf1-4030-8a8b-df9a2985c8f6,network=Network(a7f4226b-73fe-4265-ba2c-5d7dcdf154fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cc8c5a0-6c') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 14:02:53 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:02:53 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:02:53 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 14:02:53 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:02:53 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7cc8c5a0-6c, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:02:53 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7cc8c5a0-6c, col_values=(('external_ids', {'iface-id': '7cc8c5a0-6cf1-4030-8a8b-df9a2985c8f6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:c5:84', 'vm-uuid': '6dec0529-4dfb-4bc4-b8a1-b7e5f484535a'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:02:53 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:02:53 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:02:53 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:02:53 user nova-compute[72129]: INFO os_vif [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:c5:84,bridge_name='br-int',has_traffic_filtering=True,id=7cc8c5a0-6cf1-4030-8a8b-df9a2985c8f6,network=Network(a7f4226b-73fe-4265-ba2c-5d7dcdf154fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cc8c5a0-6c')
Aug 01 14:02:53 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:02:53 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] No VIF found with MAC fa:16:3e:42:c5:84, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 14:02:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c43fda3-e098-4c3a-bcd5-14eac019db06/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:02:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85062e35-e302-46f7-8d66-24cf9e7199f7/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:02:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85062e35-e302-46f7-8d66-24cf9e7199f7/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:02:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85062e35-e302-46f7-8d66-24cf9e7199f7/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:02:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85062e35-e302-46f7-8d66-24cf9e7199f7/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:02:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53b76ca4-30f0-4fd4-9928-714c7073a490/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:02:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53b76ca4-30f0-4fd4-9928-714c7073a490/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:02:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53b76ca4-30f0-4fd4-9928-714c7073a490/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:02:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53b76ca4-30f0-4fd4-9928-714c7073a490/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:02:54 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 14:02:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:02:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:02:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:02:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:02:54 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 14:02:54 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 14:02:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cf5877-55dd-44ce-9b58-b662afe8e62e/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:02:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cf5877-55dd-44ce-9b58-b662afe8e62e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:02:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cf5877-55dd-44ce-9b58-b662afe8e62e/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:02:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:02:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:02:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:02:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cf5877-55dd-44ce-9b58-b662afe8e62e/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:02:55 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 14:02:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea050cd6-60e9-41fd-a35c-05fe63d60e57/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:02:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea050cd6-60e9-41fd-a35c-05fe63d60e57/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:02:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea050cd6-60e9-41fd-a35c-05fe63d60e57/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:02:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:02:55 user nova-compute[72129]: DEBUG nova.compute.manager [req-83f7536f-ac16-447d-b71c-27261434278f req-d57bb723-c75d-414f-9dc6-2cef0926ad6a service nova] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] Received event network-vif-plugged-7cc8c5a0-6cf1-4030-8a8b-df9a2985c8f6 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:02:55 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-83f7536f-ac16-447d-b71c-27261434278f req-d57bb723-c75d-414f-9dc6-2cef0926ad6a service nova] Acquiring lock "6dec0529-4dfb-4bc4-b8a1-b7e5f484535a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:02:55 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-83f7536f-ac16-447d-b71c-27261434278f req-d57bb723-c75d-414f-9dc6-2cef0926ad6a service nova] Lock "6dec0529-4dfb-4bc4-b8a1-b7e5f484535a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:02:55 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-83f7536f-ac16-447d-b71c-27261434278f req-d57bb723-c75d-414f-9dc6-2cef0926ad6a service nova] Lock "6dec0529-4dfb-4bc4-b8a1-b7e5f484535a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:02:55 user nova-compute[72129]: DEBUG nova.compute.manager [req-83f7536f-ac16-447d-b71c-27261434278f req-d57bb723-c75d-414f-9dc6-2cef0926ad6a service nova] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] No waiting events found dispatching network-vif-plugged-7cc8c5a0-6cf1-4030-8a8b-df9a2985c8f6 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:02:55 user nova-compute[72129]: WARNING nova.compute.manager [req-83f7536f-ac16-447d-b71c-27261434278f req-d57bb723-c75d-414f-9dc6-2cef0926ad6a service nova] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] Received unexpected event network-vif-plugged-7cc8c5a0-6cf1-4030-8a8b-df9a2985c8f6 for instance with vm_state building and task_state spawning.
Aug 01 14:02:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea050cd6-60e9-41fd-a35c-05fe63d60e57/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:02:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:02:55 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:02:55 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:02:55 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Hypervisor/Node resource view: name=user free_ram=7299MB free_disk=25.172794342041016GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72129) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 14:02:55 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:02:55 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:02:56 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 97a5dccf-b499-443a-b332-cfa293a16047 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:02:56 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:02:56 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance d031973f-8f48-43b3-a338-040950103e4c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:02:56 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 53b76ca4-30f0-4fd4-9928-714c7073a490 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:02:56 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance ea050cd6-60e9-41fd-a35c-05fe63d60e57 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:02:56 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance e2cf5877-55dd-44ce-9b58-b662afe8e62e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:02:56 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 954db8d6-4806-43e6-8310-5d7f3437dc71 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:02:56 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 8e5e94dd-b575-48f1-a617-1bd917567220 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:02:56 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 85062e35-e302-46f7-8d66-24cf9e7199f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:02:56 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance e4a13a50-fe03-41aa-94f4-3431805ff481 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:02:56 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 0c43fda3-e098-4c3a-bcd5-14eac019db06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:02:56 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:02:56 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 14:02:56 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 14:02:56 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:02:56 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:02:56 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Compute_service record updated for user:user {{(pid=72129) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 14:02:56 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.481s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:02:57 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898577.132439, 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:02:57 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] VM Resumed (Lifecycle Event)
Aug 01 14:02:57 user nova-compute[72129]: DEBUG nova.compute.manager [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] Instance event wait completed in 0 seconds for  {{(pid=72129) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 14:02:57 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] Guest created on hypervisor {{(pid=72129) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 14:02:57 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] Instance spawned successfully.
Aug 01 14:02:57 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 14:02:57 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] Found default for hw_input_bus of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:02:57 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] Found default for hw_pointer_model of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:02:57 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:02:57 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:02:57 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 14:02:57 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898577.1341968, 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:02:57 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] VM Started (Lifecycle Event)
Aug 01 14:02:57 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:02:57 user nova-compute[72129]: INFO nova.compute.manager [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] Took 5.05 seconds to spawn the instance on the hypervisor.
Aug 01 14:02:57 user nova-compute[72129]: DEBUG nova.compute.manager [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:02:57 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:02:57 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 14:02:57 user nova-compute[72129]: INFO nova.compute.manager [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] Took 19.79 seconds to build instance.
Aug 01 14:02:57 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d081cdc1-2f9b-4097-85fa-878d910f1724 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "6dec0529-4dfb-4bc4-b8a1-b7e5f484535a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.884s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:02:57 user nova-compute[72129]: DEBUG nova.compute.manager [req-4720424d-3529-4b3b-8282-8e9be72550d6 req-ca4f3f67-b2bf-4db3-8214-a9e3d6cbfbb9 service nova] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] Received event network-vif-plugged-7cc8c5a0-6cf1-4030-8a8b-df9a2985c8f6 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:02:57 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-4720424d-3529-4b3b-8282-8e9be72550d6 req-ca4f3f67-b2bf-4db3-8214-a9e3d6cbfbb9 service nova] Acquiring lock "6dec0529-4dfb-4bc4-b8a1-b7e5f484535a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:02:57 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-4720424d-3529-4b3b-8282-8e9be72550d6 req-ca4f3f67-b2bf-4db3-8214-a9e3d6cbfbb9 service nova] Lock "6dec0529-4dfb-4bc4-b8a1-b7e5f484535a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:02:57 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-4720424d-3529-4b3b-8282-8e9be72550d6 req-ca4f3f67-b2bf-4db3-8214-a9e3d6cbfbb9 service nova] Lock "6dec0529-4dfb-4bc4-b8a1-b7e5f484535a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:02:57 user nova-compute[72129]: DEBUG nova.compute.manager [req-4720424d-3529-4b3b-8282-8e9be72550d6 req-ca4f3f67-b2bf-4db3-8214-a9e3d6cbfbb9 service nova] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] No waiting events found dispatching network-vif-plugged-7cc8c5a0-6cf1-4030-8a8b-df9a2985c8f6 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:02:57 user nova-compute[72129]: WARNING nova.compute.manager [req-4720424d-3529-4b3b-8282-8e9be72550d6 req-ca4f3f67-b2bf-4db3-8214-a9e3d6cbfbb9 service nova] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] Received unexpected event network-vif-plugged-7cc8c5a0-6cf1-4030-8a8b-df9a2985c8f6 for instance with vm_state active and task_state None.
Aug 01 14:02:58 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:03:00 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:03:03 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:03:05 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:03:08 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:03:10 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:03:13 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:03:14 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-453d0293-2873-4e15-a594-55840971ac91 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Acquiring lock "53b76ca4-30f0-4fd4-9928-714c7073a490" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:03:14 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-453d0293-2873-4e15-a594-55840971ac91 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "53b76ca4-30f0-4fd4-9928-714c7073a490" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:03:14 user nova-compute[72129]: INFO nova.compute.manager [None req-453d0293-2873-4e15-a594-55840971ac91 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Detaching volume 00288fea-1b8e-4835-8b92-614365fa2be4
Aug 01 14:03:14 user nova-compute[72129]: INFO nova.virt.block_device [None req-453d0293-2873-4e15-a594-55840971ac91 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Attempting to driver detach volume 00288fea-1b8e-4835-8b92-614365fa2be4 from mountpoint /dev/vdb
Aug 01 14:03:14 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-453d0293-2873-4e15-a594-55840971ac91 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Attempting to detach device vdb from instance 53b76ca4-30f0-4fd4-9928-714c7073a490 from the persistent domain config. {{(pid=72129) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 14:03:14 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-453d0293-2873-4e15-a594-55840971ac91 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 14:03:14 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:03:14 user nova-compute[72129]:   <source dev="/dev/sdb"/>
Aug 01 14:03:14 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 14:03:14 user nova-compute[72129]:   <serial>00288fea-1b8e-4835-8b92-614365fa2be4</serial>
Aug 01 14:03:14 user nova-compute[72129]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 01 14:03:14 user nova-compute[72129]: </disk>
Aug 01 14:03:14 user nova-compute[72129]:  {{(pid=72129) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 14:03:14 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-453d0293-2873-4e15-a594-55840971ac91 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Successfully detached device vdb from instance 53b76ca4-30f0-4fd4-9928-714c7073a490 from the persistent domain config.
Aug 01 14:03:14 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-453d0293-2873-4e15-a594-55840971ac91 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 53b76ca4-30f0-4fd4-9928-714c7073a490 from the live domain config. {{(pid=72129) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 14:03:14 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-453d0293-2873-4e15-a594-55840971ac91 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 14:03:14 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:03:14 user nova-compute[72129]:   <source dev="/dev/sdb"/>
Aug 01 14:03:14 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 14:03:14 user nova-compute[72129]:   <serial>00288fea-1b8e-4835-8b92-614365fa2be4</serial>
Aug 01 14:03:14 user nova-compute[72129]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 01 14:03:14 user nova-compute[72129]: </disk>
Aug 01 14:03:14 user nova-compute[72129]:  {{(pid=72129) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 14:03:14 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Received event <DeviceRemovedEvent: 1690898594.6081305, 53b76ca4-30f0-4fd4-9928-714c7073a490 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72129) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 14:03:14 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-453d0293-2873-4e15-a594-55840971ac91 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 53b76ca4-30f0-4fd4-9928-714c7073a490 {{(pid=72129) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 14:03:14 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-453d0293-2873-4e15-a594-55840971ac91 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Successfully detached device vdb from instance 53b76ca4-30f0-4fd4-9928-714c7073a490 from the live domain config.
Aug 01 14:03:14 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-453d0293-2873-4e15-a594-55840971ac91 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] calling os-brick to detach iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 14:03:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-453d0293-2873-4e15-a594-55840971ac91 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, {'target_iqns': ['iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ruipGBEm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:03:14 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-453d0293-2873-4e15-a594-55840971ac91 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:03:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-453d0293-2873-4e15-a594-55840971ac91 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:03:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-453d0293-2873-4e15-a594-55840971ac91 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:03:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-453d0293-2873-4e15-a594-55840971ac91 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4', 0)] {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 14:03:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:14 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed9847c-a4b2-4968-b309-c2a7d1d62f0f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:14 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c8a4aa9-afc5-4d30-9783-819658b7fdd1]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-453d0293-2873-4e15-a594-55840971ac91 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:03:14 user nova-compute[72129]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)
Aug 01 14:03:14 user nova-compute[72129]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 (non-flash)
Aug 01 14:03:14 user nova-compute[72129]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d (non-flash)
Aug 01 14:03:14 user nova-compute[72129]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)
Aug 01 14:03:14 user nova-compute[72129]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f (non-flash)
Aug 01 14:03:14 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:03:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-453d0293-2873-4e15-a594-55840971ac91 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:03:14 user nova-compute[72129]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)
Aug 01 14:03:14 user nova-compute[72129]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 (non-flash)
Aug 01 14:03:14 user nova-compute[72129]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d (non-flash)
Aug 01 14:03:14 user nova-compute[72129]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)
Aug 01 14:03:14 user nova-compute[72129]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f (non-flash)
Aug 01 14:03:14 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:03:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-453d0293-2873-4e15-a594-55840971ac91 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f282e134790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4'): ({'sdb'}, set())}) {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 14:03:14 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-453d0293-2873-4e15-a594-55840971ac91 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Removing single pathed devices sdb {{(pid=72129) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 14:03:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:14 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1e4911-476e-43a6-9a94-24b831d4825b]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:14 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[87566acb-c189-46e9-bc46-439914de2dc1]: (4, ('ok\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:14 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-453d0293-2873-4e15-a594-55840971ac91 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Flushing IO for device /dev/sdb {{(pid=72129) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 14:03:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:14 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d62126f4-e6cf-4f7e-91e7-564d6b3ab017]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:14 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-453d0293-2873-4e15-a594-55840971ac91 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72129) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 14:03:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:14 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[560f3e09-adf0-44ee-9c79-9514253621bf]: (4, ('1', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:14 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-453d0293-2873-4e15-a594-55840971ac91 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 14:03:14 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-453d0293-2873-4e15-a594-55840971ac91 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] SCSI volumes sdb have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 14:03:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-453d0293-2873-4e15-a594-55840971ac91 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4')] {{(pid=72129) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 14:03:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:14 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5cdf200-6256-4872-8415-cbbd4137b469]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-453d0293-2873-4e15-a594-55840971ac91 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:03:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 -p 172.16.0.220:3260 --logout {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:14 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da05962-dff9-4c16-8dbe-4ea33e933739]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-453d0293-2873-4e15-a594-55840971ac91 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4, portal: 172.16.0.220,3260]
Aug 01 14:03:14 user nova-compute[72129]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4, portal: 172.16.0.220,3260] successful.
Aug 01 14:03:14 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:03:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 -p 172.16.0.220:3260 --op delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00288fea-1b8e-4835-8b92-614365fa2be4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:14 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf746221-140b-40b7-a0bc-5c9e5ebb2eab]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-453d0293-2873-4e15-a594-55840971ac91 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:03:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-453d0293-2873-4e15-a594-55840971ac91 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:03:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-453d0293-2873-4e15-a594-55840971ac91 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] <== disconnect_volume: return (304ms) None {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:03:14 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-453d0293-2873-4e15-a594-55840971ac91 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Disconnected iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 14:03:15 user nova-compute[72129]: DEBUG nova.objects.instance [None req-453d0293-2873-4e15-a594-55840971ac91 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lazy-loading 'flavor' on Instance uuid 53b76ca4-30f0-4fd4-9928-714c7073a490 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:03:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-453d0293-2873-4e15-a594-55840971ac91 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "53b76ca4-30f0-4fd4-9928-714c7073a490" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.663s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:03:15 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:03:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-7c272637-6356-42b0-8fea-9278c4465efe tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Acquiring lock "53b76ca4-30f0-4fd4-9928-714c7073a490" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:03:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-7c272637-6356-42b0-8fea-9278c4465efe tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "53b76ca4-30f0-4fd4-9928-714c7073a490" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:03:16 user nova-compute[72129]: DEBUG nova.compute.manager [None req-7c272637-6356-42b0-8fea-9278c4465efe tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:03:16 user nova-compute[72129]: DEBUG nova.compute.manager [None req-7c272637-6356-42b0-8fea-9278c4465efe tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72129) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 01 14:03:16 user nova-compute[72129]: DEBUG nova.objects.instance [None req-7c272637-6356-42b0-8fea-9278c4465efe tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lazy-loading 'flavor' on Instance uuid 53b76ca4-30f0-4fd4-9928-714c7073a490 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:03:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:03:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:03:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:03:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:03:16 user nova-compute[72129]: DEBUG nova.compute.manager [req-6fdb73ff-1dd0-4d06-80b0-2e76e0f2a88a req-6359cfb9-2087-487d-a7f5-9e7821cf93a7 service nova] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Received event network-vif-unplugged-b7271bae-a440-4d06-87d0-cece38122deb {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:03:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-6fdb73ff-1dd0-4d06-80b0-2e76e0f2a88a req-6359cfb9-2087-487d-a7f5-9e7821cf93a7 service nova] Acquiring lock "53b76ca4-30f0-4fd4-9928-714c7073a490-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:03:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-6fdb73ff-1dd0-4d06-80b0-2e76e0f2a88a req-6359cfb9-2087-487d-a7f5-9e7821cf93a7 service nova] Lock "53b76ca4-30f0-4fd4-9928-714c7073a490-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:03:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-6fdb73ff-1dd0-4d06-80b0-2e76e0f2a88a req-6359cfb9-2087-487d-a7f5-9e7821cf93a7 service nova] Lock "53b76ca4-30f0-4fd4-9928-714c7073a490-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:03:16 user nova-compute[72129]: DEBUG nova.compute.manager [req-6fdb73ff-1dd0-4d06-80b0-2e76e0f2a88a req-6359cfb9-2087-487d-a7f5-9e7821cf93a7 service nova] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] No waiting events found dispatching network-vif-unplugged-b7271bae-a440-4d06-87d0-cece38122deb {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:03:16 user nova-compute[72129]: WARNING nova.compute.manager [req-6fdb73ff-1dd0-4d06-80b0-2e76e0f2a88a req-6359cfb9-2087-487d-a7f5-9e7821cf93a7 service nova] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Received unexpected event network-vif-unplugged-b7271bae-a440-4d06-87d0-cece38122deb for instance with vm_state active and task_state powering-off.
Aug 01 14:03:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:03:17 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Instance destroyed successfully.
Aug 01 14:03:17 user nova-compute[72129]: DEBUG nova.compute.manager [None req-7c272637-6356-42b0-8fea-9278c4465efe tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:03:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-7c272637-6356-42b0-8fea-9278c4465efe tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "53b76ca4-30f0-4fd4-9928-714c7073a490" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.827s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:03:18 user nova-compute[72129]: DEBUG nova.compute.manager [req-c13b334d-dc96-4bc6-80b2-37ee106cd8b8 req-16b33d95-6a22-4a26-999e-841f2552f2ac service nova] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Received event network-vif-plugged-b7271bae-a440-4d06-87d0-cece38122deb {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:03:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-c13b334d-dc96-4bc6-80b2-37ee106cd8b8 req-16b33d95-6a22-4a26-999e-841f2552f2ac service nova] Acquiring lock "53b76ca4-30f0-4fd4-9928-714c7073a490-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:03:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-c13b334d-dc96-4bc6-80b2-37ee106cd8b8 req-16b33d95-6a22-4a26-999e-841f2552f2ac service nova] Lock "53b76ca4-30f0-4fd4-9928-714c7073a490-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:03:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-c13b334d-dc96-4bc6-80b2-37ee106cd8b8 req-16b33d95-6a22-4a26-999e-841f2552f2ac service nova] Lock "53b76ca4-30f0-4fd4-9928-714c7073a490-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:03:18 user nova-compute[72129]: DEBUG nova.compute.manager [req-c13b334d-dc96-4bc6-80b2-37ee106cd8b8 req-16b33d95-6a22-4a26-999e-841f2552f2ac service nova] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] No waiting events found dispatching network-vif-plugged-b7271bae-a440-4d06-87d0-cece38122deb {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:03:18 user nova-compute[72129]: WARNING nova.compute.manager [req-c13b334d-dc96-4bc6-80b2-37ee106cd8b8 req-16b33d95-6a22-4a26-999e-841f2552f2ac service nova] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Received unexpected event network-vif-plugged-b7271bae-a440-4d06-87d0-cece38122deb for instance with vm_state stopped and task_state None.
Aug 01 14:03:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:03:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:03:22 user nova-compute[72129]: DEBUG nova.compute.manager [req-4856574d-df13-44a5-ac61-0fd90c888b56 req-89227065-b6dd-4f62-ba37-cb101319abe6 service nova] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Received event network-changed-04bc1afa-2e8a-4dd9-961f-e695f43e3061 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:03:22 user nova-compute[72129]: DEBUG nova.compute.manager [req-4856574d-df13-44a5-ac61-0fd90c888b56 req-89227065-b6dd-4f62-ba37-cb101319abe6 service nova] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Refreshing instance network info cache due to event network-changed-04bc1afa-2e8a-4dd9-961f-e695f43e3061. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 14:03:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-4856574d-df13-44a5-ac61-0fd90c888b56 req-89227065-b6dd-4f62-ba37-cb101319abe6 service nova] Acquiring lock "refresh_cache-8e5e94dd-b575-48f1-a617-1bd917567220" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:03:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-4856574d-df13-44a5-ac61-0fd90c888b56 req-89227065-b6dd-4f62-ba37-cb101319abe6 service nova] Acquired lock "refresh_cache-8e5e94dd-b575-48f1-a617-1bd917567220" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:03:22 user nova-compute[72129]: DEBUG nova.network.neutron [req-4856574d-df13-44a5-ac61-0fd90c888b56 req-89227065-b6dd-4f62-ba37-cb101319abe6 service nova] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Refreshing network info cache for port 04bc1afa-2e8a-4dd9-961f-e695f43e3061 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 14:03:23 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b5fbf950-5b41-4a80-a8b7-b79a8f671146 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Acquiring lock "8e5e94dd-b575-48f1-a617-1bd917567220" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:03:23 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b5fbf950-5b41-4a80-a8b7-b79a8f671146 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Lock "8e5e94dd-b575-48f1-a617-1bd917567220" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:03:23 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b5fbf950-5b41-4a80-a8b7-b79a8f671146 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Acquiring lock "8e5e94dd-b575-48f1-a617-1bd917567220-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:03:23 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b5fbf950-5b41-4a80-a8b7-b79a8f671146 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Lock "8e5e94dd-b575-48f1-a617-1bd917567220-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:03:23 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b5fbf950-5b41-4a80-a8b7-b79a8f671146 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Lock "8e5e94dd-b575-48f1-a617-1bd917567220-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:03:23 user nova-compute[72129]: INFO nova.compute.manager [None req-b5fbf950-5b41-4a80-a8b7-b79a8f671146 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Terminating instance
Aug 01 14:03:23 user nova-compute[72129]: DEBUG nova.compute.manager [None req-b5fbf950-5b41-4a80-a8b7-b79a8f671146 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Start destroying the instance on the hypervisor. {{(pid=72129) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 14:03:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:03:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:03:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:03:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:03:23 user nova-compute[72129]: DEBUG nova.compute.manager [req-928aaa5c-fdc9-4993-a9e3-c555d14130db req-4f03711c-bded-4ebc-8561-ad218127554d service nova] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Received event network-vif-unplugged-04bc1afa-2e8a-4dd9-961f-e695f43e3061 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:03:23 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-928aaa5c-fdc9-4993-a9e3-c555d14130db req-4f03711c-bded-4ebc-8561-ad218127554d service nova] Acquiring lock "8e5e94dd-b575-48f1-a617-1bd917567220-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:03:23 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-928aaa5c-fdc9-4993-a9e3-c555d14130db req-4f03711c-bded-4ebc-8561-ad218127554d service nova] Lock "8e5e94dd-b575-48f1-a617-1bd917567220-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:03:23 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-928aaa5c-fdc9-4993-a9e3-c555d14130db req-4f03711c-bded-4ebc-8561-ad218127554d service nova] Lock "8e5e94dd-b575-48f1-a617-1bd917567220-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:03:23 user nova-compute[72129]: DEBUG nova.compute.manager [req-928aaa5c-fdc9-4993-a9e3-c555d14130db req-4f03711c-bded-4ebc-8561-ad218127554d service nova] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] No waiting events found dispatching network-vif-unplugged-04bc1afa-2e8a-4dd9-961f-e695f43e3061 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:03:23 user nova-compute[72129]: DEBUG nova.compute.manager [req-928aaa5c-fdc9-4993-a9e3-c555d14130db req-4f03711c-bded-4ebc-8561-ad218127554d service nova] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Received event network-vif-unplugged-04bc1afa-2e8a-4dd9-961f-e695f43e3061 for instance with task_state deleting. {{(pid=72129) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 14:03:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:03:23 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Instance destroyed successfully.
Aug 01 14:03:23 user nova-compute[72129]: DEBUG nova.objects.instance [None req-b5fbf950-5b41-4a80-a8b7-b79a8f671146 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Lazy-loading 'resources' on Instance uuid 8e5e94dd-b575-48f1-a617-1bd917567220 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:03:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-b5fbf950-5b41-4a80-a8b7-b79a8f671146 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T13:57:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1168215618',display_name='tempest-TestShelveInstance-server-1168215618',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1168215618',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNFarSMkiI7/JpPdcoHACAwX8uNCAoNCeZYHIIMICpbfXLOVKT0O+wIjjJ8GmZRehNvjG5JuqMkHRVBmF7oISjKtI62K0zyKSE4F/GhjI/49epXOdkazkwngdzB9LjRJNQ==',key_name='tempest-TestShelveInstance-909637078',keypairs=<?>,launch_index=0,launched_at=2023-08-01T14:01:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4e0c65958662420fa6d8d73c5e9fdc25',ramdisk_id='',reservation_id='r-xsrkrpme',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-419749450',owner_user_name='tempest-TestShelveInstance-419749450-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T14:01:47Z,user_data=None,user_id='fde5b0e7d7664dfe9f4d9ce0dc20a8e4',uuid=8e5e94dd-b575-48f1-a617-1bd917567220,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "04bc1afa-2e8a-4dd9-961f-e695f43e3061", "address": "fa:16:3e:69:a4:f0", "network": {"id": "567d2893-d3e8-41e1-a0fe-4414df317d0c", "bridge": "br-int", "label": "tempest-TestShelveInstance-887577340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e0c65958662420fa6d8d73c5e9fdc25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04bc1afa-2e", "ovs_interfaceid": "04bc1afa-2e8a-4dd9-961f-e695f43e3061", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 14:03:23 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-b5fbf950-5b41-4a80-a8b7-b79a8f671146 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Converting VIF {"id": "04bc1afa-2e8a-4dd9-961f-e695f43e3061", "address": "fa:16:3e:69:a4:f0", "network": {"id": "567d2893-d3e8-41e1-a0fe-4414df317d0c", "bridge": "br-int", "label": "tempest-TestShelveInstance-887577340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e0c65958662420fa6d8d73c5e9fdc25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04bc1afa-2e", "ovs_interfaceid": "04bc1afa-2e8a-4dd9-961f-e695f43e3061", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:03:23 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-b5fbf950-5b41-4a80-a8b7-b79a8f671146 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:a4:f0,bridge_name='br-int',has_traffic_filtering=True,id=04bc1afa-2e8a-4dd9-961f-e695f43e3061,network=Network(567d2893-d3e8-41e1-a0fe-4414df317d0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04bc1afa-2e') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:03:23 user nova-compute[72129]: DEBUG os_vif [None req-b5fbf950-5b41-4a80-a8b7-b79a8f671146 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:a4:f0,bridge_name='br-int',has_traffic_filtering=True,id=04bc1afa-2e8a-4dd9-961f-e695f43e3061,network=Network(567d2893-d3e8-41e1-a0fe-4414df317d0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04bc1afa-2e') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 14:03:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:03:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap04bc1afa-2e, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:03:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:03:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:03:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:03:23 user nova-compute[72129]: INFO os_vif [None req-b5fbf950-5b41-4a80-a8b7-b79a8f671146 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:a4:f0,bridge_name='br-int',has_traffic_filtering=True,id=04bc1afa-2e8a-4dd9-961f-e695f43e3061,network=Network(567d2893-d3e8-41e1-a0fe-4414df317d0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04bc1afa-2e')
Aug 01 14:03:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5fbf950-5b41-4a80-a8b7-b79a8f671146 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] calling os-brick to detach iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 14:03:23 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5fbf950-5b41-4a80-a8b7-b79a8f671146 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, {'target_iqns': ['iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'anVDsYRG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:03:23 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-b5fbf950-5b41-4a80-a8b7-b79a8f671146 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:03:23 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-b5fbf950-5b41-4a80-a8b7-b79a8f671146 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:03:23 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-b5fbf950-5b41-4a80-a8b7-b79a8f671146 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:03:23 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5fbf950-5b41-4a80-a8b7-b79a8f671146 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d', 0)] {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 14:03:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:23 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec75f9c-28bc-4894-b287-48065cf7ce86]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:23 user nova-compute[72129]: DEBUG nova.network.neutron [req-4856574d-df13-44a5-ac61-0fd90c888b56 req-89227065-b6dd-4f62-ba37-cb101319abe6 service nova] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Updated VIF entry in instance network info cache for port 04bc1afa-2e8a-4dd9-961f-e695f43e3061. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 14:03:23 user nova-compute[72129]: DEBUG nova.network.neutron [req-4856574d-df13-44a5-ac61-0fd90c888b56 req-89227065-b6dd-4f62-ba37-cb101319abe6 service nova] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Updating instance_info_cache with network_info: [{"id": "04bc1afa-2e8a-4dd9-961f-e695f43e3061", "address": "fa:16:3e:69:a4:f0", "network": {"id": "567d2893-d3e8-41e1-a0fe-4414df317d0c", "bridge": "br-int", "label": "tempest-TestShelveInstance-887577340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e0c65958662420fa6d8d73c5e9fdc25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04bc1afa-2e", "ovs_interfaceid": "04bc1afa-2e8a-4dd9-961f-e695f43e3061", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:03:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:23 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[703c4891-c878-4d54-a84b-168d63889815]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:23 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5fbf950-5b41-4a80-a8b7-b79a8f671146 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:03:23 user nova-compute[72129]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)
Aug 01 14:03:23 user nova-compute[72129]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d (non-flash)
Aug 01 14:03:23 user nova-compute[72129]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)
Aug 01 14:03:23 user nova-compute[72129]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f (non-flash)
Aug 01 14:03:23 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:03:23 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5fbf950-5b41-4a80-a8b7-b79a8f671146 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:03:23 user nova-compute[72129]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)
Aug 01 14:03:23 user nova-compute[72129]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d (non-flash)
Aug 01 14:03:23 user nova-compute[72129]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)
Aug 01 14:03:23 user nova-compute[72129]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f (non-flash)
Aug 01 14:03:23 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:03:23 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5fbf950-5b41-4a80-a8b7-b79a8f671146 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f282833be20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d'): ({'sde'}, set())}) {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 14:03:23 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-b5fbf950-5b41-4a80-a8b7-b79a8f671146 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Removing single pathed devices sde {{(pid=72129) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 14:03:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:23 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-4856574d-df13-44a5-ac61-0fd90c888b56 req-89227065-b6dd-4f62-ba37-cb101319abe6 service nova] Releasing lock "refresh_cache-8e5e94dd-b575-48f1-a617-1bd917567220" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:03:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:23 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9ec505-9bd6-482e-82e8-72cd590f694f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:23 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[55905e38-64b1-44ee-b9b4-e8588f6f97e1]: (4, ('ok\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:23 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-b5fbf950-5b41-4a80-a8b7-b79a8f671146 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Flushing IO for device /dev/sde {{(pid=72129) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 14:03:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:24 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d679ecc-e04e-4624-9b61-a68f2f639b34]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:24 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-b5fbf950-5b41-4a80-a8b7-b79a8f671146 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72129) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 14:03:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:24 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea1d9fa-7bdf-4a9f-bff3-f3b39f1e5589]: (4, ('1', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:24 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-b5fbf950-5b41-4a80-a8b7-b79a8f671146 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 14:03:24 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-b5fbf950-5b41-4a80-a8b7-b79a8f671146 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] SCSI volumes sde have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 14:03:24 user nova-compute[72129]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23366656332633462', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_c30c5d33', '/dev/disk/by-id/scsi-1SCST_BIOc30c5d33-3fec2c4b35ec5eb7') {{(pid=82887) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 01 14:03:24 user nova-compute[72129]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23366656332633462
Aug 01 14:03:24 user nova-compute[72129]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_c30c5d33
Aug 01 14:03:24 user nova-compute[72129]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOc30c5d33-3fec2c4b35ec5eb7
Aug 01 14:03:24 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[1280b345-50c7-4ada-99c4-814068a4fec3]: (4, None) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5fbf950-5b41-4a80-a8b7-b79a8f671146 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d')] {{(pid=72129) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 14:03:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:24 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[0daff7fd-6ecf-46ed-bad7-c25d5f69974e]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5fbf950-5b41-4a80-a8b7-b79a8f671146 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:03:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d -p 172.16.0.220:3260 --logout {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:24 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b17de0-a6f1-4d7b-8ead-7dc6fd77541e]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5fbf950-5b41-4a80-a8b7-b79a8f671146 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d, portal: 172.16.0.220,3260]
Aug 01 14:03:24 user nova-compute[72129]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d, portal: 172.16.0.220,3260] successful.
Aug 01 14:03:24 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:03:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d -p 172.16.0.220:3260 --op delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e4d6571-fba3-42fe-9abd-cddd72d2c46d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:24 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65317af-bc52-4277-ac66-317725b3847f]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5fbf950-5b41-4a80-a8b7-b79a8f671146 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:03:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-b5fbf950-5b41-4a80-a8b7-b79a8f671146 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.383s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:03:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5fbf950-5b41-4a80-a8b7-b79a8f671146 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] <== disconnect_volume: return (385ms) None {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:03:24 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5fbf950-5b41-4a80-a8b7-b79a8f671146 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Disconnected iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 14:03:24 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-b5fbf950-5b41-4a80-a8b7-b79a8f671146 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Deleting instance files /opt/stack/data/nova/instances/8e5e94dd-b575-48f1-a617-1bd917567220_del
Aug 01 14:03:24 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-b5fbf950-5b41-4a80-a8b7-b79a8f671146 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Deletion of /opt/stack/data/nova/instances/8e5e94dd-b575-48f1-a617-1bd917567220_del complete
Aug 01 14:03:24 user nova-compute[72129]: INFO nova.compute.manager [None req-b5fbf950-5b41-4a80-a8b7-b79a8f671146 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Took 1.27 seconds to destroy the instance on the hypervisor.
Aug 01 14:03:24 user nova-compute[72129]: DEBUG oslo.service.loopingcall [None req-b5fbf950-5b41-4a80-a8b7-b79a8f671146 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72129) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 14:03:24 user nova-compute[72129]: DEBUG nova.compute.manager [-] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Deallocating network for instance {{(pid=72129) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 14:03:24 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] deallocate_for_instance() {{(pid=72129) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 14:03:24 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:03:24 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Took 0.58 seconds to deallocate network for instance.
Aug 01 14:03:25 user nova-compute[72129]: DEBUG nova.compute.manager [req-dabcc727-012e-4575-8f1b-36db7275315e req-7018b7ee-db10-4b69-b101-c7b2a924caba service nova] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Received event network-vif-plugged-04bc1afa-2e8a-4dd9-961f-e695f43e3061 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:03:25 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-dabcc727-012e-4575-8f1b-36db7275315e req-7018b7ee-db10-4b69-b101-c7b2a924caba service nova] Acquiring lock "8e5e94dd-b575-48f1-a617-1bd917567220-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:03:25 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-dabcc727-012e-4575-8f1b-36db7275315e req-7018b7ee-db10-4b69-b101-c7b2a924caba service nova] Lock "8e5e94dd-b575-48f1-a617-1bd917567220-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:03:25 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-dabcc727-012e-4575-8f1b-36db7275315e req-7018b7ee-db10-4b69-b101-c7b2a924caba service nova] Lock "8e5e94dd-b575-48f1-a617-1bd917567220-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:03:25 user nova-compute[72129]: DEBUG nova.compute.manager [req-dabcc727-012e-4575-8f1b-36db7275315e req-7018b7ee-db10-4b69-b101-c7b2a924caba service nova] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] No waiting events found dispatching network-vif-plugged-04bc1afa-2e8a-4dd9-961f-e695f43e3061 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:03:25 user nova-compute[72129]: WARNING nova.compute.manager [req-dabcc727-012e-4575-8f1b-36db7275315e req-7018b7ee-db10-4b69-b101-c7b2a924caba service nova] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Received unexpected event network-vif-plugged-04bc1afa-2e8a-4dd9-961f-e695f43e3061 for instance with vm_state active and task_state deleting.
Aug 01 14:03:25 user nova-compute[72129]: DEBUG nova.compute.manager [req-dabcc727-012e-4575-8f1b-36db7275315e req-7018b7ee-db10-4b69-b101-c7b2a924caba service nova] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Received event network-vif-deleted-04bc1afa-2e8a-4dd9-961f-e695f43e3061 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:03:25 user nova-compute[72129]: INFO nova.compute.manager [None req-b5fbf950-5b41-4a80-a8b7-b79a8f671146 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Took 0.80 seconds to detach 1 volumes for instance.
Aug 01 14:03:25 user nova-compute[72129]: DEBUG nova.compute.manager [None req-b5fbf950-5b41-4a80-a8b7-b79a8f671146 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Deleting volume: 9e4d6571-fba3-42fe-9abd-cddd72d2c46d {{(pid=72129) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 01 14:03:25 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b5fbf950-5b41-4a80-a8b7-b79a8f671146 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:03:25 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b5fbf950-5b41-4a80-a8b7-b79a8f671146 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:03:25 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:03:26 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-b5fbf950-5b41-4a80-a8b7-b79a8f671146 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:03:26 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-b5fbf950-5b41-4a80-a8b7-b79a8f671146 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:03:26 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b5fbf950-5b41-4a80-a8b7-b79a8f671146 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.372s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:03:26 user nova-compute[72129]: INFO nova.scheduler.client.report [None req-b5fbf950-5b41-4a80-a8b7-b79a8f671146 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Deleted allocations for instance 8e5e94dd-b575-48f1-a617-1bd917567220
Aug 01 14:03:26 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b5fbf950-5b41-4a80-a8b7-b79a8f671146 tempest-TestShelveInstance-419749450 tempest-TestShelveInstance-419749450-project-member] Lock "8e5e94dd-b575-48f1-a617-1bd917567220" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.260s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:03:28 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:03:31 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-4b84f071-db3c-4dac-ae69-4fb7d6656d58 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Acquiring lock "85062e35-e302-46f7-8d66-24cf9e7199f7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:03:31 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-4b84f071-db3c-4dac-ae69-4fb7d6656d58 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lock "85062e35-e302-46f7-8d66-24cf9e7199f7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:03:31 user nova-compute[72129]: DEBUG nova.objects.instance [None req-4b84f071-db3c-4dac-ae69-4fb7d6656d58 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lazy-loading 'flavor' on Instance uuid 85062e35-e302-46f7-8d66-24cf9e7199f7 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:03:31 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-4b84f071-db3c-4dac-ae69-4fb7d6656d58 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lock "85062e35-e302-46f7-8d66-24cf9e7199f7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:03:31 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-4b84f071-db3c-4dac-ae69-4fb7d6656d58 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Acquiring lock "85062e35-e302-46f7-8d66-24cf9e7199f7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:03:31 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-4b84f071-db3c-4dac-ae69-4fb7d6656d58 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lock "85062e35-e302-46f7-8d66-24cf9e7199f7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:03:31 user nova-compute[72129]: INFO nova.compute.manager [None req-4b84f071-db3c-4dac-ae69-4fb7d6656d58 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Attaching volume 0a025412-1d03-4a7a-97d4-0c8c20b2bde3 to /dev/vdb
Aug 01 14:03:31 user nova-compute[72129]: DEBUG os_brick.utils [None req-4b84f071-db3c-4dac-ae69-4fb7d6656d58 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:03:31 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:31 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:31 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb9a5934-c9aa-40b8-88de-67f5a211f6f3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f9b449c2cd3d\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:31 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:31 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:31 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84f62fb-052b-4952-9f15-e4a12c4df1e1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:31 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:31 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:31 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[492d2860-eabf-469b-8976-26891cda17e5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:31 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd835cc2-18a7-4c66-a9b9-4f595bbc20d3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:31 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-4b84f071-db3c-4dac-ae69-4fb7d6656d58 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Running cmd (subprocess): nvme version {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-4b84f071-db3c-4dac-ae69-4fb7d6656d58 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] 'nvme version' failed. Not Retrying. {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 14:03:32 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4b84f071-db3c-4dac-ae69-4fb7d6656d58 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] nvme not present on system {{(pid=72129) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 14:03:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 14:03:32 user nova-compute[72129]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 14:03:32 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac09e572-7c0a-49ba-b87a-efd079c26c90]: (4, '') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:32 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-4b84f071-db3c-4dac-ae69-4fb7d6656d58 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72129) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 14:03:32 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-4b84f071-db3c-4dac-ae69-4fb7d6656d58 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 14:03:32 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-4b84f071-db3c-4dac-ae69-4fb7d6656d58 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] LIGHTOS: no hostnqn found. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 14:03:32 user nova-compute[72129]: DEBUG os_brick.utils [None req-4b84f071-db3c-4dac-ae69-4fb7d6656d58 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f9b449c2cd3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:03:32 user nova-compute[72129]: DEBUG nova.virt.block_device [None req-4b84f071-db3c-4dac-ae69-4fb7d6656d58 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Updating existing volume attachment record: 05e3992a-6143-45bb-bbe7-204a38018cde {{(pid=72129) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 14:03:32 user nova-compute[72129]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690898597.1229005, 53b76ca4-30f0-4fd4-9928-714c7073a490 => Stopped> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:03:32 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] VM Stopped (Lifecycle Event)
Aug 01 14:03:32 user nova-compute[72129]: DEBUG nova.compute.manager [None req-98f5ab96-9cdf-4eaf-a45a-3a89d705335b None None] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:03:32 user nova-compute[72129]: DEBUG nova.compute.manager [None req-98f5ab96-9cdf-4eaf-a45a-3a89d705335b None None] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:03:33 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:03:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5c39b42f-c245-4dc9-8a5e-dd5ab33aef4b tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Acquiring lock "e2cf5877-55dd-44ce-9b58-b662afe8e62e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:03:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5c39b42f-c245-4dc9-8a5e-dd5ab33aef4b tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lock "e2cf5877-55dd-44ce-9b58-b662afe8e62e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:03:35 user nova-compute[72129]: DEBUG nova.objects.instance [None req-5c39b42f-c245-4dc9-8a5e-dd5ab33aef4b tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lazy-loading 'flavor' on Instance uuid e2cf5877-55dd-44ce-9b58-b662afe8e62e {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:03:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5c39b42f-c245-4dc9-8a5e-dd5ab33aef4b tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lock "e2cf5877-55dd-44ce-9b58-b662afe8e62e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:03:35 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:03:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5c39b42f-c245-4dc9-8a5e-dd5ab33aef4b tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Acquiring lock "e2cf5877-55dd-44ce-9b58-b662afe8e62e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:03:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5c39b42f-c245-4dc9-8a5e-dd5ab33aef4b tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lock "e2cf5877-55dd-44ce-9b58-b662afe8e62e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:03:35 user nova-compute[72129]: INFO nova.compute.manager [None req-5c39b42f-c245-4dc9-8a5e-dd5ab33aef4b tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Attaching volume eeaf290a-3aac-4702-af07-b8c15a4467e1 to /dev/vdb
Aug 01 14:03:36 user nova-compute[72129]: DEBUG os_brick.utils [None req-5c39b42f-c245-4dc9-8a5e-dd5ab33aef4b tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:03:36 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:36 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:36 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[443b7927-f69a-4e0b-b84a-bc41781f0120]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f9b449c2cd3d\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:36 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:36 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:36 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[1827fc01-8453-4eb7-bfad-4955952c00a1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:36 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:36 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:36 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf9402e-9f4e-4f5c-96b6-ed1029f2ff36]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:36 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee6ad50-4fed-4c81-8fd2-d894af3e8519]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:36 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-5c39b42f-c245-4dc9-8a5e-dd5ab33aef4b tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Running cmd (subprocess): nvme version {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:36 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-5c39b42f-c245-4dc9-8a5e-dd5ab33aef4b tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] 'nvme version' failed. Not Retrying. {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 14:03:36 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5c39b42f-c245-4dc9-8a5e-dd5ab33aef4b tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] nvme not present on system {{(pid=72129) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 14:03:36 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:36 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 14:03:36 user nova-compute[72129]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 14:03:36 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[299c158e-5cd3-4844-b1d0-32a965c21694]: (4, '') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:36 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-5c39b42f-c245-4dc9-8a5e-dd5ab33aef4b tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72129) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 14:03:36 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-5c39b42f-c245-4dc9-8a5e-dd5ab33aef4b tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 14:03:36 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-5c39b42f-c245-4dc9-8a5e-dd5ab33aef4b tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] LIGHTOS: no hostnqn found. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 14:03:36 user nova-compute[72129]: DEBUG os_brick.utils [None req-5c39b42f-c245-4dc9-8a5e-dd5ab33aef4b tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f9b449c2cd3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:03:36 user nova-compute[72129]: DEBUG nova.virt.block_device [None req-5c39b42f-c245-4dc9-8a5e-dd5ab33aef4b tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Updating existing volume attachment record: a5f722a7-233c-4d88-9b5e-992da6ec8d6a {{(pid=72129) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 14:03:38 user nova-compute[72129]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690898603.799755, 8e5e94dd-b575-48f1-a617-1bd917567220 => Stopped> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:03:38 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] VM Stopped (Lifecycle Event)
Aug 01 14:03:38 user nova-compute[72129]: DEBUG nova.compute.manager [None req-65b4b4c2-c609-40e4-9c21-64ddfec57e7b None None] [instance: 8e5e94dd-b575-48f1-a617-1bd917567220] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:03:38 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-bd8b3552-3ad9-4a31-9315-af1843764563 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Acquiring lock "ea050cd6-60e9-41fd-a35c-05fe63d60e57" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-bd8b3552-3ad9-4a31-9315-af1843764563 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Lock "ea050cd6-60e9-41fd-a35c-05fe63d60e57" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG nova.objects.instance [None req-bd8b3552-3ad9-4a31-9315-af1843764563 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Lazy-loading 'flavor' on Instance uuid ea050cd6-60e9-41fd-a35c-05fe63d60e57 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-bd8b3552-3ad9-4a31-9315-af1843764563 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Lock "ea050cd6-60e9-41fd-a35c-05fe63d60e57" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-bd8b3552-3ad9-4a31-9315-af1843764563 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Acquiring lock "ea050cd6-60e9-41fd-a35c-05fe63d60e57" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-bd8b3552-3ad9-4a31-9315-af1843764563 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Lock "ea050cd6-60e9-41fd-a35c-05fe63d60e57" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:03:39 user nova-compute[72129]: INFO nova.compute.manager [None req-bd8b3552-3ad9-4a31-9315-af1843764563 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Attaching volume 79d3d741-ab72-4e2a-bbae-df43b76a4170 to /dev/vdb
Aug 01 14:03:39 user nova-compute[72129]: DEBUG os_brick.utils [None req-bd8b3552-3ad9-4a31-9315-af1843764563 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[587ec972-8221-4e44-b1bb-6950ae1a1b09]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f9b449c2cd3d\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7c07fd-0421-4e71-9951-e81c2f8fb170]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25dd955-cbdf-42fa-8b22-f653375fad67]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[800c23d0-b03c-426f-8b96-ae0d4fa0949a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-bd8b3552-3ad9-4a31-9315-af1843764563 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Running cmd (subprocess): nvme version {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-bd8b3552-3ad9-4a31-9315-af1843764563 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] 'nvme version' failed. Not Retrying. {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bd8b3552-3ad9-4a31-9315-af1843764563 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] nvme not present on system {{(pid=72129) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 14:03:39 user nova-compute[72129]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 14:03:39 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[443ac670-5bef-4fc0-a9ee-20fd4e696ae1]: (4, '') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-bd8b3552-3ad9-4a31-9315-af1843764563 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72129) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-bd8b3552-3ad9-4a31-9315-af1843764563 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-bd8b3552-3ad9-4a31-9315-af1843764563 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] LIGHTOS: no hostnqn found. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG os_brick.utils [None req-bd8b3552-3ad9-4a31-9315-af1843764563 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f9b449c2cd3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG nova.virt.block_device [None req-bd8b3552-3ad9-4a31-9315-af1843764563 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Updating existing volume attachment record: ec7bfee8-2b92-4805-b6c8-fe74dc668b45 {{(pid=72129) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b84f071-db3c-4dac-ae69-4fb7d6656d58 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Calling os-brick to attach iSCSI Volume {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b84f071-db3c-4dac-ae69-4fb7d6656d58 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'waybdZCo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:03:39 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-4b84f071-db3c-4dac-ae69-4fb7d6656d58 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:03:39 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-4b84f071-db3c-4dac-ae69-4fb7d6656d58 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-4b84f071-db3c-4dac-ae69-4fb7d6656d58 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:03:39 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-4b84f071-db3c-4dac-ae69-4fb7d6656d58 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:03:39 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-4b84f071-db3c-4dac-ae69-4fb7d6656d58 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-4b84f071-db3c-4dac-ae69-4fb7d6656d58 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:03:39 user nova-compute[72129]: INFO os_brick.initiator.connectors.iscsi [None req-4b84f071-db3c-4dac-ae69-4fb7d6656d58 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 14:03:39 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 -p 172.16.0.220:3260 {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c3b72f-c375-43fe-82f0-3029af300633]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b84f071-db3c-4dac-ae69-4fb7d6656d58 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 14:03:39 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 -p 172.16.0.220:3260 --interface default --op new {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6e424d-fb51-4867-bc63-9af7f7185530]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3] added\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b84f071-db3c-4dac-ae69-4fb7d6656d58 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3] added
Aug 01 14:03:39 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad297da-7d12-4a42-982e-afd896bb0a5c]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b84f071-db3c-4dac-ae69-4fb7d6656d58 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f75031-ad00-4667-9de0-948c1ecd2bad]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b84f071-db3c-4dac-ae69-4fb7d6656d58 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v waybdZCo {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v waybdZCo" returned: 0 in 0.026s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[2efa19dc-3404-4917-ab77-fe67b0a376d7]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b84f071-db3c-4dac-ae69-4fb7d6656d58 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'waybdZCo'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[02263aa4-9a51-489d-8fe3-040d7e219fcd]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b84f071-db3c-4dac-ae69-4fb7d6656d58 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b083a17a-45b9-4246-8fd0-132a032a911d]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b84f071-db3c-4dac-ae69-4fb7d6656d58 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:03:39 user nova-compute[72129]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)
Aug 01 14:03:39 user nova-compute[72129]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)
Aug 01 14:03:39 user nova-compute[72129]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f (non-flash)
Aug 01 14:03:39 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b84f071-db3c-4dac-ae69-4fb7d6656d58 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:03:39 user nova-compute[72129]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)
Aug 01 14:03:39 user nova-compute[72129]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)
Aug 01 14:03:39 user nova-compute[72129]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f (non-flash)
Aug 01 14:03:39 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 -p 172.16.0.220:3260 --login {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[edce4147-70ee-4f11-82d0-fbf2b15cc37d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b84f071-db3c-4dac-ae69-4fb7d6656d58 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3, portal: 172.16.0.220,3260]
Aug 01 14:03:39 user nova-compute[72129]: Login to [iface: default, target: iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3, portal: 172.16.0.220,3260] successful.
Aug 01 14:03:39 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[561ff2f5-ee59-4157-9ee3-21c0c5355686]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b84f071-db3c-4dac-ae69-4fb7d6656d58 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[93cd16a1-64d8-4537-b7cd-00511c33b17e]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b84f071-db3c-4dac-ae69-4fb7d6656d58 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:03:39 user nova-compute[72129]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)
Aug 01 14:03:39 user nova-compute[72129]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)
Aug 01 14:03:39 user nova-compute[72129]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f (non-flash)
Aug 01 14:03:39 user nova-compute[72129]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 (non-flash)
Aug 01 14:03:39 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b84f071-db3c-4dac-ae69-4fb7d6656d58 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:03:39 user nova-compute[72129]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)
Aug 01 14:03:39 user nova-compute[72129]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)
Aug 01 14:03:39 user nova-compute[72129]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f (non-flash)
Aug 01 14:03:39 user nova-compute[72129]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 (non-flash)
Aug 01 14:03:39 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-4b84f071-db3c-4dac-ae69-4fb7d6656d58 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b84f071-db3c-4dac-ae69-4fb7d6656d58 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Connected to 172.16.0.220:3260 {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-4b84f071-db3c-4dac-ae69-4fb7d6656d58 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] HCTL ('33', '-', '-', 0) found on session 36 with lun 0 {{(pid=72129) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-4b84f071-db3c-4dac-ae69-4fb7d6656d58 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72129) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 14:03:39 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:40 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:40 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1732175-a4a2-4c2f-b638-9bd2ed3c24c3]: (4, ('- - 0', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:40 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-4b84f071-db3c-4dac-ae69-4fb7d6656d58 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Searching for a device in session 36 and hctl ['33', '*', '*', 0] yield: None {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 14:03:40 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:03:41 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-4b84f071-db3c-4dac-ae69-4fb7d6656d58 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Searching for a device in session 36 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 14:03:41 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b84f071-db3c-4dac-ae69-4fb7d6656d58 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'waybdZCo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 14:03:41 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-4b84f071-db3c-4dac-ae69-4fb7d6656d58 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:03:41 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b84f071-db3c-4dac-ae69-4fb7d6656d58 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '23637346330613065', 'path': '/dev/sdb'} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:03:41 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b84f071-db3c-4dac-ae69-4fb7d6656d58 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637346330613065', 'path': '/dev/sdb'} {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 14:03:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Acquiring lock "3891b9d3-832d-4ef7-8ebb-970ddd0a387a" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:03:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lock "3891b9d3-832d-4ef7-8ebb-970ddd0a387a" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:03:41 user nova-compute[72129]: INFO nova.compute.manager [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Unshelving
Aug 01 14:03:41 user nova-compute[72129]: DEBUG nova.objects.instance [None req-4b84f071-db3c-4dac-ae69-4fb7d6656d58 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lazy-loading 'flavor' on Instance uuid 85062e35-e302-46f7-8d66-24cf9e7199f7 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:03:41 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-4b84f071-db3c-4dac-ae69-4fb7d6656d58 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 14:03:41 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:03:41 user nova-compute[72129]:   <source dev="/dev/sdb"/>
Aug 01 14:03:41 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 14:03:41 user nova-compute[72129]:   <serial>0a025412-1d03-4a7a-97d4-0c8c20b2bde3</serial>
Aug 01 14:03:41 user nova-compute[72129]: </disk>
Aug 01 14:03:41 user nova-compute[72129]:  {{(pid=72129) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 14:03:41 user nova-compute[72129]: INFO nova.virt.block_device [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Booting with volume 80a7dc25-351e-4c85-967a-ce6e0c8dc840 at /dev/vdc
Aug 01 14:03:41 user nova-compute[72129]: DEBUG os_brick.utils [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:03:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:41 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ecfe1ad-9614-46c9-99e6-062947c192de]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f9b449c2cd3d\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:41 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ca6024-595a-4eab-bd63-c1b657d6ba3d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:41 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b1458b-ec45-4843-9a43-b3f88f4bf8e2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:41 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[9037616f-1e32-4cbf-a58b-2b84012cb000]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Running cmd (subprocess): nvme version {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] 'nvme version' failed. Not Retrying. {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 14:03:41 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] nvme not present on system {{(pid=72129) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 14:03:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 14:03:41 user nova-compute[72129]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 14:03:41 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[85921a89-1917-44d6-87e3-ed94b30d88c8]: (4, '') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:41 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72129) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 14:03:41 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 14:03:41 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] LIGHTOS: no hostnqn found. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 14:03:41 user nova-compute[72129]: DEBUG os_brick.utils [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f9b449c2cd3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:03:41 user nova-compute[72129]: DEBUG nova.virt.block_device [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Updating existing volume attachment record: c213fff3-3e75-4459-8bfc-fa13d12c6442 {{(pid=72129) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 14:03:41 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-4b84f071-db3c-4dac-ae69-4fb7d6656d58 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:03:41 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-4b84f071-db3c-4dac-ae69-4fb7d6656d58 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:03:41 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-4b84f071-db3c-4dac-ae69-4fb7d6656d58 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] No VIF found with MAC fa:16:3e:9d:bc:ca, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 14:03:43 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c39b42f-c245-4dc9-8a5e-dd5ab33aef4b tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Calling os-brick to attach iSCSI Volume {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 14:03:43 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c39b42f-c245-4dc9-8a5e-dd5ab33aef4b tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:eeaf290a-3aac-4702-af07-b8c15a4467e1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GABzuNwq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:03:43 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-5c39b42f-c245-4dc9-8a5e-dd5ab33aef4b tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:03:43 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-5c39b42f-c245-4dc9-8a5e-dd5ab33aef4b tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:03:43 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-5c39b42f-c245-4dc9-8a5e-dd5ab33aef4b tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:03:43 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-5c39b42f-c245-4dc9-8a5e-dd5ab33aef4b tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:03:43 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-5c39b42f-c245-4dc9-8a5e-dd5ab33aef4b tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eeaf290a-3aac-4702-af07-b8c15a4467e1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:03:43 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-5c39b42f-c245-4dc9-8a5e-dd5ab33aef4b tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eeaf290a-3aac-4702-af07-b8c15a4467e1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:03:43 user nova-compute[72129]: INFO os_brick.initiator.connectors.iscsi [None req-5c39b42f-c245-4dc9-8a5e-dd5ab33aef4b tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 14:03:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eeaf290a-3aac-4702-af07-b8c15a4467e1 -p 172.16.0.220:3260 {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:03:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eeaf290a-3aac-4702-af07-b8c15a4467e1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:43 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d14d7a7-795e-4deb-bccf-b0bf2d0fabae]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:43 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c39b42f-c245-4dc9-8a5e-dd5ab33aef4b tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 14:03:43 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:03:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eeaf290a-3aac-4702-af07-b8c15a4467e1 -p 172.16.0.220:3260 --interface default --op new {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eeaf290a-3aac-4702-af07-b8c15a4467e1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:43 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35c4964-c0fb-448b-a65c-98f0b0a96b52]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eeaf290a-3aac-4702-af07-b8c15a4467e1] added\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:43 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c39b42f-c245-4dc9-8a5e-dd5ab33aef4b tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eeaf290a-3aac-4702-af07-b8c15a4467e1] added
Aug 01 14:03:43 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:03:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eeaf290a-3aac-4702-af07-b8c15a4467e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eeaf290a-3aac-4702-af07-b8c15a4467e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:43 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[57229c3e-dd70-455e-8f60-6b6388f81f45]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:43 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c39b42f-c245-4dc9-8a5e-dd5ab33aef4b tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:03:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eeaf290a-3aac-4702-af07-b8c15a4467e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eeaf290a-3aac-4702-af07-b8c15a4467e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.033s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:43 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2bfcbb-bd24-4690-855e-ea7bf9b92d39]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:43 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c39b42f-c245-4dc9-8a5e-dd5ab33aef4b tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:03:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eeaf290a-3aac-4702-af07-b8c15a4467e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GABzuNwq {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eeaf290a-3aac-4702-af07-b8c15a4467e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GABzuNwq" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:43 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1890f99-86f5-428d-9304-b4bc5777387e]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:43 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c39b42f-c245-4dc9-8a5e-dd5ab33aef4b tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GABzuNwq'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:03:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eeaf290a-3aac-4702-af07-b8c15a4467e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-4b84f071-db3c-4dac-ae69-4fb7d6656d58 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lock "85062e35-e302-46f7-8d66-24cf9e7199f7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.133s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:03:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eeaf290a-3aac-4702-af07-b8c15a4467e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:44 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7d84cc-1d82-4100-9eab-ee3bd7f35b63]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:44 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c39b42f-c245-4dc9-8a5e-dd5ab33aef4b tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:03:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:44 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9b3878-0f29-41f4-acaa-2981cdc81aad]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:44 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c39b42f-c245-4dc9-8a5e-dd5ab33aef4b tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:03:44 user nova-compute[72129]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)
Aug 01 14:03:44 user nova-compute[72129]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)
Aug 01 14:03:44 user nova-compute[72129]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f (non-flash)
Aug 01 14:03:44 user nova-compute[72129]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 (non-flash)
Aug 01 14:03:44 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:03:44 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c39b42f-c245-4dc9-8a5e-dd5ab33aef4b tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:03:44 user nova-compute[72129]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)
Aug 01 14:03:44 user nova-compute[72129]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)
Aug 01 14:03:44 user nova-compute[72129]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f (non-flash)
Aug 01 14:03:44 user nova-compute[72129]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 (non-flash)
Aug 01 14:03:44 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:03:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eeaf290a-3aac-4702-af07-b8c15a4467e1 -p 172.16.0.220:3260 --login {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eeaf290a-3aac-4702-af07-b8c15a4467e1 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:44 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3fe8aea-bb3d-4c0c-8391-95d76d8bf889]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eeaf290a-3aac-4702-af07-b8c15a4467e1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eeaf290a-3aac-4702-af07-b8c15a4467e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:44 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c39b42f-c245-4dc9-8a5e-dd5ab33aef4b tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eeaf290a-3aac-4702-af07-b8c15a4467e1, portal: 172.16.0.220,3260]
Aug 01 14:03:44 user nova-compute[72129]: Login to [iface: default, target: iqn.2010-10.org.openstack:eeaf290a-3aac-4702-af07-b8c15a4467e1, portal: 172.16.0.220,3260] successful.
Aug 01 14:03:44 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:03:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eeaf290a-3aac-4702-af07-b8c15a4467e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eeaf290a-3aac-4702-af07-b8c15a4467e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:44 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[6138374f-db7b-484a-b139-ee531f797ad8]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:44 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c39b42f-c245-4dc9-8a5e-dd5ab33aef4b tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:03:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:44 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc5ef49-1d42-4cc3-a9a4-413b3fc719df]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eeaf290a-3aac-4702-af07-b8c15a4467e1 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:44 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c39b42f-c245-4dc9-8a5e-dd5ab33aef4b tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:03:44 user nova-compute[72129]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)
Aug 01 14:03:44 user nova-compute[72129]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)
Aug 01 14:03:44 user nova-compute[72129]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f (non-flash)
Aug 01 14:03:44 user nova-compute[72129]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 (non-flash)
Aug 01 14:03:44 user nova-compute[72129]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eeaf290a-3aac-4702-af07-b8c15a4467e1 (non-flash)
Aug 01 14:03:44 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:03:44 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c39b42f-c245-4dc9-8a5e-dd5ab33aef4b tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:03:44 user nova-compute[72129]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)
Aug 01 14:03:44 user nova-compute[72129]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)
Aug 01 14:03:44 user nova-compute[72129]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f (non-flash)
Aug 01 14:03:44 user nova-compute[72129]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 (non-flash)
Aug 01 14:03:44 user nova-compute[72129]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eeaf290a-3aac-4702-af07-b8c15a4467e1 (non-flash)
Aug 01 14:03:44 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:03:44 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-5c39b42f-c245-4dc9-8a5e-dd5ab33aef4b tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eeaf290a-3aac-4702-af07-b8c15a4467e1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:03:44 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c39b42f-c245-4dc9-8a5e-dd5ab33aef4b tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Connected to 172.16.0.220:3260 {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 14:03:44 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-5c39b42f-c245-4dc9-8a5e-dd5ab33aef4b tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] HCTL ('36', '-', '-', 0) found on session 37 with lun 0 {{(pid=72129) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 14:03:44 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-5c39b42f-c245-4dc9-8a5e-dd5ab33aef4b tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72129) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 14:03:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:44 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[de2a7a90-444b-4bd2-9d68-d2edea5f33ae]: (4, ('- - 0', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:44 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-5c39b42f-c245-4dc9-8a5e-dd5ab33aef4b tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Searching for a device in session 37 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 14:03:44 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c39b42f-c245-4dc9-8a5e-dd5ab33aef4b tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GABzuNwq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 14:03:45 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-5c39b42f-c245-4dc9-8a5e-dd5ab33aef4b tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:03:45 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c39b42f-c245-4dc9-8a5e-dd5ab33aef4b tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] <== connect_volume: return (1384ms) {'type': 'block', 'scsi_wwn': '23830313332386163', 'path': '/dev/sde'} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:03:45 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c39b42f-c245-4dc9-8a5e-dd5ab33aef4b tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23830313332386163', 'path': '/dev/sde'} {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 14:03:45 user nova-compute[72129]: DEBUG nova.objects.instance [None req-5c39b42f-c245-4dc9-8a5e-dd5ab33aef4b tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lazy-loading 'flavor' on Instance uuid e2cf5877-55dd-44ce-9b58-b662afe8e62e {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:03:45 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-5c39b42f-c245-4dc9-8a5e-dd5ab33aef4b tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 14:03:45 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:03:45 user nova-compute[72129]:   <source dev="/dev/sde"/>
Aug 01 14:03:45 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 14:03:45 user nova-compute[72129]:   <serial>eeaf290a-3aac-4702-af07-b8c15a4467e1</serial>
Aug 01 14:03:45 user nova-compute[72129]: </disk>
Aug 01 14:03:45 user nova-compute[72129]:  {{(pid=72129) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 14:03:45 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-5c39b42f-c245-4dc9-8a5e-dd5ab33aef4b tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:03:45 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-5c39b42f-c245-4dc9-8a5e-dd5ab33aef4b tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:03:45 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-5c39b42f-c245-4dc9-8a5e-dd5ab33aef4b tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] No VIF found with MAC fa:16:3e:18:48:0e, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 14:03:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5c39b42f-c245-4dc9-8a5e-dd5ab33aef4b tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lock "e2cf5877-55dd-44ce-9b58-b662afe8e62e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.861s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:03:47 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd8b3552-3ad9-4a31-9315-af1843764563 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Calling os-brick to attach iSCSI Volume {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 14:03:47 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8b3552-3ad9-4a31-9315-af1843764563 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BAjounGE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:03:47 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-bd8b3552-3ad9-4a31-9315-af1843764563 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:03:47 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-bd8b3552-3ad9-4a31-9315-af1843764563 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:03:47 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-bd8b3552-3ad9-4a31-9315-af1843764563 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:03:47 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-bd8b3552-3ad9-4a31-9315-af1843764563 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:03:47 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-bd8b3552-3ad9-4a31-9315-af1843764563 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:03:47 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-bd8b3552-3ad9-4a31-9315-af1843764563 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:03:47 user nova-compute[72129]: INFO os_brick.initiator.connectors.iscsi [None req-bd8b3552-3ad9-4a31-9315-af1843764563 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 14:03:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 -p 172.16.0.220:3260 {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:47 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[1edc1c4c-eea6-410d-b9c3-4f6dfe70d52d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:47 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8b3552-3ad9-4a31-9315-af1843764563 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 14:03:47 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:03:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 -p 172.16.0.220:3260 --interface default --op new {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:47 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[49cde4af-edad-4260-b99c-931cdef2c38b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170] added\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:47 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8b3552-3ad9-4a31-9315-af1843764563 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170] added
Aug 01 14:03:47 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:03:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:47 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe0c10e-ef05-40ad-a9c7-a32783d5112f]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:47 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8b3552-3ad9-4a31-9315-af1843764563 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:03:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:47 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6cb3aa-4aa9-4ebc-9e28-0c55f3b080f3]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:47 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8b3552-3ad9-4a31-9315-af1843764563 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:03:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BAjounGE {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BAjounGE" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:47 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d112bde-76e1-43dc-a168-7dec5dfd0fca]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:47 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8b3552-3ad9-4a31-9315-af1843764563 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BAjounGE'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:03:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:47 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-7ba697a7-a61b-4dde-aa1e-fc02e899f229 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Acquiring lock "e2cf5877-55dd-44ce-9b58-b662afe8e62e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:03:47 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-7ba697a7-a61b-4dde-aa1e-fc02e899f229 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lock "e2cf5877-55dd-44ce-9b58-b662afe8e62e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:03:47 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[949bb669-029f-4020-9a16-c6bb7440e91f]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:47 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8b3552-3ad9-4a31-9315-af1843764563 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:03:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:47 user nova-compute[72129]: INFO nova.compute.manager [None req-7ba697a7-a61b-4dde-aa1e-fc02e899f229 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Detaching volume eeaf290a-3aac-4702-af07-b8c15a4467e1
Aug 01 14:03:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:47 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16a98d4-5a82-4677-be81-ddd77f3a1fd7]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eeaf290a-3aac-4702-af07-b8c15a4467e1 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:47 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8b3552-3ad9-4a31-9315-af1843764563 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:03:47 user nova-compute[72129]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)
Aug 01 14:03:47 user nova-compute[72129]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)
Aug 01 14:03:47 user nova-compute[72129]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f (non-flash)
Aug 01 14:03:47 user nova-compute[72129]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 (non-flash)
Aug 01 14:03:47 user nova-compute[72129]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eeaf290a-3aac-4702-af07-b8c15a4467e1 (non-flash)
Aug 01 14:03:47 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:03:47 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8b3552-3ad9-4a31-9315-af1843764563 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:03:47 user nova-compute[72129]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)
Aug 01 14:03:47 user nova-compute[72129]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)
Aug 01 14:03:47 user nova-compute[72129]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f (non-flash)
Aug 01 14:03:47 user nova-compute[72129]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 (non-flash)
Aug 01 14:03:47 user nova-compute[72129]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eeaf290a-3aac-4702-af07-b8c15a4467e1 (non-flash)
Aug 01 14:03:47 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:03:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 -p 172.16.0.220:3260 --login {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:47 user nova-compute[72129]: DEBUG nova.compute.manager [req-143bf8f2-72ce-43af-a0f3-36e86fd0db43 req-3aced410-85cc-4ff8-a688-a53362d69257 service nova] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Received event network-changed-b5a06a08-bb00-4551-afd4-09ad16fe0837 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:03:47 user nova-compute[72129]: DEBUG nova.compute.manager [req-143bf8f2-72ce-43af-a0f3-36e86fd0db43 req-3aced410-85cc-4ff8-a688-a53362d69257 service nova] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Refreshing instance network info cache due to event network-changed-b5a06a08-bb00-4551-afd4-09ad16fe0837. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 14:03:47 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-143bf8f2-72ce-43af-a0f3-36e86fd0db43 req-3aced410-85cc-4ff8-a688-a53362d69257 service nova] Acquiring lock "refresh_cache-85062e35-e302-46f7-8d66-24cf9e7199f7" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:03:47 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-143bf8f2-72ce-43af-a0f3-36e86fd0db43 req-3aced410-85cc-4ff8-a688-a53362d69257 service nova] Acquired lock "refresh_cache-85062e35-e302-46f7-8d66-24cf9e7199f7" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:03:47 user nova-compute[72129]: DEBUG nova.network.neutron [req-143bf8f2-72ce-43af-a0f3-36e86fd0db43 req-3aced410-85cc-4ff8-a688-a53362d69257 service nova] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Refreshing network info cache for port b5a06a08-bb00-4551-afd4-09ad16fe0837 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 14:03:47 user nova-compute[72129]: INFO nova.virt.block_device [None req-7ba697a7-a61b-4dde-aa1e-fc02e899f229 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Attempting to driver detach volume eeaf290a-3aac-4702-af07-b8c15a4467e1 from mountpoint /dev/vdb
Aug 01 14:03:47 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-7ba697a7-a61b-4dde-aa1e-fc02e899f229 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Attempting to detach device vdb from instance e2cf5877-55dd-44ce-9b58-b662afe8e62e from the persistent domain config. {{(pid=72129) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 14:03:47 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-7ba697a7-a61b-4dde-aa1e-fc02e899f229 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 14:03:47 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:03:47 user nova-compute[72129]:   <source dev="/dev/sde"/>
Aug 01 14:03:47 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 14:03:47 user nova-compute[72129]:   <serial>eeaf290a-3aac-4702-af07-b8c15a4467e1</serial>
Aug 01 14:03:47 user nova-compute[72129]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 14:03:47 user nova-compute[72129]: </disk>
Aug 01 14:03:47 user nova-compute[72129]:  {{(pid=72129) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 14:03:47 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-7ba697a7-a61b-4dde-aa1e-fc02e899f229 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Successfully detached device vdb from instance e2cf5877-55dd-44ce-9b58-b662afe8e62e from the persistent domain config.
Aug 01 14:03:47 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-7ba697a7-a61b-4dde-aa1e-fc02e899f229 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e2cf5877-55dd-44ce-9b58-b662afe8e62e from the live domain config. {{(pid=72129) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 14:03:47 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-7ba697a7-a61b-4dde-aa1e-fc02e899f229 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 14:03:47 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:03:47 user nova-compute[72129]:   <source dev="/dev/sde"/>
Aug 01 14:03:47 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 14:03:47 user nova-compute[72129]:   <serial>eeaf290a-3aac-4702-af07-b8c15a4467e1</serial>
Aug 01 14:03:47 user nova-compute[72129]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 14:03:47 user nova-compute[72129]: </disk>
Aug 01 14:03:47 user nova-compute[72129]:  {{(pid=72129) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 14:03:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:47 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e913707-1c5c-41cc-862e-fb48fa46c9e3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:47 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8b3552-3ad9-4a31-9315-af1843764563 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170, portal: 172.16.0.220,3260]
Aug 01 14:03:47 user nova-compute[72129]: Login to [iface: default, target: iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170, portal: 172.16.0.220,3260] successful.
Aug 01 14:03:47 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:03:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:47 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[e25597c0-45b5-4c89-b30e-12b26850e315]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:47 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8b3552-3ad9-4a31-9315-af1843764563 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:03:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:48 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:48 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c462e5-7e86-47d2-a5e4-83fd59898e97]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eeaf290a-3aac-4702-af07-b8c15a4467e1 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:48 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8b3552-3ad9-4a31-9315-af1843764563 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:03:48 user nova-compute[72129]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)
Aug 01 14:03:48 user nova-compute[72129]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)
Aug 01 14:03:48 user nova-compute[72129]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f (non-flash)
Aug 01 14:03:48 user nova-compute[72129]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 (non-flash)
Aug 01 14:03:48 user nova-compute[72129]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eeaf290a-3aac-4702-af07-b8c15a4467e1 (non-flash)
Aug 01 14:03:48 user nova-compute[72129]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 (non-flash)
Aug 01 14:03:48 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:03:48 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8b3552-3ad9-4a31-9315-af1843764563 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:03:48 user nova-compute[72129]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)
Aug 01 14:03:48 user nova-compute[72129]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)
Aug 01 14:03:48 user nova-compute[72129]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f (non-flash)
Aug 01 14:03:48 user nova-compute[72129]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 (non-flash)
Aug 01 14:03:48 user nova-compute[72129]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eeaf290a-3aac-4702-af07-b8c15a4467e1 (non-flash)
Aug 01 14:03:48 user nova-compute[72129]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 (non-flash)
Aug 01 14:03:48 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:03:48 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-bd8b3552-3ad9-4a31-9315-af1843764563 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.355s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:03:48 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8b3552-3ad9-4a31-9315-af1843764563 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Connected to 172.16.0.220:3260 {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 14:03:48 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-bd8b3552-3ad9-4a31-9315-af1843764563 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] HCTL ('39', '-', '-', 0) found on session 38 with lun 0 {{(pid=72129) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 14:03:48 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-bd8b3552-3ad9-4a31-9315-af1843764563 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72129) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 14:03:48 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:48 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:48 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a4f880-2cfd-4c40-b124-f029ea9c0aad]: (4, ('- - 0', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:48 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-bd8b3552-3ad9-4a31-9315-af1843764563 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Searching for a device in session 38 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 14:03:48 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8b3552-3ad9-4a31-9315-af1843764563 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BAjounGE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 14:03:48 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Received event <DeviceRemovedEvent: 1690898628.3673766, e2cf5877-55dd-44ce-9b58-b662afe8e62e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72129) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 14:03:48 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-7ba697a7-a61b-4dde-aa1e-fc02e899f229 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e2cf5877-55dd-44ce-9b58-b662afe8e62e {{(pid=72129) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 14:03:48 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-7ba697a7-a61b-4dde-aa1e-fc02e899f229 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Successfully detached device vdb from instance e2cf5877-55dd-44ce-9b58-b662afe8e62e from the live domain config.
Aug 01 14:03:48 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ba697a7-a61b-4dde-aa1e-fc02e899f229 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] calling os-brick to detach iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 14:03:48 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba697a7-a61b-4dde-aa1e-fc02e899f229 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, {'target_iqns': ['iqn.2010-10.org.openstack:eeaf290a-3aac-4702-af07-b8c15a4467e1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GABzuNwq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:03:48 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-7ba697a7-a61b-4dde-aa1e-fc02e899f229 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:03:48 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-7ba697a7-a61b-4dde-aa1e-fc02e899f229 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:03:48 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:03:48 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:03:48 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72129) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 14:03:48 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:03:48 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:03:48 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:03:49 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-bd8b3552-3ad9-4a31-9315-af1843764563 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.391s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:03:49 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8b3552-3ad9-4a31-9315-af1843764563 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] <== connect_volume: return (1392ms) {'type': 'block', 'scsi_wwn': '23139313663626639', 'path': '/dev/sdh'} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:03:49 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd8b3552-3ad9-4a31-9315-af1843764563 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23139313663626639', 'path': '/dev/sdh'} {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 14:03:49 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-7ba697a7-a61b-4dde-aa1e-fc02e899f229 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.681s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:03:49 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba697a7-a61b-4dde-aa1e-fc02e899f229 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eeaf290a-3aac-4702-af07-b8c15a4467e1', 0)] {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 14:03:49 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:49 user nova-compute[72129]: DEBUG nova.objects.instance [None req-bd8b3552-3ad9-4a31-9315-af1843764563 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Lazy-loading 'flavor' on Instance uuid ea050cd6-60e9-41fd-a35c-05fe63d60e57 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:03:49 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:49 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c91266b-a391-4298-9fe3-ece6280a0610]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eeaf290a-3aac-4702-af07-b8c15a4467e1\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:49 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:49 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-bd8b3552-3ad9-4a31-9315-af1843764563 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 14:03:49 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:03:49 user nova-compute[72129]:   <source dev="/dev/sdh"/>
Aug 01 14:03:49 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 14:03:49 user nova-compute[72129]:   <serial>79d3d741-ab72-4e2a-bbae-df43b76a4170</serial>
Aug 01 14:03:49 user nova-compute[72129]: </disk>
Aug 01 14:03:49 user nova-compute[72129]:  {{(pid=72129) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 14:03:49 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:49 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d12494-3750-440f-ab22-a397502f73ed]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eeaf290a-3aac-4702-af07-b8c15a4467e1 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:49 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba697a7-a61b-4dde-aa1e-fc02e899f229 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:03:49 user nova-compute[72129]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)
Aug 01 14:03:49 user nova-compute[72129]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)
Aug 01 14:03:49 user nova-compute[72129]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f (non-flash)
Aug 01 14:03:49 user nova-compute[72129]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 (non-flash)
Aug 01 14:03:49 user nova-compute[72129]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eeaf290a-3aac-4702-af07-b8c15a4467e1 (non-flash)
Aug 01 14:03:49 user nova-compute[72129]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 (non-flash)
Aug 01 14:03:49 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:03:49 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba697a7-a61b-4dde-aa1e-fc02e899f229 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:03:49 user nova-compute[72129]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)
Aug 01 14:03:49 user nova-compute[72129]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)
Aug 01 14:03:49 user nova-compute[72129]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f (non-flash)
Aug 01 14:03:49 user nova-compute[72129]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 (non-flash)
Aug 01 14:03:49 user nova-compute[72129]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eeaf290a-3aac-4702-af07-b8c15a4467e1 (non-flash)
Aug 01 14:03:49 user nova-compute[72129]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 (non-flash)
Aug 01 14:03:49 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:03:49 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba697a7-a61b-4dde-aa1e-fc02e899f229 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2810420dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eeaf290a-3aac-4702-af07-b8c15a4467e1'): ({'sde'}, set())}) {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 14:03:49 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-7ba697a7-a61b-4dde-aa1e-fc02e899f229 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Removing single pathed devices sde {{(pid=72129) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 14:03:49 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:49 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:49 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf5be10-a2e1-4a47-afa5-757d7a33f339]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:49 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:49 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:49 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c3ce95-5951-4630-92b8-ad8e83cbcf9d]: (4, ('ok\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:49 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-7ba697a7-a61b-4dde-aa1e-fc02e899f229 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Flushing IO for device /dev/sde {{(pid=72129) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 14:03:49 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:49 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:49 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a96485d7-2f2a-40ea-bfa5-3eaf9048902f]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:49 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-7ba697a7-a61b-4dde-aa1e-fc02e899f229 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72129) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 14:03:49 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:49 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:49 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d76d45fb-aed5-47ac-8a21-39695f53a196]: (4, ('1', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:49 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-7ba697a7-a61b-4dde-aa1e-fc02e899f229 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 14:03:49 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-7ba697a7-a61b-4dde-aa1e-fc02e899f229 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] SCSI volumes sde have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 14:03:49 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba697a7-a61b-4dde-aa1e-fc02e899f229 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eeaf290a-3aac-4702-af07-b8c15a4467e1')] {{(pid=72129) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 14:03:49 user nova-compute[72129]: DEBUG nova.network.neutron [req-143bf8f2-72ce-43af-a0f3-36e86fd0db43 req-3aced410-85cc-4ff8-a688-a53362d69257 service nova] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Updated VIF entry in instance network info cache for port b5a06a08-bb00-4551-afd4-09ad16fe0837. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 14:03:49 user nova-compute[72129]: DEBUG nova.network.neutron [req-143bf8f2-72ce-43af-a0f3-36e86fd0db43 req-3aced410-85cc-4ff8-a688-a53362d69257 service nova] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Updating instance_info_cache with network_info: [{"id": "b5a06a08-bb00-4551-afd4-09ad16fe0837", "address": "fa:16:3e:9d:bc:ca", "network": {"id": "a7ec6cc0-140b-446b-ae97-d4aafbc42693", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-397303278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43253b37caa747b090b14c707abf96cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5a06a08-bb", "ovs_interfaceid": "b5a06a08-bb00-4551-afd4-09ad16fe0837", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:03:49 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eeaf290a-3aac-4702-af07-b8c15a4467e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:49 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-143bf8f2-72ce-43af-a0f3-36e86fd0db43 req-3aced410-85cc-4ff8-a688-a53362d69257 service nova] Releasing lock "refresh_cache-85062e35-e302-46f7-8d66-24cf9e7199f7" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:03:49 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eeaf290a-3aac-4702-af07-b8c15a4467e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:49 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b125a8-a314-4ed6-8445-4a6616b554c6]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:49 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba697a7-a61b-4dde-aa1e-fc02e899f229 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:03:49 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eeaf290a-3aac-4702-af07-b8c15a4467e1 -p 172.16.0.220:3260 --logout {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:49 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eeaf290a-3aac-4702-af07-b8c15a4467e1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:49 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff207a8-3085-4a35-869e-d169638b406b]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:eeaf290a-3aac-4702-af07-b8c15a4467e1, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:eeaf290a-3aac-4702-af07-b8c15a4467e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:49 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba697a7-a61b-4dde-aa1e-fc02e899f229 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:eeaf290a-3aac-4702-af07-b8c15a4467e1, portal: 172.16.0.220,3260]
Aug 01 14:03:49 user nova-compute[72129]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:eeaf290a-3aac-4702-af07-b8c15a4467e1, portal: 172.16.0.220,3260] successful.
Aug 01 14:03:49 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:03:49 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eeaf290a-3aac-4702-af07-b8c15a4467e1 -p 172.16.0.220:3260 --op delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:49 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eeaf290a-3aac-4702-af07-b8c15a4467e1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:49 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ed58f3-03fe-42ad-8478-53b75bd13a63]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:49 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba697a7-a61b-4dde-aa1e-fc02e899f229 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:03:49 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-7ba697a7-a61b-4dde-aa1e-fc02e899f229 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:03:49 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba697a7-a61b-4dde-aa1e-fc02e899f229 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] <== disconnect_volume: return (1016ms) None {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:03:49 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ba697a7-a61b-4dde-aa1e-fc02e899f229 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Disconnected iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 14:03:49 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:03:49 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Starting heal instance info cache {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 14:03:49 user nova-compute[72129]: DEBUG nova.compute.manager [req-ef4605ca-a350-4a76-8e82-976045ba63c8 req-1de74d70-75c5-4e2c-82b4-2e5c2083b908 service nova] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Received event network-changed-4871bc74-6594-49e6-a6ef-343bc3800742 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:03:49 user nova-compute[72129]: DEBUG nova.compute.manager [req-ef4605ca-a350-4a76-8e82-976045ba63c8 req-1de74d70-75c5-4e2c-82b4-2e5c2083b908 service nova] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Refreshing instance network info cache due to event network-changed-4871bc74-6594-49e6-a6ef-343bc3800742. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 14:03:49 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ef4605ca-a350-4a76-8e82-976045ba63c8 req-1de74d70-75c5-4e2c-82b4-2e5c2083b908 service nova] Acquiring lock "refresh_cache-97a5dccf-b499-443a-b332-cfa293a16047" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:03:49 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ef4605ca-a350-4a76-8e82-976045ba63c8 req-1de74d70-75c5-4e2c-82b4-2e5c2083b908 service nova] Acquired lock "refresh_cache-97a5dccf-b499-443a-b332-cfa293a16047" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:03:49 user nova-compute[72129]: DEBUG nova.network.neutron [req-ef4605ca-a350-4a76-8e82-976045ba63c8 req-1de74d70-75c5-4e2c-82b4-2e5c2083b908 service nova] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Refreshing network info cache for port 4871bc74-6594-49e6-a6ef-343bc3800742 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 14:03:49 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "refresh_cache-0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:03:49 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquired lock "refresh_cache-0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:03:49 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Forcefully refreshing network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 14:03:49 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-bd8b3552-3ad9-4a31-9315-af1843764563 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:03:49 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-bd8b3552-3ad9-4a31-9315-af1843764563 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:03:49 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-bd8b3552-3ad9-4a31-9315-af1843764563 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] No VIF found with MAC fa:16:3e:d8:46:16, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 14:03:49 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:03:49 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:03:49 user nova-compute[72129]: DEBUG nova.objects.instance [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lazy-loading 'pci_requests' on Instance uuid 3891b9d3-832d-4ef7-8ebb-970ddd0a387a {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:03:49 user nova-compute[72129]: DEBUG nova.objects.instance [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lazy-loading 'numa_topology' on Instance uuid 3891b9d3-832d-4ef7-8ebb-970ddd0a387a {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:03:49 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72129) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 14:03:49 user nova-compute[72129]: INFO nova.compute.claims [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Claim successful on node user
Aug 01 14:03:49 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-bd8b3552-3ad9-4a31-9315-af1843764563 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Lock "ea050cd6-60e9-41fd-a35c-05fe63d60e57" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.369s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:03:49 user nova-compute[72129]: DEBUG nova.network.neutron [req-ef4605ca-a350-4a76-8e82-976045ba63c8 req-1de74d70-75c5-4e2c-82b4-2e5c2083b908 service nova] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Updated VIF entry in instance network info cache for port 4871bc74-6594-49e6-a6ef-343bc3800742. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 14:03:49 user nova-compute[72129]: DEBUG nova.network.neutron [req-ef4605ca-a350-4a76-8e82-976045ba63c8 req-1de74d70-75c5-4e2c-82b4-2e5c2083b908 service nova] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Updating instance_info_cache with network_info: [{"id": "4871bc74-6594-49e6-a6ef-343bc3800742", "address": "fa:16:3e:a3:52:a2", "network": {"id": "4b93ad92-9a3a-4472-ba6c-d215329da98b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-734108983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0e85d9b73a546dc95e0ace26233f2a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4871bc74-65", "ovs_interfaceid": "4871bc74-6594-49e6-a6ef-343bc3800742", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:03:50 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ef4605ca-a350-4a76-8e82-976045ba63c8 req-1de74d70-75c5-4e2c-82b4-2e5c2083b908 service nova] Releasing lock "refresh_cache-97a5dccf-b499-443a-b332-cfa293a16047" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:03:50 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:03:50 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Updating instance_info_cache with network_info: [{"id": "d4f68f78-6df9-41b7-8d32-27f55f224683", "address": "fa:16:3e:23:49:b3", "network": {"id": "59b1e538-8bfe-45ce-ab7b-c5838ab25582", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1129024349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0929886fa54d1c8023793806f10d31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f68f78-6d", "ovs_interfaceid": "d4f68f78-6df9-41b7-8d32-27f55f224683", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:03:50 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:03:50 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Releasing lock "refresh_cache-0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:03:50 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Updated the network info_cache for instance {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 14:03:50 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:03:50 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:03:50 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:03:50 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:03:50 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:03:50 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72129) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 14:03:50 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.597s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:03:50 user nova-compute[72129]: DEBUG nova.objects.instance [None req-7ba697a7-a61b-4dde-aa1e-fc02e899f229 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lazy-loading 'flavor' on Instance uuid e2cf5877-55dd-44ce-9b58-b662afe8e62e {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:03:50 user nova-compute[72129]: INFO nova.network.neutron [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Updating port acb5d1d2-f038-4111-90e1-00bf99a2a7bb with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 01 14:03:50 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-7ba697a7-a61b-4dde-aa1e-fc02e899f229 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lock "e2cf5877-55dd-44ce-9b58-b662afe8e62e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.480s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:03:50 user nova-compute[72129]: DEBUG nova.compute.manager [req-c3272296-d860-4ca2-bf6c-e6dea78a9f3e req-01eddb85-75be-4d4b-b4c8-2a16557fc742 service nova] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Received event network-changed-b5a06a08-bb00-4551-afd4-09ad16fe0837 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:03:50 user nova-compute[72129]: DEBUG nova.compute.manager [req-c3272296-d860-4ca2-bf6c-e6dea78a9f3e req-01eddb85-75be-4d4b-b4c8-2a16557fc742 service nova] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Refreshing instance network info cache due to event network-changed-b5a06a08-bb00-4551-afd4-09ad16fe0837. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 14:03:50 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-c3272296-d860-4ca2-bf6c-e6dea78a9f3e req-01eddb85-75be-4d4b-b4c8-2a16557fc742 service nova] Acquiring lock "refresh_cache-85062e35-e302-46f7-8d66-24cf9e7199f7" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:03:50 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-c3272296-d860-4ca2-bf6c-e6dea78a9f3e req-01eddb85-75be-4d4b-b4c8-2a16557fc742 service nova] Acquired lock "refresh_cache-85062e35-e302-46f7-8d66-24cf9e7199f7" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:03:50 user nova-compute[72129]: DEBUG nova.network.neutron [req-c3272296-d860-4ca2-bf6c-e6dea78a9f3e req-01eddb85-75be-4d4b-b4c8-2a16557fc742 service nova] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Refreshing network info cache for port b5a06a08-bb00-4551-afd4-09ad16fe0837 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 14:03:50 user nova-compute[72129]: INFO nova.compute.manager [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Rescuing
Aug 01 14:03:50 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Acquiring lock "refresh_cache-ea050cd6-60e9-41fd-a35c-05fe63d60e57" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:03:50 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Acquired lock "refresh_cache-ea050cd6-60e9-41fd-a35c-05fe63d60e57" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:03:50 user nova-compute[72129]: DEBUG nova.network.neutron [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 14:03:50 user nova-compute[72129]: DEBUG nova.network.neutron [req-c3272296-d860-4ca2-bf6c-e6dea78a9f3e req-01eddb85-75be-4d4b-b4c8-2a16557fc742 service nova] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Updated VIF entry in instance network info cache for port b5a06a08-bb00-4551-afd4-09ad16fe0837. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 14:03:50 user nova-compute[72129]: DEBUG nova.network.neutron [req-c3272296-d860-4ca2-bf6c-e6dea78a9f3e req-01eddb85-75be-4d4b-b4c8-2a16557fc742 service nova] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Updating instance_info_cache with network_info: [{"id": "b5a06a08-bb00-4551-afd4-09ad16fe0837", "address": "fa:16:3e:9d:bc:ca", "network": {"id": "a7ec6cc0-140b-446b-ae97-d4aafbc42693", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-397303278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43253b37caa747b090b14c707abf96cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5a06a08-bb", "ovs_interfaceid": "b5a06a08-bb00-4551-afd4-09ad16fe0837", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:03:50 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-c3272296-d860-4ca2-bf6c-e6dea78a9f3e req-01eddb85-75be-4d4b-b4c8-2a16557fc742 service nova] Releasing lock "refresh_cache-85062e35-e302-46f7-8d66-24cf9e7199f7" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:03:50 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:03:51 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:03:51 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:03:51 user nova-compute[72129]: DEBUG nova.compute.manager [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Stashing vm_state: active {{(pid=72129) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 01 14:03:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:03:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:03:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c7cc1582-adab-4461-a4b3-133605466933 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Acquiring lock "85062e35-e302-46f7-8d66-24cf9e7199f7" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:03:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c7cc1582-adab-4461-a4b3-133605466933 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lock "85062e35-e302-46f7-8d66-24cf9e7199f7" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:03:51 user nova-compute[72129]: INFO nova.compute.manager [None req-c7cc1582-adab-4461-a4b3-133605466933 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Rebooting instance
Aug 01 14:03:51 user nova-compute[72129]: DEBUG nova.objects.instance [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lazy-loading 'pci_requests' on Instance uuid e4a13a50-fe03-41aa-94f4-3431805ff481 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:03:51 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72129) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 14:03:51 user nova-compute[72129]: INFO nova.compute.claims [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Claim successful on node user
Aug 01 14:03:51 user nova-compute[72129]: DEBUG nova.objects.instance [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lazy-loading 'resources' on Instance uuid e4a13a50-fe03-41aa-94f4-3431805ff481 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:03:51 user nova-compute[72129]: DEBUG nova.objects.instance [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lazy-loading 'pci_devices' on Instance uuid e4a13a50-fe03-41aa-94f4-3431805ff481 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:03:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c7cc1582-adab-4461-a4b3-133605466933 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Acquiring lock "refresh_cache-85062e35-e302-46f7-8d66-24cf9e7199f7" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:03:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c7cc1582-adab-4461-a4b3-133605466933 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Acquired lock "refresh_cache-85062e35-e302-46f7-8d66-24cf9e7199f7" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:03:51 user nova-compute[72129]: DEBUG nova.network.neutron [None req-c7cc1582-adab-4461-a4b3-133605466933 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 14:03:51 user nova-compute[72129]: INFO nova.compute.resource_tracker [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Updating resource usage from migration bd6701cb-6cc9-4417-a952-70fff9896df6
Aug 01 14:03:51 user nova-compute[72129]: DEBUG nova.compute.manager [req-a15bd6fd-925e-4aaf-9353-9969d942c385 req-73fe01a2-9087-41d5-847e-e765f06fc7cd service nova] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Received event network-changed-a36283e1-929d-4806-ba5f-175f99f44e98 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:03:51 user nova-compute[72129]: DEBUG nova.compute.manager [req-a15bd6fd-925e-4aaf-9353-9969d942c385 req-73fe01a2-9087-41d5-847e-e765f06fc7cd service nova] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Refreshing instance network info cache due to event network-changed-a36283e1-929d-4806-ba5f-175f99f44e98. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 14:03:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-a15bd6fd-925e-4aaf-9353-9969d942c385 req-73fe01a2-9087-41d5-847e-e765f06fc7cd service nova] Acquiring lock "refresh_cache-e4a13a50-fe03-41aa-94f4-3431805ff481" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:03:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-a15bd6fd-925e-4aaf-9353-9969d942c385 req-73fe01a2-9087-41d5-847e-e765f06fc7cd service nova] Acquired lock "refresh_cache-e4a13a50-fe03-41aa-94f4-3431805ff481" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:03:51 user nova-compute[72129]: DEBUG nova.network.neutron [req-a15bd6fd-925e-4aaf-9353-9969d942c385 req-73fe01a2-9087-41d5-847e-e765f06fc7cd service nova] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Refreshing network info cache for port a36283e1-929d-4806-ba5f-175f99f44e98 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 14:03:51 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:03:51 user nova-compute[72129]: DEBUG nova.network.neutron [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Updating instance_info_cache with network_info: [{"id": "fe1f3453-e3ae-494c-965a-c20868179163", "address": "fa:16:3e:d8:46:16", "network": {"id": "ce187b11-5e3e-45a9-af0f-0be815ad0a3d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1245856112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0a13467840342f281bd8b8e115eccaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1f3453-e3", "ovs_interfaceid": "fe1f3453-e3ae-494c-965a-c20868179163", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:03:51 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:03:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Releasing lock "refresh_cache-ea050cd6-60e9-41fd-a35c-05fe63d60e57" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:03:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.531s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:03:51 user nova-compute[72129]: INFO nova.compute.manager [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Migrating
Aug 01 14:03:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Acquiring lock "refresh_cache-3891b9d3-832d-4ef7-8ebb-970ddd0a387a" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:03:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Acquired lock "refresh_cache-3891b9d3-832d-4ef7-8ebb-970ddd0a387a" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:03:51 user nova-compute[72129]: DEBUG nova.network.neutron [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 14:03:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Acquiring lock "refresh_cache-e4a13a50-fe03-41aa-94f4-3431805ff481" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:03:51 user nova-compute[72129]: DEBUG nova.network.neutron [None req-c7cc1582-adab-4461-a4b3-133605466933 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Updating instance_info_cache with network_info: [{"id": "b5a06a08-bb00-4551-afd4-09ad16fe0837", "address": "fa:16:3e:9d:bc:ca", "network": {"id": "a7ec6cc0-140b-446b-ae97-d4aafbc42693", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-397303278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43253b37caa747b090b14c707abf96cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5a06a08-bb", "ovs_interfaceid": "b5a06a08-bb00-4551-afd4-09ad16fe0837", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:03:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c7cc1582-adab-4461-a4b3-133605466933 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Releasing lock "refresh_cache-85062e35-e302-46f7-8d66-24cf9e7199f7" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:03:51 user nova-compute[72129]: DEBUG nova.compute.manager [None req-c7cc1582-adab-4461-a4b3-133605466933 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:03:51 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:03:51 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:03:51 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:03:51 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:03:52 user nova-compute[72129]: DEBUG nova.network.neutron [req-a15bd6fd-925e-4aaf-9353-9969d942c385 req-73fe01a2-9087-41d5-847e-e765f06fc7cd service nova] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Updated VIF entry in instance network info cache for port a36283e1-929d-4806-ba5f-175f99f44e98. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 14:03:52 user nova-compute[72129]: DEBUG nova.network.neutron [req-a15bd6fd-925e-4aaf-9353-9969d942c385 req-73fe01a2-9087-41d5-847e-e765f06fc7cd service nova] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Updating instance_info_cache with network_info: [{"id": "a36283e1-929d-4806-ba5f-175f99f44e98", "address": "fa:16:3e:28:9b:e7", "network": {"id": "4b93ad92-9a3a-4472-ba6c-d215329da98b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-734108983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0e85d9b73a546dc95e0ace26233f2a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36283e1-92", "ovs_interfaceid": "a36283e1-929d-4806-ba5f-175f99f44e98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:03:52 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-a15bd6fd-925e-4aaf-9353-9969d942c385 req-73fe01a2-9087-41d5-847e-e765f06fc7cd service nova] Releasing lock "refresh_cache-e4a13a50-fe03-41aa-94f4-3431805ff481" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:03:52 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Acquired lock "refresh_cache-e4a13a50-fe03-41aa-94f4-3431805ff481" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:03:52 user nova-compute[72129]: DEBUG nova.network.neutron [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 14:03:52 user nova-compute[72129]: DEBUG nova.network.neutron [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Updating instance_info_cache with network_info: [{"id": "acb5d1d2-f038-4111-90e1-00bf99a2a7bb", "address": "fa:16:3e:ec:4a:5e", "network": {"id": "ce10dac7-17d0-425a-bfee-70b8220d7871", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1288141476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b724093fa43c4afb9130efa2cfc713d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacb5d1d2-f0", "ovs_interfaceid": "acb5d1d2-f038-4111-90e1-00bf99a2a7bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:03:52 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Releasing lock "refresh_cache-3891b9d3-832d-4ef7-8ebb-970ddd0a387a" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:03:52 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Creating instance directory {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 14:03:52 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Creating image(s)
Aug 01 14:03:52 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Acquiring lock "/opt/stack/data/nova/instances/3891b9d3-832d-4ef7-8ebb-970ddd0a387a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:03:52 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lock "/opt/stack/data/nova/instances/3891b9d3-832d-4ef7-8ebb-970ddd0a387a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:03:52 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lock "/opt/stack/data/nova/instances/3891b9d3-832d-4ef7-8ebb-970ddd0a387a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:03:52 user nova-compute[72129]: DEBUG nova.objects.instance [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3891b9d3-832d-4ef7-8ebb-970ddd0a387a {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:03:52 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Acquiring lock "dd127d0cbe739e7bcfaadc3538e0a428185c9733" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:03:52 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lock "dd127d0cbe739e7bcfaadc3538e0a428185c9733" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:03:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd127d0cbe739e7bcfaadc3538e0a428185c9733.part --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:53 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:03:53 user nova-compute[72129]: DEBUG nova.compute.manager [req-5bd80de8-c973-465e-bbcd-76e74af6e519 req-18d9a7bd-4da0-46b2-86e1-f9e8406587d3 service nova] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Received event network-vif-unplugged-fe1f3453-e3ae-494c-965a-c20868179163 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:03:53 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-5bd80de8-c973-465e-bbcd-76e74af6e519 req-18d9a7bd-4da0-46b2-86e1-f9e8406587d3 service nova] Acquiring lock "ea050cd6-60e9-41fd-a35c-05fe63d60e57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:03:53 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-5bd80de8-c973-465e-bbcd-76e74af6e519 req-18d9a7bd-4da0-46b2-86e1-f9e8406587d3 service nova] Lock "ea050cd6-60e9-41fd-a35c-05fe63d60e57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:03:53 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-5bd80de8-c973-465e-bbcd-76e74af6e519 req-18d9a7bd-4da0-46b2-86e1-f9e8406587d3 service nova] Lock "ea050cd6-60e9-41fd-a35c-05fe63d60e57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:03:53 user nova-compute[72129]: DEBUG nova.compute.manager [req-5bd80de8-c973-465e-bbcd-76e74af6e519 req-18d9a7bd-4da0-46b2-86e1-f9e8406587d3 service nova] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] No waiting events found dispatching network-vif-unplugged-fe1f3453-e3ae-494c-965a-c20868179163 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:03:53 user nova-compute[72129]: WARNING nova.compute.manager [req-5bd80de8-c973-465e-bbcd-76e74af6e519 req-18d9a7bd-4da0-46b2-86e1-f9e8406587d3 service nova] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Received unexpected event network-vif-unplugged-fe1f3453-e3ae-494c-965a-c20868179163 for instance with vm_state active and task_state rescuing.
Aug 01 14:03:53 user nova-compute[72129]: DEBUG nova.compute.manager [req-5bd80de8-c973-465e-bbcd-76e74af6e519 req-18d9a7bd-4da0-46b2-86e1-f9e8406587d3 service nova] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Received event network-vif-plugged-fe1f3453-e3ae-494c-965a-c20868179163 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:03:53 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-5bd80de8-c973-465e-bbcd-76e74af6e519 req-18d9a7bd-4da0-46b2-86e1-f9e8406587d3 service nova] Acquiring lock "ea050cd6-60e9-41fd-a35c-05fe63d60e57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:03:53 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-5bd80de8-c973-465e-bbcd-76e74af6e519 req-18d9a7bd-4da0-46b2-86e1-f9e8406587d3 service nova] Lock "ea050cd6-60e9-41fd-a35c-05fe63d60e57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:03:53 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-5bd80de8-c973-465e-bbcd-76e74af6e519 req-18d9a7bd-4da0-46b2-86e1-f9e8406587d3 service nova] Lock "ea050cd6-60e9-41fd-a35c-05fe63d60e57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:03:53 user nova-compute[72129]: DEBUG nova.compute.manager [req-5bd80de8-c973-465e-bbcd-76e74af6e519 req-18d9a7bd-4da0-46b2-86e1-f9e8406587d3 service nova] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] No waiting events found dispatching network-vif-plugged-fe1f3453-e3ae-494c-965a-c20868179163 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:03:53 user nova-compute[72129]: WARNING nova.compute.manager [req-5bd80de8-c973-465e-bbcd-76e74af6e519 req-18d9a7bd-4da0-46b2-86e1-f9e8406587d3 service nova] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Received unexpected event network-vif-plugged-fe1f3453-e3ae-494c-965a-c20868179163 for instance with vm_state active and task_state rescuing.
Aug 01 14:03:53 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:03:53 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:03:53 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:03:53 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Auditing locally available compute resources for user (node: user) {{(pid=72129) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 14:03:53 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Instance destroyed successfully.
Aug 01 14:03:53 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Attempting a stable device rescue
Aug 01 14:03:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd127d0cbe739e7bcfaadc3538e0a428185c9733.part --force-share --output=json" returned: 0 in 0.141s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:53 user nova-compute[72129]: DEBUG nova.virt.images [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] cc83affc-7464-465f-821c-002a21f41dc6 was qcow2, converting to raw {{(pid=72129) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 14:03:53 user nova-compute[72129]: DEBUG nova.privsep.utils [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72129) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 14:03:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dd127d0cbe739e7bcfaadc3538e0a428185c9733.part /opt/stack/data/nova/instances/_base/dd127d0cbe739e7bcfaadc3538e0a428185c9733.converted {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:53 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=72129) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 01 14:03:53 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Instance directory exists: not creating {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 01 14:03:53 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Creating image(s)
Aug 01 14:03:53 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Acquiring lock "/opt/stack/data/nova/instances/ea050cd6-60e9-41fd-a35c-05fe63d60e57/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:03:53 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Lock "/opt/stack/data/nova/instances/ea050cd6-60e9-41fd-a35c-05fe63d60e57/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:03:53 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Lock "/opt/stack/data/nova/instances/ea050cd6-60e9-41fd-a35c-05fe63d60e57/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.030s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:03:53 user nova-compute[72129]: DEBUG nova.objects.instance [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Lazy-loading 'trusted_certs' on Instance uuid ea050cd6-60e9-41fd-a35c-05fe63d60e57 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:03:53 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Acquiring lock "8d33c770a62ced091c43e09d4c878c9d3d0ebcd6" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:03:53 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Lock "8d33c770a62ced091c43e09d4c878c9d3d0ebcd6" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:03:53 user nova-compute[72129]: DEBUG nova.compute.manager [req-a89d0fbc-afba-4a8d-85a2-7b300543fff5 req-5b06b52c-cb86-4edd-91ec-7cf6a23a0b66 service nova] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Received event network-changed-acb5d1d2-f038-4111-90e1-00bf99a2a7bb {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:03:53 user nova-compute[72129]: DEBUG nova.compute.manager [req-a89d0fbc-afba-4a8d-85a2-7b300543fff5 req-5b06b52c-cb86-4edd-91ec-7cf6a23a0b66 service nova] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Refreshing instance network info cache due to event network-changed-acb5d1d2-f038-4111-90e1-00bf99a2a7bb. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 14:03:53 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-a89d0fbc-afba-4a8d-85a2-7b300543fff5 req-5b06b52c-cb86-4edd-91ec-7cf6a23a0b66 service nova] Acquiring lock "refresh_cache-3891b9d3-832d-4ef7-8ebb-970ddd0a387a" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:03:53 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-a89d0fbc-afba-4a8d-85a2-7b300543fff5 req-5b06b52c-cb86-4edd-91ec-7cf6a23a0b66 service nova] Acquired lock "refresh_cache-3891b9d3-832d-4ef7-8ebb-970ddd0a387a" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:03:53 user nova-compute[72129]: DEBUG nova.network.neutron [req-a89d0fbc-afba-4a8d-85a2-7b300543fff5 req-5b06b52c-cb86-4edd-91ec-7cf6a23a0b66 service nova] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Refreshing network info cache for port acb5d1d2-f038-4111-90e1-00bf99a2a7bb {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 14:03:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8d33c770a62ced091c43e09d4c878c9d3d0ebcd6.part --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dd127d0cbe739e7bcfaadc3538e0a428185c9733.part /opt/stack/data/nova/instances/_base/dd127d0cbe739e7bcfaadc3538e0a428185c9733.converted" returned: 0 in 1.114s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:54 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:03:54 user nova-compute[72129]: DEBUG nova.network.neutron [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Updating instance_info_cache with network_info: [{"id": "a36283e1-929d-4806-ba5f-175f99f44e98", "address": "fa:16:3e:28:9b:e7", "network": {"id": "4b93ad92-9a3a-4472-ba6c-d215329da98b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-734108983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0e85d9b73a546dc95e0ace26233f2a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36283e1-92", "ovs_interfaceid": "a36283e1-929d-4806-ba5f-175f99f44e98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:03:54 user nova-compute[72129]: DEBUG nova.compute.manager [req-2650aa17-d77f-49b3-b315-0d1740386f56 req-dd61bcfa-7ef3-47c0-b1a6-abedece5983c service nova] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Received event network-vif-unplugged-b5a06a08-bb00-4551-afd4-09ad16fe0837 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:03:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-2650aa17-d77f-49b3-b315-0d1740386f56 req-dd61bcfa-7ef3-47c0-b1a6-abedece5983c service nova] Acquiring lock "85062e35-e302-46f7-8d66-24cf9e7199f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:03:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-2650aa17-d77f-49b3-b315-0d1740386f56 req-dd61bcfa-7ef3-47c0-b1a6-abedece5983c service nova] Lock "85062e35-e302-46f7-8d66-24cf9e7199f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:03:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-2650aa17-d77f-49b3-b315-0d1740386f56 req-dd61bcfa-7ef3-47c0-b1a6-abedece5983c service nova] Lock "85062e35-e302-46f7-8d66-24cf9e7199f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:03:54 user nova-compute[72129]: DEBUG nova.compute.manager [req-2650aa17-d77f-49b3-b315-0d1740386f56 req-dd61bcfa-7ef3-47c0-b1a6-abedece5983c service nova] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] No waiting events found dispatching network-vif-unplugged-b5a06a08-bb00-4551-afd4-09ad16fe0837 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:03:54 user nova-compute[72129]: WARNING nova.compute.manager [req-2650aa17-d77f-49b3-b315-0d1740386f56 req-dd61bcfa-7ef3-47c0-b1a6-abedece5983c service nova] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Received unexpected event network-vif-unplugged-b5a06a08-bb00-4551-afd4-09ad16fe0837 for instance with vm_state active and task_state reboot_started.
Aug 01 14:03:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd127d0cbe739e7bcfaadc3538e0a428185c9733.converted --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Releasing lock "refresh_cache-e4a13a50-fe03-41aa-94f4-3431805ff481" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:03:54 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:03:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8d33c770a62ced091c43e09d4c878c9d3d0ebcd6.part --force-share --output=json" returned: 0 in 0.166s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:54 user nova-compute[72129]: DEBUG nova.virt.images [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] 66d95046-8181-453d-a433-75e70ad28d1c was qcow2, converting to raw {{(pid=72129) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 14:03:54 user nova-compute[72129]: DEBUG nova.privsep.utils [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72129) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 14:03:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8d33c770a62ced091c43e09d4c878c9d3d0ebcd6.part /opt/stack/data/nova/instances/_base/8d33c770a62ced091c43e09d4c878c9d3d0ebcd6.converted {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd127d0cbe739e7bcfaadc3538e0a428185c9733.converted --force-share --output=json" returned: 0 in 0.176s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lock "dd127d0cbe739e7bcfaadc3538e0a428185c9733" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.576s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:03:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd127d0cbe739e7bcfaadc3538e0a428185c9733 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:54 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Starting migrate_disk_and_power_off {{(pid=72129) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 01 14:03:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd127d0cbe739e7bcfaadc3538e0a428185c9733 --force-share --output=json" returned: 0 in 0.159s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Acquiring lock "dd127d0cbe739e7bcfaadc3538e0a428185c9733" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:03:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lock "dd127d0cbe739e7bcfaadc3538e0a428185c9733" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:03:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd127d0cbe739e7bcfaadc3538e0a428185c9733 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd127d0cbe739e7bcfaadc3538e0a428185c9733 --force-share --output=json" returned: 0 in 0.134s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd127d0cbe739e7bcfaadc3538e0a428185c9733,backing_fmt=raw /opt/stack/data/nova/instances/3891b9d3-832d-4ef7-8ebb-970ddd0a387a/disk 1073741824 {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dd127d0cbe739e7bcfaadc3538e0a428185c9733,backing_fmt=raw /opt/stack/data/nova/instances/3891b9d3-832d-4ef7-8ebb-970ddd0a387a/disk 1073741824" returned: 0 in 0.158s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lock "dd127d0cbe739e7bcfaadc3538e0a428185c9733" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.297s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd127d0cbe739e7bcfaadc3538e0a428185c9733 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8d33c770a62ced091c43e09d4c878c9d3d0ebcd6.part /opt/stack/data/nova/instances/_base/8d33c770a62ced091c43e09d4c878c9d3d0ebcd6.converted" returned: 0 in 0.618s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8d33c770a62ced091c43e09d4c878c9d3d0ebcd6.converted --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dd127d0cbe739e7bcfaadc3538e0a428185c9733 --force-share --output=json" returned: 0 in 0.135s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG nova.objects.instance [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lazy-loading 'migration_context' on Instance uuid 3891b9d3-832d-4ef7-8ebb-970ddd0a387a {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:03:55 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Rebasing disk image.
Aug 01 14:03:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG nova.network.neutron [req-a89d0fbc-afba-4a8d-85a2-7b300543fff5 req-5b06b52c-cb86-4edd-91ec-7cf6a23a0b66 service nova] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Updated VIF entry in instance network info cache for port acb5d1d2-f038-4111-90e1-00bf99a2a7bb. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG nova.network.neutron [req-a89d0fbc-afba-4a8d-85a2-7b300543fff5 req-5b06b52c-cb86-4edd-91ec-7cf6a23a0b66 service nova] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Updating instance_info_cache with network_info: [{"id": "acb5d1d2-f038-4111-90e1-00bf99a2a7bb", "address": "fa:16:3e:ec:4a:5e", "network": {"id": "ce10dac7-17d0-425a-bfee-70b8220d7871", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1288141476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b724093fa43c4afb9130efa2cfc713d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacb5d1d2-f0", "ovs_interfaceid": "acb5d1d2-f038-4111-90e1-00bf99a2a7bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8d33c770a62ced091c43e09d4c878c9d3d0ebcd6.converted --force-share --output=json" returned: 0 in 0.151s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Lock "8d33c770a62ced091c43e09d4c878c9d3d0ebcd6" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.893s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Acquiring lock "8d33c770a62ced091c43e09d4c878c9d3d0ebcd6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Lock "8d33c770a62ced091c43e09d4c878c9d3d0ebcd6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8d33c770a62ced091c43e09d4c878c9d3d0ebcd6 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-a89d0fbc-afba-4a8d-85a2-7b300543fff5 req-5b06b52c-cb86-4edd-91ec-7cf6a23a0b66 service nova] Releasing lock "refresh_cache-3891b9d3-832d-4ef7-8ebb-970ddd0a387a" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.144s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 -F raw /opt/stack/data/nova/instances/3891b9d3-832d-4ef7-8ebb-970ddd0a387a/disk {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8d33c770a62ced091c43e09d4c878c9d3d0ebcd6 --force-share --output=json" returned: 0 in 0.172s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8d33c770a62ced091c43e09d4c878c9d3d0ebcd6,backing_fmt=raw /opt/stack/data/nova/instances/ea050cd6-60e9-41fd-a35c-05fe63d60e57/disk.rescue {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG nova.compute.manager [req-936afc74-fe3a-4692-b7ad-ec0213740b1c req-6deaabb0-0b3e-4e68-975b-42a4fdca25c3 service nova] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Received event network-vif-unplugged-a36283e1-929d-4806-ba5f-175f99f44e98 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-936afc74-fe3a-4692-b7ad-ec0213740b1c req-6deaabb0-0b3e-4e68-975b-42a4fdca25c3 service nova] Acquiring lock "e4a13a50-fe03-41aa-94f4-3431805ff481-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-936afc74-fe3a-4692-b7ad-ec0213740b1c req-6deaabb0-0b3e-4e68-975b-42a4fdca25c3 service nova] Lock "e4a13a50-fe03-41aa-94f4-3431805ff481-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-936afc74-fe3a-4692-b7ad-ec0213740b1c req-6deaabb0-0b3e-4e68-975b-42a4fdca25c3 service nova] Lock "e4a13a50-fe03-41aa-94f4-3431805ff481-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG nova.compute.manager [req-936afc74-fe3a-4692-b7ad-ec0213740b1c req-6deaabb0-0b3e-4e68-975b-42a4fdca25c3 service nova] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] No waiting events found dispatching network-vif-unplugged-a36283e1-929d-4806-ba5f-175f99f44e98 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:03:55 user nova-compute[72129]: WARNING nova.compute.manager [req-936afc74-fe3a-4692-b7ad-ec0213740b1c req-6deaabb0-0b3e-4e68-975b-42a4fdca25c3 service nova] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Received unexpected event network-vif-unplugged-a36283e1-929d-4806-ba5f-175f99f44e98 for instance with vm_state active and task_state resize_migrating.
Aug 01 14:03:55 user nova-compute[72129]: DEBUG nova.compute.manager [req-936afc74-fe3a-4692-b7ad-ec0213740b1c req-6deaabb0-0b3e-4e68-975b-42a4fdca25c3 service nova] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Received event network-vif-plugged-a36283e1-929d-4806-ba5f-175f99f44e98 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-936afc74-fe3a-4692-b7ad-ec0213740b1c req-6deaabb0-0b3e-4e68-975b-42a4fdca25c3 service nova] Acquiring lock "e4a13a50-fe03-41aa-94f4-3431805ff481-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-936afc74-fe3a-4692-b7ad-ec0213740b1c req-6deaabb0-0b3e-4e68-975b-42a4fdca25c3 service nova] Lock "e4a13a50-fe03-41aa-94f4-3431805ff481-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-936afc74-fe3a-4692-b7ad-ec0213740b1c req-6deaabb0-0b3e-4e68-975b-42a4fdca25c3 service nova] Lock "e4a13a50-fe03-41aa-94f4-3431805ff481-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG nova.compute.manager [req-936afc74-fe3a-4692-b7ad-ec0213740b1c req-6deaabb0-0b3e-4e68-975b-42a4fdca25c3 service nova] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] No waiting events found dispatching network-vif-plugged-a36283e1-929d-4806-ba5f-175f99f44e98 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:03:55 user nova-compute[72129]: WARNING nova.compute.manager [req-936afc74-fe3a-4692-b7ad-ec0213740b1c req-6deaabb0-0b3e-4e68-975b-42a4fdca25c3 service nova] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Received unexpected event network-vif-plugged-a36283e1-929d-4806-ba5f-175f99f44e98 for instance with vm_state active and task_state resize_migrating.
Aug 01 14:03:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8d33c770a62ced091c43e09d4c878c9d3d0ebcd6,backing_fmt=raw /opt/stack/data/nova/instances/ea050cd6-60e9-41fd-a35c-05fe63d60e57/disk.rescue" returned: 0 in 0.061s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Lock "8d33c770a62ced091c43e09d4c878c9d3d0ebcd6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG nova.objects.instance [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Lazy-loading 'migration_context' on Instance uuid ea050cd6-60e9-41fd-a35c-05fe63d60e57 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Created local disks {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Start _get_guest_xml network_info=[{"id": "fe1f3453-e3ae-494c-965a-c20868179163", "address": "fa:16:3e:d8:46:16", "network": {"id": "ce187b11-5e3e-45a9-af0f-0be815ad0a3d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1245856112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1245856112-network", "vif_mac": "fa:16:3e:d8:46:16"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0a13467840342f281bd8b8e115eccaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1f3453-e3", "ovs_interfaceid": "fe1f3453-e3ae-494c-965a-c20868179163", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '66d95046-8181-453d-a433-75e70ad28d1c', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'image_id': 'b6472c34-1b0f-4034-ba3a-7e8eb5103715'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'attachment_id': 'ec7bfee8-2b92-4805-b6c8-fe74dc668b45', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BAjounGE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': 'ea050cd6-60e9-41fd-a35c-05fe63d60e57', 'attached_at': '', 'detached_at': '', 'volume_id': '79d3d741-ab72-4e2a-bbae-df43b76a4170', 'serial': '79d3d741-ab72-4e2a-bbae-df43b76a4170'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG nova.objects.instance [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Lazy-loading 'resources' on Instance uuid ea050cd6-60e9-41fd-a35c-05fe63d60e57 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG nova.objects.instance [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Lazy-loading 'numa_topology' on Instance uuid ea050cd6-60e9-41fd-a35c-05fe63d60e57 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:55 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Instance destroyed successfully.
Aug 01 14:03:55 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:01:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-320688111',display_name='tempest-ServerActionsTestOtherA-server-320688111',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-320688111',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMKxgVYWQdVKRLV+QIEDxsF4RC9I5wENeCwXhryJ2sr+8oNRgK2W8XmwhDYsUxLBCXzQXdaopDtUa2pfT9PfB2oRmI83WPjT6V3uSmwDrvE9fHgGK0Xxc5yPsVieUvlqoA==',key_name='tempest-keypair-1687158208',keypairs=<?>,launch_index=0,launched_at=2023-08-01T14:02:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b0e85d9b73a546dc95e0ace26233f2a7',ramdisk_id='',reservation_id='r-t03cme4n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1440097443',owner_user_name='tempest-ServerActionsTestOtherA-1440097443-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T14:03:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f35620862694e7295f782ab15e290a8',uuid=e4a13a50-fe03-41aa-94f4-3431805ff481,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a36283e1-929d-4806-ba5f-175f99f44e98", "address": "fa:16:3e:28:9b:e7", "network": {"id": "4b93ad92-9a3a-4472-ba6c-d215329da98b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-734108983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-734108983-network", "vif_mac": "fa:16:3e:28:9b:e7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0e85d9b73a546dc95e0ace26233f2a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36283e1-92", "ovs_interfaceid": "a36283e1-929d-4806-ba5f-175f99f44e98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Converting VIF {"id": "a36283e1-929d-4806-ba5f-175f99f44e98", "address": "fa:16:3e:28:9b:e7", "network": {"id": "4b93ad92-9a3a-4472-ba6c-d215329da98b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-734108983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-734108983-network", "vif_mac": "fa:16:3e:28:9b:e7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0e85d9b73a546dc95e0ace26233f2a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36283e1-92", "ovs_interfaceid": "a36283e1-929d-4806-ba5f-175f99f44e98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:9b:e7,bridge_name='br-int',has_traffic_filtering=True,id=a36283e1-929d-4806-ba5f-175f99f44e98,network=Network(4b93ad92-9a3a-4472-ba6c-d215329da98b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa36283e1-92') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG os_vif [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:9b:e7,bridge_name='br-int',has_traffic_filtering=True,id=a36283e1-929d-4806-ba5f-175f99f44e98,network=Network(4b93ad92-9a3a-4472-ba6c-d215329da98b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa36283e1-92') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 14:03:55 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:03:55 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:03:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa36283e1-92, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] CPU controller missing on host. {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] CPU controller found on host. {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72129) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T13:45:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Flavor limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Image limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Flavor pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Image pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Got 1 possible topologies {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG nova.objects.instance [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Lazy-loading 'vcpu_model' on Instance uuid ea050cd6-60e9-41fd-a35c-05fe63d60e57 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Calling os-brick to attach iSCSI Volume {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BAjounGE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:03:55 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:03:55 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:03:55 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:03:55 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:03:55 user nova-compute[72129]: INFO os_brick.initiator.connectors.iscsi [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 14:03:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 -p 172.16.0.220:3260 {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:55 user nova-compute[72129]: INFO os_vif [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:9b:e7,bridge_name='br-int',has_traffic_filtering=True,id=a36283e1-929d-4806-ba5f-175f99f44e98,network=Network(4b93ad92-9a3a-4472-ba6c-d215329da98b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa36283e1-92')
Aug 01 14:03:55 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] calling os-brick to detach iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, {'target_iqns': ['iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jnqFwdQU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:03:55 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:03:55 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:03:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c43fda3-e098-4c3a-bcd5-14eac019db06/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[adaa52e8-0418-4324-99f2-c452f210f2a4]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = BAjounGE\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 01 14:03:56 user nova-compute[72129]: node.name = iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170
Aug 01 14:03:56 user nova-compute[72129]: node.tpgt = -1
Aug 01 14:03:56 user nova-compute[72129]: node.startup = automatic
Aug 01 14:03:56 user nova-compute[72129]: node.leading_login = No
Aug 01 14:03:56 user nova-compute[72129]: iface.iscsi_ifacename = default
Aug 01 14:03:56 user nova-compute[72129]: iface.net_ifacename = <empty>
Aug 01 14:03:56 user nova-compute[72129]: iface.ipaddress = <empty>
Aug 01 14:03:56 user nova-compute[72129]: iface.prefix_len = 0
Aug 01 14:03:56 user nova-compute[72129]: iface.hwaddress = <empty>
Aug 01 14:03:56 user nova-compute[72129]: iface.transport_name = tcp
Aug 01 14:03:56 user nova-compute[72129]: iface.initiatorname = <empty>
Aug 01 14:03:56 user nova-compute[72129]: iface.state = <empty>
Aug 01 14:03:56 user nova-compute[72129]: iface.vlan_id = 0
Aug 01 14:03:56 user nova-compute[72129]: iface.vlan_priority = 0
Aug 01 14:03:56 user nova-compute[72129]: iface.vlan_state = <empty>
Aug 01 14:03:56 user nova-compute[72129]: iface.iface_num = 0
Aug 01 14:03:56 user nova-compute[72129]: iface.mtu = 0
Aug 01 14:03:56 user nova-compute[72129]: iface.port = 0
Aug 01 14:03:56 user nova-compute[72129]: iface.bootproto = <empty>
Aug 01 14:03:56 user nova-compute[72129]: iface.subnet_mask = <empty>
Aug 01 14:03:56 user nova-compute[72129]: iface.gateway = <empty>
Aug 01 14:03:56 user nova-compute[72129]: iface.dhcp_alt_client_id_state = <empty>
Aug 01 14:03:56 user nova-compute[72129]: iface.dhcp_alt_client_id = <empty>
Aug 01 14:03:56 user nova-compute[72129]: iface.dhcp_dns = <empty>
Aug 01 14:03:56 user nova-compute[72129]: iface.dhcp_learn_iqn = <empty>
Aug 01 14:03:56 user nova-compute[72129]: iface.dhcp_req_vendor_id_state = <empty>
Aug 01 14:03:56 user nova-compute[72129]: iface.dhcp_vendor_id_state = <empty>
Aug 01 14:03:56 user nova-compute[72129]: iface.dhcp_vendor_id = <empty>
Aug 01 14:03:56 user nova-compute[72129]: iface.dhcp_slp_da = <empty>
Aug 01 14:03:56 user nova-compute[72129]: iface.fragmentation = <empty>
Aug 01 14:03:56 user nova-compute[72129]: iface.gratuitous_arp = <empty>
Aug 01 14:03:56 user nova-compute[72129]: iface.incoming_forwarding = <empty>
Aug 01 14:03:56 user nova-compute[72129]: iface.tos_state = <empty>
Aug 01 14:03:56 user nova-compute[72129]: iface.tos = 0
Aug 01 14:03:56 user nova-compute[72129]: iface.ttl = 0
Aug 01 14:03:56 user nova-compute[72129]: iface.delayed_ack = <empty>
Aug 01 14:03:56 user nova-compute[72129]: iface.tcp_nagle = <empty>
Aug 01 14:03:56 user nova-compute[72129]: iface.tcp_wsf_state = <empty>
Aug 01 14:03:56 user nova-compute[72129]: iface.tcp_wsf = 0
Aug 01 14:03:56 user nova-compute[72129]: iface.tcp_timer_scale = 0
Aug 01 14:03:56 user nova-compute[72129]: iface.tcp_timestamp = <empty>
Aug 01 14:03:56 user nova-compute[72129]: iface.redirect = <empty>
Aug 01 14:03:56 user nova-compute[72129]: iface.def_task_mgmt_timeout = 0
Aug 01 14:03:56 user nova-compute[72129]: iface.header_digest = <empty>
Aug 01 14:03:56 user nova-compute[72129]: iface.data_digest = <empty>
Aug 01 14:03:56 user nova-compute[72129]: iface.immediate_data = <empty>
Aug 01 14:03:56 user nova-compute[72129]: iface.initial_r2t = <empty>
Aug 01 14:03:56 user nova-compute[72129]: iface.data_seq_inorder = <empty>
Aug 01 14:03:56 user nova-compute[72129]: iface.data_pdu_inorder = <empty>
Aug 01 14:03:56 user nova-compute[72129]: iface.erl = 0
Aug 01 14:03:56 user nova-compute[72129]: iface.max_receive_data_len = 0
Aug 01 14:03:56 user nova-compute[72129]: iface.first_burst_len = 0
Aug 01 14:03:56 user nova-compute[72129]: iface.max_outstanding_r2t = 0
Aug 01 14:03:56 user nova-compute[72129]: iface.max_burst_len = 0
Aug 01 14:03:56 user nova-compute[72129]: iface.chap_auth = <empty>
Aug 01 14:03:56 user nova-compute[72129]: iface.bidi_chap = <empty>
Aug 01 14:03:56 user nova-compute[72129]: iface.strict_login_compliance = <empty>
Aug 01 14:03:56 user nova-compute[72129]: iface.discovery_auth = <empty>
Aug 01 14:03:56 user nova-compute[72129]: iface.discovery_logout = <empty>
Aug 01 14:03:56 user nova-compute[72129]: node.discovery_address = <empty>
Aug 01 14:03:56 user nova-compute[72129]: node.discovery_port = 0
Aug 01 14:03:56 user nova-compute[72129]: node.discovery_type = static
Aug 01 14:03:56 user nova-compute[72129]: node.session.initial_cmdsn = 0
Aug 01 14:03:56 user nova-compute[72129]: node.session.initial_login_retry_max = 8
Aug 01 14:03:56 user nova-compute[72129]: node.session.xmit_thread_priority = -20
Aug 01 14:03:56 user nova-compute[72129]: node.session.cmds_max = 128
Aug 01 14:03:56 user nova-compute[72129]: node.session.queue_depth = 32
Aug 01 14:03:56 user nova-compute[72129]: node.session.nr_sessions = 1
Aug 01 14:03:56 user nova-compute[72129]: node.session.auth.authmethod = CHAP
Aug 01 14:03:56 user nova-compute[72129]: node.session.auth.username = BAjounGE
Aug 01 14:03:56 user nova-compute[72129]: node.session.auth.password = ***
Aug 01 14:03:56 user nova-compute[72129]: node.session.auth.username_in = <empty>
Aug 01 14:03:56 user nova-compute[72129]: node.session.auth.password_in = <empty>
Aug 01 14:03:56 user nova-compute[72129]: node.session.auth.chap_algs = MD5
Aug 01 14:03:56 user nova-compute[72129]: node.session.timeo.replacement_timeout = 120
Aug 01 14:03:56 user nova-compute[72129]: node.session.err_timeo.abort_timeout = 15
Aug 01 14:03:56 user nova-compute[72129]: node.session.err_timeo.lu_reset_timeout = 30
Aug 01 14:03:56 user nova-compute[72129]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 01 14:03:56 user nova-compute[72129]: node.session.err_timeo.host_reset_timeout = 60
Aug 01 14:03:56 user nova-compute[72129]: node.session.iscsi.FastAbort = Yes
Aug 01 14:03:56 user nova-compute[72129]: node.session.iscsi.InitialR2T = No
Aug 01 14:03:56 user nova-compute[72129]: node.session.iscsi.ImmediateData = Yes
Aug 01 14:03:56 user nova-compute[72129]: node.session.iscsi.FirstBurstLength = 262144
Aug 01 14:03:56 user nova-compute[72129]: node.session.iscsi.MaxBurstLength = 16776192
Aug 01 14:03:56 user nova-compute[72129]: node.session.iscsi.DefaultTime2Retain = 0
Aug 01 14:03:56 user nova-compute[72129]: node.session.iscsi.DefaultTime2Wait = 2
Aug 01 14:03:56 user nova-compute[72129]: node.session.iscsi.MaxConnections = 1
Aug 01 14:03:56 user nova-compute[72129]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 01 14:03:56 user nova-compute[72129]: node.session.iscsi.ERL = 0
Aug 01 14:03:56 user nova-compute[72129]: node.session.scan = manual
Aug 01 14:03:56 user nova-compute[72129]: node.session.reopen_max = 0
Aug 01 14:03:56 user nova-compute[72129]: node.conn[0].address = 172.16.0.220
Aug 01 14:03:56 user nova-compute[72129]: node.conn[0].port = 3260
Aug 01 14:03:56 user nova-compute[72129]: node.conn[0].startup = manual
Aug 01 14:03:56 user nova-compute[72129]: node.conn[0].tcp.window_size = 524288
Aug 01 14:03:56 user nova-compute[72129]: node.conn[0].tcp.type_of_service = 0
Aug 01 14:03:56 user nova-compute[72129]: node.conn[0].timeo.logout_timeout = 15
Aug 01 14:03:56 user nova-compute[72129]: node.conn[0].timeo.login_timeout = 15
Aug 01 14:03:56 user nova-compute[72129]: node.conn[0].timeo.auth_timeout = 45
Aug 01 14:03:56 user nova-compute[72129]: node.conn[0].timeo.noop_out_interval = 5
Aug 01 14:03:56 user nova-compute[72129]: node.conn[0].timeo.noop_out_timeout = 5
Aug 01 14:03:56 user nova-compute[72129]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 01 14:03:56 user nova-compute[72129]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 01 14:03:56 user nova-compute[72129]: node.conn[0].iscsi.HeaderDigest = None
Aug 01 14:03:56 user nova-compute[72129]: node.conn[0].iscsi.DataDigest = None
Aug 01 14:03:56 user nova-compute[72129]: node.conn[0].iscsi.IFMarker = No
Aug 01 14:03:56 user nova-compute[72129]: node.conn[0].iscsi.OFMarker = No
Aug 01 14:03:56 user nova-compute[72129]: # END RECORD
Aug 01 14:03:56 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47ff219-5183-4a13-a44c-ed94c118d652]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf5a0a4-0ba4-4f47-916b-5b27f8a3b382]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BAjounGE {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BAjounGE" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44ee900-84a6-4564-adcd-05fa7d5d1c57]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BAjounGE'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c43fda3-e098-4c3a-bcd5-14eac019db06/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c43fda3-e098-4c3a-bcd5-14eac019db06/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7de0ee-7098-4780-8648-28ce41b66840]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7f90f7-e2c0-4a09-af5a-aa818d795fc1]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:03:56 user nova-compute[72129]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)
Aug 01 14:03:56 user nova-compute[72129]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)
Aug 01 14:03:56 user nova-compute[72129]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f (non-flash)
Aug 01 14:03:56 user nova-compute[72129]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 (non-flash)
Aug 01 14:03:56 user nova-compute[72129]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 (non-flash)
Aug 01 14:03:56 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:03:56 user nova-compute[72129]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)
Aug 01 14:03:56 user nova-compute[72129]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)
Aug 01 14:03:56 user nova-compute[72129]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f (non-flash)
Aug 01 14:03:56 user nova-compute[72129]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 (non-flash)
Aug 01 14:03:56 user nova-compute[72129]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 (non-flash)
Aug 01 14:03:56 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Connected to 172.16.0.220:3260 {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] HCTL ('39', '0', '0', 0) found on session 38 with lun 0 {{(pid=72129) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Scanning host 39 c: 0, t: 0, l: 0) {{(pid=72129) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.014s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[11117460-ce5f-40a3-8960-f94587ea083c]: (4, ('0 0 0', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Searching for a device in session 38 and hctl ('39', '0', '0', 0) yield: sdh {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BAjounGE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.283s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] <== connect_volume: return (285ms) {'type': 'block', 'scsi_wwn': '23139313663626639', 'path': '/dev/sdh'} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23139313663626639', 'path': '/dev/sdh'} {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.270s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8', 0)] {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:56 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-c7cc1582-adab-4461-a4b3-133605466933 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Instance shutdown successfully.
Aug 01 14:03:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[df74c4b2-ffe5-4fb0-aa89-df7c698ea57f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c43fda3-e098-4c3a-bcd5-14eac019db06/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:59:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1906674292',display_name='tempest-ServerStableDeviceRescueTest-server-1906674292',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1906674292',id=24,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIloluvmwA40zqhKfuyL8nZt7CgiX8ycwdXiaBEv6UgW1UUaWlsEz3XFkowqJh9nGVbhgatwD83ZWu+nsHtuLJfq7q8QT/aiQlyv0PZxM67apvpWxm9Sutw/U44d43g6fg==',key_name='tempest-keypair-520937592',keypairs=<?>,launch_index=0,launched_at=2023-08-01T14:00:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d0a13467840342f281bd8b8e115eccaf',ramdisk_id='',reservation_id='r-iiig76vr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1490642453',owner_user_name='tempest-ServerStableDeviceRescueTest-1490642453-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T14:01:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f762f3eb1908471eae5197b9aca91734',uuid=ea050cd6-60e9-41fd-a35c-05fe63d60e57,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe1f3453-e3ae-494c-965a-c20868179163", "address": "fa:16:3e:d8:46:16", "network": {"id": "ce187b11-5e3e-45a9-af0f-0be815ad0a3d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1245856112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1245856112-network", "vif_mac": "fa:16:3e:d8:46:16"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0a13467840342f281bd8b8e115eccaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1f3453-e3", "ovs_interfaceid": "fe1f3453-e3ae-494c-965a-c20868179163", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Converting VIF {"id": "fe1f3453-e3ae-494c-965a-c20868179163", "address": "fa:16:3e:d8:46:16", "network": {"id": "ce187b11-5e3e-45a9-af0f-0be815ad0a3d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1245856112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1245856112-network", "vif_mac": "fa:16:3e:d8:46:16"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0a13467840342f281bd8b8e115eccaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1f3453-e3", "ovs_interfaceid": "fe1f3453-e3ae-494c-965a-c20868179163", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d8:46:16,bridge_name='br-int',has_traffic_filtering=True,id=fe1f3453-e3ae-494c-965a-c20868179163,network=Network(ce187b11-5e3e-45a9-af0f-0be815ad0a3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe1f3453-e3') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG nova.objects.instance [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Lazy-loading 'pci_devices' on Instance uuid ea050cd6-60e9-41fd-a35c-05fe63d60e57 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05acd7d-3584-42f1-87d7-2164bb244686]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:03:56 user nova-compute[72129]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)
Aug 01 14:03:56 user nova-compute[72129]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)
Aug 01 14:03:56 user nova-compute[72129]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f (non-flash)
Aug 01 14:03:56 user nova-compute[72129]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 (non-flash)
Aug 01 14:03:56 user nova-compute[72129]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 (non-flash)
Aug 01 14:03:56 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:03:56 user nova-compute[72129]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)
Aug 01 14:03:56 user nova-compute[72129]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)
Aug 01 14:03:56 user nova-compute[72129]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f (non-flash)
Aug 01 14:03:56 user nova-compute[72129]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 (non-flash)
Aug 01 14:03:56 user nova-compute[72129]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 (non-flash)
Aug 01 14:03:56 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2828118b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8'): ({'sdf'}, set())}) {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Removing single pathed devices sdf {{(pid=72129) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] End _get_guest_xml xml=<domain type="kvm">
Aug 01 14:03:56 user nova-compute[72129]:   <uuid>ea050cd6-60e9-41fd-a35c-05fe63d60e57</uuid>
Aug 01 14:03:56 user nova-compute[72129]:   <name>instance-00000018</name>
Aug 01 14:03:56 user nova-compute[72129]:   <memory>524288</memory>
Aug 01 14:03:56 user nova-compute[72129]:   <vcpu>1</vcpu>
Aug 01 14:03:56 user nova-compute[72129]:   <metadata>
Aug 01 14:03:56 user nova-compute[72129]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 14:03:56 user nova-compute[72129]:       <nova:package version="0.0.0"/>
Aug 01 14:03:56 user nova-compute[72129]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1906674292</nova:name>
Aug 01 14:03:56 user nova-compute[72129]:       <nova:creationTime>2023-08-01 14:03:55</nova:creationTime>
Aug 01 14:03:56 user nova-compute[72129]:       <nova:flavor name="m1.tiny">
Aug 01 14:03:56 user nova-compute[72129]:         <nova:memory>512</nova:memory>
Aug 01 14:03:56 user nova-compute[72129]:         <nova:disk>1</nova:disk>
Aug 01 14:03:56 user nova-compute[72129]:         <nova:swap>0</nova:swap>
Aug 01 14:03:56 user nova-compute[72129]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 14:03:56 user nova-compute[72129]:         <nova:vcpus>1</nova:vcpus>
Aug 01 14:03:56 user nova-compute[72129]:       </nova:flavor>
Aug 01 14:03:56 user nova-compute[72129]:       <nova:owner>
Aug 01 14:03:56 user nova-compute[72129]:         <nova:user uuid="f762f3eb1908471eae5197b9aca91734">tempest-ServerStableDeviceRescueTest-1490642453-project-member</nova:user>
Aug 01 14:03:56 user nova-compute[72129]:         <nova:project uuid="d0a13467840342f281bd8b8e115eccaf">tempest-ServerStableDeviceRescueTest-1490642453</nova:project>
Aug 01 14:03:56 user nova-compute[72129]:       </nova:owner>
Aug 01 14:03:56 user nova-compute[72129]:       <nova:root type="image" uuid="b6472c34-1b0f-4034-ba3a-7e8eb5103715"/>
Aug 01 14:03:56 user nova-compute[72129]:       <nova:ports>
Aug 01 14:03:56 user nova-compute[72129]:         <nova:port uuid="fe1f3453-e3ae-494c-965a-c20868179163">
Aug 01 14:03:56 user nova-compute[72129]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 01 14:03:56 user nova-compute[72129]:         </nova:port>
Aug 01 14:03:56 user nova-compute[72129]:       </nova:ports>
Aug 01 14:03:56 user nova-compute[72129]:     </nova:instance>
Aug 01 14:03:56 user nova-compute[72129]:   </metadata>
Aug 01 14:03:56 user nova-compute[72129]:   <sysinfo type="smbios">
Aug 01 14:03:56 user nova-compute[72129]:     <system>
Aug 01 14:03:56 user nova-compute[72129]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 14:03:56 user nova-compute[72129]:       <entry name="product">OpenStack Nova</entry>
Aug 01 14:03:56 user nova-compute[72129]:       <entry name="version">0.0.0</entry>
Aug 01 14:03:56 user nova-compute[72129]:       <entry name="serial">ea050cd6-60e9-41fd-a35c-05fe63d60e57</entry>
Aug 01 14:03:56 user nova-compute[72129]:       <entry name="uuid">ea050cd6-60e9-41fd-a35c-05fe63d60e57</entry>
Aug 01 14:03:56 user nova-compute[72129]:       <entry name="family">Virtual Machine</entry>
Aug 01 14:03:56 user nova-compute[72129]:     </system>
Aug 01 14:03:56 user nova-compute[72129]:   </sysinfo>
Aug 01 14:03:56 user nova-compute[72129]:   <os>
Aug 01 14:03:56 user nova-compute[72129]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 14:03:56 user nova-compute[72129]:     <smbios mode="sysinfo"/>
Aug 01 14:03:56 user nova-compute[72129]:   </os>
Aug 01 14:03:56 user nova-compute[72129]:   <features>
Aug 01 14:03:56 user nova-compute[72129]:     <acpi/>
Aug 01 14:03:56 user nova-compute[72129]:     <apic/>
Aug 01 14:03:56 user nova-compute[72129]:     <vmcoreinfo/>
Aug 01 14:03:56 user nova-compute[72129]:   </features>
Aug 01 14:03:56 user nova-compute[72129]:   <clock offset="utc">
Aug 01 14:03:56 user nova-compute[72129]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 14:03:56 user nova-compute[72129]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 14:03:56 user nova-compute[72129]:     <timer name="hpet" present="no"/>
Aug 01 14:03:56 user nova-compute[72129]:   </clock>
Aug 01 14:03:56 user nova-compute[72129]:   <cpu mode="custom" match="exact">
Aug 01 14:03:56 user nova-compute[72129]:     <model>Nehalem</model>
Aug 01 14:03:56 user nova-compute[72129]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 14:03:56 user nova-compute[72129]:   </cpu>
Aug 01 14:03:56 user nova-compute[72129]:   <devices>
Aug 01 14:03:56 user nova-compute[72129]:     <disk type="file" device="disk">
Aug 01 14:03:56 user nova-compute[72129]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 14:03:56 user nova-compute[72129]:       <source file="/opt/stack/data/nova/instances/ea050cd6-60e9-41fd-a35c-05fe63d60e57/disk"/>
Aug 01 14:03:56 user nova-compute[72129]:       <target dev="vda" bus="virtio"/>
Aug 01 14:03:56 user nova-compute[72129]:     </disk>
Aug 01 14:03:56 user nova-compute[72129]:     <disk type="block" device="disk">
Aug 01 14:03:56 user nova-compute[72129]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:03:56 user nova-compute[72129]:       <source dev="/dev/sdh"/>
Aug 01 14:03:56 user nova-compute[72129]:       <target dev="vdb" bus="virtio"/>
Aug 01 14:03:56 user nova-compute[72129]:       <serial>79d3d741-ab72-4e2a-bbae-df43b76a4170</serial>
Aug 01 14:03:56 user nova-compute[72129]:     </disk>
Aug 01 14:03:56 user nova-compute[72129]:     <disk type="file" device="disk">
Aug 01 14:03:56 user nova-compute[72129]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 14:03:56 user nova-compute[72129]:       <source file="/opt/stack/data/nova/instances/ea050cd6-60e9-41fd-a35c-05fe63d60e57/disk.rescue"/>
Aug 01 14:03:56 user nova-compute[72129]:       <target dev="vdc" bus="virtio"/>
Aug 01 14:03:56 user nova-compute[72129]:       <boot order="1"/>
Aug 01 14:03:56 user nova-compute[72129]:     </disk>
Aug 01 14:03:56 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 14:03:56 user nova-compute[72129]:       <mac address="fa:16:3e:d8:46:16"/>
Aug 01 14:03:56 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:03:56 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 14:03:56 user nova-compute[72129]:       <target dev="tapfe1f3453-e3"/>
Aug 01 14:03:56 user nova-compute[72129]:     </interface>
Aug 01 14:03:56 user nova-compute[72129]:     <serial type="pty">
Aug 01 14:03:56 user nova-compute[72129]:       <log file="/opt/stack/data/nova/instances/ea050cd6-60e9-41fd-a35c-05fe63d60e57/console.log" append="off"/>
Aug 01 14:03:56 user nova-compute[72129]:     </serial>
Aug 01 14:03:56 user nova-compute[72129]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 14:03:56 user nova-compute[72129]:     <video>
Aug 01 14:03:56 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:03:56 user nova-compute[72129]:     </video>
Aug 01 14:03:56 user nova-compute[72129]:     <rng model="virtio">
Aug 01 14:03:56 user nova-compute[72129]:       <backend model="random">/dev/urandom</backend>
Aug 01 14:03:56 user nova-compute[72129]:     </rng>
Aug 01 14:03:56 user nova-compute[72129]:     <controller type="usb" index="0" model="none"/>
Aug 01 14:03:56 user nova-compute[72129]:     <memballoon model="virtio">
Aug 01 14:03:56 user nova-compute[72129]:       <stats period="10"/>
Aug 01 14:03:56 user nova-compute[72129]:     </memballoon>
Aug 01 14:03:56 user nova-compute[72129]:   </devices>
Aug 01 14:03:56 user nova-compute[72129]: </domain>
Aug 01 14:03:56 user nova-compute[72129]:  {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a716def8-4564-4612-a16f-7e525ca3f249]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:56 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Instance destroyed successfully.
Aug 01 14:03:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e9f50a-cc4c-4429-847b-ac29ed50f326]: (4, ('ok\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Flushing IO for device /dev/sdf {{(pid=72129) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee378562-b91b-4c88-91ba-1700102bfa26]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72129) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.039s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[674d05ef-533e-46ed-a737-48310bed5677]: (4, ('1', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] SCSI volumes sdf have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8')] {{(pid=72129) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3a5b59-564d-4a26-b226-5a0d69f7234e]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 -p 172.16.0.220:3260 --logout {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[6194b7b9-5346-4530-a5a8-d7dc7b7114d3]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8, portal: 172.16.0.220,3260]
Aug 01 14:03:56 user nova-compute[72129]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8, portal: 172.16.0.220,3260] successful.
Aug 01 14:03:56 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 -p 172.16.0.220:3260 --op delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[2103e235-a134-48fc-9156-760fe6cd6cc4]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] <== disconnect_volume: return (572ms) None {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Disconnected iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG nova.compute.manager [req-4c894559-9346-4ff9-a3c1-c680e376d24a req-741b4b7c-23ef-4f45-a15a-93a1eab0b956 service nova] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Received event network-vif-plugged-b5a06a08-bb00-4551-afd4-09ad16fe0837 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-4c894559-9346-4ff9-a3c1-c680e376d24a req-741b4b7c-23ef-4f45-a15a-93a1eab0b956 service nova] Acquiring lock "85062e35-e302-46f7-8d66-24cf9e7199f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-4c894559-9346-4ff9-a3c1-c680e376d24a req-741b4b7c-23ef-4f45-a15a-93a1eab0b956 service nova] Lock "85062e35-e302-46f7-8d66-24cf9e7199f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-4c894559-9346-4ff9-a3c1-c680e376d24a req-741b4b7c-23ef-4f45-a15a-93a1eab0b956 service nova] Lock "85062e35-e302-46f7-8d66-24cf9e7199f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:03:56 user nova-compute[72129]: DEBUG nova.compute.manager [req-4c894559-9346-4ff9-a3c1-c680e376d24a req-741b4b7c-23ef-4f45-a15a-93a1eab0b956 service nova] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] No waiting events found dispatching network-vif-plugged-b5a06a08-bb00-4551-afd4-09ad16fe0837 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:03:56 user nova-compute[72129]: WARNING nova.compute.manager [req-4c894559-9346-4ff9-a3c1-c680e376d24a req-741b4b7c-23ef-4f45-a15a-93a1eab0b956 service nova] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Received unexpected event network-vif-plugged-b5a06a08-bb00-4551-afd4-09ad16fe0837 for instance with vm_state active and task_state reboot_started.
Aug 01 14:03:57 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:03:57 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:03:57 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:03:57 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:03:57 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:03:57 user nova-compute[72129]: DEBUG nova.network.neutron [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Port a36283e1-929d-4806-ba5f-175f99f44e98 binding to destination host user is already ACTIVE {{(pid=72129) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Acquiring lock "e4a13a50-fe03-41aa-94f4-3431805ff481-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "e4a13a50-fe03-41aa-94f4-3431805ff481-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "e4a13a50-fe03-41aa-94f4-3431805ff481-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85062e35-e302-46f7-8d66-24cf9e7199f7/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Acquiring lock "refresh_cache-e4a13a50-fe03-41aa-94f4-3431805ff481" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Acquired lock "refresh_cache-e4a13a50-fe03-41aa-94f4-3431805ff481" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG nova.network.neutron [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 -F raw /opt/stack/data/nova/instances/3891b9d3-832d-4ef7-8ebb-970ddd0a387a/disk" returned: 0 in 2.824s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Created local disks {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Ensure instance console log exists: /opt/stack/data/nova/instances/3891b9d3-832d-4ef7-8ebb-970ddd0a387a/console.log {{(pid=72129) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Start _get_guest_xml network_info=[{"id": "acb5d1d2-f038-4111-90e1-00bf99a2a7bb", "address": "fa:16:3e:ec:4a:5e", "network": {"id": "ce10dac7-17d0-425a-bfee-70b8220d7871", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1288141476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b724093fa43c4afb9130efa2cfc713d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacb5d1d2-f0", "ovs_interfaceid": "acb5d1d2-f038-4111-90e1-00bf99a2a7bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='6c38e40fabae0ca519a1ab939de6edff',container_format='bare',created_at=2023-08-01T14:01:48Z,direct_url=<?>,disk_format='qcow2',id=cc83affc-7464-465f-821c-002a21f41dc6,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-331489091-shelved',owner='b724093fa43c4afb9130efa2cfc713d9',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-01T14:01:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'image_id': 'b6472c34-1b0f-4034-ba3a-7e8eb5103715'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'attachment_id': 'c213fff3-3e75-4459-8bfc-fa13d12c6442', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:80a7dc25-351e-4c85-967a-ce6e0c8dc840'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gLMdfUJj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '3891b9d3-832d-4ef7-8ebb-970ddd0a387a', 'attached_at': '', 'detached_at': '', 'volume_id': '80a7dc25-351e-4c85-967a-ce6e0c8dc840', 'serial': '80a7dc25-351e-4c85-967a-ce6e0c8dc840'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] No VIF found with MAC fa:16:3e:d8:46:16, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 14:03:58 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:03:58 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:03:58 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] CPU controller missing on host. {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] CPU controller found on host. {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72129) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T13:45:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='6c38e40fabae0ca519a1ab939de6edff',container_format='bare',created_at=2023-08-01T14:01:48Z,direct_url=<?>,disk_format='qcow2',id=cc83affc-7464-465f-821c-002a21f41dc6,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-331489091-shelved',owner='b724093fa43c4afb9130efa2cfc713d9',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-01T14:01:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Flavor limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Image limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Flavor pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Image pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Got 1 possible topologies {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG nova.objects.instance [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3891b9d3-832d-4ef7-8ebb-970ddd0a387a {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Calling os-brick to attach iSCSI Volume {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:80a7dc25-351e-4c85-967a-ce6e0c8dc840'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gLMdfUJj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:03:58 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:03:58 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:03:58 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:03:58 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80a7dc25-351e-4c85-967a-ce6e0c8dc840" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80a7dc25-351e-4c85-967a-ce6e0c8dc840" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:03:58 user nova-compute[72129]: INFO os_brick.initiator.connectors.iscsi [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 14:03:58 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85062e35-e302-46f7-8d66-24cf9e7199f7/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a7dc25-351e-4c85-967a-ce6e0c8dc840 -p 172.16.0.220:3260 {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85062e35-e302-46f7-8d66-24cf9e7199f7/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a7dc25-351e-4c85-967a-ce6e0c8dc840 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[e635140f-97af-45b2-86e7-c8dd8aa2b49f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 14:03:58 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a7dc25-351e-4c85-967a-ce6e0c8dc840 -p 172.16.0.220:3260 --interface default --op new {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a7dc25-351e-4c85-967a-ce6e0c8dc840 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38caf6f-14ab-4c8e-8d12-be360f185516]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80a7dc25-351e-4c85-967a-ce6e0c8dc840] added\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80a7dc25-351e-4c85-967a-ce6e0c8dc840] added
Aug 01 14:03:58 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a7dc25-351e-4c85-967a-ce6e0c8dc840 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG nova.compute.manager [req-33bfb5de-a55b-485a-8e67-eb55e0703dfc req-9cbfd58a-2994-4fb7-a627-829df532acee service nova] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Received event network-vif-plugged-b5a06a08-bb00-4551-afd4-09ad16fe0837 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-33bfb5de-a55b-485a-8e67-eb55e0703dfc req-9cbfd58a-2994-4fb7-a627-829df532acee service nova] Acquiring lock "85062e35-e302-46f7-8d66-24cf9e7199f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-33bfb5de-a55b-485a-8e67-eb55e0703dfc req-9cbfd58a-2994-4fb7-a627-829df532acee service nova] Lock "85062e35-e302-46f7-8d66-24cf9e7199f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-33bfb5de-a55b-485a-8e67-eb55e0703dfc req-9cbfd58a-2994-4fb7-a627-829df532acee service nova] Lock "85062e35-e302-46f7-8d66-24cf9e7199f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG nova.compute.manager [req-33bfb5de-a55b-485a-8e67-eb55e0703dfc req-9cbfd58a-2994-4fb7-a627-829df532acee service nova] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] No waiting events found dispatching network-vif-plugged-b5a06a08-bb00-4551-afd4-09ad16fe0837 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:03:58 user nova-compute[72129]: WARNING nova.compute.manager [req-33bfb5de-a55b-485a-8e67-eb55e0703dfc req-9cbfd58a-2994-4fb7-a627-829df532acee service nova] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Received unexpected event network-vif-plugged-b5a06a08-bb00-4551-afd4-09ad16fe0837 for instance with vm_state active and task_state reboot_started.
Aug 01 14:03:58 user nova-compute[72129]: DEBUG nova.compute.manager [req-33bfb5de-a55b-485a-8e67-eb55e0703dfc req-9cbfd58a-2994-4fb7-a627-829df532acee service nova] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Received event network-vif-plugged-b5a06a08-bb00-4551-afd4-09ad16fe0837 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-33bfb5de-a55b-485a-8e67-eb55e0703dfc req-9cbfd58a-2994-4fb7-a627-829df532acee service nova] Acquiring lock "85062e35-e302-46f7-8d66-24cf9e7199f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-33bfb5de-a55b-485a-8e67-eb55e0703dfc req-9cbfd58a-2994-4fb7-a627-829df532acee service nova] Lock "85062e35-e302-46f7-8d66-24cf9e7199f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-33bfb5de-a55b-485a-8e67-eb55e0703dfc req-9cbfd58a-2994-4fb7-a627-829df532acee service nova] Lock "85062e35-e302-46f7-8d66-24cf9e7199f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG nova.compute.manager [req-33bfb5de-a55b-485a-8e67-eb55e0703dfc req-9cbfd58a-2994-4fb7-a627-829df532acee service nova] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] No waiting events found dispatching network-vif-plugged-b5a06a08-bb00-4551-afd4-09ad16fe0837 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:03:58 user nova-compute[72129]: WARNING nova.compute.manager [req-33bfb5de-a55b-485a-8e67-eb55e0703dfc req-9cbfd58a-2994-4fb7-a627-829df532acee service nova] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Received unexpected event network-vif-plugged-b5a06a08-bb00-4551-afd4-09ad16fe0837 for instance with vm_state active and task_state reboot_started.
Aug 01 14:03:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a7dc25-351e-4c85-967a-ce6e0c8dc840 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b352edc8-550c-49cb-a884-e6b7f1544ab4]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a7dc25-351e-4c85-967a-ce6e0c8dc840 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a7dc25-351e-4c85-967a-ce6e0c8dc840 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[54275043-f1b5-47b1-9c4c-46242e1b13a7]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a7dc25-351e-4c85-967a-ce6e0c8dc840 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gLMdfUJj {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85062e35-e302-46f7-8d66-24cf9e7199f7/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53b76ca4-30f0-4fd4-9928-714c7073a490/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a7dc25-351e-4c85-967a-ce6e0c8dc840 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gLMdfUJj" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[77cf8c32-d262-4a14-985a-287fef6dfcc7]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gLMdfUJj'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a7dc25-351e-4c85-967a-ce6e0c8dc840 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a7dc25-351e-4c85-967a-ce6e0c8dc840 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.036s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[4428b4fb-514e-4aaa-bf58-8d50c336f069]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e5790d-2075-425b-bf03-d1050e586594]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:03:58 user nova-compute[72129]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)
Aug 01 14:03:58 user nova-compute[72129]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f (non-flash)
Aug 01 14:03:58 user nova-compute[72129]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 (non-flash)
Aug 01 14:03:58 user nova-compute[72129]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 (non-flash)
Aug 01 14:03:58 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:03:58 user nova-compute[72129]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)
Aug 01 14:03:58 user nova-compute[72129]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f (non-flash)
Aug 01 14:03:58 user nova-compute[72129]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 (non-flash)
Aug 01 14:03:58 user nova-compute[72129]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 (non-flash)
Aug 01 14:03:58 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a7dc25-351e-4c85-967a-ce6e0c8dc840 -p 172.16.0.220:3260 --login {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53b76ca4-30f0-4fd4-9928-714c7073a490/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53b76ca4-30f0-4fd4-9928-714c7073a490/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a7dc25-351e-4c85-967a-ce6e0c8dc840 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe94073-c8ff-4b02-a1d2-56573f75bc9e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:80a7dc25-351e-4c85-967a-ce6e0c8dc840, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:80a7dc25-351e-4c85-967a-ce6e0c8dc840, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:80a7dc25-351e-4c85-967a-ce6e0c8dc840, portal: 172.16.0.220,3260]
Aug 01 14:03:58 user nova-compute[72129]: Login to [iface: default, target: iqn.2010-10.org.openstack:80a7dc25-351e-4c85-967a-ce6e0c8dc840, portal: 172.16.0.220,3260] successful.
Aug 01 14:03:58 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a7dc25-351e-4c85-967a-ce6e0c8dc840 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a7dc25-351e-4c85-967a-ce6e0c8dc840 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d62abbe9-5330-4ccb-b236-f5b12ce95006]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:03:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:59 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:59 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d2da91-b163-4551-b0af-edfb0580a054]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a7dc25-351e-4c85-967a-ce6e0c8dc840 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:59 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:03:59 user nova-compute[72129]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)
Aug 01 14:03:59 user nova-compute[72129]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f (non-flash)
Aug 01 14:03:59 user nova-compute[72129]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 (non-flash)
Aug 01 14:03:59 user nova-compute[72129]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 (non-flash)
Aug 01 14:03:59 user nova-compute[72129]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a7dc25-351e-4c85-967a-ce6e0c8dc840 (non-flash)
Aug 01 14:03:59 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:03:59 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:03:59 user nova-compute[72129]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)
Aug 01 14:03:59 user nova-compute[72129]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f (non-flash)
Aug 01 14:03:59 user nova-compute[72129]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 (non-flash)
Aug 01 14:03:59 user nova-compute[72129]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 (non-flash)
Aug 01 14:03:59 user nova-compute[72129]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a7dc25-351e-4c85-967a-ce6e0c8dc840 (non-flash)
Aug 01 14:03:59 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:03:59 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80a7dc25-351e-4c85-967a-ce6e0c8dc840" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.490s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:03:59 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Connected to 172.16.0.220:3260 {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 14:03:59 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] HCTL ('36', '-', '-', 0) found on session 39 with lun 0 {{(pid=72129) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 14:03:59 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72129) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 14:03:59 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53b76ca4-30f0-4fd4-9928-714c7073a490/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:59 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:59 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:59 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.033s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:59 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8021ca-b6b4-4f74-be57-5ca305010d7b]: (4, ('- - 0', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:59 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Searching for a device in session 39 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 14:03:59 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gLMdfUJj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 14:03:59 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:59 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:59 user nova-compute[72129]: DEBUG nova.network.neutron [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Updating instance_info_cache with network_info: [{"id": "a36283e1-929d-4806-ba5f-175f99f44e98", "address": "fa:16:3e:28:9b:e7", "network": {"id": "4b93ad92-9a3a-4472-ba6c-d215329da98b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-734108983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0e85d9b73a546dc95e0ace26233f2a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36283e1-92", "ovs_interfaceid": "a36283e1-929d-4806-ba5f-175f99f44e98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:03:59 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Releasing lock "refresh_cache-e4a13a50-fe03-41aa-94f4-3431805ff481" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:03:59 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:59 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 14:03:59 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 14:03:59 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cf5877-55dd-44ce-9b58-b662afe8e62e/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:59 user nova-compute[72129]: DEBUG os_brick.utils [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:03:59 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:59 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:59 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[00afb445-a4b2-453b-ae55-b7502d1f53d8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f9b449c2cd3d\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:59 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:59 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:59 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b13687e-6476-4186-b599-e8e523cb02a3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:59 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:59 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:59 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[840caaee-6b68-4f36-a9f0-65dd479b08dd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:59 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b490641b-268f-4316-8065-5cfc65a07d47]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:59 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Running cmd (subprocess): nvme version {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:59 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] 'nvme version' failed. Not Retrying. {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 14:03:59 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] nvme not present on system {{(pid=72129) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 14:03:59 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cf5877-55dd-44ce-9b58-b662afe8e62e/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:59 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cf5877-55dd-44ce-9b58-b662afe8e62e/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:59 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:03:59 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 14:03:59 user nova-compute[72129]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 14:03:59 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[88aeef9b-ff15-4bf8-9485-6b37ba25a63f]: (4, '') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:03:59 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72129) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 14:03:59 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 14:03:59 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] LIGHTOS: no hostnqn found. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 14:03:59 user nova-compute[72129]: DEBUG os_brick.utils [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f9b449c2cd3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:03:59 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cf5877-55dd-44ce-9b58-b662afe8e62e/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:03:59 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 14:03:59 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:04:00 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:04:00 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:04:00 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:04:00 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.571s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:04:00 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] <== connect_volume: return (1574ms) {'type': 'block', 'scsi_wwn': '26365623062306263', 'path': '/dev/sde'} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:04:00 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26365623062306263', 'path': '/dev/sde'} {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 14:04:00 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T13:59:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-331489091',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-331489091',id=23,image_ref='cc83affc-7464-465f-821c-002a21f41dc6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-2118933419',keypairs=<?>,launch_index=0,launched_at=2023-08-01T13:59:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b724093fa43c4afb9130efa2cfc713d9',ramdisk_id='',reservation_id='r-ynze9bkr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1864942034',owner_user_name='tempest-AttachVolumeShelveTestJSON-1864942034-project-member',shelved_at='2023-08-01T14:01:54.663766',shelved_host='user',shelved_image_id='cc83affc-7464-465f-821c-002a21f41dc6'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T14:03:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e5630ede467c4c99915b1b2f455ca0fb',uuid=3891b9d3-832d-4ef7-8ebb-970ddd0a387a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "acb5d1d2-f038-4111-90e1-00bf99a2a7bb", "address": "fa:16:3e:ec:4a:5e", "network": {"id": "ce10dac7-17d0-425a-bfee-70b8220d7871", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1288141476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b724093fa43c4afb9130efa2cfc713d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacb5d1d2-f0", "ovs_interfaceid": "acb5d1d2-f038-4111-90e1-00bf99a2a7bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 14:04:00 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Converting VIF {"id": "acb5d1d2-f038-4111-90e1-00bf99a2a7bb", "address": "fa:16:3e:ec:4a:5e", "network": {"id": "ce10dac7-17d0-425a-bfee-70b8220d7871", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1288141476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b724093fa43c4afb9130efa2cfc713d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacb5d1d2-f0", "ovs_interfaceid": "acb5d1d2-f038-4111-90e1-00bf99a2a7bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:04:00 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:4a:5e,bridge_name='br-int',has_traffic_filtering=True,id=acb5d1d2-f038-4111-90e1-00bf99a2a7bb,network=Network(ce10dac7-17d0-425a-bfee-70b8220d7871),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacb5d1d2-f0') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:04:00 user nova-compute[72129]: DEBUG nova.objects.instance [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lazy-loading 'pci_devices' on Instance uuid 3891b9d3-832d-4ef7-8ebb-970ddd0a387a {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:04:00 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Removed pending event for 85062e35-e302-46f7-8d66-24cf9e7199f7 due to event {{(pid=72129) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 14:04:00 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898640.1502292, 85062e35-e302-46f7-8d66-24cf9e7199f7 => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:04:00 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] VM Resumed (Lifecycle Event)
Aug 01 14:04:00 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] End _get_guest_xml xml=<domain type="kvm">
Aug 01 14:04:00 user nova-compute[72129]:   <uuid>3891b9d3-832d-4ef7-8ebb-970ddd0a387a</uuid>
Aug 01 14:04:00 user nova-compute[72129]:   <name>instance-00000017</name>
Aug 01 14:04:00 user nova-compute[72129]:   <memory>524288</memory>
Aug 01 14:04:00 user nova-compute[72129]:   <vcpu>1</vcpu>
Aug 01 14:04:00 user nova-compute[72129]:   <metadata>
Aug 01 14:04:00 user nova-compute[72129]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 14:04:00 user nova-compute[72129]:       <nova:package version="0.0.0"/>
Aug 01 14:04:00 user nova-compute[72129]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-331489091</nova:name>
Aug 01 14:04:00 user nova-compute[72129]:       <nova:creationTime>2023-08-01 14:03:58</nova:creationTime>
Aug 01 14:04:00 user nova-compute[72129]:       <nova:flavor name="m1.tiny">
Aug 01 14:04:00 user nova-compute[72129]:         <nova:memory>512</nova:memory>
Aug 01 14:04:00 user nova-compute[72129]:         <nova:disk>1</nova:disk>
Aug 01 14:04:00 user nova-compute[72129]:         <nova:swap>0</nova:swap>
Aug 01 14:04:00 user nova-compute[72129]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 14:04:00 user nova-compute[72129]:         <nova:vcpus>1</nova:vcpus>
Aug 01 14:04:00 user nova-compute[72129]:       </nova:flavor>
Aug 01 14:04:00 user nova-compute[72129]:       <nova:owner>
Aug 01 14:04:00 user nova-compute[72129]:         <nova:user uuid="e5630ede467c4c99915b1b2f455ca0fb">tempest-AttachVolumeShelveTestJSON-1864942034-project-member</nova:user>
Aug 01 14:04:00 user nova-compute[72129]:         <nova:project uuid="b724093fa43c4afb9130efa2cfc713d9">tempest-AttachVolumeShelveTestJSON-1864942034</nova:project>
Aug 01 14:04:00 user nova-compute[72129]:       </nova:owner>
Aug 01 14:04:00 user nova-compute[72129]:       <nova:root type="image" uuid="cc83affc-7464-465f-821c-002a21f41dc6"/>
Aug 01 14:04:00 user nova-compute[72129]:       <nova:ports>
Aug 01 14:04:00 user nova-compute[72129]:         <nova:port uuid="acb5d1d2-f038-4111-90e1-00bf99a2a7bb">
Aug 01 14:04:00 user nova-compute[72129]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 01 14:04:00 user nova-compute[72129]:         </nova:port>
Aug 01 14:04:00 user nova-compute[72129]:       </nova:ports>
Aug 01 14:04:00 user nova-compute[72129]:     </nova:instance>
Aug 01 14:04:00 user nova-compute[72129]:   </metadata>
Aug 01 14:04:00 user nova-compute[72129]:   <sysinfo type="smbios">
Aug 01 14:04:00 user nova-compute[72129]:     <system>
Aug 01 14:04:00 user nova-compute[72129]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 14:04:00 user nova-compute[72129]:       <entry name="product">OpenStack Nova</entry>
Aug 01 14:04:00 user nova-compute[72129]:       <entry name="version">0.0.0</entry>
Aug 01 14:04:00 user nova-compute[72129]:       <entry name="serial">3891b9d3-832d-4ef7-8ebb-970ddd0a387a</entry>
Aug 01 14:04:00 user nova-compute[72129]:       <entry name="uuid">3891b9d3-832d-4ef7-8ebb-970ddd0a387a</entry>
Aug 01 14:04:00 user nova-compute[72129]:       <entry name="family">Virtual Machine</entry>
Aug 01 14:04:00 user nova-compute[72129]:     </system>
Aug 01 14:04:00 user nova-compute[72129]:   </sysinfo>
Aug 01 14:04:00 user nova-compute[72129]:   <os>
Aug 01 14:04:00 user nova-compute[72129]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 14:04:00 user nova-compute[72129]:     <boot dev="hd"/>
Aug 01 14:04:00 user nova-compute[72129]:     <smbios mode="sysinfo"/>
Aug 01 14:04:00 user nova-compute[72129]:   </os>
Aug 01 14:04:00 user nova-compute[72129]:   <features>
Aug 01 14:04:00 user nova-compute[72129]:     <acpi/>
Aug 01 14:04:00 user nova-compute[72129]:     <apic/>
Aug 01 14:04:00 user nova-compute[72129]:     <vmcoreinfo/>
Aug 01 14:04:00 user nova-compute[72129]:   </features>
Aug 01 14:04:00 user nova-compute[72129]:   <clock offset="utc">
Aug 01 14:04:00 user nova-compute[72129]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 14:04:00 user nova-compute[72129]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 14:04:00 user nova-compute[72129]:     <timer name="hpet" present="no"/>
Aug 01 14:04:00 user nova-compute[72129]:   </clock>
Aug 01 14:04:00 user nova-compute[72129]:   <cpu mode="custom" match="exact">
Aug 01 14:04:00 user nova-compute[72129]:     <model>Nehalem</model>
Aug 01 14:04:00 user nova-compute[72129]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 14:04:00 user nova-compute[72129]:   </cpu>
Aug 01 14:04:00 user nova-compute[72129]:   <devices>
Aug 01 14:04:00 user nova-compute[72129]:     <disk type="file" device="disk">
Aug 01 14:04:00 user nova-compute[72129]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 14:04:00 user nova-compute[72129]:       <source file="/opt/stack/data/nova/instances/3891b9d3-832d-4ef7-8ebb-970ddd0a387a/disk"/>
Aug 01 14:04:00 user nova-compute[72129]:       <target dev="vda" bus="virtio"/>
Aug 01 14:04:00 user nova-compute[72129]:     </disk>
Aug 01 14:04:00 user nova-compute[72129]:     <disk type="block" device="disk">
Aug 01 14:04:00 user nova-compute[72129]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:04:00 user nova-compute[72129]:       <source dev="/dev/sde"/>
Aug 01 14:04:00 user nova-compute[72129]:       <target dev="vdc" bus="virtio"/>
Aug 01 14:04:00 user nova-compute[72129]:       <serial>80a7dc25-351e-4c85-967a-ce6e0c8dc840</serial>
Aug 01 14:04:00 user nova-compute[72129]:     </disk>
Aug 01 14:04:00 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 14:04:00 user nova-compute[72129]:       <mac address="fa:16:3e:ec:4a:5e"/>
Aug 01 14:04:00 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:04:00 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 14:04:00 user nova-compute[72129]:       <target dev="tapacb5d1d2-f0"/>
Aug 01 14:04:00 user nova-compute[72129]:     </interface>
Aug 01 14:04:00 user nova-compute[72129]:     <serial type="pty">
Aug 01 14:04:00 user nova-compute[72129]:       <log file="/opt/stack/data/nova/instances/3891b9d3-832d-4ef7-8ebb-970ddd0a387a/console.log" append="off"/>
Aug 01 14:04:00 user nova-compute[72129]:     </serial>
Aug 01 14:04:00 user nova-compute[72129]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 14:04:00 user nova-compute[72129]:     <video>
Aug 01 14:04:00 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:04:00 user nova-compute[72129]:     </video>
Aug 01 14:04:00 user nova-compute[72129]:     <rng model="virtio">
Aug 01 14:04:00 user nova-compute[72129]:       <backend model="random">/dev/urandom</backend>
Aug 01 14:04:00 user nova-compute[72129]:     </rng>
Aug 01 14:04:00 user nova-compute[72129]:     <controller type="usb" index="0" model="none"/>
Aug 01 14:04:00 user nova-compute[72129]:     <memballoon model="virtio">
Aug 01 14:04:00 user nova-compute[72129]:       <stats period="10"/>
Aug 01 14:04:00 user nova-compute[72129]:     </memballoon>
Aug 01 14:04:00 user nova-compute[72129]:   </devices>
Aug 01 14:04:00 user nova-compute[72129]: </domain>
Aug 01 14:04:00 user nova-compute[72129]:  {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 14:04:00 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T13:59:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-331489091',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-331489091',id=23,image_ref='cc83affc-7464-465f-821c-002a21f41dc6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-2118933419',keypairs=<?>,launch_index=0,launched_at=2023-08-01T13:59:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b724093fa43c4afb9130efa2cfc713d9',ramdisk_id='',reservation_id='r-ynze9bkr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1864942034',owner_user_name='tempest-AttachVolumeShelveTestJSON-1864942034-project-member',shelved_at='2023-08-01T14:01:54.663766',shelved_host='user',shelved_image_id='cc83affc-7464-465f-821c-002a21f41dc6'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T14:03:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e5630ede467c4c99915b1b2f455ca0fb',uuid=3891b9d3-832d-4ef7-8ebb-970ddd0a387a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "acb5d1d2-f038-4111-90e1-00bf99a2a7bb", "address": "fa:16:3e:ec:4a:5e", "network": {"id": "ce10dac7-17d0-425a-bfee-70b8220d7871", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1288141476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b724093fa43c4afb9130efa2cfc713d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacb5d1d2-f0", "ovs_interfaceid": "acb5d1d2-f038-4111-90e1-00bf99a2a7bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 14:04:00 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Converting VIF {"id": "acb5d1d2-f038-4111-90e1-00bf99a2a7bb", "address": "fa:16:3e:ec:4a:5e", "network": {"id": "ce10dac7-17d0-425a-bfee-70b8220d7871", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1288141476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b724093fa43c4afb9130efa2cfc713d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacb5d1d2-f0", "ovs_interfaceid": "acb5d1d2-f038-4111-90e1-00bf99a2a7bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:04:00 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:4a:5e,bridge_name='br-int',has_traffic_filtering=True,id=acb5d1d2-f038-4111-90e1-00bf99a2a7bb,network=Network(ce10dac7-17d0-425a-bfee-70b8220d7871),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacb5d1d2-f0') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:04:00 user nova-compute[72129]: DEBUG os_vif [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:4a:5e,bridge_name='br-int',has_traffic_filtering=True,id=acb5d1d2-f038-4111-90e1-00bf99a2a7bb,network=Network(ce10dac7-17d0-425a-bfee-70b8220d7871),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacb5d1d2-f0') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 14:04:00 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:04:00 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:04:00 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 14:04:00 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:04:00 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:04:00 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapacb5d1d2-f0, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:04:00 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapacb5d1d2-f0, col_values=(('external_ids', {'iface-id': 'acb5d1d2-f038-4111-90e1-00bf99a2a7bb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:4a:5e', 'vm-uuid': '3891b9d3-832d-4ef7-8ebb-970ddd0a387a'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:04:00 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:04:00 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Instance running successfully.
Aug 01 14:04:00 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-c7cc1582-adab-4461-a4b3-133605466933 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Instance soft rebooted successfully.
Aug 01 14:04:00 user nova-compute[72129]: DEBUG nova.compute.manager [None req-c7cc1582-adab-4461-a4b3-133605466933 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:04:00 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:04:00 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:04:00 user nova-compute[72129]: INFO os_vif [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:4a:5e,bridge_name='br-int',has_traffic_filtering=True,id=acb5d1d2-f038-4111-90e1-00bf99a2a7bb,network=Network(ce10dac7-17d0-425a-bfee-70b8220d7871),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacb5d1d2-f0')
Aug 01 14:04:00 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] During sync_power_state the instance has a pending task (reboot_started). Skip.
Aug 01 14:04:00 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898640.151346, 85062e35-e302-46f7-8d66-24cf9e7199f7 => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:04:00 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] VM Started (Lifecycle Event)
Aug 01 14:04:00 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:04:00 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:04:00 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c7cc1582-adab-4461-a4b3-133605466933 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lock "85062e35-e302-46f7-8d66-24cf9e7199f7" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 9.218s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:04:00 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea050cd6-60e9-41fd-a35c-05fe63d60e57/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:04:00 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:04:00 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:04:00 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] No VIF found with MAC fa:16:3e:ec:4a:5e, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 14:04:00 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea050cd6-60e9-41fd-a35c-05fe63d60e57/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:04:00 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea050cd6-60e9-41fd-a35c-05fe63d60e57/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:04:00 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:04:00 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:04:00 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:04:00 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:04:00 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:04:00 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:04:00 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea050cd6-60e9-41fd-a35c-05fe63d60e57/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:04:00 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 14:04:00 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea050cd6-60e9-41fd-a35c-05fe63d60e57/disk.rescue --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:04:01 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea050cd6-60e9-41fd-a35c-05fe63d60e57/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:04:01 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea050cd6-60e9-41fd-a35c-05fe63d60e57/disk.rescue --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:04:01 user nova-compute[72129]: DEBUG nova.compute.manager [req-7e1aba39-81e6-4a23-a6e5-f9002ff19c9f req-b6e49af5-c9ec-48c7-a165-1de155f718bd service nova] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Received event network-vif-plugged-fe1f3453-e3ae-494c-965a-c20868179163 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:04:01 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-7e1aba39-81e6-4a23-a6e5-f9002ff19c9f req-b6e49af5-c9ec-48c7-a165-1de155f718bd service nova] Acquiring lock "ea050cd6-60e9-41fd-a35c-05fe63d60e57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:04:01 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-7e1aba39-81e6-4a23-a6e5-f9002ff19c9f req-b6e49af5-c9ec-48c7-a165-1de155f718bd service nova] Lock "ea050cd6-60e9-41fd-a35c-05fe63d60e57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:04:01 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-7e1aba39-81e6-4a23-a6e5-f9002ff19c9f req-b6e49af5-c9ec-48c7-a165-1de155f718bd service nova] Lock "ea050cd6-60e9-41fd-a35c-05fe63d60e57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:04:01 user nova-compute[72129]: DEBUG nova.compute.manager [req-7e1aba39-81e6-4a23-a6e5-f9002ff19c9f req-b6e49af5-c9ec-48c7-a165-1de155f718bd service nova] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] No waiting events found dispatching network-vif-plugged-fe1f3453-e3ae-494c-965a-c20868179163 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:04:01 user nova-compute[72129]: WARNING nova.compute.manager [req-7e1aba39-81e6-4a23-a6e5-f9002ff19c9f req-b6e49af5-c9ec-48c7-a165-1de155f718bd service nova] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Received unexpected event network-vif-plugged-fe1f3453-e3ae-494c-965a-c20868179163 for instance with vm_state active and task_state rescuing.
Aug 01 14:04:01 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea050cd6-60e9-41fd-a35c-05fe63d60e57/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:04:04 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:04:04 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Removed pending event for ea050cd6-60e9-41fd-a35c-05fe63d60e57 due to event {{(pid=72129) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 14:04:04 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898642.768973, ea050cd6-60e9-41fd-a35c-05fe63d60e57 => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:04:04 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] VM Resumed (Lifecycle Event)
Aug 01 14:04:05 user nova-compute[72129]: DEBUG nova.compute.manager [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Instance event wait completed in 0 seconds for  {{(pid=72129) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 14:04:05 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Guest created on hypervisor {{(pid=72129) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 14:04:05 user nova-compute[72129]: DEBUG nova.compute.manager [req-314b348b-7449-4809-a75e-be25d03e99e3 req-fa13f120-c535-4240-8e16-bd29669cd46f service nova] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Received event network-vif-plugged-acb5d1d2-f038-4111-90e1-00bf99a2a7bb {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:04:05 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-314b348b-7449-4809-a75e-be25d03e99e3 req-fa13f120-c535-4240-8e16-bd29669cd46f service nova] Acquiring lock "3891b9d3-832d-4ef7-8ebb-970ddd0a387a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:04:05 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-314b348b-7449-4809-a75e-be25d03e99e3 req-fa13f120-c535-4240-8e16-bd29669cd46f service nova] Lock "3891b9d3-832d-4ef7-8ebb-970ddd0a387a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:04:05 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-314b348b-7449-4809-a75e-be25d03e99e3 req-fa13f120-c535-4240-8e16-bd29669cd46f service nova] Lock "3891b9d3-832d-4ef7-8ebb-970ddd0a387a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:04:05 user nova-compute[72129]: DEBUG nova.compute.manager [req-314b348b-7449-4809-a75e-be25d03e99e3 req-fa13f120-c535-4240-8e16-bd29669cd46f service nova] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] No waiting events found dispatching network-vif-plugged-acb5d1d2-f038-4111-90e1-00bf99a2a7bb {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:04:05 user nova-compute[72129]: WARNING nova.compute.manager [req-314b348b-7449-4809-a75e-be25d03e99e3 req-fa13f120-c535-4240-8e16-bd29669cd46f service nova] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Received unexpected event network-vif-plugged-acb5d1d2-f038-4111-90e1-00bf99a2a7bb for instance with vm_state shelved_offloaded and task_state spawning.
Aug 01 14:04:05 user nova-compute[72129]: DEBUG nova.compute.manager [req-283913f7-be9d-42c1-90f6-0c0244d94567 req-1ba45840-313a-4e9e-9834-5dd560eebb5f service nova] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Received event network-vif-plugged-fe1f3453-e3ae-494c-965a-c20868179163 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:04:05 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-283913f7-be9d-42c1-90f6-0c0244d94567 req-1ba45840-313a-4e9e-9834-5dd560eebb5f service nova] Acquiring lock "ea050cd6-60e9-41fd-a35c-05fe63d60e57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:04:05 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-283913f7-be9d-42c1-90f6-0c0244d94567 req-1ba45840-313a-4e9e-9834-5dd560eebb5f service nova] Lock "ea050cd6-60e9-41fd-a35c-05fe63d60e57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:04:05 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-283913f7-be9d-42c1-90f6-0c0244d94567 req-1ba45840-313a-4e9e-9834-5dd560eebb5f service nova] Lock "ea050cd6-60e9-41fd-a35c-05fe63d60e57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:04:05 user nova-compute[72129]: DEBUG nova.compute.manager [req-283913f7-be9d-42c1-90f6-0c0244d94567 req-1ba45840-313a-4e9e-9834-5dd560eebb5f service nova] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] No waiting events found dispatching network-vif-plugged-fe1f3453-e3ae-494c-965a-c20868179163 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:04:05 user nova-compute[72129]: WARNING nova.compute.manager [req-283913f7-be9d-42c1-90f6-0c0244d94567 req-1ba45840-313a-4e9e-9834-5dd560eebb5f service nova] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Received unexpected event network-vif-plugged-fe1f3453-e3ae-494c-965a-c20868179163 for instance with vm_state active and task_state rescuing.
Aug 01 14:04:05 user nova-compute[72129]: DEBUG nova.compute.manager [req-c9d1047b-261e-47b4-814a-829b73312414 req-8a8b5763-06be-439d-b127-11b89fc80a72 service nova] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Received event network-vif-plugged-acb5d1d2-f038-4111-90e1-00bf99a2a7bb {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:04:05 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-c9d1047b-261e-47b4-814a-829b73312414 req-8a8b5763-06be-439d-b127-11b89fc80a72 service nova] Acquiring lock "3891b9d3-832d-4ef7-8ebb-970ddd0a387a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:04:05 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-c9d1047b-261e-47b4-814a-829b73312414 req-8a8b5763-06be-439d-b127-11b89fc80a72 service nova] Lock "3891b9d3-832d-4ef7-8ebb-970ddd0a387a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:04:05 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-c9d1047b-261e-47b4-814a-829b73312414 req-8a8b5763-06be-439d-b127-11b89fc80a72 service nova] Lock "3891b9d3-832d-4ef7-8ebb-970ddd0a387a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:04:05 user nova-compute[72129]: DEBUG nova.compute.manager [req-c9d1047b-261e-47b4-814a-829b73312414 req-8a8b5763-06be-439d-b127-11b89fc80a72 service nova] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] No waiting events found dispatching network-vif-plugged-acb5d1d2-f038-4111-90e1-00bf99a2a7bb {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:04:05 user nova-compute[72129]: WARNING nova.compute.manager [req-c9d1047b-261e-47b4-814a-829b73312414 req-8a8b5763-06be-439d-b127-11b89fc80a72 service nova] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Received unexpected event network-vif-plugged-acb5d1d2-f038-4111-90e1-00bf99a2a7bb for instance with vm_state shelved_offloaded and task_state spawning.
Aug 01 14:04:05 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:04:05 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9c429273-97a8-499d-8d0f-16a5a61093aa tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:04:05 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:04:05 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:04:05 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:04:05 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Hypervisor/Node resource view: name=user free_ram=7515MB free_disk=25.03595733642578GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72129) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 14:04:05 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:04:05 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:04:05 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Instance spawned successfully.
Aug 01 14:04:05 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 01 14:04:05 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898642.7768836, ea050cd6-60e9-41fd-a35c-05fe63d60e57 => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:04:05 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] VM Started (Lifecycle Event)
Aug 01 14:04:05 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:04:05 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:04:05 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 01 14:04:05 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898644.856418, 3891b9d3-832d-4ef7-8ebb-970ddd0a387a => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:04:05 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] VM Resumed (Lifecycle Event)
Aug 01 14:04:05 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:04:05 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:04:05 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Applying migration context for instance e4a13a50-fe03-41aa-94f4-3431805ff481 as it has an incoming, in-progress migration bd6701cb-6cc9-4417-a952-70fff9896df6. Migration status is post-migrating {{(pid=72129) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 01 14:04:05 user nova-compute[72129]: INFO nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Updating resource usage from migration bd6701cb-6cc9-4417-a952-70fff9896df6
Aug 01 14:04:05 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 14:04:05 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898644.8576138, 3891b9d3-832d-4ef7-8ebb-970ddd0a387a => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:04:05 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] VM Started (Lifecycle Event)
Aug 01 14:04:05 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:04:05 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:04:05 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 97a5dccf-b499-443a-b332-cfa293a16047 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:04:05 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:04:05 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance d031973f-8f48-43b3-a338-040950103e4c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:04:05 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 53b76ca4-30f0-4fd4-9928-714c7073a490 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:04:05 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance ea050cd6-60e9-41fd-a35c-05fe63d60e57 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:04:05 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance e2cf5877-55dd-44ce-9b58-b662afe8e62e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:04:05 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 954db8d6-4806-43e6-8310-5d7f3437dc71 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:04:05 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 85062e35-e302-46f7-8d66-24cf9e7199f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:04:05 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 0c43fda3-e098-4c3a-bcd5-14eac019db06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:04:05 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:04:05 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (c2f345c3-9b82-4164-b21d-1eef8e661842): {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Aug 01 14:04:05 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Migration bd6701cb-6cc9-4417-a952-70fff9896df6 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 01 14:04:05 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance e4a13a50-fe03-41aa-94f4-3431805ff481 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:04:05 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 14:04:05 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 14:04:05 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:04:05 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 14:04:05 user nova-compute[72129]: DEBUG nova.compute.manager [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:04:05 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-6cf45fd9-4eea-4244-9a35-c79c36ed44bf tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lock "3891b9d3-832d-4ef7-8ebb-970ddd0a387a" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 24.505s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:04:05 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:04:05 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:04:05 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Compute_service record updated for user:user {{(pid=72129) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 14:04:05 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.742s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:04:05 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:04:06 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Starting finish_migration {{(pid=72129) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Instance directory exists: not creating {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 01 14:04:09 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Creating image(s)
Aug 01 14:04:09 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Did not create local disks {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Ensure instance console log exists: /opt/stack/data/nova/instances/e4a13a50-fe03-41aa-94f4-3431805ff481/console.log {{(pid=72129) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Start _get_guest_xml network_info=[{"id": "a36283e1-929d-4806-ba5f-175f99f44e98", "address": "fa:16:3e:28:9b:e7", "network": {"id": "4b93ad92-9a3a-4472-ba6c-d215329da98b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-734108983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-734108983-network", "vif_mac": "fa:16:3e:28:9b:e7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0e85d9b73a546dc95e0ace26233f2a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36283e1-92", "ovs_interfaceid": "a36283e1-929d-4806-ba5f-175f99f44e98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': 'e4ddbaf8-0bc8-42d0-936a-4ebe8d71c2bb', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jnqFwdQU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'e4a13a50-fe03-41aa-94f4-3431805ff481', 'attached_at': '2023-08-01T14:04:09.000000', 'detached_at': '', 'volume_id': '58507a4b-e017-48d8-aeb1-8036a2a2a0a8', 'serial': '58507a4b-e017-48d8-aeb1-8036a2a2a0a8'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 14:04:09 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:04:09 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:04:09 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] CPU controller missing on host. {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] CPU controller found on host. {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72129) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T13:45:50Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Flavor limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Image limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Flavor pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Image pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Got 1 possible topologies {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG nova.objects.instance [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lazy-loading 'vcpu_model' on Instance uuid e4a13a50-fe03-41aa-94f4-3431805ff481 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Calling os-brick to attach iSCSI Volume {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jnqFwdQU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:04:09 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:04:09 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:04:09 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:04:09 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:04:09 user nova-compute[72129]: INFO os_brick.initiator.connectors.iscsi [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 14:04:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 -p 172.16.0.220:3260 {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b1f9fe-cf21-4c95-ac77-42dd1becd096]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 14:04:09 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 -p 172.16.0.220:3260 --interface default --op new {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa026af9-6703-4ce2-86da-2c2011ac4b96]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8] added\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8] added
Aug 01 14:04:09 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ea9862-d777-4be5-b9f2-bc50387f66c2]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f074c6-c107-4c6d-a5a7-ef6b3e9e266b]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jnqFwdQU {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jnqFwdQU" returned: 0 in 0.024s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b10ff8-e8ea-42cf-8e28-b2abaa95d658]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jnqFwdQU'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dfae9aa-07ca-46d9-b90d-aff25c499177]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[27fe0b39-75a0-4461-9fc3-4205300112c7]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a7dc25-351e-4c85-967a-ce6e0c8dc840 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:04:09 user nova-compute[72129]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)
Aug 01 14:04:09 user nova-compute[72129]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f (non-flash)
Aug 01 14:04:09 user nova-compute[72129]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 (non-flash)
Aug 01 14:04:09 user nova-compute[72129]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 (non-flash)
Aug 01 14:04:09 user nova-compute[72129]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a7dc25-351e-4c85-967a-ce6e0c8dc840 (non-flash)
Aug 01 14:04:09 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:04:09 user nova-compute[72129]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)
Aug 01 14:04:09 user nova-compute[72129]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f (non-flash)
Aug 01 14:04:09 user nova-compute[72129]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 (non-flash)
Aug 01 14:04:09 user nova-compute[72129]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 (non-flash)
Aug 01 14:04:09 user nova-compute[72129]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a7dc25-351e-4c85-967a-ce6e0c8dc840 (non-flash)
Aug 01 14:04:09 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 -p 172.16.0.220:3260 --login {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3a9dd2-d601-4b42-88e9-46848a374324]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8, portal: 172.16.0.220,3260]
Aug 01 14:04:09 user nova-compute[72129]: Login to [iface: default, target: iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8, portal: 172.16.0.220,3260] successful.
Aug 01 14:04:09 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[763f0328-2067-4a49-968f-da5e23501c5c]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf3dc04-f356-434a-a906-55b8503790f4]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a7dc25-351e-4c85-967a-ce6e0c8dc840 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:04:09 user nova-compute[72129]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)
Aug 01 14:04:09 user nova-compute[72129]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f (non-flash)
Aug 01 14:04:09 user nova-compute[72129]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 (non-flash)
Aug 01 14:04:09 user nova-compute[72129]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 (non-flash)
Aug 01 14:04:09 user nova-compute[72129]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a7dc25-351e-4c85-967a-ce6e0c8dc840 (non-flash)
Aug 01 14:04:09 user nova-compute[72129]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)
Aug 01 14:04:09 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:04:09 user nova-compute[72129]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)
Aug 01 14:04:09 user nova-compute[72129]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f (non-flash)
Aug 01 14:04:09 user nova-compute[72129]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 (non-flash)
Aug 01 14:04:09 user nova-compute[72129]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 (non-flash)
Aug 01 14:04:09 user nova-compute[72129]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a7dc25-351e-4c85-967a-ce6e0c8dc840 (non-flash)
Aug 01 14:04:09 user nova-compute[72129]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)
Aug 01 14:04:09 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Connected to 172.16.0.220:3260 {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] HCTL ('37', '-', '-', 0) found on session 40 with lun 0 {{(pid=72129) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72129) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26fba32-012e-434c-8c5a-5579cf6cdc91]: (4, ('- - 0', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:04:09 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Searching for a device in session 40 and hctl ['37', '*', '*', 0] yield: None {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 14:04:10 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:04:10 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Searching for a device in session 40 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 14:04:10 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jnqFwdQU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 14:04:10 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:04:10 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] <== connect_volume: return (1370ms) {'type': 'block', 'scsi_wwn': '23638393534323266', 'path': '/dev/sdf'} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:04:10 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23638393534323266', 'path': '/dev/sdf'} {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 14:04:10 user nova-compute[72129]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690898635.7942128, e4a13a50-fe03-41aa-94f4-3431805ff481 => Stopped> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:04:10 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] VM Stopped (Lifecycle Event)
Aug 01 14:04:10 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:01:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-320688111',display_name='tempest-ServerActionsTestOtherA-server-320688111',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-320688111',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMKxgVYWQdVKRLV+QIEDxsF4RC9I5wENeCwXhryJ2sr+8oNRgK2W8XmwhDYsUxLBCXzQXdaopDtUa2pfT9PfB2oRmI83WPjT6V3uSmwDrvE9fHgGK0Xxc5yPsVieUvlqoA==',key_name='tempest-keypair-1687158208',keypairs=<?>,launch_index=0,launched_at=2023-08-01T14:02:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b0e85d9b73a546dc95e0ace26233f2a7',ramdisk_id='',reservation_id='r-t03cme4n',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1440097443',owner_user_name='tempest-ServerActionsTestOtherA-1440097443-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T14:03:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f35620862694e7295f782ab15e290a8',uuid=e4a13a50-fe03-41aa-94f4-3431805ff481,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a36283e1-929d-4806-ba5f-175f99f44e98", "address": "fa:16:3e:28:9b:e7", "network": {"id": "4b93ad92-9a3a-4472-ba6c-d215329da98b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-734108983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-734108983-network", "vif_mac": "fa:16:3e:28:9b:e7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0e85d9b73a546dc95e0ace26233f2a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36283e1-92", "ovs_interfaceid": "a36283e1-929d-4806-ba5f-175f99f44e98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 14:04:10 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Converting VIF {"id": "a36283e1-929d-4806-ba5f-175f99f44e98", "address": "fa:16:3e:28:9b:e7", "network": {"id": "4b93ad92-9a3a-4472-ba6c-d215329da98b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-734108983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-734108983-network", "vif_mac": "fa:16:3e:28:9b:e7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0e85d9b73a546dc95e0ace26233f2a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36283e1-92", "ovs_interfaceid": "a36283e1-929d-4806-ba5f-175f99f44e98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:04:10 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:9b:e7,bridge_name='br-int',has_traffic_filtering=True,id=a36283e1-929d-4806-ba5f-175f99f44e98,network=Network(4b93ad92-9a3a-4472-ba6c-d215329da98b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa36283e1-92') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:04:10 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] End _get_guest_xml xml=<domain type="kvm">
Aug 01 14:04:10 user nova-compute[72129]:   <uuid>e4a13a50-fe03-41aa-94f4-3431805ff481</uuid>
Aug 01 14:04:10 user nova-compute[72129]:   <name>instance-0000001c</name>
Aug 01 14:04:10 user nova-compute[72129]:   <memory>2097152</memory>
Aug 01 14:04:10 user nova-compute[72129]:   <vcpu>1</vcpu>
Aug 01 14:04:10 user nova-compute[72129]:   <metadata>
Aug 01 14:04:10 user nova-compute[72129]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 14:04:10 user nova-compute[72129]:       <nova:package version="0.0.0"/>
Aug 01 14:04:10 user nova-compute[72129]:       <nova:name>tempest-ServerActionsTestOtherA-server-320688111</nova:name>
Aug 01 14:04:10 user nova-compute[72129]:       <nova:creationTime>2023-08-01 14:04:09</nova:creationTime>
Aug 01 14:04:10 user nova-compute[72129]:       <nova:flavor name="m1.small">
Aug 01 14:04:10 user nova-compute[72129]:         <nova:memory>2048</nova:memory>
Aug 01 14:04:10 user nova-compute[72129]:         <nova:disk>20</nova:disk>
Aug 01 14:04:10 user nova-compute[72129]:         <nova:swap>0</nova:swap>
Aug 01 14:04:10 user nova-compute[72129]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 14:04:10 user nova-compute[72129]:         <nova:vcpus>1</nova:vcpus>
Aug 01 14:04:10 user nova-compute[72129]:       </nova:flavor>
Aug 01 14:04:10 user nova-compute[72129]:       <nova:owner>
Aug 01 14:04:10 user nova-compute[72129]:         <nova:user uuid="1f35620862694e7295f782ab15e290a8">tempest-ServerActionsTestOtherA-1440097443-project-member</nova:user>
Aug 01 14:04:10 user nova-compute[72129]:         <nova:project uuid="b0e85d9b73a546dc95e0ace26233f2a7">tempest-ServerActionsTestOtherA-1440097443</nova:project>
Aug 01 14:04:10 user nova-compute[72129]:       </nova:owner>
Aug 01 14:04:10 user nova-compute[72129]:       <nova:ports>
Aug 01 14:04:10 user nova-compute[72129]:         <nova:port uuid="a36283e1-929d-4806-ba5f-175f99f44e98">
Aug 01 14:04:10 user nova-compute[72129]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 01 14:04:10 user nova-compute[72129]:         </nova:port>
Aug 01 14:04:10 user nova-compute[72129]:       </nova:ports>
Aug 01 14:04:10 user nova-compute[72129]:     </nova:instance>
Aug 01 14:04:10 user nova-compute[72129]:   </metadata>
Aug 01 14:04:10 user nova-compute[72129]:   <sysinfo type="smbios">
Aug 01 14:04:10 user nova-compute[72129]:     <system>
Aug 01 14:04:10 user nova-compute[72129]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 14:04:10 user nova-compute[72129]:       <entry name="product">OpenStack Nova</entry>
Aug 01 14:04:10 user nova-compute[72129]:       <entry name="version">0.0.0</entry>
Aug 01 14:04:10 user nova-compute[72129]:       <entry name="serial">e4a13a50-fe03-41aa-94f4-3431805ff481</entry>
Aug 01 14:04:10 user nova-compute[72129]:       <entry name="uuid">e4a13a50-fe03-41aa-94f4-3431805ff481</entry>
Aug 01 14:04:10 user nova-compute[72129]:       <entry name="family">Virtual Machine</entry>
Aug 01 14:04:10 user nova-compute[72129]:     </system>
Aug 01 14:04:10 user nova-compute[72129]:   </sysinfo>
Aug 01 14:04:10 user nova-compute[72129]:   <os>
Aug 01 14:04:10 user nova-compute[72129]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 14:04:10 user nova-compute[72129]:     <boot dev="hd"/>
Aug 01 14:04:10 user nova-compute[72129]:     <smbios mode="sysinfo"/>
Aug 01 14:04:10 user nova-compute[72129]:   </os>
Aug 01 14:04:10 user nova-compute[72129]:   <features>
Aug 01 14:04:10 user nova-compute[72129]:     <acpi/>
Aug 01 14:04:10 user nova-compute[72129]:     <apic/>
Aug 01 14:04:10 user nova-compute[72129]:     <vmcoreinfo/>
Aug 01 14:04:10 user nova-compute[72129]:   </features>
Aug 01 14:04:10 user nova-compute[72129]:   <clock offset="utc">
Aug 01 14:04:10 user nova-compute[72129]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 14:04:10 user nova-compute[72129]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 14:04:10 user nova-compute[72129]:     <timer name="hpet" present="no"/>
Aug 01 14:04:10 user nova-compute[72129]:   </clock>
Aug 01 14:04:10 user nova-compute[72129]:   <cpu mode="custom" match="exact">
Aug 01 14:04:10 user nova-compute[72129]:     <model>Nehalem</model>
Aug 01 14:04:10 user nova-compute[72129]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 14:04:10 user nova-compute[72129]:   </cpu>
Aug 01 14:04:10 user nova-compute[72129]:   <devices>
Aug 01 14:04:10 user nova-compute[72129]:     <disk type="block" device="disk">
Aug 01 14:04:10 user nova-compute[72129]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:04:10 user nova-compute[72129]:       <source dev="/dev/sdf"/>
Aug 01 14:04:10 user nova-compute[72129]:       <target dev="vda" bus="virtio"/>
Aug 01 14:04:10 user nova-compute[72129]:       <serial>58507a4b-e017-48d8-aeb1-8036a2a2a0a8</serial>
Aug 01 14:04:10 user nova-compute[72129]:     </disk>
Aug 01 14:04:10 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 14:04:10 user nova-compute[72129]:       <mac address="fa:16:3e:28:9b:e7"/>
Aug 01 14:04:10 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:04:10 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 14:04:10 user nova-compute[72129]:       <target dev="tapa36283e1-92"/>
Aug 01 14:04:10 user nova-compute[72129]:     </interface>
Aug 01 14:04:10 user nova-compute[72129]:     <serial type="pty">
Aug 01 14:04:10 user nova-compute[72129]:       <log file="/opt/stack/data/nova/instances/e4a13a50-fe03-41aa-94f4-3431805ff481/console.log" append="off"/>
Aug 01 14:04:10 user nova-compute[72129]:     </serial>
Aug 01 14:04:10 user nova-compute[72129]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 14:04:10 user nova-compute[72129]:     <video>
Aug 01 14:04:10 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:04:10 user nova-compute[72129]:     </video>
Aug 01 14:04:10 user nova-compute[72129]:     <rng model="virtio">
Aug 01 14:04:10 user nova-compute[72129]:       <backend model="random">/dev/urandom</backend>
Aug 01 14:04:10 user nova-compute[72129]:     </rng>
Aug 01 14:04:10 user nova-compute[72129]:     <controller type="usb" index="0" model="none"/>
Aug 01 14:04:10 user nova-compute[72129]:     <memballoon model="virtio">
Aug 01 14:04:10 user nova-compute[72129]:       <stats period="10"/>
Aug 01 14:04:10 user nova-compute[72129]:     </memballoon>
Aug 01 14:04:10 user nova-compute[72129]:   </devices>
Aug 01 14:04:10 user nova-compute[72129]: </domain>
Aug 01 14:04:10 user nova-compute[72129]:  {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 14:04:10 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:01:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-320688111',display_name='tempest-ServerActionsTestOtherA-server-320688111',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-320688111',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMKxgVYWQdVKRLV+QIEDxsF4RC9I5wENeCwXhryJ2sr+8oNRgK2W8XmwhDYsUxLBCXzQXdaopDtUa2pfT9PfB2oRmI83WPjT6V3uSmwDrvE9fHgGK0Xxc5yPsVieUvlqoA==',key_name='tempest-keypair-1687158208',keypairs=<?>,launch_index=0,launched_at=2023-08-01T14:02:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b0e85d9b73a546dc95e0ace26233f2a7',ramdisk_id='',reservation_id='r-t03cme4n',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1440097443',owner_user_name='tempest-ServerActionsTestOtherA-1440097443-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T14:03:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f35620862694e7295f782ab15e290a8',uuid=e4a13a50-fe03-41aa-94f4-3431805ff481,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a36283e1-929d-4806-ba5f-175f99f44e98", "address": "fa:16:3e:28:9b:e7", "network": {"id": "4b93ad92-9a3a-4472-ba6c-d215329da98b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-734108983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-734108983-network", "vif_mac": "fa:16:3e:28:9b:e7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0e85d9b73a546dc95e0ace26233f2a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36283e1-92", "ovs_interfaceid": "a36283e1-929d-4806-ba5f-175f99f44e98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 14:04:10 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Converting VIF {"id": "a36283e1-929d-4806-ba5f-175f99f44e98", "address": "fa:16:3e:28:9b:e7", "network": {"id": "4b93ad92-9a3a-4472-ba6c-d215329da98b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-734108983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-734108983-network", "vif_mac": "fa:16:3e:28:9b:e7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0e85d9b73a546dc95e0ace26233f2a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36283e1-92", "ovs_interfaceid": "a36283e1-929d-4806-ba5f-175f99f44e98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:04:10 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:9b:e7,bridge_name='br-int',has_traffic_filtering=True,id=a36283e1-929d-4806-ba5f-175f99f44e98,network=Network(4b93ad92-9a3a-4472-ba6c-d215329da98b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa36283e1-92') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:04:10 user nova-compute[72129]: DEBUG os_vif [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:9b:e7,bridge_name='br-int',has_traffic_filtering=True,id=a36283e1-929d-4806-ba5f-175f99f44e98,network=Network(4b93ad92-9a3a-4472-ba6c-d215329da98b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa36283e1-92') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 14:04:10 user nova-compute[72129]: DEBUG nova.compute.manager [None req-83e50c5e-96d0-4f7a-b949-6c02ec8a5e88 None None] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:04:10 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:04:10 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:04:10 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 14:04:10 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:04:10 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa36283e1-92, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:04:10 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa36283e1-92, col_values=(('external_ids', {'iface-id': 'a36283e1-929d-4806-ba5f-175f99f44e98', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:9b:e7', 'vm-uuid': 'e4a13a50-fe03-41aa-94f4-3431805ff481'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:04:10 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:04:10 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:04:10 user nova-compute[72129]: DEBUG nova.compute.manager [None req-83e50c5e-96d0-4f7a-b949-6c02ec8a5e88 None None] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:04:10 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:04:10 user nova-compute[72129]: INFO os_vif [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:9b:e7,bridge_name='br-int',has_traffic_filtering=True,id=a36283e1-929d-4806-ba5f-175f99f44e98,network=Network(4b93ad92-9a3a-4472-ba6c-d215329da98b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa36283e1-92')
Aug 01 14:04:10 user nova-compute[72129]: INFO nova.compute.manager [None req-83e50c5e-96d0-4f7a-b949-6c02ec8a5e88 None None] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 01 14:04:10 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:04:10 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] No VIF found with MAC fa:16:3e:28:9b:e7, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 14:04:12 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:04:12 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:04:12 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:04:12 user nova-compute[72129]: DEBUG nova.compute.manager [req-4ea166dc-05e1-4da5-a419-4262be29e44a req-71cf69f8-74cf-4a93-bfdd-89a9374fc57c service nova] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Received event network-vif-plugged-a36283e1-929d-4806-ba5f-175f99f44e98 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:04:12 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-4ea166dc-05e1-4da5-a419-4262be29e44a req-71cf69f8-74cf-4a93-bfdd-89a9374fc57c service nova] Acquiring lock "e4a13a50-fe03-41aa-94f4-3431805ff481-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:04:12 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-4ea166dc-05e1-4da5-a419-4262be29e44a req-71cf69f8-74cf-4a93-bfdd-89a9374fc57c service nova] Lock "e4a13a50-fe03-41aa-94f4-3431805ff481-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:04:12 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-4ea166dc-05e1-4da5-a419-4262be29e44a req-71cf69f8-74cf-4a93-bfdd-89a9374fc57c service nova] Lock "e4a13a50-fe03-41aa-94f4-3431805ff481-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:04:12 user nova-compute[72129]: DEBUG nova.compute.manager [req-4ea166dc-05e1-4da5-a419-4262be29e44a req-71cf69f8-74cf-4a93-bfdd-89a9374fc57c service nova] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] No waiting events found dispatching network-vif-plugged-a36283e1-929d-4806-ba5f-175f99f44e98 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:04:12 user nova-compute[72129]: WARNING nova.compute.manager [req-4ea166dc-05e1-4da5-a419-4262be29e44a req-71cf69f8-74cf-4a93-bfdd-89a9374fc57c service nova] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Received unexpected event network-vif-plugged-a36283e1-929d-4806-ba5f-175f99f44e98 for instance with vm_state active and task_state resize_finish.
Aug 01 14:04:12 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:04:12 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:04:14 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898654.5561318, e4a13a50-fe03-41aa-94f4-3431805ff481 => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:04:14 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] VM Resumed (Lifecycle Event)
Aug 01 14:04:14 user nova-compute[72129]: DEBUG nova.compute.manager [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Instance event wait completed in 0 seconds for  {{(pid=72129) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 14:04:14 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Instance running successfully.
Aug 01 14:04:14 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Failed to set time: agent not configured {{(pid=72129) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 01 14:04:14 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-2572f926-d4a0-41c1-b6c2-183fb22f8c89 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] finish_migration finished successfully. {{(pid=72129) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 01 14:04:14 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:04:14 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:04:14 user nova-compute[72129]: DEBUG nova.compute.manager [req-582c92d0-7192-4ee5-9b4f-a6901d947367 req-e1fff3af-4924-4b09-8abc-06f4d3eae9eb service nova] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Received event network-vif-plugged-a36283e1-929d-4806-ba5f-175f99f44e98 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:04:14 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-582c92d0-7192-4ee5-9b4f-a6901d947367 req-e1fff3af-4924-4b09-8abc-06f4d3eae9eb service nova] Acquiring lock "e4a13a50-fe03-41aa-94f4-3431805ff481-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:04:14 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-582c92d0-7192-4ee5-9b4f-a6901d947367 req-e1fff3af-4924-4b09-8abc-06f4d3eae9eb service nova] Lock "e4a13a50-fe03-41aa-94f4-3431805ff481-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:04:14 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-582c92d0-7192-4ee5-9b4f-a6901d947367 req-e1fff3af-4924-4b09-8abc-06f4d3eae9eb service nova] Lock "e4a13a50-fe03-41aa-94f4-3431805ff481-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:04:14 user nova-compute[72129]: DEBUG nova.compute.manager [req-582c92d0-7192-4ee5-9b4f-a6901d947367 req-e1fff3af-4924-4b09-8abc-06f4d3eae9eb service nova] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] No waiting events found dispatching network-vif-plugged-a36283e1-929d-4806-ba5f-175f99f44e98 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:04:14 user nova-compute[72129]: WARNING nova.compute.manager [req-582c92d0-7192-4ee5-9b4f-a6901d947367 req-e1fff3af-4924-4b09-8abc-06f4d3eae9eb service nova] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Received unexpected event network-vif-plugged-a36283e1-929d-4806-ba5f-175f99f44e98 for instance with vm_state active and task_state resize_finish.
Aug 01 14:04:14 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 01 14:04:14 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898654.5641663, e4a13a50-fe03-41aa-94f4-3431805ff481 => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:04:14 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] VM Started (Lifecycle Event)
Aug 01 14:04:14 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:04:14 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:04:14 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 01 14:04:15 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:04:15 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:04:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:04:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:04:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:04:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:04:25 user nova-compute[72129]: DEBUG nova.compute.manager [None req-b80b115b-00b3-4775-8b49-8adf17acb13e tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:04:25 user nova-compute[72129]: INFO nova.compute.manager [None req-b80b115b-00b3-4775-8b49-8adf17acb13e tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] instance snapshotting
Aug 01 14:04:25 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-b80b115b-00b3-4775-8b49-8adf17acb13e tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Beginning live snapshot process
Aug 01 14:04:25 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-b80b115b-00b3-4775-8b49-8adf17acb13e tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c43fda3-e098-4c3a-bcd5-14eac019db06/disk --force-share --output=json -f qcow2 {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:04:25 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-b80b115b-00b3-4775-8b49-8adf17acb13e tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c43fda3-e098-4c3a-bcd5-14eac019db06/disk --force-share --output=json -f qcow2" returned: 0 in 0.202s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:04:25 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-b80b115b-00b3-4775-8b49-8adf17acb13e tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c43fda3-e098-4c3a-bcd5-14eac019db06/disk --force-share --output=json -f qcow2 {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:04:25 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:04:25 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:04:25 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-b80b115b-00b3-4775-8b49-8adf17acb13e tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c43fda3-e098-4c3a-bcd5-14eac019db06/disk --force-share --output=json -f qcow2" returned: 0 in 0.132s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:04:25 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-b80b115b-00b3-4775-8b49-8adf17acb13e tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:04:26 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-b80b115b-00b3-4775-8b49-8adf17acb13e tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.143s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:04:26 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-b80b115b-00b3-4775-8b49-8adf17acb13e tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp9ksipaog/a322add070cd4b47bd55f2ff33e7da32.delta 1073741824 {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:04:26 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-b80b115b-00b3-4775-8b49-8adf17acb13e tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp9ksipaog/a322add070cd4b47bd55f2ff33e7da32.delta 1073741824" returned: 0 in 0.050s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:04:26 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-b80b115b-00b3-4775-8b49-8adf17acb13e tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 01 14:04:26 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-b80b115b-00b3-4775-8b49-8adf17acb13e tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72129) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 14:04:27 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-b80b115b-00b3-4775-8b49-8adf17acb13e tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] COPY block job progress, current cursor: 25034752 final cursor: 75497472 {{(pid=72129) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 14:04:27 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-b80b115b-00b3-4775-8b49-8adf17acb13e tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72129) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 14:04:27 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-b80b115b-00b3-4775-8b49-8adf17acb13e tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 01 14:04:27 user nova-compute[72129]: DEBUG nova.privsep.utils [None req-b80b115b-00b3-4775-8b49-8adf17acb13e tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72129) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 14:04:27 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-b80b115b-00b3-4775-8b49-8adf17acb13e tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp9ksipaog/a322add070cd4b47bd55f2ff33e7da32.delta /opt/stack/data/nova/instances/snapshots/tmp9ksipaog/a322add070cd4b47bd55f2ff33e7da32 {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:04:28 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-b80b115b-00b3-4775-8b49-8adf17acb13e tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp9ksipaog/a322add070cd4b47bd55f2ff33e7da32.delta /opt/stack/data/nova/instances/snapshots/tmp9ksipaog/a322add070cd4b47bd55f2ff33e7da32" returned: 0 in 0.460s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:04:28 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-b80b115b-00b3-4775-8b49-8adf17acb13e tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Snapshot extracted, beginning image upload
Aug 01 14:04:28 user nova-compute[72129]: DEBUG nova.compute.manager [req-0ac14204-0c8c-46ff-bfe7-48989887d131 req-6821b729-f932-4c5d-8e85-1654f5ea9037 service nova] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] Received event network-changed-7cc8c5a0-6cf1-4030-8a8b-df9a2985c8f6 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:04:28 user nova-compute[72129]: DEBUG nova.compute.manager [req-0ac14204-0c8c-46ff-bfe7-48989887d131 req-6821b729-f932-4c5d-8e85-1654f5ea9037 service nova] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] Refreshing instance network info cache due to event network-changed-7cc8c5a0-6cf1-4030-8a8b-df9a2985c8f6. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 14:04:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-0ac14204-0c8c-46ff-bfe7-48989887d131 req-6821b729-f932-4c5d-8e85-1654f5ea9037 service nova] Acquiring lock "refresh_cache-6dec0529-4dfb-4bc4-b8a1-b7e5f484535a" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:04:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-0ac14204-0c8c-46ff-bfe7-48989887d131 req-6821b729-f932-4c5d-8e85-1654f5ea9037 service nova] Acquired lock "refresh_cache-6dec0529-4dfb-4bc4-b8a1-b7e5f484535a" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:04:28 user nova-compute[72129]: DEBUG nova.network.neutron [req-0ac14204-0c8c-46ff-bfe7-48989887d131 req-6821b729-f932-4c5d-8e85-1654f5ea9037 service nova] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] Refreshing network info cache for port 7cc8c5a0-6cf1-4030-8a8b-df9a2985c8f6 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 14:04:29 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b1f343a1-4427-4025-9d7a-0194cab52db4 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Acquiring lock "6dec0529-4dfb-4bc4-b8a1-b7e5f484535a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:04:29 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b1f343a1-4427-4025-9d7a-0194cab52db4 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "6dec0529-4dfb-4bc4-b8a1-b7e5f484535a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:04:29 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b1f343a1-4427-4025-9d7a-0194cab52db4 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Acquiring lock "6dec0529-4dfb-4bc4-b8a1-b7e5f484535a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:04:29 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b1f343a1-4427-4025-9d7a-0194cab52db4 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "6dec0529-4dfb-4bc4-b8a1-b7e5f484535a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:04:29 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b1f343a1-4427-4025-9d7a-0194cab52db4 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "6dec0529-4dfb-4bc4-b8a1-b7e5f484535a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:04:29 user nova-compute[72129]: INFO nova.compute.manager [None req-b1f343a1-4427-4025-9d7a-0194cab52db4 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] Terminating instance
Aug 01 14:04:29 user nova-compute[72129]: DEBUG nova.compute.manager [None req-b1f343a1-4427-4025-9d7a-0194cab52db4 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] Start destroying the instance on the hypervisor. {{(pid=72129) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 14:04:29 user nova-compute[72129]: DEBUG nova.network.neutron [req-0ac14204-0c8c-46ff-bfe7-48989887d131 req-6821b729-f932-4c5d-8e85-1654f5ea9037 service nova] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] Updated VIF entry in instance network info cache for port 7cc8c5a0-6cf1-4030-8a8b-df9a2985c8f6. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 14:04:29 user nova-compute[72129]: DEBUG nova.network.neutron [req-0ac14204-0c8c-46ff-bfe7-48989887d131 req-6821b729-f932-4c5d-8e85-1654f5ea9037 service nova] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] Updating instance_info_cache with network_info: [{"id": "7cc8c5a0-6cf1-4030-8a8b-df9a2985c8f6", "address": "fa:16:3e:42:c5:84", "network": {"id": "a7f4226b-73fe-4265-ba2c-5d7dcdf154fd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1142462884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210837255c8148ec9b482ba3e2551362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc8c5a0-6c", "ovs_interfaceid": "7cc8c5a0-6cf1-4030-8a8b-df9a2985c8f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:04:29 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-0ac14204-0c8c-46ff-bfe7-48989887d131 req-6821b729-f932-4c5d-8e85-1654f5ea9037 service nova] Releasing lock "refresh_cache-6dec0529-4dfb-4bc4-b8a1-b7e5f484535a" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:04:29 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:04:29 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:04:29 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:04:29 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:04:30 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] Instance destroyed successfully.
Aug 01 14:04:30 user nova-compute[72129]: DEBUG nova.objects.instance [None req-b1f343a1-4427-4025-9d7a-0194cab52db4 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lazy-loading 'resources' on Instance uuid 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:04:30 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-b1f343a1-4427-4025-9d7a-0194cab52db4 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:02:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-967467479',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-967467479',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-967467479',id=30,image_ref='6c638e64-5739-4878-8a5b-2dcada441ae8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAH4n2nvVRQTPZrG39EH15KwTJd3Q7Zpidu9AS4REfe0bESUaZSUJj4UEisr+LMb2PwZ0o01AMNMGuurrSVfvD87MfKfblcUKepKuykmmOvIHu21jCyxs/zQnznziRgT3g==',key_name='tempest-keypair-1832327356',keypairs=<?>,launch_index=0,launched_at=2023-08-01T14:02:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='210837255c8148ec9b482ba3e2551362',ramdisk_id='',reservation_id='r-xpz077hp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1876154436',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1876154436-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1876154436',owner_user_name='tempest-TestVolumeBootPattern-1876154436-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T14:02:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c341be2816c43cfa9adb58ee84e942b',uuid=6dec0529-4dfb-4bc4-b8a1-b7e5f484535a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7cc8c5a0-6cf1-4030-8a8b-df9a2985c8f6", "address": "fa:16:3e:42:c5:84", "network": {"id": "a7f4226b-73fe-4265-ba2c-5d7dcdf154fd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1142462884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210837255c8148ec9b482ba3e2551362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc8c5a0-6c", "ovs_interfaceid": "7cc8c5a0-6cf1-4030-8a8b-df9a2985c8f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 14:04:30 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-b1f343a1-4427-4025-9d7a-0194cab52db4 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Converting VIF {"id": "7cc8c5a0-6cf1-4030-8a8b-df9a2985c8f6", "address": "fa:16:3e:42:c5:84", "network": {"id": "a7f4226b-73fe-4265-ba2c-5d7dcdf154fd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1142462884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210837255c8148ec9b482ba3e2551362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc8c5a0-6c", "ovs_interfaceid": "7cc8c5a0-6cf1-4030-8a8b-df9a2985c8f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:04:30 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-b1f343a1-4427-4025-9d7a-0194cab52db4 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:c5:84,bridge_name='br-int',has_traffic_filtering=True,id=7cc8c5a0-6cf1-4030-8a8b-df9a2985c8f6,network=Network(a7f4226b-73fe-4265-ba2c-5d7dcdf154fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cc8c5a0-6c') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:04:30 user nova-compute[72129]: DEBUG os_vif [None req-b1f343a1-4427-4025-9d7a-0194cab52db4 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:c5:84,bridge_name='br-int',has_traffic_filtering=True,id=7cc8c5a0-6cf1-4030-8a8b-df9a2985c8f6,network=Network(a7f4226b-73fe-4265-ba2c-5d7dcdf154fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cc8c5a0-6c') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 14:04:30 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:04:30 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7cc8c5a0-6c, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:04:30 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:04:30 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:04:30 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:04:30 user nova-compute[72129]: INFO os_vif [None req-b1f343a1-4427-4025-9d7a-0194cab52db4 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:c5:84,bridge_name='br-int',has_traffic_filtering=True,id=7cc8c5a0-6cf1-4030-8a8b-df9a2985c8f6,network=Network(a7f4226b-73fe-4265-ba2c-5d7dcdf154fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cc8c5a0-6c')
Aug 01 14:04:30 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1f343a1-4427-4025-9d7a-0194cab52db4 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] calling os-brick to detach iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 14:04:30 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1f343a1-4427-4025-9d7a-0194cab52db4 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, {'target_iqns': ['iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QTCelvmX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:04:30 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-b1f343a1-4427-4025-9d7a-0194cab52db4 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:04:30 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-b1f343a1-4427-4025-9d7a-0194cab52db4 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:04:30 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-b1f343a1-4427-4025-9d7a-0194cab52db4 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:04:30 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1f343a1-4427-4025-9d7a-0194cab52db4 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f', 0)] {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 14:04:30 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:04:30 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:04:30 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6b0655-bea6-4404-b833-5e04db20e800]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80a7dc25-351e-4c85-967a-ce6e0c8dc840\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:04:30 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:04:30 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:04:30 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d792bc1-414c-416c-bb5e-64540af803b8]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a7dc25-351e-4c85-967a-ce6e0c8dc840 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:04:30 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1f343a1-4427-4025-9d7a-0194cab52db4 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:04:30 user nova-compute[72129]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)
Aug 01 14:04:30 user nova-compute[72129]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f (non-flash)
Aug 01 14:04:30 user nova-compute[72129]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 (non-flash)
Aug 01 14:04:30 user nova-compute[72129]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 (non-flash)
Aug 01 14:04:30 user nova-compute[72129]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a7dc25-351e-4c85-967a-ce6e0c8dc840 (non-flash)
Aug 01 14:04:30 user nova-compute[72129]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)
Aug 01 14:04:30 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:04:30 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1f343a1-4427-4025-9d7a-0194cab52db4 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:04:30 user nova-compute[72129]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)
Aug 01 14:04:30 user nova-compute[72129]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f (non-flash)
Aug 01 14:04:30 user nova-compute[72129]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 (non-flash)
Aug 01 14:04:30 user nova-compute[72129]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 (non-flash)
Aug 01 14:04:30 user nova-compute[72129]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a7dc25-351e-4c85-967a-ce6e0c8dc840 (non-flash)
Aug 01 14:04:30 user nova-compute[72129]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)
Aug 01 14:04:30 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:04:30 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1f343a1-4427-4025-9d7a-0194cab52db4 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2810420c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f'): ({'sdg'}, set())}) {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 14:04:30 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-b1f343a1-4427-4025-9d7a-0194cab52db4 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Removing single pathed devices sdg {{(pid=72129) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 14:04:30 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:04:30 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:04:30 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c7edb4-3836-41ac-ab17-041ca4d4095f]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:04:30 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:04:30 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:04:30 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b28527-44ca-4546-bc58-07015232214b]: (4, ('ok\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:04:30 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-b1f343a1-4427-4025-9d7a-0194cab52db4 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Flushing IO for device /dev/sdg {{(pid=72129) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 14:04:30 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:04:30 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:04:30 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[bece53d3-f1aa-4187-a6bb-56e64165abc3]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:04:30 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-b1f343a1-4427-4025-9d7a-0194cab52db4 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72129) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 14:04:30 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:04:30 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.056s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:04:30 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[70fe9263-cbff-4156-97af-f5154c0c08ab]: (4, ('1', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:04:30 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-b1f343a1-4427-4025-9d7a-0194cab52db4 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 14:04:30 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-b1f343a1-4427-4025-9d7a-0194cab52db4 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] SCSI volumes sdg have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 14:04:30 user nova-compute[72129]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO81a71046-39b3911689e81b95', '/dev/disk/by-id/scsi-23339623339313136', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_81a71046') {{(pid=82887) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 01 14:04:30 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4a1220-2df7-43d9-8009-923726c47f34]: (4, None) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:04:30 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1f343a1-4427-4025-9d7a-0194cab52db4 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f')] {{(pid=72129) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 14:04:30 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:04:30 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:04:30 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1fb1b19-86f0-440d-8a56-a4ce5a64d6ad]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:04:30 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1f343a1-4427-4025-9d7a-0194cab52db4 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:04:30 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f -p 172.16.0.220:3260 --logout {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:04:30 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:04:30 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2bc9a3-9df2-4c00-a64e-1ef12c1f96c4]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:04:30 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1f343a1-4427-4025-9d7a-0194cab52db4 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f, portal: 172.16.0.220,3260]
Aug 01 14:04:30 user nova-compute[72129]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f, portal: 172.16.0.220,3260] successful.
Aug 01 14:04:30 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:04:30 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f -p 172.16.0.220:3260 --op delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:04:30 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c10553c0-6eee-471f-9316-f3f5cc71bd3f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:04:30 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f699300-26a5-468a-9dfc-5da14a9fbcf4]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:04:30 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1f343a1-4427-4025-9d7a-0194cab52db4 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:04:30 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-b1f343a1-4427-4025-9d7a-0194cab52db4 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:04:30 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1f343a1-4427-4025-9d7a-0194cab52db4 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] <== disconnect_volume: return (363ms) None {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:04:30 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1f343a1-4427-4025-9d7a-0194cab52db4 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] Disconnected iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 14:04:30 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-b1f343a1-4427-4025-9d7a-0194cab52db4 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] Deleting instance files /opt/stack/data/nova/instances/6dec0529-4dfb-4bc4-b8a1-b7e5f484535a_del
Aug 01 14:04:30 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-b1f343a1-4427-4025-9d7a-0194cab52db4 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] Deletion of /opt/stack/data/nova/instances/6dec0529-4dfb-4bc4-b8a1-b7e5f484535a_del complete
Aug 01 14:04:30 user nova-compute[72129]: INFO nova.compute.manager [None req-b1f343a1-4427-4025-9d7a-0194cab52db4 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] Took 1.41 seconds to destroy the instance on the hypervisor.
Aug 01 14:04:30 user nova-compute[72129]: DEBUG oslo.service.loopingcall [None req-b1f343a1-4427-4025-9d7a-0194cab52db4 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72129) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 14:04:30 user nova-compute[72129]: DEBUG nova.compute.manager [-] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] Deallocating network for instance {{(pid=72129) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 14:04:30 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] deallocate_for_instance() {{(pid=72129) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 14:04:30 user nova-compute[72129]: DEBUG nova.compute.manager [req-dc59909f-e870-4cec-b366-9ba076df35ed req-c09824fe-3171-4730-b97c-ddcaad86c3a8 service nova] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] Received event network-vif-unplugged-7cc8c5a0-6cf1-4030-8a8b-df9a2985c8f6 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:04:30 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-dc59909f-e870-4cec-b366-9ba076df35ed req-c09824fe-3171-4730-b97c-ddcaad86c3a8 service nova] Acquiring lock "6dec0529-4dfb-4bc4-b8a1-b7e5f484535a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:04:30 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-dc59909f-e870-4cec-b366-9ba076df35ed req-c09824fe-3171-4730-b97c-ddcaad86c3a8 service nova] Lock "6dec0529-4dfb-4bc4-b8a1-b7e5f484535a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:04:30 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-dc59909f-e870-4cec-b366-9ba076df35ed req-c09824fe-3171-4730-b97c-ddcaad86c3a8 service nova] Lock "6dec0529-4dfb-4bc4-b8a1-b7e5f484535a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:04:30 user nova-compute[72129]: DEBUG nova.compute.manager [req-dc59909f-e870-4cec-b366-9ba076df35ed req-c09824fe-3171-4730-b97c-ddcaad86c3a8 service nova] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] No waiting events found dispatching network-vif-unplugged-7cc8c5a0-6cf1-4030-8a8b-df9a2985c8f6 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:04:30 user nova-compute[72129]: DEBUG nova.compute.manager [req-dc59909f-e870-4cec-b366-9ba076df35ed req-c09824fe-3171-4730-b97c-ddcaad86c3a8 service nova] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] Received event network-vif-unplugged-7cc8c5a0-6cf1-4030-8a8b-df9a2985c8f6 for instance with task_state deleting. {{(pid=72129) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 14:04:30 user nova-compute[72129]: DEBUG nova.compute.manager [req-dc59909f-e870-4cec-b366-9ba076df35ed req-c09824fe-3171-4730-b97c-ddcaad86c3a8 service nova] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] Received event network-vif-plugged-7cc8c5a0-6cf1-4030-8a8b-df9a2985c8f6 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:04:30 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-dc59909f-e870-4cec-b366-9ba076df35ed req-c09824fe-3171-4730-b97c-ddcaad86c3a8 service nova] Acquiring lock "6dec0529-4dfb-4bc4-b8a1-b7e5f484535a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:04:30 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-dc59909f-e870-4cec-b366-9ba076df35ed req-c09824fe-3171-4730-b97c-ddcaad86c3a8 service nova] Lock "6dec0529-4dfb-4bc4-b8a1-b7e5f484535a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:04:30 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-dc59909f-e870-4cec-b366-9ba076df35ed req-c09824fe-3171-4730-b97c-ddcaad86c3a8 service nova] Lock "6dec0529-4dfb-4bc4-b8a1-b7e5f484535a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:04:30 user nova-compute[72129]: DEBUG nova.compute.manager [req-dc59909f-e870-4cec-b366-9ba076df35ed req-c09824fe-3171-4730-b97c-ddcaad86c3a8 service nova] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] No waiting events found dispatching network-vif-plugged-7cc8c5a0-6cf1-4030-8a8b-df9a2985c8f6 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:04:30 user nova-compute[72129]: WARNING nova.compute.manager [req-dc59909f-e870-4cec-b366-9ba076df35ed req-c09824fe-3171-4730-b97c-ddcaad86c3a8 service nova] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] Received unexpected event network-vif-plugged-7cc8c5a0-6cf1-4030-8a8b-df9a2985c8f6 for instance with vm_state active and task_state deleting.
Aug 01 14:04:30 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:04:31 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-b80b115b-00b3-4775-8b49-8adf17acb13e tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Snapshot image upload complete
Aug 01 14:04:31 user nova-compute[72129]: INFO nova.compute.manager [None req-b80b115b-00b3-4775-8b49-8adf17acb13e tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Took 5.90 seconds to snapshot the instance on the hypervisor.
Aug 01 14:04:31 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:04:31 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] Took 1.23 seconds to deallocate network for instance.
Aug 01 14:04:32 user nova-compute[72129]: DEBUG nova.compute.manager [req-de4cd8bf-6670-4994-87c9-31810d9ab221 req-c8006562-f036-46f7-a9e7-a3e37d556d66 service nova] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] Received event network-vif-deleted-7cc8c5a0-6cf1-4030-8a8b-df9a2985c8f6 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:04:32 user nova-compute[72129]: INFO nova.compute.manager [None req-b1f343a1-4427-4025-9d7a-0194cab52db4 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] Took 0.72 seconds to detach 1 volumes for instance.
Aug 01 14:04:32 user nova-compute[72129]: DEBUG nova.compute.manager [None req-b1f343a1-4427-4025-9d7a-0194cab52db4 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] Deleting volume: c10553c0-6eee-471f-9316-f3f5cc71bd3f {{(pid=72129) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 01 14:04:32 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b1f343a1-4427-4025-9d7a-0194cab52db4 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:04:32 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b1f343a1-4427-4025-9d7a-0194cab52db4 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:04:33 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-b1f343a1-4427-4025-9d7a-0194cab52db4 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:04:33 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-b1f343a1-4427-4025-9d7a-0194cab52db4 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:04:33 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b1f343a1-4427-4025-9d7a-0194cab52db4 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.416s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:04:33 user nova-compute[72129]: INFO nova.scheduler.client.report [None req-b1f343a1-4427-4025-9d7a-0194cab52db4 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Deleted allocations for instance 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a
Aug 01 14:04:33 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b1f343a1-4427-4025-9d7a-0194cab52db4 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "6dec0529-4dfb-4bc4-b8a1-b7e5f484535a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.044s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:04:35 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:04:35 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:04:40 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:04:40 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:04:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-7a811f62-a651-4a33-96fb-61b017672252 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Acquiring lock "e2cf5877-55dd-44ce-9b58-b662afe8e62e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:04:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-7a811f62-a651-4a33-96fb-61b017672252 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lock "e2cf5877-55dd-44ce-9b58-b662afe8e62e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:04:41 user nova-compute[72129]: DEBUG nova.objects.instance [None req-7a811f62-a651-4a33-96fb-61b017672252 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lazy-loading 'flavor' on Instance uuid e2cf5877-55dd-44ce-9b58-b662afe8e62e {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:04:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-7a811f62-a651-4a33-96fb-61b017672252 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lock "e2cf5877-55dd-44ce-9b58-b662afe8e62e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:04:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-7a811f62-a651-4a33-96fb-61b017672252 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Acquiring lock "e2cf5877-55dd-44ce-9b58-b662afe8e62e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:04:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-7a811f62-a651-4a33-96fb-61b017672252 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lock "e2cf5877-55dd-44ce-9b58-b662afe8e62e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:04:42 user nova-compute[72129]: INFO nova.compute.manager [None req-7a811f62-a651-4a33-96fb-61b017672252 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Attaching volume fa058327-fc77-44ae-b480-330deae4faff to /dev/vdb
Aug 01 14:04:42 user nova-compute[72129]: DEBUG os_brick.utils [None req-7a811f62-a651-4a33-96fb-61b017672252 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:04:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:04:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:04:42 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d228d90-fc8c-46a5-b5af-787e8c52156b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f9b449c2cd3d\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:04:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:04:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:04:42 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb12c0f-b9a0-48c3-b184-a6a4d6c26119]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:04:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:04:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:04:42 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ec17ee-9ab4-400c-a66d-3db045e760d7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:04:42 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[58057887-7e37-4984-8262-2c4608da41a9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:04:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-7a811f62-a651-4a33-96fb-61b017672252 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Running cmd (subprocess): nvme version {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:04:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-7a811f62-a651-4a33-96fb-61b017672252 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] 'nvme version' failed. Not Retrying. {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 14:04:42 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7a811f62-a651-4a33-96fb-61b017672252 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] nvme not present on system {{(pid=72129) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 14:04:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:04:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 14:04:42 user nova-compute[72129]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 14:04:42 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e12a466-ac19-401b-b666-970074195ec3]: (4, '') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:04:42 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-7a811f62-a651-4a33-96fb-61b017672252 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72129) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 14:04:42 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-7a811f62-a651-4a33-96fb-61b017672252 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 14:04:42 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-7a811f62-a651-4a33-96fb-61b017672252 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] LIGHTOS: no hostnqn found. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 14:04:42 user nova-compute[72129]: DEBUG os_brick.utils [None req-7a811f62-a651-4a33-96fb-61b017672252 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f9b449c2cd3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:04:42 user nova-compute[72129]: DEBUG nova.virt.block_device [None req-7a811f62-a651-4a33-96fb-61b017672252 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Updating existing volume attachment record: 68b7cb11-8ba3-4152-a0c7-92257be8ba5b {{(pid=72129) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 14:04:45 user nova-compute[72129]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690898670.1993032, 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a => Stopped> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:04:45 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] VM Stopped (Lifecycle Event)
Aug 01 14:04:45 user nova-compute[72129]: DEBUG nova.compute.manager [None req-bd3a3846-6480-49de-a386-77e43e7807b0 None None] [instance: 6dec0529-4dfb-4bc4-b8a1-b7e5f484535a] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:04:45 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:04:45 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:04:48 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:04:48 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:04:48 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:04:49 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:04:49 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Starting heal instance info cache {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 14:04:49 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "refresh_cache-d031973f-8f48-43b3-a338-040950103e4c" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:04:49 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquired lock "refresh_cache-d031973f-8f48-43b3-a338-040950103e4c" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:04:49 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: d031973f-8f48-43b3-a338-040950103e4c] Forcefully refreshing network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 14:04:49 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: d031973f-8f48-43b3-a338-040950103e4c] Updating instance_info_cache with network_info: [{"id": "a978f40a-6406-423f-81f7-1e8077b43fd5", "address": "fa:16:3e:09:fd:e5", "network": {"id": "59b1e538-8bfe-45ce-ab7b-c5838ab25582", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1129024349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0929886fa54d1c8023793806f10d31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa978f40a-64", "ovs_interfaceid": "a978f40a-6406-423f-81f7-1e8077b43fd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:04:49 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Releasing lock "refresh_cache-d031973f-8f48-43b3-a338-040950103e4c" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:04:49 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: d031973f-8f48-43b3-a338-040950103e4c] Updated the network info_cache for instance {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 14:04:49 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:04:50 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:04:50 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72129) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 14:04:50 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:04:50 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a811f62-a651-4a33-96fb-61b017672252 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Calling os-brick to attach iSCSI Volume {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 14:04:50 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a811f62-a651-4a33-96fb-61b017672252 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fa058327-fc77-44ae-b480-330deae4faff'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HRBCgbQK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:04:50 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-7a811f62-a651-4a33-96fb-61b017672252 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:04:50 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-7a811f62-a651-4a33-96fb-61b017672252 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:04:50 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-7a811f62-a651-4a33-96fb-61b017672252 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:04:50 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-7a811f62-a651-4a33-96fb-61b017672252 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:04:50 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-7a811f62-a651-4a33-96fb-61b017672252 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa058327-fc77-44ae-b480-330deae4faff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:04:50 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-7a811f62-a651-4a33-96fb-61b017672252 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa058327-fc77-44ae-b480-330deae4faff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:04:50 user nova-compute[72129]: INFO os_brick.initiator.connectors.iscsi [None req-7a811f62-a651-4a33-96fb-61b017672252 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 14:04:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa058327-fc77-44ae-b480-330deae4faff -p 172.16.0.220:3260 {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:04:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa058327-fc77-44ae-b480-330deae4faff -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:04:50 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc96516a-0fb5-45ea-bd6f-f97797f84216]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:04:50 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a811f62-a651-4a33-96fb-61b017672252 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 14:04:50 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:04:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa058327-fc77-44ae-b480-330deae4faff -p 172.16.0.220:3260 --interface default --op new {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:04:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa058327-fc77-44ae-b480-330deae4faff -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:04:50 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ecf590-b5f5-4363-ab06-b9d188bdf66e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa058327-fc77-44ae-b480-330deae4faff] added\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:04:50 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a811f62-a651-4a33-96fb-61b017672252 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa058327-fc77-44ae-b480-330deae4faff] added
Aug 01 14:04:50 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:04:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa058327-fc77-44ae-b480-330deae4faff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:04:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa058327-fc77-44ae-b480-330deae4faff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:04:50 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38614b5-ffc3-4a1b-9524-a578cc8fce7f]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:04:50 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a811f62-a651-4a33-96fb-61b017672252 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:04:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa058327-fc77-44ae-b480-330deae4faff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:04:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa058327-fc77-44ae-b480-330deae4faff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:04:50 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[8875a3f2-415a-4439-bc03-29b220e360a2]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:04:50 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a811f62-a651-4a33-96fb-61b017672252 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:04:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa058327-fc77-44ae-b480-330deae4faff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HRBCgbQK {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:04:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa058327-fc77-44ae-b480-330deae4faff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HRBCgbQK" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:04:50 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f43d3a-35b2-4346-bb29-4453abeccca0]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:04:50 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a811f62-a651-4a33-96fb-61b017672252 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HRBCgbQK'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:04:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa058327-fc77-44ae-b480-330deae4faff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:04:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa058327-fc77-44ae-b480-330deae4faff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:04:50 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a6a775a-aa28-4bc2-b968-8cabcf9198f2]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:04:50 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a811f62-a651-4a33-96fb-61b017672252 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:04:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:04:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:04:50 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a498b754-b617-41de-a919-ab20f11c0c36]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a7dc25-351e-4c85-967a-ce6e0c8dc840 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:04:50 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a811f62-a651-4a33-96fb-61b017672252 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:04:50 user nova-compute[72129]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)
Aug 01 14:04:50 user nova-compute[72129]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 (non-flash)
Aug 01 14:04:50 user nova-compute[72129]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 (non-flash)
Aug 01 14:04:50 user nova-compute[72129]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a7dc25-351e-4c85-967a-ce6e0c8dc840 (non-flash)
Aug 01 14:04:50 user nova-compute[72129]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)
Aug 01 14:04:50 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:04:50 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a811f62-a651-4a33-96fb-61b017672252 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:04:50 user nova-compute[72129]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)
Aug 01 14:04:50 user nova-compute[72129]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 (non-flash)
Aug 01 14:04:50 user nova-compute[72129]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 (non-flash)
Aug 01 14:04:50 user nova-compute[72129]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a7dc25-351e-4c85-967a-ce6e0c8dc840 (non-flash)
Aug 01 14:04:50 user nova-compute[72129]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)
Aug 01 14:04:50 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:04:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa058327-fc77-44ae-b480-330deae4faff -p 172.16.0.220:3260 --login {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:04:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa058327-fc77-44ae-b480-330deae4faff -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:04:50 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[52060219-1ed6-400a-876b-fc9fbf66e37d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa058327-fc77-44ae-b480-330deae4faff, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fa058327-fc77-44ae-b480-330deae4faff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:04:50 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a811f62-a651-4a33-96fb-61b017672252 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa058327-fc77-44ae-b480-330deae4faff, portal: 172.16.0.220,3260]
Aug 01 14:04:50 user nova-compute[72129]: Login to [iface: default, target: iqn.2010-10.org.openstack:fa058327-fc77-44ae-b480-330deae4faff, portal: 172.16.0.220,3260] successful.
Aug 01 14:04:50 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:04:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa058327-fc77-44ae-b480-330deae4faff -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:04:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa058327-fc77-44ae-b480-330deae4faff -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:04:50 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a561eb7-af85-417a-891c-f03edc270519]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:04:50 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a811f62-a651-4a33-96fb-61b017672252 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:04:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:04:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:04:50 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4853121-ec97-4a41-885b-53a9448d85c8]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a7dc25-351e-4c85-967a-ce6e0c8dc840 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa058327-fc77-44ae-b480-330deae4faff (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:04:50 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a811f62-a651-4a33-96fb-61b017672252 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:04:50 user nova-compute[72129]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)
Aug 01 14:04:50 user nova-compute[72129]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 (non-flash)
Aug 01 14:04:50 user nova-compute[72129]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 (non-flash)
Aug 01 14:04:50 user nova-compute[72129]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a7dc25-351e-4c85-967a-ce6e0c8dc840 (non-flash)
Aug 01 14:04:50 user nova-compute[72129]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)
Aug 01 14:04:50 user nova-compute[72129]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa058327-fc77-44ae-b480-330deae4faff (non-flash)
Aug 01 14:04:50 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:04:50 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a811f62-a651-4a33-96fb-61b017672252 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:04:50 user nova-compute[72129]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)
Aug 01 14:04:50 user nova-compute[72129]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 (non-flash)
Aug 01 14:04:50 user nova-compute[72129]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 (non-flash)
Aug 01 14:04:50 user nova-compute[72129]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a7dc25-351e-4c85-967a-ce6e0c8dc840 (non-flash)
Aug 01 14:04:50 user nova-compute[72129]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)
Aug 01 14:04:50 user nova-compute[72129]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa058327-fc77-44ae-b480-330deae4faff (non-flash)
Aug 01 14:04:50 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:04:50 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-7a811f62-a651-4a33-96fb-61b017672252 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa058327-fc77-44ae-b480-330deae4faff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:04:50 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a811f62-a651-4a33-96fb-61b017672252 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Connected to 172.16.0.220:3260 {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 14:04:50 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-7a811f62-a651-4a33-96fb-61b017672252 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] HCTL ('38', '-', '-', 0) found on session 41 with lun 0 {{(pid=72129) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 14:04:50 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-7a811f62-a651-4a33-96fb-61b017672252 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72129) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 14:04:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:04:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:04:50 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a511ced0-e794-4a80-a2cb-45bb635d66b4]: (4, ('- - 0', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:04:50 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-7a811f62-a651-4a33-96fb-61b017672252 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Searching for a device in session 41 and hctl ['38', '*', '*', 0] yield: None {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 14:04:51 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-7a811f62-a651-4a33-96fb-61b017672252 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Searching for a device in session 41 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 14:04:51 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a811f62-a651-4a33-96fb-61b017672252 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HRBCgbQK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 14:04:51 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-7a811f62-a651-4a33-96fb-61b017672252 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:04:51 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a811f62-a651-4a33-96fb-61b017672252 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '23631343563303762', 'path': '/dev/sdg'} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:04:51 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a811f62-a651-4a33-96fb-61b017672252 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23631343563303762', 'path': '/dev/sdg'} {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 14:04:51 user nova-compute[72129]: DEBUG nova.objects.instance [None req-7a811f62-a651-4a33-96fb-61b017672252 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lazy-loading 'flavor' on Instance uuid e2cf5877-55dd-44ce-9b58-b662afe8e62e {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:04:51 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-7a811f62-a651-4a33-96fb-61b017672252 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 14:04:51 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:04:51 user nova-compute[72129]:   <source dev="/dev/sdg"/>
Aug 01 14:04:51 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 14:04:51 user nova-compute[72129]:   <serial>fa058327-fc77-44ae-b480-330deae4faff</serial>
Aug 01 14:04:51 user nova-compute[72129]: </disk>
Aug 01 14:04:51 user nova-compute[72129]:  {{(pid=72129) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 14:04:52 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:04:52 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-7a811f62-a651-4a33-96fb-61b017672252 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:04:52 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-7a811f62-a651-4a33-96fb-61b017672252 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:04:52 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-7a811f62-a651-4a33-96fb-61b017672252 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] No VIF found with MAC fa:16:3e:18:48:0e, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 14:04:52 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-7a811f62-a651-4a33-96fb-61b017672252 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lock "e2cf5877-55dd-44ce-9b58-b662afe8e62e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.040s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:04:53 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:04:53 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:04:53 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:04:53 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:04:53 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:04:53 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Auditing locally available compute resources for user (node: user) {{(pid=72129) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 14:04:53 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 14:04:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:04:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:04:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:04:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:04:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c43fda3-e098-4c3a-bcd5-14eac019db06/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:04:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c43fda3-e098-4c3a-bcd5-14eac019db06/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:04:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c43fda3-e098-4c3a-bcd5-14eac019db06/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:04:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c43fda3-e098-4c3a-bcd5-14eac019db06/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:04:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85062e35-e302-46f7-8d66-24cf9e7199f7/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:04:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85062e35-e302-46f7-8d66-24cf9e7199f7/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:04:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85062e35-e302-46f7-8d66-24cf9e7199f7/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:04:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85062e35-e302-46f7-8d66-24cf9e7199f7/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:04:54 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 14:04:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53b76ca4-30f0-4fd4-9928-714c7073a490/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:04:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53b76ca4-30f0-4fd4-9928-714c7073a490/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:04:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53b76ca4-30f0-4fd4-9928-714c7073a490/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:04:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53b76ca4-30f0-4fd4-9928-714c7073a490/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:04:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:04:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:04:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:04:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-766ad983-f4d3-4c81-8691-639981302c31 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Acquiring lock "e2cf5877-55dd-44ce-9b58-b662afe8e62e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:04:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-766ad983-f4d3-4c81-8691-639981302c31 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lock "e2cf5877-55dd-44ce-9b58-b662afe8e62e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:04:54 user nova-compute[72129]: INFO nova.compute.manager [None req-766ad983-f4d3-4c81-8691-639981302c31 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Detaching volume fa058327-fc77-44ae-b480-330deae4faff
Aug 01 14:04:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:04:54 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 14:04:54 user nova-compute[72129]: INFO nova.virt.block_device [None req-766ad983-f4d3-4c81-8691-639981302c31 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Attempting to driver detach volume fa058327-fc77-44ae-b480-330deae4faff from mountpoint /dev/vdb
Aug 01 14:04:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cf5877-55dd-44ce-9b58-b662afe8e62e/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:04:54 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-766ad983-f4d3-4c81-8691-639981302c31 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Attempting to detach device vdb from instance e2cf5877-55dd-44ce-9b58-b662afe8e62e from the persistent domain config. {{(pid=72129) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 14:04:54 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-766ad983-f4d3-4c81-8691-639981302c31 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 14:04:54 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:04:54 user nova-compute[72129]:   <source dev="/dev/sdg"/>
Aug 01 14:04:54 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 14:04:54 user nova-compute[72129]:   <serial>fa058327-fc77-44ae-b480-330deae4faff</serial>
Aug 01 14:04:54 user nova-compute[72129]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 14:04:54 user nova-compute[72129]: </disk>
Aug 01 14:04:54 user nova-compute[72129]:  {{(pid=72129) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 14:04:54 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-766ad983-f4d3-4c81-8691-639981302c31 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Successfully detached device vdb from instance e2cf5877-55dd-44ce-9b58-b662afe8e62e from the persistent domain config.
Aug 01 14:04:54 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-766ad983-f4d3-4c81-8691-639981302c31 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e2cf5877-55dd-44ce-9b58-b662afe8e62e from the live domain config. {{(pid=72129) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 14:04:54 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-766ad983-f4d3-4c81-8691-639981302c31 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 14:04:54 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:04:54 user nova-compute[72129]:   <source dev="/dev/sdg"/>
Aug 01 14:04:54 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 14:04:54 user nova-compute[72129]:   <serial>fa058327-fc77-44ae-b480-330deae4faff</serial>
Aug 01 14:04:54 user nova-compute[72129]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 14:04:54 user nova-compute[72129]: </disk>
Aug 01 14:04:54 user nova-compute[72129]:  {{(pid=72129) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 14:04:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cf5877-55dd-44ce-9b58-b662afe8e62e/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:04:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cf5877-55dd-44ce-9b58-b662afe8e62e/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:04:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cf5877-55dd-44ce-9b58-b662afe8e62e/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:04:55 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 14:04:55 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 14:04:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3891b9d3-832d-4ef7-8ebb-970ddd0a387a/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:04:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3891b9d3-832d-4ef7-8ebb-970ddd0a387a/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:04:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3891b9d3-832d-4ef7-8ebb-970ddd0a387a/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:04:55 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Received event <DeviceRemovedEvent: 1690898695.218929, e2cf5877-55dd-44ce-9b58-b662afe8e62e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72129) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 14:04:55 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-766ad983-f4d3-4c81-8691-639981302c31 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e2cf5877-55dd-44ce-9b58-b662afe8e62e {{(pid=72129) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 14:04:55 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-766ad983-f4d3-4c81-8691-639981302c31 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Successfully detached device vdb from instance e2cf5877-55dd-44ce-9b58-b662afe8e62e from the live domain config.
Aug 01 14:04:55 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-766ad983-f4d3-4c81-8691-639981302c31 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] calling os-brick to detach iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 14:04:55 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-766ad983-f4d3-4c81-8691-639981302c31 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, {'target_iqns': ['iqn.2010-10.org.openstack:fa058327-fc77-44ae-b480-330deae4faff'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HRBCgbQK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:04:55 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-766ad983-f4d3-4c81-8691-639981302c31 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:04:55 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-766ad983-f4d3-4c81-8691-639981302c31 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:04:55 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-766ad983-f4d3-4c81-8691-639981302c31 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:04:55 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-766ad983-f4d3-4c81-8691-639981302c31 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa058327-fc77-44ae-b480-330deae4faff', 0)] {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 14:04:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:04:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:04:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:04:55 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e71a83-806e-4c17-a506-8f69fb1cb89a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80a7dc25-351e-4c85-967a-ce6e0c8dc840\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa058327-fc77-44ae-b480-330deae4faff\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:04:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:04:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:04:55 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[f325e5f9-d2a1-4838-b601-47fdb12f15c7]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a7dc25-351e-4c85-967a-ce6e0c8dc840 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa058327-fc77-44ae-b480-330deae4faff (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:04:55 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-766ad983-f4d3-4c81-8691-639981302c31 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:04:55 user nova-compute[72129]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)
Aug 01 14:04:55 user nova-compute[72129]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 (non-flash)
Aug 01 14:04:55 user nova-compute[72129]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 (non-flash)
Aug 01 14:04:55 user nova-compute[72129]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a7dc25-351e-4c85-967a-ce6e0c8dc840 (non-flash)
Aug 01 14:04:55 user nova-compute[72129]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)
Aug 01 14:04:55 user nova-compute[72129]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa058327-fc77-44ae-b480-330deae4faff (non-flash)
Aug 01 14:04:55 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:04:55 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-766ad983-f4d3-4c81-8691-639981302c31 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:04:55 user nova-compute[72129]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)
Aug 01 14:04:55 user nova-compute[72129]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 (non-flash)
Aug 01 14:04:55 user nova-compute[72129]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 (non-flash)
Aug 01 14:04:55 user nova-compute[72129]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a7dc25-351e-4c85-967a-ce6e0c8dc840 (non-flash)
Aug 01 14:04:55 user nova-compute[72129]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)
Aug 01 14:04:55 user nova-compute[72129]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa058327-fc77-44ae-b480-330deae4faff (non-flash)
Aug 01 14:04:55 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:04:55 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-766ad983-f4d3-4c81-8691-639981302c31 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f282e029900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa058327-fc77-44ae-b480-330deae4faff'): ({'sdg'}, set())}) {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 14:04:55 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-766ad983-f4d3-4c81-8691-639981302c31 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Removing single pathed devices sdg {{(pid=72129) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 14:04:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:04:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3891b9d3-832d-4ef7-8ebb-970ddd0a387a/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:04:55 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 14:04:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea050cd6-60e9-41fd-a35c-05fe63d60e57/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:04:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:04:55 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a343e6fc-3db9-48b9-a7c8-e501e1924b0e]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:04:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:04:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:04:55 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c9caf8-e2da-4731-946d-9646bd0946ce]: (4, ('ok\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:04:55 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-766ad983-f4d3-4c81-8691-639981302c31 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Flushing IO for device /dev/sdg {{(pid=72129) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 14:04:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:04:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:04:55 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a394f51-dae3-43e9-8c89-7ada82b6837b]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:04:55 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-766ad983-f4d3-4c81-8691-639981302c31 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72129) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 14:04:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:04:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.036s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:04:55 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d8ee22b-bfcf-4f14-95ee-37bca26a4c9f]: (4, ('1', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:04:55 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-766ad983-f4d3-4c81-8691-639981302c31 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 14:04:55 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-766ad983-f4d3-4c81-8691-639981302c31 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] SCSI volumes sdg have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 14:04:55 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-766ad983-f4d3-4c81-8691-639981302c31 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa058327-fc77-44ae-b480-330deae4faff')] {{(pid=72129) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 14:04:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa058327-fc77-44ae-b480-330deae4faff -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:04:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea050cd6-60e9-41fd-a35c-05fe63d60e57/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:04:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea050cd6-60e9-41fd-a35c-05fe63d60e57/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:04:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa058327-fc77-44ae-b480-330deae4faff -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:04:55 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[988ad0f0-ada7-4bbb-9b58-a7352ed7073b]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:04:55 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-766ad983-f4d3-4c81-8691-639981302c31 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:04:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa058327-fc77-44ae-b480-330deae4faff -p 172.16.0.220:3260 --logout {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:04:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa058327-fc77-44ae-b480-330deae4faff -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:04:55 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c81b762-08cb-4dd2-91cf-65bfead0a009]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:fa058327-fc77-44ae-b480-330deae4faff, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:fa058327-fc77-44ae-b480-330deae4faff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:04:55 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-766ad983-f4d3-4c81-8691-639981302c31 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:fa058327-fc77-44ae-b480-330deae4faff, portal: 172.16.0.220,3260]
Aug 01 14:04:55 user nova-compute[72129]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:fa058327-fc77-44ae-b480-330deae4faff, portal: 172.16.0.220,3260] successful.
Aug 01 14:04:55 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:04:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa058327-fc77-44ae-b480-330deae4faff -p 172.16.0.220:3260 --op delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:04:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea050cd6-60e9-41fd-a35c-05fe63d60e57/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:04:55 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 14:04:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea050cd6-60e9-41fd-a35c-05fe63d60e57/disk.rescue --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:04:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa058327-fc77-44ae-b480-330deae4faff -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:04:55 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93668b6-9027-44e9-a760-31de218a0abb]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:04:55 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-766ad983-f4d3-4c81-8691-639981302c31 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:04:55 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-766ad983-f4d3-4c81-8691-639981302c31 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.397s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:04:55 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-766ad983-f4d3-4c81-8691-639981302c31 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] <== disconnect_volume: return (399ms) None {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:04:55 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-766ad983-f4d3-4c81-8691-639981302c31 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Disconnected iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 14:04:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea050cd6-60e9-41fd-a35c-05fe63d60e57/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:04:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea050cd6-60e9-41fd-a35c-05fe63d60e57/disk.rescue --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:04:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea050cd6-60e9-41fd-a35c-05fe63d60e57/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:04:56 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:04:56 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:04:56 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:04:56 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Hypervisor/Node resource view: name=user free_ram=7360MB free_disk=24.95905303955078GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72129) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 14:04:56 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:04:56 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:04:56 user nova-compute[72129]: DEBUG nova.objects.instance [None req-766ad983-f4d3-4c81-8691-639981302c31 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lazy-loading 'flavor' on Instance uuid e2cf5877-55dd-44ce-9b58-b662afe8e62e {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:04:56 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-766ad983-f4d3-4c81-8691-639981302c31 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lock "e2cf5877-55dd-44ce-9b58-b662afe8e62e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.800s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:04:56 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Applying migration context for instance e4a13a50-fe03-41aa-94f4-3431805ff481 as it has an incoming, in-progress migration bd6701cb-6cc9-4417-a952-70fff9896df6. Migration status is finished {{(pid=72129) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 01 14:04:56 user nova-compute[72129]: INFO nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Updating resource usage from migration bd6701cb-6cc9-4417-a952-70fff9896df6
Aug 01 14:04:56 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 97a5dccf-b499-443a-b332-cfa293a16047 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:04:56 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:04:56 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance d031973f-8f48-43b3-a338-040950103e4c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:04:56 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 53b76ca4-30f0-4fd4-9928-714c7073a490 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:04:56 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance ea050cd6-60e9-41fd-a35c-05fe63d60e57 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:04:56 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance e2cf5877-55dd-44ce-9b58-b662afe8e62e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:04:56 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 954db8d6-4806-43e6-8310-5d7f3437dc71 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:04:56 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 85062e35-e302-46f7-8d66-24cf9e7199f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:04:56 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 0c43fda3-e098-4c3a-bcd5-14eac019db06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:04:56 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 3891b9d3-832d-4ef7-8ebb-970ddd0a387a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:04:56 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Migration bd6701cb-6cc9-4417-a952-70fff9896df6 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 01 14:04:56 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance e4a13a50-fe03-41aa-94f4-3431805ff481 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:04:56 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 14:04:56 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 14:04:56 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:04:56 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:04:56 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Compute_service record updated for user:user {{(pid=72129) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 14:04:56 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.554s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:05:00 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:05:05 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:05:07 user nova-compute[72129]: DEBUG nova.objects.instance [None req-c0987821-9e53-4dde-89e7-a99e49eb5ad5 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lazy-loading 'flavor' on Instance uuid 53b76ca4-30f0-4fd4-9928-714c7073a490 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:05:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c0987821-9e53-4dde-89e7-a99e49eb5ad5 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Acquiring lock "refresh_cache-53b76ca4-30f0-4fd4-9928-714c7073a490" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:05:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c0987821-9e53-4dde-89e7-a99e49eb5ad5 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Acquired lock "refresh_cache-53b76ca4-30f0-4fd4-9928-714c7073a490" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:05:07 user nova-compute[72129]: DEBUG nova.network.neutron [None req-c0987821-9e53-4dde-89e7-a99e49eb5ad5 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 14:05:07 user nova-compute[72129]: DEBUG nova.objects.instance [None req-c0987821-9e53-4dde-89e7-a99e49eb5ad5 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lazy-loading 'info_cache' on Instance uuid 53b76ca4-30f0-4fd4-9928-714c7073a490 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:05:07 user nova-compute[72129]: DEBUG nova.network.neutron [None req-c0987821-9e53-4dde-89e7-a99e49eb5ad5 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Updating instance_info_cache with network_info: [{"id": "b7271bae-a440-4d06-87d0-cece38122deb", "address": "fa:16:3e:6b:eb:be", "network": {"id": "b0eb2211-5a6a-4b7e-a119-92a0f0deb947", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1159988670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6120989bad342a4a6fa2a8975f5932f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7271bae-a4", "ovs_interfaceid": "b7271bae-a440-4d06-87d0-cece38122deb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:05:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c0987821-9e53-4dde-89e7-a99e49eb5ad5 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Releasing lock "refresh_cache-53b76ca4-30f0-4fd4-9928-714c7073a490" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:05:07 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Instance destroyed successfully.
Aug 01 14:05:07 user nova-compute[72129]: DEBUG nova.objects.instance [None req-c0987821-9e53-4dde-89e7-a99e49eb5ad5 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lazy-loading 'resources' on Instance uuid 53b76ca4-30f0-4fd4-9928-714c7073a490 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:05:07 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-c0987821-9e53-4dde-89e7-a99e49eb5ad5 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:57:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-850515568',display_name='tempest-AttachVolumeTestJSON-server-850515568',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-850515568',id=20,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMYJypdJqmxJKXNm404Q0Cl0WuuC4kkdldjTIBUyN/EtYQvDQbUuKBkqlwMSJuSlO9CdP4jtMdwoobiqIkSyVtZDYG9OaB7GLwJQRR3hShHH6YafWHv11ydfwe0fTFZOZw==',key_name='tempest-keypair-1711923464',keypairs=<?>,launch_index=0,launched_at=2023-08-01T13:57:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a6120989bad342a4a6fa2a8975f5932f',ramdisk_id='',reservation_id='r-84r01nk5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-55653475',owner_user_name='tempest-AttachVolumeTestJSON-55653475-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T14:03:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13a3c19bbcbb4833abbb2997944a6564',uuid=53b76ca4-30f0-4fd4-9928-714c7073a490,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "b7271bae-a440-4d06-87d0-cece38122deb", "address": "fa:16:3e:6b:eb:be", "network": {"id": "b0eb2211-5a6a-4b7e-a119-92a0f0deb947", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1159988670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6120989bad342a4a6fa2a8975f5932f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7271bae-a4", "ovs_interfaceid": "b7271bae-a440-4d06-87d0-cece38122deb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 14:05:07 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-c0987821-9e53-4dde-89e7-a99e49eb5ad5 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Converting VIF {"id": "b7271bae-a440-4d06-87d0-cece38122deb", "address": "fa:16:3e:6b:eb:be", "network": {"id": "b0eb2211-5a6a-4b7e-a119-92a0f0deb947", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1159988670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6120989bad342a4a6fa2a8975f5932f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7271bae-a4", "ovs_interfaceid": "b7271bae-a440-4d06-87d0-cece38122deb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:05:07 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-c0987821-9e53-4dde-89e7-a99e49eb5ad5 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:eb:be,bridge_name='br-int',has_traffic_filtering=True,id=b7271bae-a440-4d06-87d0-cece38122deb,network=Network(b0eb2211-5a6a-4b7e-a119-92a0f0deb947),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7271bae-a4') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:05:07 user nova-compute[72129]: DEBUG os_vif [None req-c0987821-9e53-4dde-89e7-a99e49eb5ad5 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:eb:be,bridge_name='br-int',has_traffic_filtering=True,id=b7271bae-a440-4d06-87d0-cece38122deb,network=Network(b0eb2211-5a6a-4b7e-a119-92a0f0deb947),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7271bae-a4') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 14:05:07 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:05:07 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb7271bae-a4, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:05:07 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:05:07 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:05:07 user nova-compute[72129]: INFO os_vif [None req-c0987821-9e53-4dde-89e7-a99e49eb5ad5 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:eb:be,bridge_name='br-int',has_traffic_filtering=True,id=b7271bae-a440-4d06-87d0-cece38122deb,network=Network(b0eb2211-5a6a-4b7e-a119-92a0f0deb947),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7271bae-a4')
Aug 01 14:05:07 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-c0987821-9e53-4dde-89e7-a99e49eb5ad5 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Start _get_guest_xml network_info=[{"id": "b7271bae-a440-4d06-87d0-cece38122deb", "address": "fa:16:3e:6b:eb:be", "network": {"id": "b0eb2211-5a6a-4b7e-a119-92a0f0deb947", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1159988670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6120989bad342a4a6fa2a8975f5932f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7271bae-a4", "ovs_interfaceid": "b7271bae-a440-4d06-87d0-cece38122deb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'image_id': 'b6472c34-1b0f-4034-ba3a-7e8eb5103715'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 14:05:07 user nova-compute[72129]: DEBUG nova.objects.instance [None req-c0987821-9e53-4dde-89e7-a99e49eb5ad5 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lazy-loading 'numa_topology' on Instance uuid 53b76ca4-30f0-4fd4-9928-714c7073a490 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:05:07 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-c0987821-9e53-4dde-89e7-a99e49eb5ad5 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:05:07 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-c0987821-9e53-4dde-89e7-a99e49eb5ad5 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:05:07 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-c0987821-9e53-4dde-89e7-a99e49eb5ad5 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 14:05:07 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-c0987821-9e53-4dde-89e7-a99e49eb5ad5 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] CPU controller missing on host. {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 14:05:07 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-c0987821-9e53-4dde-89e7-a99e49eb5ad5 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 14:05:07 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-c0987821-9e53-4dde-89e7-a99e49eb5ad5 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] CPU controller found on host. {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 14:05:07 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-c0987821-9e53-4dde-89e7-a99e49eb5ad5 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72129) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 14:05:07 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-c0987821-9e53-4dde-89e7-a99e49eb5ad5 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T13:45:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 14:05:07 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-c0987821-9e53-4dde-89e7-a99e49eb5ad5 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Flavor limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 14:05:07 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-c0987821-9e53-4dde-89e7-a99e49eb5ad5 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Image limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 14:05:07 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-c0987821-9e53-4dde-89e7-a99e49eb5ad5 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Flavor pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 14:05:07 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-c0987821-9e53-4dde-89e7-a99e49eb5ad5 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Image pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 14:05:07 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-c0987821-9e53-4dde-89e7-a99e49eb5ad5 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 14:05:07 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-c0987821-9e53-4dde-89e7-a99e49eb5ad5 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 14:05:07 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-c0987821-9e53-4dde-89e7-a99e49eb5ad5 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 14:05:07 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-c0987821-9e53-4dde-89e7-a99e49eb5ad5 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Got 1 possible topologies {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 14:05:07 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-c0987821-9e53-4dde-89e7-a99e49eb5ad5 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 14:05:07 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-c0987821-9e53-4dde-89e7-a99e49eb5ad5 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 14:05:07 user nova-compute[72129]: DEBUG nova.objects.instance [None req-c0987821-9e53-4dde-89e7-a99e49eb5ad5 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lazy-loading 'vcpu_model' on Instance uuid 53b76ca4-30f0-4fd4-9928-714c7073a490 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:05:07 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-c0987821-9e53-4dde-89e7-a99e49eb5ad5 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:57:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-850515568',display_name='tempest-AttachVolumeTestJSON-server-850515568',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-850515568',id=20,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMYJypdJqmxJKXNm404Q0Cl0WuuC4kkdldjTIBUyN/EtYQvDQbUuKBkqlwMSJuSlO9CdP4jtMdwoobiqIkSyVtZDYG9OaB7GLwJQRR3hShHH6YafWHv11ydfwe0fTFZOZw==',key_name='tempest-keypair-1711923464',keypairs=<?>,launch_index=0,launched_at=2023-08-01T13:57:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a6120989bad342a4a6fa2a8975f5932f',ramdisk_id='',reservation_id='r-84r01nk5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-55653475',owner_user_name='tempest-AttachVolumeTestJSON-55653475-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T14:03:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13a3c19bbcbb4833abbb2997944a6564',uuid=53b76ca4-30f0-4fd4-9928-714c7073a490,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "b7271bae-a440-4d06-87d0-cece38122deb", "address": "fa:16:3e:6b:eb:be", "network": {"id": "b0eb2211-5a6a-4b7e-a119-92a0f0deb947", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1159988670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6120989bad342a4a6fa2a8975f5932f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7271bae-a4", "ovs_interfaceid": "b7271bae-a440-4d06-87d0-cece38122deb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 14:05:07 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-c0987821-9e53-4dde-89e7-a99e49eb5ad5 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Converting VIF {"id": "b7271bae-a440-4d06-87d0-cece38122deb", "address": "fa:16:3e:6b:eb:be", "network": {"id": "b0eb2211-5a6a-4b7e-a119-92a0f0deb947", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1159988670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6120989bad342a4a6fa2a8975f5932f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7271bae-a4", "ovs_interfaceid": "b7271bae-a440-4d06-87d0-cece38122deb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:05:07 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-c0987821-9e53-4dde-89e7-a99e49eb5ad5 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:eb:be,bridge_name='br-int',has_traffic_filtering=True,id=b7271bae-a440-4d06-87d0-cece38122deb,network=Network(b0eb2211-5a6a-4b7e-a119-92a0f0deb947),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7271bae-a4') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:05:07 user nova-compute[72129]: DEBUG nova.objects.instance [None req-c0987821-9e53-4dde-89e7-a99e49eb5ad5 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lazy-loading 'pci_devices' on Instance uuid 53b76ca4-30f0-4fd4-9928-714c7073a490 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:05:07 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-c0987821-9e53-4dde-89e7-a99e49eb5ad5 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] End _get_guest_xml xml=<domain type="kvm">
Aug 01 14:05:07 user nova-compute[72129]:   <uuid>53b76ca4-30f0-4fd4-9928-714c7073a490</uuid>
Aug 01 14:05:07 user nova-compute[72129]:   <name>instance-00000014</name>
Aug 01 14:05:07 user nova-compute[72129]:   <memory>524288</memory>
Aug 01 14:05:07 user nova-compute[72129]:   <vcpu>1</vcpu>
Aug 01 14:05:07 user nova-compute[72129]:   <metadata>
Aug 01 14:05:07 user nova-compute[72129]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 14:05:07 user nova-compute[72129]:       <nova:package version="0.0.0"/>
Aug 01 14:05:07 user nova-compute[72129]:       <nova:name>tempest-AttachVolumeTestJSON-server-850515568</nova:name>
Aug 01 14:05:07 user nova-compute[72129]:       <nova:creationTime>2023-08-01 14:05:07</nova:creationTime>
Aug 01 14:05:07 user nova-compute[72129]:       <nova:flavor name="m1.tiny">
Aug 01 14:05:07 user nova-compute[72129]:         <nova:memory>512</nova:memory>
Aug 01 14:05:07 user nova-compute[72129]:         <nova:disk>1</nova:disk>
Aug 01 14:05:07 user nova-compute[72129]:         <nova:swap>0</nova:swap>
Aug 01 14:05:07 user nova-compute[72129]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 14:05:07 user nova-compute[72129]:         <nova:vcpus>1</nova:vcpus>
Aug 01 14:05:07 user nova-compute[72129]:       </nova:flavor>
Aug 01 14:05:07 user nova-compute[72129]:       <nova:owner>
Aug 01 14:05:07 user nova-compute[72129]:         <nova:user uuid="13a3c19bbcbb4833abbb2997944a6564">tempest-AttachVolumeTestJSON-55653475-project-member</nova:user>
Aug 01 14:05:07 user nova-compute[72129]:         <nova:project uuid="a6120989bad342a4a6fa2a8975f5932f">tempest-AttachVolumeTestJSON-55653475</nova:project>
Aug 01 14:05:07 user nova-compute[72129]:       </nova:owner>
Aug 01 14:05:07 user nova-compute[72129]:       <nova:root type="image" uuid="b6472c34-1b0f-4034-ba3a-7e8eb5103715"/>
Aug 01 14:05:07 user nova-compute[72129]:       <nova:ports>
Aug 01 14:05:07 user nova-compute[72129]:         <nova:port uuid="b7271bae-a440-4d06-87d0-cece38122deb">
Aug 01 14:05:07 user nova-compute[72129]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 01 14:05:07 user nova-compute[72129]:         </nova:port>
Aug 01 14:05:07 user nova-compute[72129]:       </nova:ports>
Aug 01 14:05:07 user nova-compute[72129]:     </nova:instance>
Aug 01 14:05:07 user nova-compute[72129]:   </metadata>
Aug 01 14:05:07 user nova-compute[72129]:   <sysinfo type="smbios">
Aug 01 14:05:07 user nova-compute[72129]:     <system>
Aug 01 14:05:07 user nova-compute[72129]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 14:05:07 user nova-compute[72129]:       <entry name="product">OpenStack Nova</entry>
Aug 01 14:05:07 user nova-compute[72129]:       <entry name="version">0.0.0</entry>
Aug 01 14:05:07 user nova-compute[72129]:       <entry name="serial">53b76ca4-30f0-4fd4-9928-714c7073a490</entry>
Aug 01 14:05:07 user nova-compute[72129]:       <entry name="uuid">53b76ca4-30f0-4fd4-9928-714c7073a490</entry>
Aug 01 14:05:07 user nova-compute[72129]:       <entry name="family">Virtual Machine</entry>
Aug 01 14:05:07 user nova-compute[72129]:     </system>
Aug 01 14:05:07 user nova-compute[72129]:   </sysinfo>
Aug 01 14:05:07 user nova-compute[72129]:   <os>
Aug 01 14:05:07 user nova-compute[72129]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 14:05:07 user nova-compute[72129]:     <boot dev="hd"/>
Aug 01 14:05:07 user nova-compute[72129]:     <smbios mode="sysinfo"/>
Aug 01 14:05:07 user nova-compute[72129]:   </os>
Aug 01 14:05:07 user nova-compute[72129]:   <features>
Aug 01 14:05:07 user nova-compute[72129]:     <acpi/>
Aug 01 14:05:07 user nova-compute[72129]:     <apic/>
Aug 01 14:05:07 user nova-compute[72129]:     <vmcoreinfo/>
Aug 01 14:05:07 user nova-compute[72129]:   </features>
Aug 01 14:05:07 user nova-compute[72129]:   <clock offset="utc">
Aug 01 14:05:07 user nova-compute[72129]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 14:05:07 user nova-compute[72129]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 14:05:07 user nova-compute[72129]:     <timer name="hpet" present="no"/>
Aug 01 14:05:07 user nova-compute[72129]:   </clock>
Aug 01 14:05:07 user nova-compute[72129]:   <cpu mode="custom" match="exact">
Aug 01 14:05:07 user nova-compute[72129]:     <model>Nehalem</model>
Aug 01 14:05:07 user nova-compute[72129]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 14:05:07 user nova-compute[72129]:   </cpu>
Aug 01 14:05:07 user nova-compute[72129]:   <devices>
Aug 01 14:05:07 user nova-compute[72129]:     <disk type="file" device="disk">
Aug 01 14:05:07 user nova-compute[72129]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 14:05:07 user nova-compute[72129]:       <source file="/opt/stack/data/nova/instances/53b76ca4-30f0-4fd4-9928-714c7073a490/disk"/>
Aug 01 14:05:07 user nova-compute[72129]:       <target dev="vda" bus="virtio"/>
Aug 01 14:05:07 user nova-compute[72129]:     </disk>
Aug 01 14:05:07 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 14:05:07 user nova-compute[72129]:       <mac address="fa:16:3e:6b:eb:be"/>
Aug 01 14:05:07 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:05:07 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 14:05:07 user nova-compute[72129]:       <target dev="tapb7271bae-a4"/>
Aug 01 14:05:07 user nova-compute[72129]:     </interface>
Aug 01 14:05:07 user nova-compute[72129]:     <serial type="pty">
Aug 01 14:05:07 user nova-compute[72129]:       <log file="/opt/stack/data/nova/instances/53b76ca4-30f0-4fd4-9928-714c7073a490/console.log" append="off"/>
Aug 01 14:05:07 user nova-compute[72129]:     </serial>
Aug 01 14:05:07 user nova-compute[72129]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 14:05:07 user nova-compute[72129]:     <video>
Aug 01 14:05:07 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:05:07 user nova-compute[72129]:     </video>
Aug 01 14:05:07 user nova-compute[72129]:     <rng model="virtio">
Aug 01 14:05:07 user nova-compute[72129]:       <backend model="random">/dev/urandom</backend>
Aug 01 14:05:07 user nova-compute[72129]:     </rng>
Aug 01 14:05:07 user nova-compute[72129]:     <controller type="usb" index="0" model="none"/>
Aug 01 14:05:07 user nova-compute[72129]:     <memballoon model="virtio">
Aug 01 14:05:07 user nova-compute[72129]:       <stats period="10"/>
Aug 01 14:05:07 user nova-compute[72129]:     </memballoon>
Aug 01 14:05:07 user nova-compute[72129]:   </devices>
Aug 01 14:05:07 user nova-compute[72129]: </domain>
Aug 01 14:05:07 user nova-compute[72129]:  {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 14:05:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-c0987821-9e53-4dde-89e7-a99e49eb5ad5 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53b76ca4-30f0-4fd4-9928-714c7073a490/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-c0987821-9e53-4dde-89e7-a99e49eb5ad5 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53b76ca4-30f0-4fd4-9928-714c7073a490/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-c0987821-9e53-4dde-89e7-a99e49eb5ad5 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53b76ca4-30f0-4fd4-9928-714c7073a490/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-c0987821-9e53-4dde-89e7-a99e49eb5ad5 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53b76ca4-30f0-4fd4-9928-714c7073a490/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:08 user nova-compute[72129]: DEBUG nova.objects.instance [None req-c0987821-9e53-4dde-89e7-a99e49eb5ad5 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lazy-loading 'trusted_certs' on Instance uuid 53b76ca4-30f0-4fd4-9928-714c7073a490 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:05:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-c0987821-9e53-4dde-89e7-a99e49eb5ad5 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-c0987821-9e53-4dde-89e7-a99e49eb5ad5 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.134s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:08 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-c0987821-9e53-4dde-89e7-a99e49eb5ad5 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Checking if we can resize image /opt/stack/data/nova/instances/53b76ca4-30f0-4fd4-9928-714c7073a490/disk. size=1073741824 {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 14:05:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-c0987821-9e53-4dde-89e7-a99e49eb5ad5 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53b76ca4-30f0-4fd4-9928-714c7073a490/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-c0987821-9e53-4dde-89e7-a99e49eb5ad5 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53b76ca4-30f0-4fd4-9928-714c7073a490/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:08 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-c0987821-9e53-4dde-89e7-a99e49eb5ad5 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Cannot resize image /opt/stack/data/nova/instances/53b76ca4-30f0-4fd4-9928-714c7073a490/disk to a smaller size. {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 14:05:08 user nova-compute[72129]: DEBUG nova.objects.instance [None req-c0987821-9e53-4dde-89e7-a99e49eb5ad5 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lazy-loading 'migration_context' on Instance uuid 53b76ca4-30f0-4fd4-9928-714c7073a490 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:05:08 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-c0987821-9e53-4dde-89e7-a99e49eb5ad5 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:57:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-850515568',display_name='tempest-AttachVolumeTestJSON-server-850515568',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-850515568',id=20,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMYJypdJqmxJKXNm404Q0Cl0WuuC4kkdldjTIBUyN/EtYQvDQbUuKBkqlwMSJuSlO9CdP4jtMdwoobiqIkSyVtZDYG9OaB7GLwJQRR3hShHH6YafWHv11ydfwe0fTFZOZw==',key_name='tempest-keypair-1711923464',keypairs=<?>,launch_index=0,launched_at=2023-08-01T13:57:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='a6120989bad342a4a6fa2a8975f5932f',ramdisk_id='',reservation_id='r-84r01nk5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-55653475',owner_user_name='tempest-AttachVolumeTestJSON-55653475-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T14:03:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13a3c19bbcbb4833abbb2997944a6564',uuid=53b76ca4-30f0-4fd4-9928-714c7073a490,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "b7271bae-a440-4d06-87d0-cece38122deb", "address": "fa:16:3e:6b:eb:be", "network": {"id": "b0eb2211-5a6a-4b7e-a119-92a0f0deb947", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1159988670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6120989bad342a4a6fa2a8975f5932f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7271bae-a4", "ovs_interfaceid": "b7271bae-a440-4d06-87d0-cece38122deb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 14:05:08 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-c0987821-9e53-4dde-89e7-a99e49eb5ad5 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Converting VIF {"id": "b7271bae-a440-4d06-87d0-cece38122deb", "address": "fa:16:3e:6b:eb:be", "network": {"id": "b0eb2211-5a6a-4b7e-a119-92a0f0deb947", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1159988670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6120989bad342a4a6fa2a8975f5932f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7271bae-a4", "ovs_interfaceid": "b7271bae-a440-4d06-87d0-cece38122deb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:05:08 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-c0987821-9e53-4dde-89e7-a99e49eb5ad5 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:eb:be,bridge_name='br-int',has_traffic_filtering=True,id=b7271bae-a440-4d06-87d0-cece38122deb,network=Network(b0eb2211-5a6a-4b7e-a119-92a0f0deb947),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7271bae-a4') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:05:08 user nova-compute[72129]: DEBUG os_vif [None req-c0987821-9e53-4dde-89e7-a99e49eb5ad5 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:eb:be,bridge_name='br-int',has_traffic_filtering=True,id=b7271bae-a440-4d06-87d0-cece38122deb,network=Network(b0eb2211-5a6a-4b7e-a119-92a0f0deb947),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7271bae-a4') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 14:05:08 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:05:08 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:05:08 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 14:05:08 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:05:08 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb7271bae-a4, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:05:08 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb7271bae-a4, col_values=(('external_ids', {'iface-id': 'b7271bae-a440-4d06-87d0-cece38122deb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:eb:be', 'vm-uuid': '53b76ca4-30f0-4fd4-9928-714c7073a490'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:05:08 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:05:08 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:05:08 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:05:08 user nova-compute[72129]: INFO os_vif [None req-c0987821-9e53-4dde-89e7-a99e49eb5ad5 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:eb:be,bridge_name='br-int',has_traffic_filtering=True,id=b7271bae-a440-4d06-87d0-cece38122deb,network=Network(b0eb2211-5a6a-4b7e-a119-92a0f0deb947),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7271bae-a4')
Aug 01 14:05:09 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:05:09 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:05:09 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:05:10 user nova-compute[72129]: DEBUG nova.compute.manager [req-1f3f7d74-1f99-45f3-a536-a351e19e3208 req-54837230-7fe3-46bf-a8d2-cda5553d3414 service nova] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Received event network-vif-plugged-b7271bae-a440-4d06-87d0-cece38122deb {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:05:10 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-1f3f7d74-1f99-45f3-a536-a351e19e3208 req-54837230-7fe3-46bf-a8d2-cda5553d3414 service nova] Acquiring lock "53b76ca4-30f0-4fd4-9928-714c7073a490-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:05:10 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-1f3f7d74-1f99-45f3-a536-a351e19e3208 req-54837230-7fe3-46bf-a8d2-cda5553d3414 service nova] Lock "53b76ca4-30f0-4fd4-9928-714c7073a490-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:05:10 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-1f3f7d74-1f99-45f3-a536-a351e19e3208 req-54837230-7fe3-46bf-a8d2-cda5553d3414 service nova] Lock "53b76ca4-30f0-4fd4-9928-714c7073a490-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:05:10 user nova-compute[72129]: DEBUG nova.compute.manager [req-1f3f7d74-1f99-45f3-a536-a351e19e3208 req-54837230-7fe3-46bf-a8d2-cda5553d3414 service nova] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] No waiting events found dispatching network-vif-plugged-b7271bae-a440-4d06-87d0-cece38122deb {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:05:10 user nova-compute[72129]: WARNING nova.compute.manager [req-1f3f7d74-1f99-45f3-a536-a351e19e3208 req-54837230-7fe3-46bf-a8d2-cda5553d3414 service nova] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Received unexpected event network-vif-plugged-b7271bae-a440-4d06-87d0-cece38122deb for instance with vm_state stopped and task_state powering-on.
Aug 01 14:05:10 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:05:10 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:05:10 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:05:10 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:05:10 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:05:12 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898712.055912, 53b76ca4-30f0-4fd4-9928-714c7073a490 => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:05:12 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] VM Resumed (Lifecycle Event)
Aug 01 14:05:12 user nova-compute[72129]: DEBUG nova.compute.manager [None req-c0987821-9e53-4dde-89e7-a99e49eb5ad5 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Instance event wait completed in 0 seconds for  {{(pid=72129) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 14:05:12 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Instance rebooted successfully.
Aug 01 14:05:12 user nova-compute[72129]: DEBUG nova.compute.manager [None req-c0987821-9e53-4dde-89e7-a99e49eb5ad5 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:05:12 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:05:12 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:05:12 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 01 14:05:12 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898712.0580382, 53b76ca4-30f0-4fd4-9928-714c7073a490 => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:05:12 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] VM Started (Lifecycle Event)
Aug 01 14:05:12 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:05:12 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:05:12 user nova-compute[72129]: DEBUG nova.compute.manager [req-efc30ec5-29b7-4edd-96a8-d7181ec5aecf req-23a8e3b4-3d6e-4bc6-ae3b-cb4bad7f925d service nova] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Received event network-vif-plugged-b7271bae-a440-4d06-87d0-cece38122deb {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:05:12 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-efc30ec5-29b7-4edd-96a8-d7181ec5aecf req-23a8e3b4-3d6e-4bc6-ae3b-cb4bad7f925d service nova] Acquiring lock "53b76ca4-30f0-4fd4-9928-714c7073a490-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:05:12 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-efc30ec5-29b7-4edd-96a8-d7181ec5aecf req-23a8e3b4-3d6e-4bc6-ae3b-cb4bad7f925d service nova] Lock "53b76ca4-30f0-4fd4-9928-714c7073a490-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:05:12 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-efc30ec5-29b7-4edd-96a8-d7181ec5aecf req-23a8e3b4-3d6e-4bc6-ae3b-cb4bad7f925d service nova] Lock "53b76ca4-30f0-4fd4-9928-714c7073a490-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:05:12 user nova-compute[72129]: DEBUG nova.compute.manager [req-efc30ec5-29b7-4edd-96a8-d7181ec5aecf req-23a8e3b4-3d6e-4bc6-ae3b-cb4bad7f925d service nova] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] No waiting events found dispatching network-vif-plugged-b7271bae-a440-4d06-87d0-cece38122deb {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:05:12 user nova-compute[72129]: WARNING nova.compute.manager [req-efc30ec5-29b7-4edd-96a8-d7181ec5aecf req-23a8e3b4-3d6e-4bc6-ae3b-cb4bad7f925d service nova] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Received unexpected event network-vif-plugged-b7271bae-a440-4d06-87d0-cece38122deb for instance with vm_state active and task_state None.
Aug 01 14:05:13 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:05:15 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:05:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:05:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:05:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:05:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72129) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 14:05:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:05:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:05:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:05:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-261b4496-f8ac-4f07-8af1-5bc5f1c891be tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Acquiring lock "954db8d6-4806-43e6-8310-5d7f3437dc71" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:05:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-261b4496-f8ac-4f07-8af1-5bc5f1c891be tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "954db8d6-4806-43e6-8310-5d7f3437dc71" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:05:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-261b4496-f8ac-4f07-8af1-5bc5f1c891be tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Acquiring lock "954db8d6-4806-43e6-8310-5d7f3437dc71-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:05:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-261b4496-f8ac-4f07-8af1-5bc5f1c891be tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "954db8d6-4806-43e6-8310-5d7f3437dc71-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:05:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-261b4496-f8ac-4f07-8af1-5bc5f1c891be tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "954db8d6-4806-43e6-8310-5d7f3437dc71-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:05:24 user nova-compute[72129]: INFO nova.compute.manager [None req-261b4496-f8ac-4f07-8af1-5bc5f1c891be tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] Terminating instance
Aug 01 14:05:24 user nova-compute[72129]: DEBUG nova.compute.manager [None req-261b4496-f8ac-4f07-8af1-5bc5f1c891be tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] Start destroying the instance on the hypervisor. {{(pid=72129) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 14:05:24 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:05:24 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:05:24 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:05:24 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:05:24 user nova-compute[72129]: DEBUG nova.compute.manager [req-6de55039-d34b-4b09-9255-8f646654d1e7 req-c0843a4a-999a-4d7f-a320-6bf060bd7ecb service nova] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] Received event network-vif-unplugged-f6944a05-0ad8-4f1a-b849-0dbb7732b739 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:05:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-6de55039-d34b-4b09-9255-8f646654d1e7 req-c0843a4a-999a-4d7f-a320-6bf060bd7ecb service nova] Acquiring lock "954db8d6-4806-43e6-8310-5d7f3437dc71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:05:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-6de55039-d34b-4b09-9255-8f646654d1e7 req-c0843a4a-999a-4d7f-a320-6bf060bd7ecb service nova] Lock "954db8d6-4806-43e6-8310-5d7f3437dc71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:05:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-6de55039-d34b-4b09-9255-8f646654d1e7 req-c0843a4a-999a-4d7f-a320-6bf060bd7ecb service nova] Lock "954db8d6-4806-43e6-8310-5d7f3437dc71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:05:24 user nova-compute[72129]: DEBUG nova.compute.manager [req-6de55039-d34b-4b09-9255-8f646654d1e7 req-c0843a4a-999a-4d7f-a320-6bf060bd7ecb service nova] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] No waiting events found dispatching network-vif-unplugged-f6944a05-0ad8-4f1a-b849-0dbb7732b739 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:05:24 user nova-compute[72129]: DEBUG nova.compute.manager [req-6de55039-d34b-4b09-9255-8f646654d1e7 req-c0843a4a-999a-4d7f-a320-6bf060bd7ecb service nova] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] Received event network-vif-unplugged-f6944a05-0ad8-4f1a-b849-0dbb7732b739 for instance with task_state deleting. {{(pid=72129) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 14:05:24 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:05:25 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] Instance destroyed successfully.
Aug 01 14:05:25 user nova-compute[72129]: DEBUG nova.objects.instance [None req-261b4496-f8ac-4f07-8af1-5bc5f1c891be tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lazy-loading 'resources' on Instance uuid 954db8d6-4806-43e6-8310-5d7f3437dc71 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:05:25 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-261b4496-f8ac-4f07-8af1-5bc5f1c891be tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:00:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-775511038',display_name='tempest-TestVolumeBootPattern-volume-backed-server-775511038',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-775511038',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJHOBrrs6TVudk7SfefpSSEcPt7HQlUtN6DNv8+fPk/DIRISiQFoniGVIEcnGGU1SfBAEX5XOn/G2LwqxOXKb4sePVF953dRaT2SKqC8aavY3f30YH4vNGxqZFU7uy0DqQ==',key_name='tempest-keypair-778397316',keypairs=<?>,launch_index=0,launched_at=2023-08-01T14:00:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='210837255c8148ec9b482ba3e2551362',ramdisk_id='',reservation_id='r-lmvee45i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1876154436',owner_user_name='tempest-TestVolumeBootPattern-1876154436-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T14:00:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c341be2816c43cfa9adb58ee84e942b',uuid=954db8d6-4806-43e6-8310-5d7f3437dc71,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f6944a05-0ad8-4f1a-b849-0dbb7732b739", "address": "fa:16:3e:b7:4f:45", "network": {"id": "a7f4226b-73fe-4265-ba2c-5d7dcdf154fd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1142462884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210837255c8148ec9b482ba3e2551362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6944a05-0a", "ovs_interfaceid": "f6944a05-0ad8-4f1a-b849-0dbb7732b739", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 14:05:25 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-261b4496-f8ac-4f07-8af1-5bc5f1c891be tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Converting VIF {"id": "f6944a05-0ad8-4f1a-b849-0dbb7732b739", "address": "fa:16:3e:b7:4f:45", "network": {"id": "a7f4226b-73fe-4265-ba2c-5d7dcdf154fd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1142462884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210837255c8148ec9b482ba3e2551362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6944a05-0a", "ovs_interfaceid": "f6944a05-0ad8-4f1a-b849-0dbb7732b739", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:05:25 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-261b4496-f8ac-4f07-8af1-5bc5f1c891be tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b7:4f:45,bridge_name='br-int',has_traffic_filtering=True,id=f6944a05-0ad8-4f1a-b849-0dbb7732b739,network=Network(a7f4226b-73fe-4265-ba2c-5d7dcdf154fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6944a05-0a') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:05:25 user nova-compute[72129]: DEBUG os_vif [None req-261b4496-f8ac-4f07-8af1-5bc5f1c891be tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:4f:45,bridge_name='br-int',has_traffic_filtering=True,id=f6944a05-0ad8-4f1a-b849-0dbb7732b739,network=Network(a7f4226b-73fe-4265-ba2c-5d7dcdf154fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6944a05-0a') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 14:05:25 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:05:25 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf6944a05-0a, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:05:25 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:05:25 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:05:25 user nova-compute[72129]: INFO os_vif [None req-261b4496-f8ac-4f07-8af1-5bc5f1c891be tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:4f:45,bridge_name='br-int',has_traffic_filtering=True,id=f6944a05-0ad8-4f1a-b849-0dbb7732b739,network=Network(a7f4226b-73fe-4265-ba2c-5d7dcdf154fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6944a05-0a')
Aug 01 14:05:25 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-261b4496-f8ac-4f07-8af1-5bc5f1c891be tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] calling os-brick to detach iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 14:05:25 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-261b4496-f8ac-4f07-8af1-5bc5f1c891be tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, {'target_iqns': ['iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MgpKnyzA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:05:25 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-261b4496-f8ac-4f07-8af1-5bc5f1c891be tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:05:25 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-261b4496-f8ac-4f07-8af1-5bc5f1c891be tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:05:25 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-261b4496-f8ac-4f07-8af1-5bc5f1c891be tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:05:25 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-261b4496-f8ac-4f07-8af1-5bc5f1c891be tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043', 0)] {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 14:05:25 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:25 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:25 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab40d218-8135-40f2-88c1-ddf69f11f731]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80a7dc25-351e-4c85-967a-ce6e0c8dc840\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:05:25 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:25 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:25 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea8fa60-d70f-4865-a3c2-d5f4f4d609e9]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a7dc25-351e-4c85-967a-ce6e0c8dc840 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:05:25 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-261b4496-f8ac-4f07-8af1-5bc5f1c891be tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:05:25 user nova-compute[72129]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)
Aug 01 14:05:25 user nova-compute[72129]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 (non-flash)
Aug 01 14:05:25 user nova-compute[72129]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 (non-flash)
Aug 01 14:05:25 user nova-compute[72129]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a7dc25-351e-4c85-967a-ce6e0c8dc840 (non-flash)
Aug 01 14:05:25 user nova-compute[72129]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)
Aug 01 14:05:25 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:05:25 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-261b4496-f8ac-4f07-8af1-5bc5f1c891be tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:05:25 user nova-compute[72129]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 (non-flash)
Aug 01 14:05:25 user nova-compute[72129]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 (non-flash)
Aug 01 14:05:25 user nova-compute[72129]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 (non-flash)
Aug 01 14:05:25 user nova-compute[72129]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a7dc25-351e-4c85-967a-ce6e0c8dc840 (non-flash)
Aug 01 14:05:25 user nova-compute[72129]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)
Aug 01 14:05:25 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:05:25 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-261b4496-f8ac-4f07-8af1-5bc5f1c891be tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f28201f4040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043'): ({'sdd'}, set())}) {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 14:05:25 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-261b4496-f8ac-4f07-8af1-5bc5f1c891be tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Removing single pathed devices sdd {{(pid=72129) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 14:05:25 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:25 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:25 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a70cd5-ba61-4ae9-ae00-aa43caf38c89]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:05:25 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:25 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:25 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d09f8aad-7509-405c-9fc4-5117474e677a]: (4, ('ok\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:05:25 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-261b4496-f8ac-4f07-8af1-5bc5f1c891be tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Flushing IO for device /dev/sdd {{(pid=72129) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 14:05:25 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:25 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:25 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e74b5a-54d3-4bcf-9f3a-c4035af4fab1]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:05:25 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-261b4496-f8ac-4f07-8af1-5bc5f1c891be tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72129) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 14:05:25 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:25 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.052s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:25 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f931c4-ea6a-465d-adeb-0ce453a4a0fd]: (4, ('1', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:05:25 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-261b4496-f8ac-4f07-8af1-5bc5f1c891be tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 14:05:25 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-261b4496-f8ac-4f07-8af1-5bc5f1c891be tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] SCSI volumes sdd have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 14:05:25 user nova-compute[72129]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO58a961a-7735c01286b34153', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_58a961a', '/dev/disk/by-id/scsi-23737333563303132') {{(pid=82887) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 01 14:05:25 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7307c1-5afc-4b32-8952-f4be25f16f61]: (4, None) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:05:25 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-261b4496-f8ac-4f07-8af1-5bc5f1c891be tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043')] {{(pid=72129) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 14:05:25 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:25 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:25 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[435cda26-fa79-48e7-a83d-709eb8bf0366]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:05:25 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-261b4496-f8ac-4f07-8af1-5bc5f1c891be tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:05:25 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 -p 172.16.0.220:3260 --logout {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:25 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:25 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0156c3e-13b9-4137-9e3c-0d3e6ba37567]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:05:25 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-261b4496-f8ac-4f07-8af1-5bc5f1c891be tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043, portal: 172.16.0.220,3260]
Aug 01 14:05:25 user nova-compute[72129]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043, portal: 172.16.0.220,3260] successful.
Aug 01 14:05:25 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:05:25 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 -p 172.16.0.220:3260 --op delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:25 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92501218-291d-42fd-bb6f-d9402326b043 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:25 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10dd7c0-239e-47c3-b169-5b816412773f]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:05:25 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-261b4496-f8ac-4f07-8af1-5bc5f1c891be tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:05:25 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-261b4496-f8ac-4f07-8af1-5bc5f1c891be tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:05:25 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-261b4496-f8ac-4f07-8af1-5bc5f1c891be tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] <== disconnect_volume: return (333ms) None {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:05:25 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-261b4496-f8ac-4f07-8af1-5bc5f1c891be tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] Disconnected iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 14:05:25 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-261b4496-f8ac-4f07-8af1-5bc5f1c891be tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] Deleting instance files /opt/stack/data/nova/instances/954db8d6-4806-43e6-8310-5d7f3437dc71_del
Aug 01 14:05:25 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-261b4496-f8ac-4f07-8af1-5bc5f1c891be tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] Deletion of /opt/stack/data/nova/instances/954db8d6-4806-43e6-8310-5d7f3437dc71_del complete
Aug 01 14:05:25 user nova-compute[72129]: INFO nova.compute.manager [None req-261b4496-f8ac-4f07-8af1-5bc5f1c891be tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] Took 1.19 seconds to destroy the instance on the hypervisor.
Aug 01 14:05:25 user nova-compute[72129]: DEBUG oslo.service.loopingcall [None req-261b4496-f8ac-4f07-8af1-5bc5f1c891be tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72129) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 14:05:25 user nova-compute[72129]: DEBUG nova.compute.manager [-] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] Deallocating network for instance {{(pid=72129) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 14:05:25 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] deallocate_for_instance() {{(pid=72129) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 14:05:25 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:05:26 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:05:26 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] Took 1.03 seconds to deallocate network for instance.
Aug 01 14:05:26 user nova-compute[72129]: DEBUG nova.compute.manager [req-c4e6de7d-8aef-425f-bbec-51d10bdc8c8e req-a7f4fabf-7591-49a9-a843-9a54554cf295 service nova] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] Received event network-vif-deleted-f6944a05-0ad8-4f1a-b849-0dbb7732b739 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:05:26 user nova-compute[72129]: INFO nova.compute.manager [req-c4e6de7d-8aef-425f-bbec-51d10bdc8c8e req-a7f4fabf-7591-49a9-a843-9a54554cf295 service nova] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] Neutron deleted interface f6944a05-0ad8-4f1a-b849-0dbb7732b739; detaching it from the instance and deleting it from the info cache
Aug 01 14:05:26 user nova-compute[72129]: DEBUG nova.network.neutron [req-c4e6de7d-8aef-425f-bbec-51d10bdc8c8e req-a7f4fabf-7591-49a9-a843-9a54554cf295 service nova] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:05:26 user nova-compute[72129]: DEBUG nova.compute.manager [req-c4e6de7d-8aef-425f-bbec-51d10bdc8c8e req-a7f4fabf-7591-49a9-a843-9a54554cf295 service nova] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] Detach interface failed, port_id=f6944a05-0ad8-4f1a-b849-0dbb7732b739, reason: Instance 954db8d6-4806-43e6-8310-5d7f3437dc71 could not be found. {{(pid=72129) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 14:05:26 user nova-compute[72129]: DEBUG nova.compute.manager [req-9d010372-3ed5-44fd-96cc-388c9d7f6077 req-de2a6344-d166-44e7-b581-0384641e2a22 service nova] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] Received event network-vif-plugged-f6944a05-0ad8-4f1a-b849-0dbb7732b739 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:05:26 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-9d010372-3ed5-44fd-96cc-388c9d7f6077 req-de2a6344-d166-44e7-b581-0384641e2a22 service nova] Acquiring lock "954db8d6-4806-43e6-8310-5d7f3437dc71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:05:26 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-9d010372-3ed5-44fd-96cc-388c9d7f6077 req-de2a6344-d166-44e7-b581-0384641e2a22 service nova] Lock "954db8d6-4806-43e6-8310-5d7f3437dc71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:05:26 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-9d010372-3ed5-44fd-96cc-388c9d7f6077 req-de2a6344-d166-44e7-b581-0384641e2a22 service nova] Lock "954db8d6-4806-43e6-8310-5d7f3437dc71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:05:26 user nova-compute[72129]: DEBUG nova.compute.manager [req-9d010372-3ed5-44fd-96cc-388c9d7f6077 req-de2a6344-d166-44e7-b581-0384641e2a22 service nova] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] No waiting events found dispatching network-vif-plugged-f6944a05-0ad8-4f1a-b849-0dbb7732b739 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:05:26 user nova-compute[72129]: WARNING nova.compute.manager [req-9d010372-3ed5-44fd-96cc-388c9d7f6077 req-de2a6344-d166-44e7-b581-0384641e2a22 service nova] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] Received unexpected event network-vif-plugged-f6944a05-0ad8-4f1a-b849-0dbb7732b739 for instance with vm_state active and task_state deleting.
Aug 01 14:05:27 user nova-compute[72129]: INFO nova.compute.manager [None req-261b4496-f8ac-4f07-8af1-5bc5f1c891be tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] Took 0.72 seconds to detach 1 volumes for instance.
Aug 01 14:05:27 user nova-compute[72129]: DEBUG nova.compute.manager [None req-261b4496-f8ac-4f07-8af1-5bc5f1c891be tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] Deleting volume: 92501218-291d-42fd-bb6f-d9402326b043 {{(pid=72129) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 01 14:05:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-261b4496-f8ac-4f07-8af1-5bc5f1c891be tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:05:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-261b4496-f8ac-4f07-8af1-5bc5f1c891be tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:05:27 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-261b4496-f8ac-4f07-8af1-5bc5f1c891be tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:05:27 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-261b4496-f8ac-4f07-8af1-5bc5f1c891be tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:05:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-261b4496-f8ac-4f07-8af1-5bc5f1c891be tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.341s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:05:27 user nova-compute[72129]: INFO nova.scheduler.client.report [None req-261b4496-f8ac-4f07-8af1-5bc5f1c891be tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Deleted allocations for instance 954db8d6-4806-43e6-8310-5d7f3437dc71
Aug 01 14:05:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-261b4496-f8ac-4f07-8af1-5bc5f1c891be tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "954db8d6-4806-43e6-8310-5d7f3437dc71" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.522s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:05:30 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:05:30 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:05:31 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-3f4acb72-458c-457d-b41f-603c6e476c37 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Acquiring lock "3891b9d3-832d-4ef7-8ebb-970ddd0a387a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:05:31 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-3f4acb72-458c-457d-b41f-603c6e476c37 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lock "3891b9d3-832d-4ef7-8ebb-970ddd0a387a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:05:31 user nova-compute[72129]: INFO nova.compute.manager [None req-3f4acb72-458c-457d-b41f-603c6e476c37 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Detaching volume 80a7dc25-351e-4c85-967a-ce6e0c8dc840
Aug 01 14:05:31 user nova-compute[72129]: INFO nova.virt.block_device [None req-3f4acb72-458c-457d-b41f-603c6e476c37 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Attempting to driver detach volume 80a7dc25-351e-4c85-967a-ce6e0c8dc840 from mountpoint /dev/vdc
Aug 01 14:05:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-3f4acb72-458c-457d-b41f-603c6e476c37 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Attempting to detach device vdc from instance 3891b9d3-832d-4ef7-8ebb-970ddd0a387a from the persistent domain config. {{(pid=72129) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 14:05:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-3f4acb72-458c-457d-b41f-603c6e476c37 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 14:05:31 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:05:31 user nova-compute[72129]:   <source dev="/dev/sde"/>
Aug 01 14:05:31 user nova-compute[72129]:   <target dev="vdc" bus="virtio"/>
Aug 01 14:05:31 user nova-compute[72129]:   <serial>80a7dc25-351e-4c85-967a-ce6e0c8dc840</serial>
Aug 01 14:05:31 user nova-compute[72129]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 01 14:05:31 user nova-compute[72129]: </disk>
Aug 01 14:05:31 user nova-compute[72129]:  {{(pid=72129) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 14:05:31 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-3f4acb72-458c-457d-b41f-603c6e476c37 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Successfully detached device vdc from instance 3891b9d3-832d-4ef7-8ebb-970ddd0a387a from the persistent domain config.
Aug 01 14:05:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-3f4acb72-458c-457d-b41f-603c6e476c37 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 3891b9d3-832d-4ef7-8ebb-970ddd0a387a from the live domain config. {{(pid=72129) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 14:05:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-3f4acb72-458c-457d-b41f-603c6e476c37 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 14:05:31 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:05:31 user nova-compute[72129]:   <source dev="/dev/sde"/>
Aug 01 14:05:31 user nova-compute[72129]:   <target dev="vdc" bus="virtio"/>
Aug 01 14:05:31 user nova-compute[72129]:   <serial>80a7dc25-351e-4c85-967a-ce6e0c8dc840</serial>
Aug 01 14:05:31 user nova-compute[72129]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 01 14:05:31 user nova-compute[72129]: </disk>
Aug 01 14:05:31 user nova-compute[72129]:  {{(pid=72129) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 14:05:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Received event <DeviceRemovedEvent: 1690898731.8928983, 3891b9d3-832d-4ef7-8ebb-970ddd0a387a => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72129) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 14:05:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-3f4acb72-458c-457d-b41f-603c6e476c37 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 3891b9d3-832d-4ef7-8ebb-970ddd0a387a {{(pid=72129) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 14:05:31 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-3f4acb72-458c-457d-b41f-603c6e476c37 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Successfully detached device vdc from instance 3891b9d3-832d-4ef7-8ebb-970ddd0a387a from the live domain config.
Aug 01 14:05:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f4acb72-458c-457d-b41f-603c6e476c37 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] calling os-brick to detach iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 14:05:31 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f4acb72-458c-457d-b41f-603c6e476c37 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, {'target_iqns': ['iqn.2010-10.org.openstack:80a7dc25-351e-4c85-967a-ce6e0c8dc840'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gLMdfUJj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:05:31 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-3f4acb72-458c-457d-b41f-603c6e476c37 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:05:31 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-3f4acb72-458c-457d-b41f-603c6e476c37 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:05:31 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-3f4acb72-458c-457d-b41f-603c6e476c37 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:05:31 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f4acb72-458c-457d-b41f-603c6e476c37 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80a7dc25-351e-4c85-967a-ce6e0c8dc840', 0)] {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 14:05:31 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:31 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:31 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[9922279f-b042-4672-bd29-719d4256841f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80a7dc25-351e-4c85-967a-ce6e0c8dc840\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:05:31 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:31 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:31 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ce4135-94c3-464a-b8c4-8b62ebc8291b]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a7dc25-351e-4c85-967a-ce6e0c8dc840 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:05:31 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f4acb72-458c-457d-b41f-603c6e476c37 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:05:31 user nova-compute[72129]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 (non-flash)
Aug 01 14:05:31 user nova-compute[72129]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 (non-flash)
Aug 01 14:05:31 user nova-compute[72129]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a7dc25-351e-4c85-967a-ce6e0c8dc840 (non-flash)
Aug 01 14:05:31 user nova-compute[72129]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)
Aug 01 14:05:31 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:05:31 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f4acb72-458c-457d-b41f-603c6e476c37 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:05:31 user nova-compute[72129]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 (non-flash)
Aug 01 14:05:31 user nova-compute[72129]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 (non-flash)
Aug 01 14:05:31 user nova-compute[72129]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a7dc25-351e-4c85-967a-ce6e0c8dc840 (non-flash)
Aug 01 14:05:31 user nova-compute[72129]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)
Aug 01 14:05:31 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:05:31 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f4acb72-458c-457d-b41f-603c6e476c37 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f28105bae60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80a7dc25-351e-4c85-967a-ce6e0c8dc840'): ({'sde'}, set())}) {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 14:05:31 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-3f4acb72-458c-457d-b41f-603c6e476c37 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Removing single pathed devices sde {{(pid=72129) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 14:05:31 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:31 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:31 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f5c91ee-9206-4edf-8c06-f65640843d31]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:05:31 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:32 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[60037aa1-49d0-41f8-a187-bd9542a03639]: (4, ('ok\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:05:32 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-3f4acb72-458c-457d-b41f-603c6e476c37 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Flushing IO for device /dev/sde {{(pid=72129) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 14:05:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:32 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d1671d-1b8e-4d68-9f0a-2fcc8a102bcf]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:05:32 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-3f4acb72-458c-457d-b41f-603c6e476c37 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72129) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 14:05:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.054s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:32 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77b7089-45d0-479b-85d9-2a1faf91c6a9]: (4, ('1', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:05:32 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-3f4acb72-458c-457d-b41f-603c6e476c37 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 14:05:32 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-3f4acb72-458c-457d-b41f-603c6e476c37 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] SCSI volumes sde have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 14:05:32 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f4acb72-458c-457d-b41f-603c6e476c37 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80a7dc25-351e-4c85-967a-ce6e0c8dc840')] {{(pid=72129) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 14:05:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a7dc25-351e-4c85-967a-ce6e0c8dc840 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a7dc25-351e-4c85-967a-ce6e0c8dc840 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:32 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7549de4-3c53-44b7-8e91-e65e0fc2192f]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:05:32 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f4acb72-458c-457d-b41f-603c6e476c37 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:05:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a7dc25-351e-4c85-967a-ce6e0c8dc840 -p 172.16.0.220:3260 --logout {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a7dc25-351e-4c85-967a-ce6e0c8dc840 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:32 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c9250c-d5ef-4913-b48c-9975f7bca8ea]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:80a7dc25-351e-4c85-967a-ce6e0c8dc840, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:80a7dc25-351e-4c85-967a-ce6e0c8dc840, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:05:32 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f4acb72-458c-457d-b41f-603c6e476c37 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:80a7dc25-351e-4c85-967a-ce6e0c8dc840, portal: 172.16.0.220,3260]
Aug 01 14:05:32 user nova-compute[72129]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:80a7dc25-351e-4c85-967a-ce6e0c8dc840, portal: 172.16.0.220,3260] successful.
Aug 01 14:05:32 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:05:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a7dc25-351e-4c85-967a-ce6e0c8dc840 -p 172.16.0.220:3260 --op delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a7dc25-351e-4c85-967a-ce6e0c8dc840 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:32 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[63758bfa-3c9e-467a-a41c-e07c4bf0ae71]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:05:32 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f4acb72-458c-457d-b41f-603c6e476c37 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:05:32 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-3f4acb72-458c-457d-b41f-603c6e476c37 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:05:32 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f4acb72-458c-457d-b41f-603c6e476c37 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] <== disconnect_volume: return (319ms) None {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:05:32 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f4acb72-458c-457d-b41f-603c6e476c37 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Disconnected iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 14:05:32 user nova-compute[72129]: DEBUG nova.objects.instance [None req-3f4acb72-458c-457d-b41f-603c6e476c37 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lazy-loading 'flavor' on Instance uuid 3891b9d3-832d-4ef7-8ebb-970ddd0a387a {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:05:33 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-3f4acb72-458c-457d-b41f-603c6e476c37 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lock "3891b9d3-832d-4ef7-8ebb-970ddd0a387a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.660s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:05:33 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Acquiring lock "418f4c53-9dc5-402f-ad21-ac481674b083" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:05:33 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "418f4c53-9dc5-402f-ad21-ac481674b083" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:05:33 user nova-compute[72129]: DEBUG nova.compute.manager [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Starting instance... {{(pid=72129) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 14:05:33 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:05:33 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:05:33 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72129) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 14:05:33 user nova-compute[72129]: INFO nova.compute.claims [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Claim successful on node user
Aug 01 14:05:33 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:05:33 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:05:33 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.608s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:05:33 user nova-compute[72129]: DEBUG nova.compute.manager [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Start building networks asynchronously for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 14:05:34 user nova-compute[72129]: DEBUG nova.compute.manager [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Allocating IP information in the background. {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 14:05:34 user nova-compute[72129]: DEBUG nova.network.neutron [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] allocate_for_instance() {{(pid=72129) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 14:05:34 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 14:05:34 user nova-compute[72129]: DEBUG nova.compute.manager [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Start building block device mappings for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 14:05:34 user nova-compute[72129]: INFO nova.virt.block_device [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Booting with volume-backed-image b6472c34-1b0f-4034-ba3a-7e8eb5103715 at /dev/vda
Aug 01 14:05:34 user nova-compute[72129]: DEBUG nova.policy [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cdb6f66592fe4cdebea02e5f5c1f4a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0929886fa54d1c8023793806f10d31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72129) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 14:05:34 user nova-compute[72129]: DEBUG nova.network.neutron [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Successfully created port: df042689-7692-445c-89d8-cc6d908dd216 {{(pid=72129) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 14:05:35 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:05:35 user nova-compute[72129]: DEBUG nova.network.neutron [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Successfully updated port: df042689-7692-445c-89d8-cc6d908dd216 {{(pid=72129) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 14:05:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Acquiring lock "refresh_cache-418f4c53-9dc5-402f-ad21-ac481674b083" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:05:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Acquired lock "refresh_cache-418f4c53-9dc5-402f-ad21-ac481674b083" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:05:35 user nova-compute[72129]: DEBUG nova.network.neutron [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 14:05:35 user nova-compute[72129]: DEBUG nova.compute.manager [req-123b5913-10f2-4b8c-a006-ea2ff6bab2b5 req-d22e4dcd-10a5-4576-84d0-d619e330ba08 service nova] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Received event network-changed-df042689-7692-445c-89d8-cc6d908dd216 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:05:35 user nova-compute[72129]: DEBUG nova.compute.manager [req-123b5913-10f2-4b8c-a006-ea2ff6bab2b5 req-d22e4dcd-10a5-4576-84d0-d619e330ba08 service nova] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Refreshing instance network info cache due to event network-changed-df042689-7692-445c-89d8-cc6d908dd216. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 14:05:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-123b5913-10f2-4b8c-a006-ea2ff6bab2b5 req-d22e4dcd-10a5-4576-84d0-d619e330ba08 service nova] Acquiring lock "refresh_cache-418f4c53-9dc5-402f-ad21-ac481674b083" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:05:35 user nova-compute[72129]: DEBUG nova.network.neutron [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Instance cache missing network info. {{(pid=72129) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 14:05:35 user nova-compute[72129]: DEBUG nova.network.neutron [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Updating instance_info_cache with network_info: [{"id": "df042689-7692-445c-89d8-cc6d908dd216", "address": "fa:16:3e:33:ea:dd", "network": {"id": "59b1e538-8bfe-45ce-ab7b-c5838ab25582", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1129024349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0929886fa54d1c8023793806f10d31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf042689-76", "ovs_interfaceid": "df042689-7692-445c-89d8-cc6d908dd216", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:05:35 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:05:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Releasing lock "refresh_cache-418f4c53-9dc5-402f-ad21-ac481674b083" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:05:35 user nova-compute[72129]: DEBUG nova.compute.manager [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Instance network_info: |[{"id": "df042689-7692-445c-89d8-cc6d908dd216", "address": "fa:16:3e:33:ea:dd", "network": {"id": "59b1e538-8bfe-45ce-ab7b-c5838ab25582", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1129024349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0929886fa54d1c8023793806f10d31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf042689-76", "ovs_interfaceid": "df042689-7692-445c-89d8-cc6d908dd216", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 14:05:36 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-123b5913-10f2-4b8c-a006-ea2ff6bab2b5 req-d22e4dcd-10a5-4576-84d0-d619e330ba08 service nova] Acquired lock "refresh_cache-418f4c53-9dc5-402f-ad21-ac481674b083" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:05:36 user nova-compute[72129]: DEBUG nova.network.neutron [req-123b5913-10f2-4b8c-a006-ea2ff6bab2b5 req-d22e4dcd-10a5-4576-84d0-d619e330ba08 service nova] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Refreshing network info cache for port df042689-7692-445c-89d8-cc6d908dd216 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 14:05:36 user nova-compute[72129]: DEBUG nova.network.neutron [req-123b5913-10f2-4b8c-a006-ea2ff6bab2b5 req-d22e4dcd-10a5-4576-84d0-d619e330ba08 service nova] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Updated VIF entry in instance network info cache for port df042689-7692-445c-89d8-cc6d908dd216. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 14:05:36 user nova-compute[72129]: DEBUG nova.network.neutron [req-123b5913-10f2-4b8c-a006-ea2ff6bab2b5 req-d22e4dcd-10a5-4576-84d0-d619e330ba08 service nova] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Updating instance_info_cache with network_info: [{"id": "df042689-7692-445c-89d8-cc6d908dd216", "address": "fa:16:3e:33:ea:dd", "network": {"id": "59b1e538-8bfe-45ce-ab7b-c5838ab25582", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1129024349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0929886fa54d1c8023793806f10d31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf042689-76", "ovs_interfaceid": "df042689-7692-445c-89d8-cc6d908dd216", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:05:36 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-123b5913-10f2-4b8c-a006-ea2ff6bab2b5 req-d22e4dcd-10a5-4576-84d0-d619e330ba08 service nova] Releasing lock "refresh_cache-418f4c53-9dc5-402f-ad21-ac481674b083" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:05:40 user nova-compute[72129]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690898725.068677, 954db8d6-4806-43e6-8310-5d7f3437dc71 => Stopped> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:05:40 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] VM Stopped (Lifecycle Event)
Aug 01 14:05:40 user nova-compute[72129]: DEBUG nova.compute.manager [None req-f5c79778-c727-43ec-9986-346d200bbd0a None None] [instance: 954db8d6-4806-43e6-8310-5d7f3437dc71] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:05:40 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:05:40 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d7e22c7e-8976-4406-bebd-b5cb2c14da66 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Acquiring lock "e4a13a50-fe03-41aa-94f4-3431805ff481" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:05:40 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d7e22c7e-8976-4406-bebd-b5cb2c14da66 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "e4a13a50-fe03-41aa-94f4-3431805ff481" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:05:40 user nova-compute[72129]: DEBUG nova.compute.manager [None req-d7e22c7e-8976-4406-bebd-b5cb2c14da66 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Going to confirm migration 2 {{(pid=72129) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Aug 01 14:05:40 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:05:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d7e22c7e-8976-4406-bebd-b5cb2c14da66 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Acquiring lock "refresh_cache-e4a13a50-fe03-41aa-94f4-3431805ff481" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:05:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d7e22c7e-8976-4406-bebd-b5cb2c14da66 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Acquired lock "refresh_cache-e4a13a50-fe03-41aa-94f4-3431805ff481" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:05:41 user nova-compute[72129]: DEBUG nova.network.neutron [None req-d7e22c7e-8976-4406-bebd-b5cb2c14da66 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 14:05:41 user nova-compute[72129]: DEBUG nova.objects.instance [None req-d7e22c7e-8976-4406-bebd-b5cb2c14da66 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lazy-loading 'info_cache' on Instance uuid e4a13a50-fe03-41aa-94f4-3431805ff481 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:05:41 user nova-compute[72129]: DEBUG nova.network.neutron [None req-d7e22c7e-8976-4406-bebd-b5cb2c14da66 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Updating instance_info_cache with network_info: [{"id": "a36283e1-929d-4806-ba5f-175f99f44e98", "address": "fa:16:3e:28:9b:e7", "network": {"id": "4b93ad92-9a3a-4472-ba6c-d215329da98b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-734108983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0e85d9b73a546dc95e0ace26233f2a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36283e1-92", "ovs_interfaceid": "a36283e1-929d-4806-ba5f-175f99f44e98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:05:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d7e22c7e-8976-4406-bebd-b5cb2c14da66 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Releasing lock "refresh_cache-e4a13a50-fe03-41aa-94f4-3431805ff481" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:05:41 user nova-compute[72129]: DEBUG nova.objects.instance [None req-d7e22c7e-8976-4406-bebd-b5cb2c14da66 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lazy-loading 'migration_context' on Instance uuid e4a13a50-fe03-41aa-94f4-3431805ff481 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:05:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d7e22c7e-8976-4406-bebd-b5cb2c14da66 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:05:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d7e22c7e-8976-4406-bebd-b5cb2c14da66 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:05:41 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-d7e22c7e-8976-4406-bebd-b5cb2c14da66 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:05:41 user nova-compute[72129]: INFO nova.compute.manager [None req-983dd59d-c0d4-4c77-998e-d754732d1426 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Unrescuing
Aug 01 14:05:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-983dd59d-c0d4-4c77-998e-d754732d1426 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Acquiring lock "refresh_cache-ea050cd6-60e9-41fd-a35c-05fe63d60e57" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:05:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-983dd59d-c0d4-4c77-998e-d754732d1426 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Acquired lock "refresh_cache-ea050cd6-60e9-41fd-a35c-05fe63d60e57" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:05:41 user nova-compute[72129]: DEBUG nova.network.neutron [None req-983dd59d-c0d4-4c77-998e-d754732d1426 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 14:05:41 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-d7e22c7e-8976-4406-bebd-b5cb2c14da66 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:05:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d7e22c7e-8976-4406-bebd-b5cb2c14da66 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.387s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:05:42 user nova-compute[72129]: INFO nova.scheduler.client.report [None req-d7e22c7e-8976-4406-bebd-b5cb2c14da66 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Deleted allocation for migration bd6701cb-6cc9-4417-a952-70fff9896df6
Aug 01 14:05:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d7e22c7e-8976-4406-bebd-b5cb2c14da66 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "e4a13a50-fe03-41aa-94f4-3431805ff481" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.350s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:05:42 user nova-compute[72129]: DEBUG nova.network.neutron [None req-983dd59d-c0d4-4c77-998e-d754732d1426 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Updating instance_info_cache with network_info: [{"id": "fe1f3453-e3ae-494c-965a-c20868179163", "address": "fa:16:3e:d8:46:16", "network": {"id": "ce187b11-5e3e-45a9-af0f-0be815ad0a3d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1245856112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0a13467840342f281bd8b8e115eccaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1f3453-e3", "ovs_interfaceid": "fe1f3453-e3ae-494c-965a-c20868179163", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:05:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-983dd59d-c0d4-4c77-998e-d754732d1426 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Releasing lock "refresh_cache-ea050cd6-60e9-41fd-a35c-05fe63d60e57" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:05:42 user nova-compute[72129]: DEBUG nova.objects.instance [None req-983dd59d-c0d4-4c77-998e-d754732d1426 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Lazy-loading 'flavor' on Instance uuid ea050cd6-60e9-41fd-a35c-05fe63d60e57 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:05:42 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:05:42 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:05:42 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:05:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:05:43 user nova-compute[72129]: DEBUG nova.compute.manager [req-e6686295-0024-4473-a27e-2a041dc3c45e req-ebe23e33-ea11-4653-8b36-7b90f975ac8e service nova] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Received event network-vif-unplugged-fe1f3453-e3ae-494c-965a-c20868179163 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:05:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-e6686295-0024-4473-a27e-2a041dc3c45e req-ebe23e33-ea11-4653-8b36-7b90f975ac8e service nova] Acquiring lock "ea050cd6-60e9-41fd-a35c-05fe63d60e57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:05:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-e6686295-0024-4473-a27e-2a041dc3c45e req-ebe23e33-ea11-4653-8b36-7b90f975ac8e service nova] Lock "ea050cd6-60e9-41fd-a35c-05fe63d60e57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:05:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-e6686295-0024-4473-a27e-2a041dc3c45e req-ebe23e33-ea11-4653-8b36-7b90f975ac8e service nova] Lock "ea050cd6-60e9-41fd-a35c-05fe63d60e57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:05:43 user nova-compute[72129]: DEBUG nova.compute.manager [req-e6686295-0024-4473-a27e-2a041dc3c45e req-ebe23e33-ea11-4653-8b36-7b90f975ac8e service nova] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] No waiting events found dispatching network-vif-unplugged-fe1f3453-e3ae-494c-965a-c20868179163 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:05:43 user nova-compute[72129]: WARNING nova.compute.manager [req-e6686295-0024-4473-a27e-2a041dc3c45e req-ebe23e33-ea11-4653-8b36-7b90f975ac8e service nova] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Received unexpected event network-vif-unplugged-fe1f3453-e3ae-494c-965a-c20868179163 for instance with vm_state rescued and task_state unrescuing.
Aug 01 14:05:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:05:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:05:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:05:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:05:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:05:43 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Instance destroyed successfully.
Aug 01 14:05:43 user nova-compute[72129]: DEBUG nova.compute.manager [req-b8adcae0-aea2-426d-b749-fd6a94809b45 req-7c804bb3-814c-452f-83a5-13acc6b1de80 service nova] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Received event network-changed-fe1f3453-e3ae-494c-965a-c20868179163 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:05:43 user nova-compute[72129]: DEBUG nova.compute.manager [req-b8adcae0-aea2-426d-b749-fd6a94809b45 req-7c804bb3-814c-452f-83a5-13acc6b1de80 service nova] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Refreshing instance network info cache due to event network-changed-fe1f3453-e3ae-494c-965a-c20868179163. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 14:05:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-b8adcae0-aea2-426d-b749-fd6a94809b45 req-7c804bb3-814c-452f-83a5-13acc6b1de80 service nova] Acquiring lock "refresh_cache-ea050cd6-60e9-41fd-a35c-05fe63d60e57" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:05:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-b8adcae0-aea2-426d-b749-fd6a94809b45 req-7c804bb3-814c-452f-83a5-13acc6b1de80 service nova] Acquired lock "refresh_cache-ea050cd6-60e9-41fd-a35c-05fe63d60e57" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:05:43 user nova-compute[72129]: DEBUG nova.network.neutron [req-b8adcae0-aea2-426d-b749-fd6a94809b45 req-7c804bb3-814c-452f-83a5-13acc6b1de80 service nova] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Refreshing network info cache for port fe1f3453-e3ae-494c-965a-c20868179163 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 14:05:44 user nova-compute[72129]: DEBUG nova.network.neutron [req-b8adcae0-aea2-426d-b749-fd6a94809b45 req-7c804bb3-814c-452f-83a5-13acc6b1de80 service nova] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Updated VIF entry in instance network info cache for port fe1f3453-e3ae-494c-965a-c20868179163. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 14:05:44 user nova-compute[72129]: DEBUG nova.network.neutron [req-b8adcae0-aea2-426d-b749-fd6a94809b45 req-7c804bb3-814c-452f-83a5-13acc6b1de80 service nova] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Updating instance_info_cache with network_info: [{"id": "fe1f3453-e3ae-494c-965a-c20868179163", "address": "fa:16:3e:d8:46:16", "network": {"id": "ce187b11-5e3e-45a9-af0f-0be815ad0a3d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1245856112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0a13467840342f281bd8b8e115eccaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1f3453-e3", "ovs_interfaceid": "fe1f3453-e3ae-494c-965a-c20868179163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:05:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-b8adcae0-aea2-426d-b749-fd6a94809b45 req-7c804bb3-814c-452f-83a5-13acc6b1de80 service nova] Releasing lock "refresh_cache-ea050cd6-60e9-41fd-a35c-05fe63d60e57" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:05:44 user nova-compute[72129]: DEBUG nova.compute.manager [req-6afff289-b923-440a-a746-f05ca0e77f44 req-ad62686f-e085-41c4-8199-3f956dca6adc service nova] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Received event network-changed-b5a06a08-bb00-4551-afd4-09ad16fe0837 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:05:44 user nova-compute[72129]: DEBUG nova.compute.manager [req-6afff289-b923-440a-a746-f05ca0e77f44 req-ad62686f-e085-41c4-8199-3f956dca6adc service nova] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Refreshing instance network info cache due to event network-changed-b5a06a08-bb00-4551-afd4-09ad16fe0837. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 14:05:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-6afff289-b923-440a-a746-f05ca0e77f44 req-ad62686f-e085-41c4-8199-3f956dca6adc service nova] Acquiring lock "refresh_cache-85062e35-e302-46f7-8d66-24cf9e7199f7" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:05:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-6afff289-b923-440a-a746-f05ca0e77f44 req-ad62686f-e085-41c4-8199-3f956dca6adc service nova] Acquired lock "refresh_cache-85062e35-e302-46f7-8d66-24cf9e7199f7" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:05:44 user nova-compute[72129]: DEBUG nova.network.neutron [req-6afff289-b923-440a-a746-f05ca0e77f44 req-ad62686f-e085-41c4-8199-3f956dca6adc service nova] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Refreshing network info cache for port b5a06a08-bb00-4551-afd4-09ad16fe0837 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 14:05:44 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:05:44 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:05:44 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:05:44 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:05:44 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:05:44 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:05:44 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:05:44 user nova-compute[72129]: DEBUG nova.network.neutron [req-6afff289-b923-440a-a746-f05ca0e77f44 req-ad62686f-e085-41c4-8199-3f956dca6adc service nova] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Updated VIF entry in instance network info cache for port b5a06a08-bb00-4551-afd4-09ad16fe0837. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 14:05:44 user nova-compute[72129]: DEBUG nova.network.neutron [req-6afff289-b923-440a-a746-f05ca0e77f44 req-ad62686f-e085-41c4-8199-3f956dca6adc service nova] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Updating instance_info_cache with network_info: [{"id": "b5a06a08-bb00-4551-afd4-09ad16fe0837", "address": "fa:16:3e:9d:bc:ca", "network": {"id": "a7ec6cc0-140b-446b-ae97-d4aafbc42693", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-397303278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43253b37caa747b090b14c707abf96cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5a06a08-bb", "ovs_interfaceid": "b5a06a08-bb00-4551-afd4-09ad16fe0837", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:05:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-6afff289-b923-440a-a746-f05ca0e77f44 req-ad62686f-e085-41c4-8199-3f956dca6adc service nova] Releasing lock "refresh_cache-85062e35-e302-46f7-8d66-24cf9e7199f7" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:05:44 user nova-compute[72129]: DEBUG os_brick.utils [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:05:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:44 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb10fc5c-9b91-4745-8c9e-0a6b107d4f60]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f9b449c2cd3d\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:05:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:44 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a543747a-a65b-46e9-a80e-d9791f059351]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:05:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:44 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea9459d-353a-4ac8-967b-aa58a3d85854]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:05:44 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:05:44 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[0152cad9-1c85-4c8a-9b33-c1eee14238fd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:05:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Running cmd (subprocess): nvme version {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] 'nvme version' failed. Not Retrying. {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 14:05:44 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:05:44 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.nvmeof [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] nvme not present on system {{(pid=72129) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 14:05:44 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:05:44 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:45 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:05:45 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 14:05:45 user nova-compute[72129]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 14:05:45 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[cccfda66-f882-4918-ab4d-3d2d6801a44d]: (4, '') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:05:45 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72129) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 14:05:45 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 14:05:45 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] LIGHTOS: no hostnqn found. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 14:05:45 user nova-compute[72129]: DEBUG os_brick.utils [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f9b449c2cd3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:05:45 user nova-compute[72129]: DEBUG nova.virt.block_device [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Updating existing volume attachment record: 5d81d68c-d390-43e4-bfea-3eb24d836ed1 {{(pid=72129) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 14:05:45 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:05:45 user nova-compute[72129]: DEBUG nova.compute.manager [req-3a79bc86-a91f-4e8b-8d66-79a18353b83d req-80f27a23-f0b1-42e8-885d-0317f76d4f22 service nova] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Received event network-vif-plugged-fe1f3453-e3ae-494c-965a-c20868179163 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:05:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-3a79bc86-a91f-4e8b-8d66-79a18353b83d req-80f27a23-f0b1-42e8-885d-0317f76d4f22 service nova] Acquiring lock "ea050cd6-60e9-41fd-a35c-05fe63d60e57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:05:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-3a79bc86-a91f-4e8b-8d66-79a18353b83d req-80f27a23-f0b1-42e8-885d-0317f76d4f22 service nova] Lock "ea050cd6-60e9-41fd-a35c-05fe63d60e57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:05:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-3a79bc86-a91f-4e8b-8d66-79a18353b83d req-80f27a23-f0b1-42e8-885d-0317f76d4f22 service nova] Lock "ea050cd6-60e9-41fd-a35c-05fe63d60e57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:05:45 user nova-compute[72129]: DEBUG nova.compute.manager [req-3a79bc86-a91f-4e8b-8d66-79a18353b83d req-80f27a23-f0b1-42e8-885d-0317f76d4f22 service nova] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] No waiting events found dispatching network-vif-plugged-fe1f3453-e3ae-494c-965a-c20868179163 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:05:45 user nova-compute[72129]: WARNING nova.compute.manager [req-3a79bc86-a91f-4e8b-8d66-79a18353b83d req-80f27a23-f0b1-42e8-885d-0317f76d4f22 service nova] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Received unexpected event network-vif-plugged-fe1f3453-e3ae-494c-965a-c20868179163 for instance with vm_state rescued and task_state unrescuing.
Aug 01 14:05:45 user nova-compute[72129]: DEBUG nova.compute.manager [req-3a79bc86-a91f-4e8b-8d66-79a18353b83d req-80f27a23-f0b1-42e8-885d-0317f76d4f22 service nova] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Received event network-vif-plugged-fe1f3453-e3ae-494c-965a-c20868179163 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:05:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-3a79bc86-a91f-4e8b-8d66-79a18353b83d req-80f27a23-f0b1-42e8-885d-0317f76d4f22 service nova] Acquiring lock "ea050cd6-60e9-41fd-a35c-05fe63d60e57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:05:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-3a79bc86-a91f-4e8b-8d66-79a18353b83d req-80f27a23-f0b1-42e8-885d-0317f76d4f22 service nova] Lock "ea050cd6-60e9-41fd-a35c-05fe63d60e57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:05:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-3a79bc86-a91f-4e8b-8d66-79a18353b83d req-80f27a23-f0b1-42e8-885d-0317f76d4f22 service nova] Lock "ea050cd6-60e9-41fd-a35c-05fe63d60e57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:05:45 user nova-compute[72129]: DEBUG nova.compute.manager [req-3a79bc86-a91f-4e8b-8d66-79a18353b83d req-80f27a23-f0b1-42e8-885d-0317f76d4f22 service nova] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] No waiting events found dispatching network-vif-plugged-fe1f3453-e3ae-494c-965a-c20868179163 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:05:45 user nova-compute[72129]: WARNING nova.compute.manager [req-3a79bc86-a91f-4e8b-8d66-79a18353b83d req-80f27a23-f0b1-42e8-885d-0317f76d4f22 service nova] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Received unexpected event network-vif-plugged-fe1f3453-e3ae-494c-965a-c20868179163 for instance with vm_state rescued and task_state unrescuing.
Aug 01 14:05:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-04e069e4-5d45-4089-b74c-8552e96cbd41 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Acquiring lock "85062e35-e302-46f7-8d66-24cf9e7199f7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:05:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-04e069e4-5d45-4089-b74c-8552e96cbd41 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lock "85062e35-e302-46f7-8d66-24cf9e7199f7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:05:45 user nova-compute[72129]: INFO nova.compute.manager [None req-04e069e4-5d45-4089-b74c-8552e96cbd41 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Detaching volume 0a025412-1d03-4a7a-97d4-0c8c20b2bde3
Aug 01 14:05:45 user nova-compute[72129]: INFO nova.virt.block_device [None req-04e069e4-5d45-4089-b74c-8552e96cbd41 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Attempting to driver detach volume 0a025412-1d03-4a7a-97d4-0c8c20b2bde3 from mountpoint /dev/vdb
Aug 01 14:05:45 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-04e069e4-5d45-4089-b74c-8552e96cbd41 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Attempting to detach device vdb from instance 85062e35-e302-46f7-8d66-24cf9e7199f7 from the persistent domain config. {{(pid=72129) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 14:05:45 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-04e069e4-5d45-4089-b74c-8552e96cbd41 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 14:05:45 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:05:45 user nova-compute[72129]:   <source dev="/dev/sdb"/>
Aug 01 14:05:45 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 14:05:45 user nova-compute[72129]:   <serial>0a025412-1d03-4a7a-97d4-0c8c20b2bde3</serial>
Aug 01 14:05:45 user nova-compute[72129]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 14:05:45 user nova-compute[72129]: </disk>
Aug 01 14:05:45 user nova-compute[72129]:  {{(pid=72129) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 14:05:45 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-04e069e4-5d45-4089-b74c-8552e96cbd41 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Successfully detached device vdb from instance 85062e35-e302-46f7-8d66-24cf9e7199f7 from the persistent domain config.
Aug 01 14:05:45 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-04e069e4-5d45-4089-b74c-8552e96cbd41 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 85062e35-e302-46f7-8d66-24cf9e7199f7 from the live domain config. {{(pid=72129) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 14:05:45 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-04e069e4-5d45-4089-b74c-8552e96cbd41 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 14:05:45 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:05:45 user nova-compute[72129]:   <source dev="/dev/sdb"/>
Aug 01 14:05:45 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 14:05:45 user nova-compute[72129]:   <serial>0a025412-1d03-4a7a-97d4-0c8c20b2bde3</serial>
Aug 01 14:05:45 user nova-compute[72129]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 14:05:45 user nova-compute[72129]: </disk>
Aug 01 14:05:45 user nova-compute[72129]:  {{(pid=72129) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 14:05:45 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:05:45 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:05:45 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:05:45 user nova-compute[72129]: DEBUG nova.compute.manager [req-307e2c7a-53ac-415f-92f5-e20895aed5b7 req-e557f7a0-8b54-4921-9d97-87f7ed32a8eb service nova] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Received event network-changed-fe1f3453-e3ae-494c-965a-c20868179163 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:05:45 user nova-compute[72129]: DEBUG nova.compute.manager [req-307e2c7a-53ac-415f-92f5-e20895aed5b7 req-e557f7a0-8b54-4921-9d97-87f7ed32a8eb service nova] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Refreshing instance network info cache due to event network-changed-fe1f3453-e3ae-494c-965a-c20868179163. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 14:05:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-307e2c7a-53ac-415f-92f5-e20895aed5b7 req-e557f7a0-8b54-4921-9d97-87f7ed32a8eb service nova] Acquiring lock "refresh_cache-ea050cd6-60e9-41fd-a35c-05fe63d60e57" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:05:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-307e2c7a-53ac-415f-92f5-e20895aed5b7 req-e557f7a0-8b54-4921-9d97-87f7ed32a8eb service nova] Acquired lock "refresh_cache-ea050cd6-60e9-41fd-a35c-05fe63d60e57" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:05:45 user nova-compute[72129]: DEBUG nova.network.neutron [req-307e2c7a-53ac-415f-92f5-e20895aed5b7 req-e557f7a0-8b54-4921-9d97-87f7ed32a8eb service nova] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Refreshing network info cache for port fe1f3453-e3ae-494c-965a-c20868179163 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 14:05:45 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:05:45 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:05:45 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Received event <DeviceRemovedEvent: 1690898745.9813635, 85062e35-e302-46f7-8d66-24cf9e7199f7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72129) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 14:05:45 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-04e069e4-5d45-4089-b74c-8552e96cbd41 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 85062e35-e302-46f7-8d66-24cf9e7199f7 {{(pid=72129) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 14:05:45 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-04e069e4-5d45-4089-b74c-8552e96cbd41 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Successfully detached device vdb from instance 85062e35-e302-46f7-8d66-24cf9e7199f7 from the live domain config.
Aug 01 14:05:45 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04e069e4-5d45-4089-b74c-8552e96cbd41 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] calling os-brick to detach iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 14:05:45 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e069e4-5d45-4089-b74c-8552e96cbd41 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, {'target_iqns': ['iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'waybdZCo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:05:45 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-04e069e4-5d45-4089-b74c-8552e96cbd41 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:05:45 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-04e069e4-5d45-4089-b74c-8552e96cbd41 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:05:45 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-04e069e4-5d45-4089-b74c-8552e96cbd41 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:05:45 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e069e4-5d45-4089-b74c-8552e96cbd41 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3', 0)] {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 14:05:46 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:05:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:46 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41e34cf-c347-44f8-a516-76e1980df215]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:05:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:46 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[e915ecb5-80e7-4cc9-bb82-306869700740]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:05:46 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e069e4-5d45-4089-b74c-8552e96cbd41 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:05:46 user nova-compute[72129]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 (non-flash)
Aug 01 14:05:46 user nova-compute[72129]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 (non-flash)
Aug 01 14:05:46 user nova-compute[72129]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)
Aug 01 14:05:46 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:05:46 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e069e4-5d45-4089-b74c-8552e96cbd41 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:05:46 user nova-compute[72129]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 (non-flash)
Aug 01 14:05:46 user nova-compute[72129]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 (non-flash)
Aug 01 14:05:46 user nova-compute[72129]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)
Aug 01 14:05:46 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:05:46 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e069e4-5d45-4089-b74c-8552e96cbd41 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2828128310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3'): ({'sdb'}, set())}) {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 14:05:46 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-04e069e4-5d45-4089-b74c-8552e96cbd41 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Removing single pathed devices sdb {{(pid=72129) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 14:05:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:46 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b84edd8-f297-4cfd-981e-915680d3a602]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:05:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:46 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[983f3f53-46b3-498f-af1f-d68fe7234f62]: (4, ('ok\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:05:46 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-04e069e4-5d45-4089-b74c-8552e96cbd41 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Flushing IO for device /dev/sdb {{(pid=72129) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 14:05:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:46 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2243d6c-33bf-4f4f-80e3-56f37142a16e]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:05:46 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-04e069e4-5d45-4089-b74c-8552e96cbd41 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72129) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 14:05:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:46 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[36039adc-58d4-4b0b-a654-1355e3223660]: (4, ('1', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:05:46 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-04e069e4-5d45-4089-b74c-8552e96cbd41 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 14:05:46 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-04e069e4-5d45-4089-b74c-8552e96cbd41 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] SCSI volumes sdb have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 14:05:46 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e069e4-5d45-4089-b74c-8552e96cbd41 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3')] {{(pid=72129) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 14:05:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:46 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d609a9b5-4e18-4262-8b99-203fc9f58f15]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:05:46 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e069e4-5d45-4089-b74c-8552e96cbd41 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:05:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 -p 172.16.0.220:3260 --logout {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:46 user nova-compute[72129]: DEBUG nova.network.neutron [req-307e2c7a-53ac-415f-92f5-e20895aed5b7 req-e557f7a0-8b54-4921-9d97-87f7ed32a8eb service nova] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Updated VIF entry in instance network info cache for port fe1f3453-e3ae-494c-965a-c20868179163. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 14:05:46 user nova-compute[72129]: DEBUG nova.network.neutron [req-307e2c7a-53ac-415f-92f5-e20895aed5b7 req-e557f7a0-8b54-4921-9d97-87f7ed32a8eb service nova] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Updating instance_info_cache with network_info: [{"id": "fe1f3453-e3ae-494c-965a-c20868179163", "address": "fa:16:3e:d8:46:16", "network": {"id": "ce187b11-5e3e-45a9-af0f-0be815ad0a3d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1245856112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0a13467840342f281bd8b8e115eccaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1f3453-e3", "ovs_interfaceid": "fe1f3453-e3ae-494c-965a-c20868179163", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:05:46 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-307e2c7a-53ac-415f-92f5-e20895aed5b7 req-e557f7a0-8b54-4921-9d97-87f7ed32a8eb service nova] Releasing lock "refresh_cache-ea050cd6-60e9-41fd-a35c-05fe63d60e57" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:05:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:46 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e07120-6c24-44ad-acc7-4f8082896aa7]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:05:46 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e069e4-5d45-4089-b74c-8552e96cbd41 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3, portal: 172.16.0.220,3260]
Aug 01 14:05:46 user nova-compute[72129]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3, portal: 172.16.0.220,3260] successful.
Aug 01 14:05:46 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:05:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 -p 172.16.0.220:3260 --op delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:46 user nova-compute[72129]: DEBUG nova.compute.manager [req-db282866-ad28-482a-8ce1-eb332f356134 req-a9c39159-2ed1-428a-afbe-c99cb80eb20d service nova] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Received event network-changed-b5a06a08-bb00-4551-afd4-09ad16fe0837 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:05:46 user nova-compute[72129]: DEBUG nova.compute.manager [req-db282866-ad28-482a-8ce1-eb332f356134 req-a9c39159-2ed1-428a-afbe-c99cb80eb20d service nova] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Refreshing instance network info cache due to event network-changed-b5a06a08-bb00-4551-afd4-09ad16fe0837. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 14:05:46 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-db282866-ad28-482a-8ce1-eb332f356134 req-a9c39159-2ed1-428a-afbe-c99cb80eb20d service nova] Acquiring lock "refresh_cache-85062e35-e302-46f7-8d66-24cf9e7199f7" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:05:46 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-db282866-ad28-482a-8ce1-eb332f356134 req-a9c39159-2ed1-428a-afbe-c99cb80eb20d service nova] Acquired lock "refresh_cache-85062e35-e302-46f7-8d66-24cf9e7199f7" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:05:46 user nova-compute[72129]: DEBUG nova.network.neutron [req-db282866-ad28-482a-8ce1-eb332f356134 req-a9c39159-2ed1-428a-afbe-c99cb80eb20d service nova] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Refreshing network info cache for port b5a06a08-bb00-4551-afd4-09ad16fe0837 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 14:05:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a025412-1d03-4a7a-97d4-0c8c20b2bde3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:46 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9c85d7-2c7d-4007-b452-4cffe9b5e96c]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:05:46 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e069e4-5d45-4089-b74c-8552e96cbd41 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:05:46 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-04e069e4-5d45-4089-b74c-8552e96cbd41 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:05:46 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e069e4-5d45-4089-b74c-8552e96cbd41 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] <== disconnect_volume: return (324ms) None {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:05:46 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04e069e4-5d45-4089-b74c-8552e96cbd41 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Disconnected iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 14:05:46 user nova-compute[72129]: DEBUG nova.network.neutron [req-db282866-ad28-482a-8ce1-eb332f356134 req-a9c39159-2ed1-428a-afbe-c99cb80eb20d service nova] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Updated VIF entry in instance network info cache for port b5a06a08-bb00-4551-afd4-09ad16fe0837. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 14:05:46 user nova-compute[72129]: DEBUG nova.network.neutron [req-db282866-ad28-482a-8ce1-eb332f356134 req-a9c39159-2ed1-428a-afbe-c99cb80eb20d service nova] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Updating instance_info_cache with network_info: [{"id": "b5a06a08-bb00-4551-afd4-09ad16fe0837", "address": "fa:16:3e:9d:bc:ca", "network": {"id": "a7ec6cc0-140b-446b-ae97-d4aafbc42693", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-397303278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43253b37caa747b090b14c707abf96cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5a06a08-bb", "ovs_interfaceid": "b5a06a08-bb00-4551-afd4-09ad16fe0837", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:05:46 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-db282866-ad28-482a-8ce1-eb332f356134 req-a9c39159-2ed1-428a-afbe-c99cb80eb20d service nova] Releasing lock "refresh_cache-85062e35-e302-46f7-8d66-24cf9e7199f7" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:05:47 user nova-compute[72129]: DEBUG nova.objects.instance [None req-04e069e4-5d45-4089-b74c-8552e96cbd41 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lazy-loading 'flavor' on Instance uuid 85062e35-e302-46f7-8d66-24cf9e7199f7 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:05:47 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-04e069e4-5d45-4089-b74c-8552e96cbd41 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lock "85062e35-e302-46f7-8d66-24cf9e7199f7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.821s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:05:47 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Removed pending event for ea050cd6-60e9-41fd-a35c-05fe63d60e57 due to event {{(pid=72129) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 14:05:47 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898747.2899694, ea050cd6-60e9-41fd-a35c-05fe63d60e57 => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:05:47 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] VM Resumed (Lifecycle Event)
Aug 01 14:05:47 user nova-compute[72129]: DEBUG nova.compute.manager [None req-983dd59d-c0d4-4c77-998e-d754732d1426 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:05:47 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:05:47 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:05:47 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 01 14:05:47 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898747.2928123, ea050cd6-60e9-41fd-a35c-05fe63d60e57 => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:05:47 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] VM Started (Lifecycle Event)
Aug 01 14:05:47 user nova-compute[72129]: DEBUG nova.compute.manager [req-e14538fa-84a8-4d69-a994-04e723a4e8da req-5053a086-f6f9-4e15-af8b-33915b91d2e8 service nova] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Received event network-vif-plugged-fe1f3453-e3ae-494c-965a-c20868179163 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:05:47 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-e14538fa-84a8-4d69-a994-04e723a4e8da req-5053a086-f6f9-4e15-af8b-33915b91d2e8 service nova] Acquiring lock "ea050cd6-60e9-41fd-a35c-05fe63d60e57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:05:47 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-e14538fa-84a8-4d69-a994-04e723a4e8da req-5053a086-f6f9-4e15-af8b-33915b91d2e8 service nova] Lock "ea050cd6-60e9-41fd-a35c-05fe63d60e57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:05:47 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-e14538fa-84a8-4d69-a994-04e723a4e8da req-5053a086-f6f9-4e15-af8b-33915b91d2e8 service nova] Lock "ea050cd6-60e9-41fd-a35c-05fe63d60e57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:05:47 user nova-compute[72129]: DEBUG nova.compute.manager [req-e14538fa-84a8-4d69-a994-04e723a4e8da req-5053a086-f6f9-4e15-af8b-33915b91d2e8 service nova] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] No waiting events found dispatching network-vif-plugged-fe1f3453-e3ae-494c-965a-c20868179163 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:05:47 user nova-compute[72129]: WARNING nova.compute.manager [req-e14538fa-84a8-4d69-a994-04e723a4e8da req-5053a086-f6f9-4e15-af8b-33915b91d2e8 service nova] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Received unexpected event network-vif-plugged-fe1f3453-e3ae-494c-965a-c20868179163 for instance with vm_state rescued and task_state unrescuing.
Aug 01 14:05:47 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:05:47 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:05:48 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c9540c33-88c1-4c96-9e9f-20573e117817 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Acquiring lock "e2cf5877-55dd-44ce-9b58-b662afe8e62e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:05:48 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c9540c33-88c1-4c96-9e9f-20573e117817 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lock "e2cf5877-55dd-44ce-9b58-b662afe8e62e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:05:48 user nova-compute[72129]: DEBUG nova.objects.instance [None req-c9540c33-88c1-4c96-9e9f-20573e117817 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lazy-loading 'flavor' on Instance uuid e2cf5877-55dd-44ce-9b58-b662afe8e62e {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:05:48 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c9540c33-88c1-4c96-9e9f-20573e117817 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lock "e2cf5877-55dd-44ce-9b58-b662afe8e62e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:05:49 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c9540c33-88c1-4c96-9e9f-20573e117817 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Acquiring lock "e2cf5877-55dd-44ce-9b58-b662afe8e62e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:05:49 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c9540c33-88c1-4c96-9e9f-20573e117817 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lock "e2cf5877-55dd-44ce-9b58-b662afe8e62e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:05:49 user nova-compute[72129]: INFO nova.compute.manager [None req-c9540c33-88c1-4c96-9e9f-20573e117817 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Attaching volume 22ea527e-8024-4b3e-b015-74c200f40230 to /dev/vdb
Aug 01 14:05:49 user nova-compute[72129]: DEBUG os_brick.utils [None req-c9540c33-88c1-4c96-9e9f-20573e117817 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:05:49 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:49 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:49 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd10204-1d14-403a-8766-4814f6bc2d5b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f9b449c2cd3d\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:05:49 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:49 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:49 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8fa6aef-5477-487a-8f44-85b3c30baaf5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:05:49 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:49 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:49 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dcbd3e8-e4d7-4188-b789-750637009701]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:05:49 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[42017d31-62e4-438f-bee0-3fef753d0642]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:05:49 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-c9540c33-88c1-4c96-9e9f-20573e117817 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Running cmd (subprocess): nvme version {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:49 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-c9540c33-88c1-4c96-9e9f-20573e117817 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] 'nvme version' failed. Not Retrying. {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 14:05:49 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c9540c33-88c1-4c96-9e9f-20573e117817 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] nvme not present on system {{(pid=72129) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 14:05:49 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:49 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 14:05:49 user nova-compute[72129]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 14:05:49 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db14f1e-8a11-4140-a0f7-b0130b0882a2]: (4, '') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:05:49 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-c9540c33-88c1-4c96-9e9f-20573e117817 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72129) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 14:05:49 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-c9540c33-88c1-4c96-9e9f-20573e117817 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 14:05:49 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-c9540c33-88c1-4c96-9e9f-20573e117817 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] LIGHTOS: no hostnqn found. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 14:05:49 user nova-compute[72129]: DEBUG os_brick.utils [None req-c9540c33-88c1-4c96-9e9f-20573e117817 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f9b449c2cd3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:05:49 user nova-compute[72129]: DEBUG nova.virt.block_device [None req-c9540c33-88c1-4c96-9e9f-20573e117817 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Updating existing volume attachment record: 6c22637b-1e92-4fb7-b10b-20012f17e4ae {{(pid=72129) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 14:05:50 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:05:51 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:05:52 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:05:52 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Starting heal instance info cache {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 14:05:52 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "refresh_cache-53b76ca4-30f0-4fd4-9928-714c7073a490" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:05:52 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquired lock "refresh_cache-53b76ca4-30f0-4fd4-9928-714c7073a490" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:05:52 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Forcefully refreshing network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 14:05:52 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Updating instance_info_cache with network_info: [{"id": "b7271bae-a440-4d06-87d0-cece38122deb", "address": "fa:16:3e:6b:eb:be", "network": {"id": "b0eb2211-5a6a-4b7e-a119-92a0f0deb947", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1159988670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6120989bad342a4a6fa2a8975f5932f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7271bae-a4", "ovs_interfaceid": "b7271bae-a440-4d06-87d0-cece38122deb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:05:52 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Releasing lock "refresh_cache-53b76ca4-30f0-4fd4-9928-714c7073a490" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:05:52 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Updated the network info_cache for instance {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 14:05:52 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:05:52 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:05:52 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:05:52 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:05:52 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:05:52 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72129) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 14:05:52 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:05:52 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72129) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG nova.compute.manager [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Start spawning the instance on the hypervisor. {{(pid=72129) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Creating instance directory {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 14:05:53 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Creating image(s)
Aug 01 14:05:53 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Did not create local disks {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Ensure instance console log exists: /opt/stack/data/nova/instances/418f4c53-9dc5-402f-ad21-ac481674b083/console.log {{(pid=72129) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Start _get_guest_xml network_info=[{"id": "df042689-7692-445c-89d8-cc6d908dd216", "address": "fa:16:3e:33:ea:dd", "network": {"id": "59b1e538-8bfe-45ce-ab7b-c5838ab25582", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1129024349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0929886fa54d1c8023793806f10d31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf042689-76", "ovs_interfaceid": "df042689-7692-445c-89d8-cc6d908dd216", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '5d81d68c-d390-43e4-bfea-3eb24d836ed1', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CthoGEYk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '418f4c53-9dc5-402f-ad21-ac481674b083', 'attached_at': '', 'detached_at': '', 'volume_id': '80fd8043-1d68-4b79-b574-464fdf0b8057', 'serial': '80fd8043-1d68-4b79-b574-464fdf0b8057'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 14:05:53 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:05:53 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:05:53 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] CPU controller missing on host. {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] CPU controller found on host. {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72129) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T13:45:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Flavor limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Image limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Flavor pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Image pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Got 1 possible topologies {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Calling os-brick to attach iSCSI Volume {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CthoGEYk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:05:53 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:05:53 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:05:53 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:05:53 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:05:53 user nova-compute[72129]: INFO os_brick.initiator.connectors.iscsi [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 14:05:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 -p 172.16.0.220:3260 {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[36dc9f08-278d-491b-9a35-6c8e4e7d8f9a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 14:05:53 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 -p 172.16.0.220:3260 --interface default --op new {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d012a1-defe-4df2-8768-efb512bd13fc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057] added\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057] added
Aug 01 14:05:53 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[6afe3896-3ebc-49ea-b990-982ec44932f9]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3351267-2392-4a43-9a3d-25dc8a139103]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CthoGEYk {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CthoGEYk" returned: 0 in 0.024s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a565ac-e26e-438b-a74e-fe63a7184e9a]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CthoGEYk'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b7483b-74b2-4507-994d-3247cbaef29d]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[828c8732-4b00-4244-9ffc-36571930c70e]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:05:53 user nova-compute[72129]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 (non-flash)
Aug 01 14:05:53 user nova-compute[72129]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)
Aug 01 14:05:53 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:05:53 user nova-compute[72129]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 (non-flash)
Aug 01 14:05:53 user nova-compute[72129]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)
Aug 01 14:05:53 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 -p 172.16.0.220:3260 --login {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[f614e285-4421-4e56-b845-58c564821d97]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057, portal: 172.16.0.220,3260]
Aug 01 14:05:53 user nova-compute[72129]: Login to [iface: default, target: iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057, portal: 172.16.0.220,3260] successful.
Aug 01 14:05:53 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b40ee6f-f902-4c03-85c4-0a0239086bad]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff5f780-c6e4-4692-a372-59d55b48e443]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:05:53 user nova-compute[72129]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 (non-flash)
Aug 01 14:05:53 user nova-compute[72129]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)
Aug 01 14:05:53 user nova-compute[72129]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 (non-flash)
Aug 01 14:05:53 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:05:53 user nova-compute[72129]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 (non-flash)
Aug 01 14:05:53 user nova-compute[72129]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)
Aug 01 14:05:53 user nova-compute[72129]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 (non-flash)
Aug 01 14:05:53 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Connected to 172.16.0.220:3260 {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=72129) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72129) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[270cb046-c28f-40a0-b0a7-8d6c151259ac]: (4, ('- - 0', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 14:05:53 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CthoGEYk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 14:05:54 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:05:54 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:05:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:05:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:05:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:05:54 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Auditing locally available compute resources for user (node: user) {{(pid=72129) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 14:05:54 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 14:05:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c43fda3-e098-4c3a-bcd5-14eac019db06/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:54 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:05:54 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '23536333632386639', 'path': '/dev/sdb'} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:05:54 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23536333632386639', 'path': '/dev/sdb'} {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 14:05:54 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:05:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1423869095',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1423869095',id=31,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e0929886fa54d1c8023793806f10d31',ramdisk_id='',reservation_id='r-677hcku4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1414609013',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T14:05:34Z,user_data=None,user_id='cdb6f66592fe4cdebea02e5f5c1f4a60',uuid=418f4c53-9dc5-402f-ad21-ac481674b083,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df042689-7692-445c-89d8-cc6d908dd216", "address": "fa:16:3e:33:ea:dd", "network": {"id": "59b1e538-8bfe-45ce-ab7b-c5838ab25582", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1129024349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0929886fa54d1c8023793806f10d31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf042689-76", "ovs_interfaceid": "df042689-7692-445c-89d8-cc6d908dd216", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 14:05:54 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Converting VIF {"id": "df042689-7692-445c-89d8-cc6d908dd216", "address": "fa:16:3e:33:ea:dd", "network": {"id": "59b1e538-8bfe-45ce-ab7b-c5838ab25582", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1129024349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0929886fa54d1c8023793806f10d31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf042689-76", "ovs_interfaceid": "df042689-7692-445c-89d8-cc6d908dd216", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:05:54 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:ea:dd,bridge_name='br-int',has_traffic_filtering=True,id=df042689-7692-445c-89d8-cc6d908dd216,network=Network(59b1e538-8bfe-45ce-ab7b-c5838ab25582),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf042689-76') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:05:54 user nova-compute[72129]: DEBUG nova.objects.instance [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lazy-loading 'pci_devices' on Instance uuid 418f4c53-9dc5-402f-ad21-ac481674b083 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:05:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c43fda3-e098-4c3a-bcd5-14eac019db06/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c43fda3-e098-4c3a-bcd5-14eac019db06/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:54 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] End _get_guest_xml xml=<domain type="kvm">
Aug 01 14:05:54 user nova-compute[72129]:   <uuid>418f4c53-9dc5-402f-ad21-ac481674b083</uuid>
Aug 01 14:05:54 user nova-compute[72129]:   <name>instance-0000001f</name>
Aug 01 14:05:54 user nova-compute[72129]:   <memory>524288</memory>
Aug 01 14:05:54 user nova-compute[72129]:   <vcpu>1</vcpu>
Aug 01 14:05:54 user nova-compute[72129]:   <metadata>
Aug 01 14:05:54 user nova-compute[72129]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 14:05:54 user nova-compute[72129]:       <nova:package version="0.0.0"/>
Aug 01 14:05:54 user nova-compute[72129]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1423869095</nova:name>
Aug 01 14:05:54 user nova-compute[72129]:       <nova:creationTime>2023-08-01 14:05:53</nova:creationTime>
Aug 01 14:05:54 user nova-compute[72129]:       <nova:flavor name="m1.tiny">
Aug 01 14:05:54 user nova-compute[72129]:         <nova:memory>512</nova:memory>
Aug 01 14:05:54 user nova-compute[72129]:         <nova:disk>1</nova:disk>
Aug 01 14:05:54 user nova-compute[72129]:         <nova:swap>0</nova:swap>
Aug 01 14:05:54 user nova-compute[72129]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 14:05:54 user nova-compute[72129]:         <nova:vcpus>1</nova:vcpus>
Aug 01 14:05:54 user nova-compute[72129]:       </nova:flavor>
Aug 01 14:05:54 user nova-compute[72129]:       <nova:owner>
Aug 01 14:05:54 user nova-compute[72129]:         <nova:user uuid="cdb6f66592fe4cdebea02e5f5c1f4a60">tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member</nova:user>
Aug 01 14:05:54 user nova-compute[72129]:         <nova:project uuid="1e0929886fa54d1c8023793806f10d31">tempest-ServerBootFromVolumeStableRescueTest-1414609013</nova:project>
Aug 01 14:05:54 user nova-compute[72129]:       </nova:owner>
Aug 01 14:05:54 user nova-compute[72129]:       <nova:root type="image" uuid="b6472c34-1b0f-4034-ba3a-7e8eb5103715"/>
Aug 01 14:05:54 user nova-compute[72129]:       <nova:ports>
Aug 01 14:05:54 user nova-compute[72129]:         <nova:port uuid="df042689-7692-445c-89d8-cc6d908dd216">
Aug 01 14:05:54 user nova-compute[72129]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 01 14:05:54 user nova-compute[72129]:         </nova:port>
Aug 01 14:05:54 user nova-compute[72129]:       </nova:ports>
Aug 01 14:05:54 user nova-compute[72129]:     </nova:instance>
Aug 01 14:05:54 user nova-compute[72129]:   </metadata>
Aug 01 14:05:54 user nova-compute[72129]:   <sysinfo type="smbios">
Aug 01 14:05:54 user nova-compute[72129]:     <system>
Aug 01 14:05:54 user nova-compute[72129]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 14:05:54 user nova-compute[72129]:       <entry name="product">OpenStack Nova</entry>
Aug 01 14:05:54 user nova-compute[72129]:       <entry name="version">0.0.0</entry>
Aug 01 14:05:54 user nova-compute[72129]:       <entry name="serial">418f4c53-9dc5-402f-ad21-ac481674b083</entry>
Aug 01 14:05:54 user nova-compute[72129]:       <entry name="uuid">418f4c53-9dc5-402f-ad21-ac481674b083</entry>
Aug 01 14:05:54 user nova-compute[72129]:       <entry name="family">Virtual Machine</entry>
Aug 01 14:05:54 user nova-compute[72129]:     </system>
Aug 01 14:05:54 user nova-compute[72129]:   </sysinfo>
Aug 01 14:05:54 user nova-compute[72129]:   <os>
Aug 01 14:05:54 user nova-compute[72129]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 14:05:54 user nova-compute[72129]:     <boot dev="hd"/>
Aug 01 14:05:54 user nova-compute[72129]:     <smbios mode="sysinfo"/>
Aug 01 14:05:54 user nova-compute[72129]:   </os>
Aug 01 14:05:54 user nova-compute[72129]:   <features>
Aug 01 14:05:54 user nova-compute[72129]:     <acpi/>
Aug 01 14:05:54 user nova-compute[72129]:     <apic/>
Aug 01 14:05:54 user nova-compute[72129]:     <vmcoreinfo/>
Aug 01 14:05:54 user nova-compute[72129]:   </features>
Aug 01 14:05:54 user nova-compute[72129]:   <clock offset="utc">
Aug 01 14:05:54 user nova-compute[72129]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 14:05:54 user nova-compute[72129]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 14:05:54 user nova-compute[72129]:     <timer name="hpet" present="no"/>
Aug 01 14:05:54 user nova-compute[72129]:   </clock>
Aug 01 14:05:54 user nova-compute[72129]:   <cpu mode="custom" match="exact">
Aug 01 14:05:54 user nova-compute[72129]:     <model>Nehalem</model>
Aug 01 14:05:54 user nova-compute[72129]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 14:05:54 user nova-compute[72129]:   </cpu>
Aug 01 14:05:54 user nova-compute[72129]:   <devices>
Aug 01 14:05:54 user nova-compute[72129]:     <disk type="block" device="disk">
Aug 01 14:05:54 user nova-compute[72129]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:05:54 user nova-compute[72129]:       <source dev="/dev/sdb"/>
Aug 01 14:05:54 user nova-compute[72129]:       <target dev="vda" bus="virtio"/>
Aug 01 14:05:54 user nova-compute[72129]:       <serial>80fd8043-1d68-4b79-b574-464fdf0b8057</serial>
Aug 01 14:05:54 user nova-compute[72129]:     </disk>
Aug 01 14:05:54 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 14:05:54 user nova-compute[72129]:       <mac address="fa:16:3e:33:ea:dd"/>
Aug 01 14:05:54 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:05:54 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 14:05:54 user nova-compute[72129]:       <target dev="tapdf042689-76"/>
Aug 01 14:05:54 user nova-compute[72129]:     </interface>
Aug 01 14:05:54 user nova-compute[72129]:     <serial type="pty">
Aug 01 14:05:54 user nova-compute[72129]:       <log file="/opt/stack/data/nova/instances/418f4c53-9dc5-402f-ad21-ac481674b083/console.log" append="off"/>
Aug 01 14:05:54 user nova-compute[72129]:     </serial>
Aug 01 14:05:54 user nova-compute[72129]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 14:05:54 user nova-compute[72129]:     <video>
Aug 01 14:05:54 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:05:54 user nova-compute[72129]:     </video>
Aug 01 14:05:54 user nova-compute[72129]:     <rng model="virtio">
Aug 01 14:05:54 user nova-compute[72129]:       <backend model="random">/dev/urandom</backend>
Aug 01 14:05:54 user nova-compute[72129]:     </rng>
Aug 01 14:05:54 user nova-compute[72129]:     <controller type="usb" index="0" model="none"/>
Aug 01 14:05:54 user nova-compute[72129]:     <memballoon model="virtio">
Aug 01 14:05:54 user nova-compute[72129]:       <stats period="10"/>
Aug 01 14:05:54 user nova-compute[72129]:     </memballoon>
Aug 01 14:05:54 user nova-compute[72129]:   </devices>
Aug 01 14:05:54 user nova-compute[72129]: </domain>
Aug 01 14:05:54 user nova-compute[72129]:  {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 14:05:54 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:05:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1423869095',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1423869095',id=31,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e0929886fa54d1c8023793806f10d31',ramdisk_id='',reservation_id='r-677hcku4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1414609013',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T14:05:34Z,user_data=None,user_id='cdb6f66592fe4cdebea02e5f5c1f4a60',uuid=418f4c53-9dc5-402f-ad21-ac481674b083,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df042689-7692-445c-89d8-cc6d908dd216", "address": "fa:16:3e:33:ea:dd", "network": {"id": "59b1e538-8bfe-45ce-ab7b-c5838ab25582", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1129024349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0929886fa54d1c8023793806f10d31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf042689-76", "ovs_interfaceid": "df042689-7692-445c-89d8-cc6d908dd216", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 14:05:54 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Converting VIF {"id": "df042689-7692-445c-89d8-cc6d908dd216", "address": "fa:16:3e:33:ea:dd", "network": {"id": "59b1e538-8bfe-45ce-ab7b-c5838ab25582", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1129024349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0929886fa54d1c8023793806f10d31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf042689-76", "ovs_interfaceid": "df042689-7692-445c-89d8-cc6d908dd216", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:05:54 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:ea:dd,bridge_name='br-int',has_traffic_filtering=True,id=df042689-7692-445c-89d8-cc6d908dd216,network=Network(59b1e538-8bfe-45ce-ab7b-c5838ab25582),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf042689-76') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:05:54 user nova-compute[72129]: DEBUG os_vif [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:ea:dd,bridge_name='br-int',has_traffic_filtering=True,id=df042689-7692-445c-89d8-cc6d908dd216,network=Network(59b1e538-8bfe-45ce-ab7b-c5838ab25582),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf042689-76') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 14:05:54 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:05:54 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:05:54 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 14:05:54 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:05:54 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdf042689-76, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:05:54 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdf042689-76, col_values=(('external_ids', {'iface-id': 'df042689-7692-445c-89d8-cc6d908dd216', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:ea:dd', 'vm-uuid': '418f4c53-9dc5-402f-ad21-ac481674b083'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:05:54 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:05:54 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:05:54 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:05:54 user nova-compute[72129]: INFO os_vif [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:ea:dd,bridge_name='br-int',has_traffic_filtering=True,id=df042689-7692-445c-89d8-cc6d908dd216,network=Network(59b1e538-8bfe-45ce-ab7b-c5838ab25582),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf042689-76')
Aug 01 14:05:54 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:05:54 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] No VIF found with MAC fa:16:3e:33:ea:dd, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 14:05:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c43fda3-e098-4c3a-bcd5-14eac019db06/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85062e35-e302-46f7-8d66-24cf9e7199f7/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85062e35-e302-46f7-8d66-24cf9e7199f7/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85062e35-e302-46f7-8d66-24cf9e7199f7/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85062e35-e302-46f7-8d66-24cf9e7199f7/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53b76ca4-30f0-4fd4-9928-714c7073a490/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53b76ca4-30f0-4fd4-9928-714c7073a490/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53b76ca4-30f0-4fd4-9928-714c7073a490/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53b76ca4-30f0-4fd4-9928-714c7073a490/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cf5877-55dd-44ce-9b58-b662afe8e62e/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cf5877-55dd-44ce-9b58-b662afe8e62e/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cf5877-55dd-44ce-9b58-b662afe8e62e/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cf5877-55dd-44ce-9b58-b662afe8e62e/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:56 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 14:05:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3891b9d3-832d-4ef7-8ebb-970ddd0a387a/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:56 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:05:56 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:05:56 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:05:56 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:05:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3891b9d3-832d-4ef7-8ebb-970ddd0a387a/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3891b9d3-832d-4ef7-8ebb-970ddd0a387a/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3891b9d3-832d-4ef7-8ebb-970ddd0a387a/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea050cd6-60e9-41fd-a35c-05fe63d60e57/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:56 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:05:56 user nova-compute[72129]: DEBUG nova.compute.manager [req-90ac68fd-d61b-400e-86c7-ff59f2e1204f req-516a6e46-989d-4573-b3e4-2feb6212af04 service nova] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Received event network-vif-plugged-df042689-7692-445c-89d8-cc6d908dd216 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:05:56 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-90ac68fd-d61b-400e-86c7-ff59f2e1204f req-516a6e46-989d-4573-b3e4-2feb6212af04 service nova] Acquiring lock "418f4c53-9dc5-402f-ad21-ac481674b083-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:05:56 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-90ac68fd-d61b-400e-86c7-ff59f2e1204f req-516a6e46-989d-4573-b3e4-2feb6212af04 service nova] Lock "418f4c53-9dc5-402f-ad21-ac481674b083-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:05:56 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-90ac68fd-d61b-400e-86c7-ff59f2e1204f req-516a6e46-989d-4573-b3e4-2feb6212af04 service nova] Lock "418f4c53-9dc5-402f-ad21-ac481674b083-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:05:56 user nova-compute[72129]: DEBUG nova.compute.manager [req-90ac68fd-d61b-400e-86c7-ff59f2e1204f req-516a6e46-989d-4573-b3e4-2feb6212af04 service nova] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] No waiting events found dispatching network-vif-plugged-df042689-7692-445c-89d8-cc6d908dd216 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:05:56 user nova-compute[72129]: WARNING nova.compute.manager [req-90ac68fd-d61b-400e-86c7-ff59f2e1204f req-516a6e46-989d-4573-b3e4-2feb6212af04 service nova] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Received unexpected event network-vif-plugged-df042689-7692-445c-89d8-cc6d908dd216 for instance with vm_state building and task_state spawning.
Aug 01 14:05:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea050cd6-60e9-41fd-a35c-05fe63d60e57/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea050cd6-60e9-41fd-a35c-05fe63d60e57/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea050cd6-60e9-41fd-a35c-05fe63d60e57/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:56 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 14:05:57 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:05:57 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:05:57 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Hypervisor/Node resource view: name=user free_ram=7533MB free_disk=24.94861602783203GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72129) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 14:05:57 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:05:57 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:05:57 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9540c33-88c1-4c96-9e9f-20573e117817 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Calling os-brick to attach iSCSI Volume {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 14:05:57 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9540c33-88c1-4c96-9e9f-20573e117817 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:22ea527e-8024-4b3e-b015-74c200f40230'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tvyNxjfQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:05:57 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-c9540c33-88c1-4c96-9e9f-20573e117817 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:05:57 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-c9540c33-88c1-4c96-9e9f-20573e117817 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:05:57 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-c9540c33-88c1-4c96-9e9f-20573e117817 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:05:57 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-c9540c33-88c1-4c96-9e9f-20573e117817 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:05:57 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-c9540c33-88c1-4c96-9e9f-20573e117817 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22ea527e-8024-4b3e-b015-74c200f40230" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:05:57 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-c9540c33-88c1-4c96-9e9f-20573e117817 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22ea527e-8024-4b3e-b015-74c200f40230" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:05:57 user nova-compute[72129]: INFO os_brick.initiator.connectors.iscsi [None req-c9540c33-88c1-4c96-9e9f-20573e117817 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 14:05:57 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22ea527e-8024-4b3e-b015-74c200f40230 -p 172.16.0.220:3260 {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:57 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22ea527e-8024-4b3e-b015-74c200f40230 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:57 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e96697-dec0-44c0-8a4e-cf01b8149a84]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:05:57 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9540c33-88c1-4c96-9e9f-20573e117817 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 14:05:57 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:05:57 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22ea527e-8024-4b3e-b015-74c200f40230 -p 172.16.0.220:3260 --interface default --op new {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:57 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22ea527e-8024-4b3e-b015-74c200f40230 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:57 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8296850-a9f6-4076-9126-db07312debe2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:22ea527e-8024-4b3e-b015-74c200f40230] added\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:05:57 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9540c33-88c1-4c96-9e9f-20573e117817 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:22ea527e-8024-4b3e-b015-74c200f40230] added
Aug 01 14:05:57 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:05:57 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22ea527e-8024-4b3e-b015-74c200f40230 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:57 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 97a5dccf-b499-443a-b332-cfa293a16047 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:05:57 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:05:57 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance d031973f-8f48-43b3-a338-040950103e4c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:05:57 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 53b76ca4-30f0-4fd4-9928-714c7073a490 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:05:57 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance ea050cd6-60e9-41fd-a35c-05fe63d60e57 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:05:57 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance e2cf5877-55dd-44ce-9b58-b662afe8e62e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:05:57 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 85062e35-e302-46f7-8d66-24cf9e7199f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:05:57 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 0c43fda3-e098-4c3a-bcd5-14eac019db06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:05:57 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 3891b9d3-832d-4ef7-8ebb-970ddd0a387a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:05:57 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance e4a13a50-fe03-41aa-94f4-3431805ff481 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:05:57 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 418f4c53-9dc5-402f-ad21-ac481674b083 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:05:57 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 14:05:57 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 14:05:57 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22ea527e-8024-4b3e-b015-74c200f40230 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:57 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[23472722-173e-4b8a-ba54-c2a880bcb5c4]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:05:57 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9540c33-88c1-4c96-9e9f-20573e117817 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:05:57 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22ea527e-8024-4b3e-b015-74c200f40230 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:57 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22ea527e-8024-4b3e-b015-74c200f40230 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:57 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6cb38f9-5c4c-45bb-b42e-c485a38973de]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:05:57 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9540c33-88c1-4c96-9e9f-20573e117817 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:05:57 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22ea527e-8024-4b3e-b015-74c200f40230 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tvyNxjfQ {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:57 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Refreshing inventories for resource provider c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 14:05:57 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22ea527e-8024-4b3e-b015-74c200f40230 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tvyNxjfQ" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:57 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc03ca37-3334-41be-b105-48ef21b21a85]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:05:57 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9540c33-88c1-4c96-9e9f-20573e117817 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tvyNxjfQ'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:05:57 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22ea527e-8024-4b3e-b015-74c200f40230 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:57 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Updating ProviderTree inventory for provider c2f345c3-9b82-4164-b21d-1eef8e661842 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 14:05:57 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Updating inventory in ProviderTree for provider c2f345c3-9b82-4164-b21d-1eef8e661842 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 14:05:57 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22ea527e-8024-4b3e-b015-74c200f40230 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:57 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c772a7-14ff-440c-84ab-2ceb491f6d93]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:05:57 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9540c33-88c1-4c96-9e9f-20573e117817 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:05:57 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:57 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Refreshing aggregate associations for resource provider c2f345c3-9b82-4164-b21d-1eef8e661842, aggregates: None {{(pid=72129) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 14:05:57 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:57 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa80842-4e0e-4f62-a497-61f80a85811c]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:05:57 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9540c33-88c1-4c96-9e9f-20573e117817 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:05:57 user nova-compute[72129]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 (non-flash)
Aug 01 14:05:57 user nova-compute[72129]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)
Aug 01 14:05:57 user nova-compute[72129]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 (non-flash)
Aug 01 14:05:57 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:05:57 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9540c33-88c1-4c96-9e9f-20573e117817 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:05:57 user nova-compute[72129]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 (non-flash)
Aug 01 14:05:57 user nova-compute[72129]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)
Aug 01 14:05:57 user nova-compute[72129]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 (non-flash)
Aug 01 14:05:57 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:05:57 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22ea527e-8024-4b3e-b015-74c200f40230 -p 172.16.0.220:3260 --login {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:57 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Refreshing trait associations for resource provider c2f345c3-9b82-4164-b21d-1eef8e661842, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE {{(pid=72129) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 14:05:57 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22ea527e-8024-4b3e-b015-74c200f40230 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:57 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[7444f547-4c7a-453a-a455-3aa4fe163d2f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:22ea527e-8024-4b3e-b015-74c200f40230, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:22ea527e-8024-4b3e-b015-74c200f40230, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:05:57 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9540c33-88c1-4c96-9e9f-20573e117817 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:22ea527e-8024-4b3e-b015-74c200f40230, portal: 172.16.0.220,3260]
Aug 01 14:05:57 user nova-compute[72129]: Login to [iface: default, target: iqn.2010-10.org.openstack:22ea527e-8024-4b3e-b015-74c200f40230, portal: 172.16.0.220,3260] successful.
Aug 01 14:05:57 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:05:57 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22ea527e-8024-4b3e-b015-74c200f40230 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:57 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22ea527e-8024-4b3e-b015-74c200f40230 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:57 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b307428b-7dc5-4549-a6c8-e29838f56fcc]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:05:57 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9540c33-88c1-4c96-9e9f-20573e117817 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:05:57 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:57 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:57 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8276c69-f6d2-40d4-a547-f0694c6d5a62]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ea527e-8024-4b3e-b015-74c200f40230 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:05:57 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9540c33-88c1-4c96-9e9f-20573e117817 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:05:57 user nova-compute[72129]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 (non-flash)
Aug 01 14:05:57 user nova-compute[72129]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)
Aug 01 14:05:57 user nova-compute[72129]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 (non-flash)
Aug 01 14:05:57 user nova-compute[72129]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ea527e-8024-4b3e-b015-74c200f40230 (non-flash)
Aug 01 14:05:57 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:05:57 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9540c33-88c1-4c96-9e9f-20573e117817 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:05:57 user nova-compute[72129]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 (non-flash)
Aug 01 14:05:57 user nova-compute[72129]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)
Aug 01 14:05:57 user nova-compute[72129]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 (non-flash)
Aug 01 14:05:57 user nova-compute[72129]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ea527e-8024-4b3e-b015-74c200f40230 (non-flash)
Aug 01 14:05:57 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:05:57 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-c9540c33-88c1-4c96-9e9f-20573e117817 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22ea527e-8024-4b3e-b015-74c200f40230" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:05:57 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9540c33-88c1-4c96-9e9f-20573e117817 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Connected to 172.16.0.220:3260 {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 14:05:57 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-c9540c33-88c1-4c96-9e9f-20573e117817 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] HCTL ('35', '-', '-', 0) found on session 43 with lun 0 {{(pid=72129) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 14:05:57 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-c9540c33-88c1-4c96-9e9f-20573e117817 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72129) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 14:05:57 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:05:57 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:05:57 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[29bf1d85-d4b4-4b87-bcc8-524e655a7d8e]: (4, ('- - 0', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:05:57 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-c9540c33-88c1-4c96-9e9f-20573e117817 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 14:05:57 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9540c33-88c1-4c96-9e9f-20573e117817 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tvyNxjfQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 14:05:58 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:05:58 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:05:58 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Compute_service record updated for user:user {{(pid=72129) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 14:05:58 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.835s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:05:58 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898758.2960289, 418f4c53-9dc5-402f-ad21-ac481674b083 => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:05:58 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] VM Resumed (Lifecycle Event)
Aug 01 14:05:58 user nova-compute[72129]: DEBUG nova.compute.manager [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Instance event wait completed in 0 seconds for  {{(pid=72129) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 14:05:58 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Guest created on hypervisor {{(pid=72129) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 14:05:58 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Instance spawned successfully.
Aug 01 14:05:58 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 14:05:58 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:05:58 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:05:58 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Found default for hw_cdrom_bus of ide {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:05:58 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Found default for hw_disk_bus of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:05:58 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Found default for hw_input_bus of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:05:58 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Found default for hw_pointer_model of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:05:58 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Found default for hw_video_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:05:58 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Found default for hw_vif_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:05:58 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 14:05:58 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898758.297185, 418f4c53-9dc5-402f-ad21-ac481674b083 => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:05:58 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] VM Started (Lifecycle Event)
Aug 01 14:05:58 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:05:58 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:05:58 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 14:05:58 user nova-compute[72129]: INFO nova.compute.manager [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Took 5.21 seconds to spawn the instance on the hypervisor.
Aug 01 14:05:58 user nova-compute[72129]: DEBUG nova.compute.manager [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:05:58 user nova-compute[72129]: INFO nova.compute.manager [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Took 25.20 seconds to build instance.
Aug 01 14:05:58 user nova-compute[72129]: DEBUG nova.compute.manager [req-bfa0f221-f52f-497a-9ebb-176854552f29 req-ca9cd917-31ee-45de-94d6-9039b91a2bdc service nova] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Received event network-vif-plugged-df042689-7692-445c-89d8-cc6d908dd216 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:05:58 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-bfa0f221-f52f-497a-9ebb-176854552f29 req-ca9cd917-31ee-45de-94d6-9039b91a2bdc service nova] Acquiring lock "418f4c53-9dc5-402f-ad21-ac481674b083-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:05:58 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-bfa0f221-f52f-497a-9ebb-176854552f29 req-ca9cd917-31ee-45de-94d6-9039b91a2bdc service nova] Lock "418f4c53-9dc5-402f-ad21-ac481674b083-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:05:58 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-bfa0f221-f52f-497a-9ebb-176854552f29 req-ca9cd917-31ee-45de-94d6-9039b91a2bdc service nova] Lock "418f4c53-9dc5-402f-ad21-ac481674b083-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:05:58 user nova-compute[72129]: DEBUG nova.compute.manager [req-bfa0f221-f52f-497a-9ebb-176854552f29 req-ca9cd917-31ee-45de-94d6-9039b91a2bdc service nova] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] No waiting events found dispatching network-vif-plugged-df042689-7692-445c-89d8-cc6d908dd216 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:05:58 user nova-compute[72129]: WARNING nova.compute.manager [req-bfa0f221-f52f-497a-9ebb-176854552f29 req-ca9cd917-31ee-45de-94d6-9039b91a2bdc service nova] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Received unexpected event network-vif-plugged-df042689-7692-445c-89d8-cc6d908dd216 for instance with vm_state active and task_state None.
Aug 01 14:05:58 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-60282cf1-6de0-438b-997f-5188cd65776f tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "418f4c53-9dc5-402f-ad21-ac481674b083" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.289s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:05:58 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-c9540c33-88c1-4c96-9e9f-20573e117817 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.387s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:05:58 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9540c33-88c1-4c96-9e9f-20573e117817 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] <== connect_volume: return (1389ms) {'type': 'block', 'scsi_wwn': '26362633931656333', 'path': '/dev/sdd'} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:05:58 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9540c33-88c1-4c96-9e9f-20573e117817 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362633931656333', 'path': '/dev/sdd'} {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 14:05:58 user nova-compute[72129]: DEBUG nova.objects.instance [None req-c9540c33-88c1-4c96-9e9f-20573e117817 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lazy-loading 'flavor' on Instance uuid e2cf5877-55dd-44ce-9b58-b662afe8e62e {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:05:58 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-c9540c33-88c1-4c96-9e9f-20573e117817 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 14:05:58 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:05:58 user nova-compute[72129]:   <source dev="/dev/sdd"/>
Aug 01 14:05:58 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 14:05:58 user nova-compute[72129]:   <serial>22ea527e-8024-4b3e-b015-74c200f40230</serial>
Aug 01 14:05:58 user nova-compute[72129]: </disk>
Aug 01 14:05:58 user nova-compute[72129]:  {{(pid=72129) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 14:05:59 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-c9540c33-88c1-4c96-9e9f-20573e117817 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:05:59 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-c9540c33-88c1-4c96-9e9f-20573e117817 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:05:59 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-c9540c33-88c1-4c96-9e9f-20573e117817 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] No VIF found with MAC fa:16:3e:18:48:0e, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 14:05:59 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c9540c33-88c1-4c96-9e9f-20573e117817 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lock "e2cf5877-55dd-44ce-9b58-b662afe8e62e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.375s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:05:59 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:06:01 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:06:01 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-2a61be7c-b4a1-4103-b0b0-0472ee6c7d71 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Acquiring lock "e2cf5877-55dd-44ce-9b58-b662afe8e62e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:06:01 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-2a61be7c-b4a1-4103-b0b0-0472ee6c7d71 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lock "e2cf5877-55dd-44ce-9b58-b662afe8e62e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:06:01 user nova-compute[72129]: INFO nova.compute.manager [None req-2a61be7c-b4a1-4103-b0b0-0472ee6c7d71 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Detaching volume 22ea527e-8024-4b3e-b015-74c200f40230
Aug 01 14:06:01 user nova-compute[72129]: INFO nova.virt.block_device [None req-2a61be7c-b4a1-4103-b0b0-0472ee6c7d71 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Attempting to driver detach volume 22ea527e-8024-4b3e-b015-74c200f40230 from mountpoint /dev/vdb
Aug 01 14:06:01 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-2a61be7c-b4a1-4103-b0b0-0472ee6c7d71 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Attempting to detach device vdb from instance e2cf5877-55dd-44ce-9b58-b662afe8e62e from the persistent domain config. {{(pid=72129) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 14:06:01 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-2a61be7c-b4a1-4103-b0b0-0472ee6c7d71 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 14:06:01 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:06:01 user nova-compute[72129]:   <source dev="/dev/sdd"/>
Aug 01 14:06:01 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 14:06:01 user nova-compute[72129]:   <serial>22ea527e-8024-4b3e-b015-74c200f40230</serial>
Aug 01 14:06:01 user nova-compute[72129]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 14:06:01 user nova-compute[72129]: </disk>
Aug 01 14:06:01 user nova-compute[72129]:  {{(pid=72129) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 14:06:01 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-2a61be7c-b4a1-4103-b0b0-0472ee6c7d71 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Successfully detached device vdb from instance e2cf5877-55dd-44ce-9b58-b662afe8e62e from the persistent domain config.
Aug 01 14:06:01 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-2a61be7c-b4a1-4103-b0b0-0472ee6c7d71 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e2cf5877-55dd-44ce-9b58-b662afe8e62e from the live domain config. {{(pid=72129) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 14:06:01 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-2a61be7c-b4a1-4103-b0b0-0472ee6c7d71 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 14:06:01 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:06:01 user nova-compute[72129]:   <source dev="/dev/sdd"/>
Aug 01 14:06:01 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 14:06:01 user nova-compute[72129]:   <serial>22ea527e-8024-4b3e-b015-74c200f40230</serial>
Aug 01 14:06:01 user nova-compute[72129]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 14:06:01 user nova-compute[72129]: </disk>
Aug 01 14:06:01 user nova-compute[72129]:  {{(pid=72129) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 14:06:02 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Received event <DeviceRemovedEvent: 1690898762.251175, e2cf5877-55dd-44ce-9b58-b662afe8e62e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72129) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 14:06:02 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-2a61be7c-b4a1-4103-b0b0-0472ee6c7d71 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e2cf5877-55dd-44ce-9b58-b662afe8e62e {{(pid=72129) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 14:06:02 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-2a61be7c-b4a1-4103-b0b0-0472ee6c7d71 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Successfully detached device vdb from instance e2cf5877-55dd-44ce-9b58-b662afe8e62e from the live domain config.
Aug 01 14:06:02 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a61be7c-b4a1-4103-b0b0-0472ee6c7d71 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] calling os-brick to detach iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 14:06:02 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a61be7c-b4a1-4103-b0b0-0472ee6c7d71 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, {'target_iqns': ['iqn.2010-10.org.openstack:22ea527e-8024-4b3e-b015-74c200f40230'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tvyNxjfQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:06:02 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-2a61be7c-b4a1-4103-b0b0-0472ee6c7d71 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:06:02 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-2a61be7c-b4a1-4103-b0b0-0472ee6c7d71 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:06:02 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-2a61be7c-b4a1-4103-b0b0-0472ee6c7d71 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:06:02 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a61be7c-b4a1-4103-b0b0-0472ee6c7d71 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22ea527e-8024-4b3e-b015-74c200f40230', 0)] {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 14:06:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:06:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:06:02 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[074f3282-9d00-4446-be73-07e224113965]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22ea527e-8024-4b3e-b015-74c200f40230\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:06:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:06:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:06:02 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4de89cd-722b-4c1d-a2a5-60d50476ad11]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ea527e-8024-4b3e-b015-74c200f40230 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:06:02 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a61be7c-b4a1-4103-b0b0-0472ee6c7d71 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:06:02 user nova-compute[72129]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 (non-flash)
Aug 01 14:06:02 user nova-compute[72129]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)
Aug 01 14:06:02 user nova-compute[72129]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 (non-flash)
Aug 01 14:06:02 user nova-compute[72129]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ea527e-8024-4b3e-b015-74c200f40230 (non-flash)
Aug 01 14:06:02 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:06:02 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a61be7c-b4a1-4103-b0b0-0472ee6c7d71 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:06:02 user nova-compute[72129]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 (non-flash)
Aug 01 14:06:02 user nova-compute[72129]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)
Aug 01 14:06:02 user nova-compute[72129]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 (non-flash)
Aug 01 14:06:02 user nova-compute[72129]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ea527e-8024-4b3e-b015-74c200f40230 (non-flash)
Aug 01 14:06:02 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:06:02 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a61be7c-b4a1-4103-b0b0-0472ee6c7d71 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f282e029900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22ea527e-8024-4b3e-b015-74c200f40230'): ({'sdd'}, set())}) {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 14:06:02 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-2a61be7c-b4a1-4103-b0b0-0472ee6c7d71 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Removing single pathed devices sdd {{(pid=72129) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 14:06:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:06:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:06:02 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f89c8a-6a37-4f0f-991b-33e44421695e]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:06:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:06:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:06:02 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de94825-7076-406c-8b55-80f7c138e4a0]: (4, ('ok\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:06:02 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-2a61be7c-b4a1-4103-b0b0-0472ee6c7d71 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Flushing IO for device /dev/sdd {{(pid=72129) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 14:06:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:06:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:06:02 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5641ad-fdaf-49c6-b513-859043584d7e]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:06:02 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-2a61be7c-b4a1-4103-b0b0-0472ee6c7d71 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72129) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 14:06:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:06:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.036s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:06:02 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[1abdb40b-9d66-4951-b8eb-8adcb5ad5c32]: (4, ('1', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:06:02 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-2a61be7c-b4a1-4103-b0b0-0472ee6c7d71 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 14:06:02 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-2a61be7c-b4a1-4103-b0b0-0472ee6c7d71 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] SCSI volumes sdd have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 14:06:02 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a61be7c-b4a1-4103-b0b0-0472ee6c7d71 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22ea527e-8024-4b3e-b015-74c200f40230')] {{(pid=72129) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 14:06:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22ea527e-8024-4b3e-b015-74c200f40230 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:06:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22ea527e-8024-4b3e-b015-74c200f40230 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:06:02 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[81822d6c-42fd-4f53-bd11-d6c618e335ac]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:06:02 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a61be7c-b4a1-4103-b0b0-0472ee6c7d71 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:06:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22ea527e-8024-4b3e-b015-74c200f40230 -p 172.16.0.220:3260 --logout {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:06:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22ea527e-8024-4b3e-b015-74c200f40230 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:06:02 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fea1964-2d93-4974-857f-d4419803d9a1]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:22ea527e-8024-4b3e-b015-74c200f40230, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:22ea527e-8024-4b3e-b015-74c200f40230, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:06:02 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a61be7c-b4a1-4103-b0b0-0472ee6c7d71 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:22ea527e-8024-4b3e-b015-74c200f40230, portal: 172.16.0.220,3260]
Aug 01 14:06:02 user nova-compute[72129]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:22ea527e-8024-4b3e-b015-74c200f40230, portal: 172.16.0.220,3260] successful.
Aug 01 14:06:02 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:06:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22ea527e-8024-4b3e-b015-74c200f40230 -p 172.16.0.220:3260 --op delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:06:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22ea527e-8024-4b3e-b015-74c200f40230 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:06:02 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f22c3f-29ce-49c0-954d-08ba4f767bfc]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:06:02 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a61be7c-b4a1-4103-b0b0-0472ee6c7d71 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:06:02 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-2a61be7c-b4a1-4103-b0b0-0472ee6c7d71 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:06:02 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a61be7c-b4a1-4103-b0b0-0472ee6c7d71 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] <== disconnect_volume: return (312ms) None {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:06:02 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a61be7c-b4a1-4103-b0b0-0472ee6c7d71 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Disconnected iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 14:06:03 user nova-compute[72129]: DEBUG nova.objects.instance [None req-2a61be7c-b4a1-4103-b0b0-0472ee6c7d71 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lazy-loading 'flavor' on Instance uuid e2cf5877-55dd-44ce-9b58-b662afe8e62e {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:06:03 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-2a61be7c-b4a1-4103-b0b0-0472ee6c7d71 tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lock "e2cf5877-55dd-44ce-9b58-b662afe8e62e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.755s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:06:04 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:06:04 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:06:06 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:06:09 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:06:09 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Cleaning up deleted instances {{(pid=72129) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 14:06:09 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] There are 0 instances to clean {{(pid=72129) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 14:06:09 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:06:11 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:06:14 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:06:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-06130242-041c-400d-b4e5-a5d56a02eed5 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Acquiring lock "ea050cd6-60e9-41fd-a35c-05fe63d60e57" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:06:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-06130242-041c-400d-b4e5-a5d56a02eed5 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Lock "ea050cd6-60e9-41fd-a35c-05fe63d60e57" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:06:15 user nova-compute[72129]: INFO nova.compute.manager [None req-06130242-041c-400d-b4e5-a5d56a02eed5 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Detaching volume 79d3d741-ab72-4e2a-bbae-df43b76a4170
Aug 01 14:06:15 user nova-compute[72129]: INFO nova.virt.block_device [None req-06130242-041c-400d-b4e5-a5d56a02eed5 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Attempting to driver detach volume 79d3d741-ab72-4e2a-bbae-df43b76a4170 from mountpoint /dev/vdb
Aug 01 14:06:15 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-06130242-041c-400d-b4e5-a5d56a02eed5 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Attempting to detach device vdb from instance ea050cd6-60e9-41fd-a35c-05fe63d60e57 from the persistent domain config. {{(pid=72129) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 14:06:15 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-06130242-041c-400d-b4e5-a5d56a02eed5 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 14:06:15 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:06:15 user nova-compute[72129]:   <source dev="/dev/sdh"/>
Aug 01 14:06:15 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 14:06:15 user nova-compute[72129]:   <serial>79d3d741-ab72-4e2a-bbae-df43b76a4170</serial>
Aug 01 14:06:15 user nova-compute[72129]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 14:06:15 user nova-compute[72129]: </disk>
Aug 01 14:06:15 user nova-compute[72129]:  {{(pid=72129) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 14:06:15 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-06130242-041c-400d-b4e5-a5d56a02eed5 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Successfully detached device vdb from instance ea050cd6-60e9-41fd-a35c-05fe63d60e57 from the persistent domain config.
Aug 01 14:06:15 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-06130242-041c-400d-b4e5-a5d56a02eed5 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ea050cd6-60e9-41fd-a35c-05fe63d60e57 from the live domain config. {{(pid=72129) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 14:06:15 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-06130242-041c-400d-b4e5-a5d56a02eed5 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 14:06:15 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:06:15 user nova-compute[72129]:   <source dev="/dev/sdh"/>
Aug 01 14:06:15 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 14:06:15 user nova-compute[72129]:   <serial>79d3d741-ab72-4e2a-bbae-df43b76a4170</serial>
Aug 01 14:06:15 user nova-compute[72129]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 14:06:15 user nova-compute[72129]: </disk>
Aug 01 14:06:15 user nova-compute[72129]:  {{(pid=72129) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 14:06:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:06:16 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Received event <DeviceRemovedEvent: 1690898776.1000326, ea050cd6-60e9-41fd-a35c-05fe63d60e57 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72129) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 14:06:16 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-06130242-041c-400d-b4e5-a5d56a02eed5 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ea050cd6-60e9-41fd-a35c-05fe63d60e57 {{(pid=72129) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 14:06:16 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-06130242-041c-400d-b4e5-a5d56a02eed5 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Successfully detached device vdb from instance ea050cd6-60e9-41fd-a35c-05fe63d60e57 from the live domain config.
Aug 01 14:06:16 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06130242-041c-400d-b4e5-a5d56a02eed5 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] calling os-brick to detach iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 14:06:16 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-06130242-041c-400d-b4e5-a5d56a02eed5 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, {'target_iqns': ['iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BAjounGE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:06:16 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-06130242-041c-400d-b4e5-a5d56a02eed5 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:06:16 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-06130242-041c-400d-b4e5-a5d56a02eed5 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:06:16 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-06130242-041c-400d-b4e5-a5d56a02eed5 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:06:16 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-06130242-041c-400d-b4e5-a5d56a02eed5 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170', 0)] {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 14:06:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:06:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:06:16 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[93aec78e-006e-4de3-bce0-e597814bc02e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:06:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:06:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:06:16 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[421803cb-893b-4ba7-b6ca-c382c9e9e3f0]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:06:16 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-06130242-041c-400d-b4e5-a5d56a02eed5 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:06:16 user nova-compute[72129]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 (non-flash)
Aug 01 14:06:16 user nova-compute[72129]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)
Aug 01 14:06:16 user nova-compute[72129]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 (non-flash)
Aug 01 14:06:16 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:06:16 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-06130242-041c-400d-b4e5-a5d56a02eed5 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:06:16 user nova-compute[72129]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 (non-flash)
Aug 01 14:06:16 user nova-compute[72129]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)
Aug 01 14:06:16 user nova-compute[72129]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 (non-flash)
Aug 01 14:06:16 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:06:16 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-06130242-041c-400d-b4e5-a5d56a02eed5 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f282812aa70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170'): ({'sdh'}, set())}) {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 14:06:16 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-06130242-041c-400d-b4e5-a5d56a02eed5 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Removing single pathed devices sdh {{(pid=72129) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 14:06:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:06:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:06:16 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ffeb8a-1545-4e4c-85b7-5b122b0d2cb5]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:06:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:06:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:06:16 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa91a8b-1dbc-4913-b14d-1f06d19f147e]: (4, ('ok\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:06:16 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-06130242-041c-400d-b4e5-a5d56a02eed5 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Flushing IO for device /dev/sdh {{(pid=72129) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 14:06:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:06:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:06:16 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[93bea3db-d3cd-4d4b-81e0-af08660ec1af]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:06:16 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-06130242-041c-400d-b4e5-a5d56a02eed5 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72129) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 14:06:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:06:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.043s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:06:16 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88bd975-3054-4b4f-a229-ec5c980d737b]: (4, ('1', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:06:16 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-06130242-041c-400d-b4e5-a5d56a02eed5 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 14:06:16 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-06130242-041c-400d-b4e5-a5d56a02eed5 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] SCSI volumes sdh have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 14:06:16 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-06130242-041c-400d-b4e5-a5d56a02eed5 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170')] {{(pid=72129) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 14:06:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:06:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:06:16 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[30872225-096b-461a-ad48-fc2b28d71b1e]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:06:16 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-06130242-041c-400d-b4e5-a5d56a02eed5 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:06:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 -p 172.16.0.220:3260 --logout {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:06:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:06:16 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a614dc-d359-4d66-89b7-0ab61b73cbf5]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:06:16 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-06130242-041c-400d-b4e5-a5d56a02eed5 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170, portal: 172.16.0.220,3260]
Aug 01 14:06:16 user nova-compute[72129]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170, portal: 172.16.0.220,3260] successful.
Aug 01 14:06:16 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:06:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 -p 172.16.0.220:3260 --op delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:06:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79d3d741-ab72-4e2a-bbae-df43b76a4170 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:06:16 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[54026ac5-bc2d-4558-9124-7f2b036d5377]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:06:16 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-06130242-041c-400d-b4e5-a5d56a02eed5 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:06:16 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-06130242-041c-400d-b4e5-a5d56a02eed5 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:06:16 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-06130242-041c-400d-b4e5-a5d56a02eed5 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] <== disconnect_volume: return (297ms) None {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:06:16 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06130242-041c-400d-b4e5-a5d56a02eed5 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Disconnected iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 14:06:17 user nova-compute[72129]: DEBUG nova.objects.instance [None req-06130242-041c-400d-b4e5-a5d56a02eed5 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Lazy-loading 'flavor' on Instance uuid ea050cd6-60e9-41fd-a35c-05fe63d60e57 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:06:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-06130242-041c-400d-b4e5-a5d56a02eed5 tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Lock "ea050cd6-60e9-41fd-a35c-05fe63d60e57" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.786s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:06:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:06:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:06:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-6915e1b3-7aff-4986-ade5-0e14e2b53ca1 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Acquiring lock "3891b9d3-832d-4ef7-8ebb-970ddd0a387a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:06:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-6915e1b3-7aff-4986-ade5-0e14e2b53ca1 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lock "3891b9d3-832d-4ef7-8ebb-970ddd0a387a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:06:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-6915e1b3-7aff-4986-ade5-0e14e2b53ca1 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Acquiring lock "3891b9d3-832d-4ef7-8ebb-970ddd0a387a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:06:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-6915e1b3-7aff-4986-ade5-0e14e2b53ca1 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lock "3891b9d3-832d-4ef7-8ebb-970ddd0a387a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:06:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-6915e1b3-7aff-4986-ade5-0e14e2b53ca1 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lock "3891b9d3-832d-4ef7-8ebb-970ddd0a387a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:06:21 user nova-compute[72129]: INFO nova.compute.manager [None req-6915e1b3-7aff-4986-ade5-0e14e2b53ca1 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Terminating instance
Aug 01 14:06:21 user nova-compute[72129]: DEBUG nova.compute.manager [None req-6915e1b3-7aff-4986-ade5-0e14e2b53ca1 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Start destroying the instance on the hypervisor. {{(pid=72129) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 14:06:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:06:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:06:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:06:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:06:22 user nova-compute[72129]: DEBUG nova.compute.manager [req-faa1736f-f500-400b-b51b-3f63a4c5b88a req-04c49f8a-c87c-4d52-9686-2e0a0db2c615 service nova] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Received event network-vif-unplugged-acb5d1d2-f038-4111-90e1-00bf99a2a7bb {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:06:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-faa1736f-f500-400b-b51b-3f63a4c5b88a req-04c49f8a-c87c-4d52-9686-2e0a0db2c615 service nova] Acquiring lock "3891b9d3-832d-4ef7-8ebb-970ddd0a387a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:06:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-faa1736f-f500-400b-b51b-3f63a4c5b88a req-04c49f8a-c87c-4d52-9686-2e0a0db2c615 service nova] Lock "3891b9d3-832d-4ef7-8ebb-970ddd0a387a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:06:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-faa1736f-f500-400b-b51b-3f63a4c5b88a req-04c49f8a-c87c-4d52-9686-2e0a0db2c615 service nova] Lock "3891b9d3-832d-4ef7-8ebb-970ddd0a387a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:06:22 user nova-compute[72129]: DEBUG nova.compute.manager [req-faa1736f-f500-400b-b51b-3f63a4c5b88a req-04c49f8a-c87c-4d52-9686-2e0a0db2c615 service nova] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] No waiting events found dispatching network-vif-unplugged-acb5d1d2-f038-4111-90e1-00bf99a2a7bb {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:06:22 user nova-compute[72129]: DEBUG nova.compute.manager [req-faa1736f-f500-400b-b51b-3f63a4c5b88a req-04c49f8a-c87c-4d52-9686-2e0a0db2c615 service nova] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Received event network-vif-unplugged-acb5d1d2-f038-4111-90e1-00bf99a2a7bb for instance with task_state deleting. {{(pid=72129) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 14:06:22 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:06:22 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:06:22 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Instance destroyed successfully.
Aug 01 14:06:22 user nova-compute[72129]: DEBUG nova.objects.instance [None req-6915e1b3-7aff-4986-ade5-0e14e2b53ca1 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lazy-loading 'resources' on Instance uuid 3891b9d3-832d-4ef7-8ebb-970ddd0a387a {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:06:22 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-6915e1b3-7aff-4986-ade5-0e14e2b53ca1 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T13:59:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-331489091',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-331489091',id=23,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKNwLt9cG/6UYIO5eEhR/1sQRqxswPW3s3IV/zKywgy3aWV4brDlp6I18ZlFxAhUiEoZChgO4LCEJ1KG2zNJDnYs8CHJgeupzFEtMFvJdCyWU9LKgI89N0dlz92eDVpGtw==',key_name='tempest-keypair-2118933419',keypairs=<?>,launch_index=0,launched_at=2023-08-01T14:04:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b724093fa43c4afb9130efa2cfc713d9',ramdisk_id='',reservation_id='r-ynze9bkr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1864942034',owner_user_name='tempest-AttachVolumeShelveTestJSON-1864942034-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T14:04:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e5630ede467c4c99915b1b2f455ca0fb',uuid=3891b9d3-832d-4ef7-8ebb-970ddd0a387a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "acb5d1d2-f038-4111-90e1-00bf99a2a7bb", "address": "fa:16:3e:ec:4a:5e", "network": {"id": "ce10dac7-17d0-425a-bfee-70b8220d7871", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1288141476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b724093fa43c4afb9130efa2cfc713d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacb5d1d2-f0", "ovs_interfaceid": "acb5d1d2-f038-4111-90e1-00bf99a2a7bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 14:06:22 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-6915e1b3-7aff-4986-ade5-0e14e2b53ca1 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Converting VIF {"id": "acb5d1d2-f038-4111-90e1-00bf99a2a7bb", "address": "fa:16:3e:ec:4a:5e", "network": {"id": "ce10dac7-17d0-425a-bfee-70b8220d7871", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1288141476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b724093fa43c4afb9130efa2cfc713d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacb5d1d2-f0", "ovs_interfaceid": "acb5d1d2-f038-4111-90e1-00bf99a2a7bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:06:22 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-6915e1b3-7aff-4986-ade5-0e14e2b53ca1 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:4a:5e,bridge_name='br-int',has_traffic_filtering=True,id=acb5d1d2-f038-4111-90e1-00bf99a2a7bb,network=Network(ce10dac7-17d0-425a-bfee-70b8220d7871),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacb5d1d2-f0') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:06:22 user nova-compute[72129]: DEBUG os_vif [None req-6915e1b3-7aff-4986-ade5-0e14e2b53ca1 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:4a:5e,bridge_name='br-int',has_traffic_filtering=True,id=acb5d1d2-f038-4111-90e1-00bf99a2a7bb,network=Network(ce10dac7-17d0-425a-bfee-70b8220d7871),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacb5d1d2-f0') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 14:06:22 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:06:22 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapacb5d1d2-f0, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:06:22 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:06:22 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:06:22 user nova-compute[72129]: INFO os_vif [None req-6915e1b3-7aff-4986-ade5-0e14e2b53ca1 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:4a:5e,bridge_name='br-int',has_traffic_filtering=True,id=acb5d1d2-f038-4111-90e1-00bf99a2a7bb,network=Network(ce10dac7-17d0-425a-bfee-70b8220d7871),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacb5d1d2-f0')
Aug 01 14:06:22 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-6915e1b3-7aff-4986-ade5-0e14e2b53ca1 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Deleting instance files /opt/stack/data/nova/instances/3891b9d3-832d-4ef7-8ebb-970ddd0a387a_del
Aug 01 14:06:22 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-6915e1b3-7aff-4986-ade5-0e14e2b53ca1 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Deletion of /opt/stack/data/nova/instances/3891b9d3-832d-4ef7-8ebb-970ddd0a387a_del complete
Aug 01 14:06:22 user nova-compute[72129]: INFO nova.compute.manager [None req-6915e1b3-7aff-4986-ade5-0e14e2b53ca1 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 01 14:06:22 user nova-compute[72129]: DEBUG oslo.service.loopingcall [None req-6915e1b3-7aff-4986-ade5-0e14e2b53ca1 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72129) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 14:06:22 user nova-compute[72129]: DEBUG nova.compute.manager [-] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Deallocating network for instance {{(pid=72129) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 14:06:22 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] deallocate_for_instance() {{(pid=72129) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 14:06:23 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:06:23 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Took 0.96 seconds to deallocate network for instance.
Aug 01 14:06:23 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-6915e1b3-7aff-4986-ade5-0e14e2b53ca1 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:06:23 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-6915e1b3-7aff-4986-ade5-0e14e2b53ca1 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:06:24 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-6915e1b3-7aff-4986-ade5-0e14e2b53ca1 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:06:24 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-6915e1b3-7aff-4986-ade5-0e14e2b53ca1 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:06:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-6915e1b3-7aff-4986-ade5-0e14e2b53ca1 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.380s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:06:24 user nova-compute[72129]: INFO nova.scheduler.client.report [None req-6915e1b3-7aff-4986-ade5-0e14e2b53ca1 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Deleted allocations for instance 3891b9d3-832d-4ef7-8ebb-970ddd0a387a
Aug 01 14:06:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-6915e1b3-7aff-4986-ade5-0e14e2b53ca1 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lock "3891b9d3-832d-4ef7-8ebb-970ddd0a387a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.448s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:06:24 user nova-compute[72129]: DEBUG nova.compute.manager [req-9c6968a2-d835-43a0-bfad-1ce6b30a0297 req-9fdb9ba5-515a-41a1-be62-78021a94c262 service nova] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Received event network-vif-plugged-acb5d1d2-f038-4111-90e1-00bf99a2a7bb {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:06:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-9c6968a2-d835-43a0-bfad-1ce6b30a0297 req-9fdb9ba5-515a-41a1-be62-78021a94c262 service nova] Acquiring lock "3891b9d3-832d-4ef7-8ebb-970ddd0a387a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:06:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-9c6968a2-d835-43a0-bfad-1ce6b30a0297 req-9fdb9ba5-515a-41a1-be62-78021a94c262 service nova] Lock "3891b9d3-832d-4ef7-8ebb-970ddd0a387a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:06:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-9c6968a2-d835-43a0-bfad-1ce6b30a0297 req-9fdb9ba5-515a-41a1-be62-78021a94c262 service nova] Lock "3891b9d3-832d-4ef7-8ebb-970ddd0a387a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:06:24 user nova-compute[72129]: DEBUG nova.compute.manager [req-9c6968a2-d835-43a0-bfad-1ce6b30a0297 req-9fdb9ba5-515a-41a1-be62-78021a94c262 service nova] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] No waiting events found dispatching network-vif-plugged-acb5d1d2-f038-4111-90e1-00bf99a2a7bb {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:06:24 user nova-compute[72129]: WARNING nova.compute.manager [req-9c6968a2-d835-43a0-bfad-1ce6b30a0297 req-9fdb9ba5-515a-41a1-be62-78021a94c262 service nova] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Received unexpected event network-vif-plugged-acb5d1d2-f038-4111-90e1-00bf99a2a7bb for instance with vm_state deleted and task_state None.
Aug 01 14:06:24 user nova-compute[72129]: DEBUG nova.compute.manager [req-9c6968a2-d835-43a0-bfad-1ce6b30a0297 req-9fdb9ba5-515a-41a1-be62-78021a94c262 service nova] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Received event network-vif-deleted-acb5d1d2-f038-4111-90e1-00bf99a2a7bb {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:06:25 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Acquiring lock "05e80bdd-ad15-4b98-b8ac-a40656f5f717" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:06:25 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "05e80bdd-ad15-4b98-b8ac-a40656f5f717" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:06:25 user nova-compute[72129]: DEBUG nova.compute.manager [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] Starting instance... {{(pid=72129) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 14:06:25 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:06:25 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:06:25 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72129) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 14:06:25 user nova-compute[72129]: INFO nova.compute.claims [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] Claim successful on node user
Aug 01 14:06:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:06:26 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:06:26 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:06:26 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.402s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:06:26 user nova-compute[72129]: DEBUG nova.compute.manager [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] Start building networks asynchronously for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 14:06:26 user nova-compute[72129]: DEBUG nova.compute.manager [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] Allocating IP information in the background. {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 14:06:26 user nova-compute[72129]: DEBUG nova.network.neutron [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] allocate_for_instance() {{(pid=72129) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 14:06:26 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 14:06:26 user nova-compute[72129]: DEBUG nova.compute.manager [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] Start building block device mappings for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 14:06:26 user nova-compute[72129]: INFO nova.virt.block_device [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] Booting with volume becf1ccd-4c86-418e-a9eb-be3cb1fff883 at /dev/vda
Aug 01 14:06:26 user nova-compute[72129]: DEBUG nova.policy [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7c341be2816c43cfa9adb58ee84e942b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '210837255c8148ec9b482ba3e2551362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72129) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 14:06:26 user nova-compute[72129]: DEBUG os_brick.utils [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:06:26 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:06:26 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:06:26 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3c38c8-7dc1-4327-a502-eda667cf176b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f9b449c2cd3d\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:06:26 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:06:26 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:06:26 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83e4516-b7f8-48dc-bac2-c98cd345b359]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:06:26 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:06:26 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:06:26 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b308dee-21a1-4bf7-aedd-b73e657f46c8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:06:26 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ddf2de-fc42-4cee-b5d6-a5876b305dcc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:06:26 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Running cmd (subprocess): nvme version {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:06:26 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] 'nvme version' failed. Not Retrying. {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 14:06:26 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] nvme not present on system {{(pid=72129) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 14:06:26 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:06:26 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 14:06:26 user nova-compute[72129]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 14:06:26 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff58058-df01-4d5f-99aa-312501f828ab]: (4, '') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:06:26 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72129) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 14:06:26 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 14:06:26 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] LIGHTOS: no hostnqn found. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 14:06:26 user nova-compute[72129]: DEBUG os_brick.utils [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f9b449c2cd3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:06:26 user nova-compute[72129]: DEBUG nova.virt.block_device [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] Updating existing volume attachment record: ee1cc940-38c4-453d-b8d6-16e9ac34fe7e {{(pid=72129) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 14:06:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:06:27 user nova-compute[72129]: DEBUG nova.network.neutron [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] Successfully created port: 02054cb7-cdfb-4f42-bb44-c83648beac1a {{(pid=72129) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 14:06:27 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:06:27 user nova-compute[72129]: DEBUG nova.network.neutron [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] Successfully updated port: 02054cb7-cdfb-4f42-bb44-c83648beac1a {{(pid=72129) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 14:06:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Acquiring lock "refresh_cache-05e80bdd-ad15-4b98-b8ac-a40656f5f717" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:06:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Acquired lock "refresh_cache-05e80bdd-ad15-4b98-b8ac-a40656f5f717" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:06:27 user nova-compute[72129]: DEBUG nova.network.neutron [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 14:06:27 user nova-compute[72129]: DEBUG nova.compute.manager [req-1381c1af-e29f-4767-822b-43bb57131a68 req-0970cabc-56a9-4511-bfd0-a5ba046467b8 service nova] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] Received event network-changed-02054cb7-cdfb-4f42-bb44-c83648beac1a {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:06:27 user nova-compute[72129]: DEBUG nova.compute.manager [req-1381c1af-e29f-4767-822b-43bb57131a68 req-0970cabc-56a9-4511-bfd0-a5ba046467b8 service nova] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] Refreshing instance network info cache due to event network-changed-02054cb7-cdfb-4f42-bb44-c83648beac1a. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 14:06:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-1381c1af-e29f-4767-822b-43bb57131a68 req-0970cabc-56a9-4511-bfd0-a5ba046467b8 service nova] Acquiring lock "refresh_cache-05e80bdd-ad15-4b98-b8ac-a40656f5f717" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:06:27 user nova-compute[72129]: DEBUG nova.network.neutron [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] Instance cache missing network info. {{(pid=72129) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 14:06:28 user nova-compute[72129]: DEBUG nova.network.neutron [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] Updating instance_info_cache with network_info: [{"id": "02054cb7-cdfb-4f42-bb44-c83648beac1a", "address": "fa:16:3e:f8:70:a5", "network": {"id": "a7f4226b-73fe-4265-ba2c-5d7dcdf154fd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1142462884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210837255c8148ec9b482ba3e2551362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02054cb7-cd", "ovs_interfaceid": "02054cb7-cdfb-4f42-bb44-c83648beac1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:06:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Releasing lock "refresh_cache-05e80bdd-ad15-4b98-b8ac-a40656f5f717" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:06:28 user nova-compute[72129]: DEBUG nova.compute.manager [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] Instance network_info: |[{"id": "02054cb7-cdfb-4f42-bb44-c83648beac1a", "address": "fa:16:3e:f8:70:a5", "network": {"id": "a7f4226b-73fe-4265-ba2c-5d7dcdf154fd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1142462884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210837255c8148ec9b482ba3e2551362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02054cb7-cd", "ovs_interfaceid": "02054cb7-cdfb-4f42-bb44-c83648beac1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 14:06:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-1381c1af-e29f-4767-822b-43bb57131a68 req-0970cabc-56a9-4511-bfd0-a5ba046467b8 service nova] Acquired lock "refresh_cache-05e80bdd-ad15-4b98-b8ac-a40656f5f717" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:06:28 user nova-compute[72129]: DEBUG nova.network.neutron [req-1381c1af-e29f-4767-822b-43bb57131a68 req-0970cabc-56a9-4511-bfd0-a5ba046467b8 service nova] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] Refreshing network info cache for port 02054cb7-cdfb-4f42-bb44-c83648beac1a {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 14:06:28 user nova-compute[72129]: DEBUG nova.network.neutron [req-1381c1af-e29f-4767-822b-43bb57131a68 req-0970cabc-56a9-4511-bfd0-a5ba046467b8 service nova] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] Updated VIF entry in instance network info cache for port 02054cb7-cdfb-4f42-bb44-c83648beac1a. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 14:06:28 user nova-compute[72129]: DEBUG nova.network.neutron [req-1381c1af-e29f-4767-822b-43bb57131a68 req-0970cabc-56a9-4511-bfd0-a5ba046467b8 service nova] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] Updating instance_info_cache with network_info: [{"id": "02054cb7-cdfb-4f42-bb44-c83648beac1a", "address": "fa:16:3e:f8:70:a5", "network": {"id": "a7f4226b-73fe-4265-ba2c-5d7dcdf154fd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1142462884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210837255c8148ec9b482ba3e2551362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02054cb7-cd", "ovs_interfaceid": "02054cb7-cdfb-4f42-bb44-c83648beac1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:06:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-1381c1af-e29f-4767-822b-43bb57131a68 req-0970cabc-56a9-4511-bfd0-a5ba046467b8 service nova] Releasing lock "refresh_cache-05e80bdd-ad15-4b98-b8ac-a40656f5f717" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:06:31 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:06:32 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG nova.compute.manager [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] Start spawning the instance on the hypervisor. {{(pid=72129) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] Creating instance directory {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 14:06:34 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] Creating image(s)
Aug 01 14:06:34 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] Did not create local disks {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] Ensure instance console log exists: /opt/stack/data/nova/instances/05e80bdd-ad15-4b98-b8ac-a40656f5f717/console.log {{(pid=72129) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] Start _get_guest_xml network_info=[{"id": "02054cb7-cdfb-4f42-bb44-c83648beac1a", "address": "fa:16:3e:f8:70:a5", "network": {"id": "a7f4226b-73fe-4265-ba2c-5d7dcdf154fd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1142462884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210837255c8148ec9b482ba3e2551362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02054cb7-cd", "ovs_interfaceid": "02054cb7-cdfb-4f42-bb44-c83648beac1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': 'ee1cc940-38c4-453d-b8d6-16e9ac34fe7e', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pedDTuLS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '05e80bdd-ad15-4b98-b8ac-a40656f5f717', 'attached_at': '', 'detached_at': '', 'volume_id': 'becf1ccd-4c86-418e-a9eb-be3cb1fff883', 'serial': 'becf1ccd-4c86-418e-a9eb-be3cb1fff883'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 14:06:34 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:06:34 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:06:34 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] CPU controller missing on host. {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] CPU controller found on host. {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72129) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T13:45:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Flavor limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Image limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Flavor pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Image pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Got 1 possible topologies {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] Calling os-brick to attach iSCSI Volume {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pedDTuLS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:06:34 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:06:34 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:06:34 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:06:34 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:06:34 user nova-compute[72129]: INFO os_brick.initiator.connectors.iscsi [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 14:06:34 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 -p 172.16.0.220:3260 {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[8631b866-aefc-46ee-8e3f-2cf34d45f12a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 14:06:34 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 -p 172.16.0.220:3260 --interface default --op new {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[fecbb6a2-67a0-4216-a43f-f960930b3a2d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883] added\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883] added
Aug 01 14:06:34 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9acc39-0335-4ab6-b73c-96e429359775]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15b1174-16f2-419e-be1f-e8979390b32d]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pedDTuLS {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pedDTuLS" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[bffc0d61-908a-4067-9863-4617d3283170]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pedDTuLS'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff783bc-2bc9-46ad-aae1-539565b7c666]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf799db-750b-4976-9012-1bc04c2fa1fe]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:06:34 user nova-compute[72129]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)
Aug 01 14:06:34 user nova-compute[72129]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 (non-flash)
Aug 01 14:06:34 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:06:34 user nova-compute[72129]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)
Aug 01 14:06:34 user nova-compute[72129]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 (non-flash)
Aug 01 14:06:34 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 -p 172.16.0.220:3260 --login {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d0747e-398a-4e9a-857b-cafc54c66375]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883, portal: 172.16.0.220,3260]
Aug 01 14:06:34 user nova-compute[72129]: Login to [iface: default, target: iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883, portal: 172.16.0.220,3260] successful.
Aug 01 14:06:34 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e7d47f-5ccb-4392-b434-b91cb4d54854]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae82f7a-d731-43d1-8d5d-b0334695f03e]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:06:34 user nova-compute[72129]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)
Aug 01 14:06:34 user nova-compute[72129]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 (non-flash)
Aug 01 14:06:34 user nova-compute[72129]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 (non-flash)
Aug 01 14:06:34 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:06:34 user nova-compute[72129]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)
Aug 01 14:06:34 user nova-compute[72129]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 (non-flash)
Aug 01 14:06:34 user nova-compute[72129]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 (non-flash)
Aug 01 14:06:34 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Connected to 172.16.0.220:3260 {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] HCTL ('35', '-', '-', 0) found on session 44 with lun 0 {{(pid=72129) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72129) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2713a8-01f0-4a45-b97b-9ace7f31241f]: (4, ('- - 0', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Searching for a device in session 44 and hctl ['35', '*', '*', 0] yield: None {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:06:34 user nova-compute[72129]: WARNING nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] While synchronizing instance power states, found 11 instances in the database and 10 instances on the hypervisor.
Aug 01 14:06:34 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Triggering sync for uuid 97a5dccf-b499-443a-b332-cfa293a16047 {{(pid=72129) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Triggering sync for uuid 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d {{(pid=72129) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Triggering sync for uuid d031973f-8f48-43b3-a338-040950103e4c {{(pid=72129) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Triggering sync for uuid 53b76ca4-30f0-4fd4-9928-714c7073a490 {{(pid=72129) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Triggering sync for uuid ea050cd6-60e9-41fd-a35c-05fe63d60e57 {{(pid=72129) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Triggering sync for uuid e2cf5877-55dd-44ce-9b58-b662afe8e62e {{(pid=72129) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Triggering sync for uuid 85062e35-e302-46f7-8d66-24cf9e7199f7 {{(pid=72129) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Triggering sync for uuid e4a13a50-fe03-41aa-94f4-3431805ff481 {{(pid=72129) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Triggering sync for uuid 0c43fda3-e098-4c3a-bcd5-14eac019db06 {{(pid=72129) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Triggering sync for uuid 418f4c53-9dc5-402f-ad21-ac481674b083 {{(pid=72129) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Triggering sync for uuid 05e80bdd-ad15-4b98-b8ac-a40656f5f717 {{(pid=72129) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "97a5dccf-b499-443a-b332-cfa293a16047" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "97a5dccf-b499-443a-b332-cfa293a16047" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "d031973f-8f48-43b3-a338-040950103e4c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "d031973f-8f48-43b3-a338-040950103e4c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "53b76ca4-30f0-4fd4-9928-714c7073a490" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "53b76ca4-30f0-4fd4-9928-714c7073a490" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "ea050cd6-60e9-41fd-a35c-05fe63d60e57" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "ea050cd6-60e9-41fd-a35c-05fe63d60e57" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "e2cf5877-55dd-44ce-9b58-b662afe8e62e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "e2cf5877-55dd-44ce-9b58-b662afe8e62e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "85062e35-e302-46f7-8d66-24cf9e7199f7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "85062e35-e302-46f7-8d66-24cf9e7199f7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "e4a13a50-fe03-41aa-94f4-3431805ff481" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "e4a13a50-fe03-41aa-94f4-3431805ff481" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "0c43fda3-e098-4c3a-bcd5-14eac019db06" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "0c43fda3-e098-4c3a-bcd5-14eac019db06" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:06:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "418f4c53-9dc5-402f-ad21-ac481674b083" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:06:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "418f4c53-9dc5-402f-ad21-ac481674b083" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:06:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "05e80bdd-ad15-4b98-b8ac-a40656f5f717" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:06:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "97a5dccf-b499-443a-b332-cfa293a16047" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:06:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:06:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "d031973f-8f48-43b3-a338-040950103e4c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:06:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "53b76ca4-30f0-4fd4-9928-714c7073a490" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.056s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:06:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "85062e35-e302-46f7-8d66-24cf9e7199f7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.059s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:06:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "e2cf5877-55dd-44ce-9b58-b662afe8e62e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.064s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:06:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "0c43fda3-e098-4c3a-bcd5-14eac019db06" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.067s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:06:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "ea050cd6-60e9-41fd-a35c-05fe63d60e57" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.073s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:06:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "418f4c53-9dc5-402f-ad21-ac481674b083" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.071s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:06:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "e4a13a50-fe03-41aa-94f4-3431805ff481" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:06:35 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Searching for a device in session 44 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 14:06:35 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pedDTuLS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 14:06:35 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:06:35 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23764633831346631', 'path': '/dev/sdd'} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:06:35 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23764633831346631', 'path': '/dev/sdd'} {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 14:06:35 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:06:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1298389106',display_name='tempest-TestVolumeBootPattern-server-1298389106',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1298389106',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNC/W23SfZUyUykD+/RvnPe5L4yiaqOIZwhr2x6wMubzv0aJUgMCBBDug36LSArw18K2rZhhyJmbPtRQrPLsQ9v32QcGWNTH4aynBroBlcsIvr6dB/z67zo0JXowDVQS+w==',key_name='tempest-TestVolumeBootPattern-1986080939',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='210837255c8148ec9b482ba3e2551362',ramdisk_id='',reservation_id='r-616xu2d9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1876154436',owner_user_name='tempest-TestVolumeBootPattern-1876154436-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T14:06:26Z,user_data=None,user_id='7c341be2816c43cfa9adb58ee84e942b',uuid=05e80bdd-ad15-4b98-b8ac-a40656f5f717,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02054cb7-cdfb-4f42-bb44-c83648beac1a", "address": "fa:16:3e:f8:70:a5", "network": {"id": "a7f4226b-73fe-4265-ba2c-5d7dcdf154fd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1142462884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210837255c8148ec9b482ba3e2551362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02054cb7-cd", "ovs_interfaceid": "02054cb7-cdfb-4f42-bb44-c83648beac1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 14:06:35 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Converting VIF {"id": "02054cb7-cdfb-4f42-bb44-c83648beac1a", "address": "fa:16:3e:f8:70:a5", "network": {"id": "a7f4226b-73fe-4265-ba2c-5d7dcdf154fd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1142462884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210837255c8148ec9b482ba3e2551362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02054cb7-cd", "ovs_interfaceid": "02054cb7-cdfb-4f42-bb44-c83648beac1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:06:35 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:70:a5,bridge_name='br-int',has_traffic_filtering=True,id=02054cb7-cdfb-4f42-bb44-c83648beac1a,network=Network(a7f4226b-73fe-4265-ba2c-5d7dcdf154fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02054cb7-cd') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:06:35 user nova-compute[72129]: DEBUG nova.objects.instance [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lazy-loading 'pci_devices' on Instance uuid 05e80bdd-ad15-4b98-b8ac-a40656f5f717 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:06:35 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] End _get_guest_xml xml=<domain type="kvm">
Aug 01 14:06:35 user nova-compute[72129]:   <uuid>05e80bdd-ad15-4b98-b8ac-a40656f5f717</uuid>
Aug 01 14:06:35 user nova-compute[72129]:   <name>instance-00000020</name>
Aug 01 14:06:35 user nova-compute[72129]:   <memory>524288</memory>
Aug 01 14:06:35 user nova-compute[72129]:   <vcpu>1</vcpu>
Aug 01 14:06:35 user nova-compute[72129]:   <metadata>
Aug 01 14:06:35 user nova-compute[72129]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 14:06:35 user nova-compute[72129]:       <nova:package version="0.0.0"/>
Aug 01 14:06:35 user nova-compute[72129]:       <nova:name>tempest-TestVolumeBootPattern-server-1298389106</nova:name>
Aug 01 14:06:35 user nova-compute[72129]:       <nova:creationTime>2023-08-01 14:06:34</nova:creationTime>
Aug 01 14:06:35 user nova-compute[72129]:       <nova:flavor name="m1.tiny">
Aug 01 14:06:35 user nova-compute[72129]:         <nova:memory>512</nova:memory>
Aug 01 14:06:35 user nova-compute[72129]:         <nova:disk>1</nova:disk>
Aug 01 14:06:35 user nova-compute[72129]:         <nova:swap>0</nova:swap>
Aug 01 14:06:35 user nova-compute[72129]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 14:06:35 user nova-compute[72129]:         <nova:vcpus>1</nova:vcpus>
Aug 01 14:06:35 user nova-compute[72129]:       </nova:flavor>
Aug 01 14:06:35 user nova-compute[72129]:       <nova:owner>
Aug 01 14:06:35 user nova-compute[72129]:         <nova:user uuid="7c341be2816c43cfa9adb58ee84e942b">tempest-TestVolumeBootPattern-1876154436-project-member</nova:user>
Aug 01 14:06:35 user nova-compute[72129]:         <nova:project uuid="210837255c8148ec9b482ba3e2551362">tempest-TestVolumeBootPattern-1876154436</nova:project>
Aug 01 14:06:35 user nova-compute[72129]:       </nova:owner>
Aug 01 14:06:35 user nova-compute[72129]:       <nova:ports>
Aug 01 14:06:35 user nova-compute[72129]:         <nova:port uuid="02054cb7-cdfb-4f42-bb44-c83648beac1a">
Aug 01 14:06:35 user nova-compute[72129]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 01 14:06:35 user nova-compute[72129]:         </nova:port>
Aug 01 14:06:35 user nova-compute[72129]:       </nova:ports>
Aug 01 14:06:35 user nova-compute[72129]:     </nova:instance>
Aug 01 14:06:35 user nova-compute[72129]:   </metadata>
Aug 01 14:06:35 user nova-compute[72129]:   <sysinfo type="smbios">
Aug 01 14:06:35 user nova-compute[72129]:     <system>
Aug 01 14:06:35 user nova-compute[72129]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 14:06:35 user nova-compute[72129]:       <entry name="product">OpenStack Nova</entry>
Aug 01 14:06:35 user nova-compute[72129]:       <entry name="version">0.0.0</entry>
Aug 01 14:06:35 user nova-compute[72129]:       <entry name="serial">05e80bdd-ad15-4b98-b8ac-a40656f5f717</entry>
Aug 01 14:06:35 user nova-compute[72129]:       <entry name="uuid">05e80bdd-ad15-4b98-b8ac-a40656f5f717</entry>
Aug 01 14:06:35 user nova-compute[72129]:       <entry name="family">Virtual Machine</entry>
Aug 01 14:06:35 user nova-compute[72129]:     </system>
Aug 01 14:06:35 user nova-compute[72129]:   </sysinfo>
Aug 01 14:06:35 user nova-compute[72129]:   <os>
Aug 01 14:06:35 user nova-compute[72129]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 14:06:35 user nova-compute[72129]:     <boot dev="hd"/>
Aug 01 14:06:35 user nova-compute[72129]:     <smbios mode="sysinfo"/>
Aug 01 14:06:35 user nova-compute[72129]:   </os>
Aug 01 14:06:35 user nova-compute[72129]:   <features>
Aug 01 14:06:35 user nova-compute[72129]:     <acpi/>
Aug 01 14:06:35 user nova-compute[72129]:     <apic/>
Aug 01 14:06:35 user nova-compute[72129]:     <vmcoreinfo/>
Aug 01 14:06:35 user nova-compute[72129]:   </features>
Aug 01 14:06:35 user nova-compute[72129]:   <clock offset="utc">
Aug 01 14:06:35 user nova-compute[72129]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 14:06:35 user nova-compute[72129]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 14:06:35 user nova-compute[72129]:     <timer name="hpet" present="no"/>
Aug 01 14:06:35 user nova-compute[72129]:   </clock>
Aug 01 14:06:35 user nova-compute[72129]:   <cpu mode="custom" match="exact">
Aug 01 14:06:35 user nova-compute[72129]:     <model>Nehalem</model>
Aug 01 14:06:35 user nova-compute[72129]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 14:06:35 user nova-compute[72129]:   </cpu>
Aug 01 14:06:35 user nova-compute[72129]:   <devices>
Aug 01 14:06:35 user nova-compute[72129]:     <disk type="block" device="disk">
Aug 01 14:06:35 user nova-compute[72129]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:06:35 user nova-compute[72129]:       <source dev="/dev/sdd"/>
Aug 01 14:06:35 user nova-compute[72129]:       <target dev="vda" bus="virtio"/>
Aug 01 14:06:35 user nova-compute[72129]:       <serial>becf1ccd-4c86-418e-a9eb-be3cb1fff883</serial>
Aug 01 14:06:35 user nova-compute[72129]:     </disk>
Aug 01 14:06:35 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 14:06:35 user nova-compute[72129]:       <mac address="fa:16:3e:f8:70:a5"/>
Aug 01 14:06:35 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:06:35 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 14:06:35 user nova-compute[72129]:       <target dev="tap02054cb7-cd"/>
Aug 01 14:06:35 user nova-compute[72129]:     </interface>
Aug 01 14:06:35 user nova-compute[72129]:     <serial type="pty">
Aug 01 14:06:35 user nova-compute[72129]:       <log file="/opt/stack/data/nova/instances/05e80bdd-ad15-4b98-b8ac-a40656f5f717/console.log" append="off"/>
Aug 01 14:06:35 user nova-compute[72129]:     </serial>
Aug 01 14:06:35 user nova-compute[72129]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 14:06:35 user nova-compute[72129]:     <video>
Aug 01 14:06:35 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:06:35 user nova-compute[72129]:     </video>
Aug 01 14:06:35 user nova-compute[72129]:     <rng model="virtio">
Aug 01 14:06:35 user nova-compute[72129]:       <backend model="random">/dev/urandom</backend>
Aug 01 14:06:35 user nova-compute[72129]:     </rng>
Aug 01 14:06:35 user nova-compute[72129]:     <controller type="usb" index="0" model="none"/>
Aug 01 14:06:35 user nova-compute[72129]:     <memballoon model="virtio">
Aug 01 14:06:35 user nova-compute[72129]:       <stats period="10"/>
Aug 01 14:06:35 user nova-compute[72129]:     </memballoon>
Aug 01 14:06:35 user nova-compute[72129]:   </devices>
Aug 01 14:06:35 user nova-compute[72129]: </domain>
Aug 01 14:06:35 user nova-compute[72129]:  {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 14:06:35 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:06:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1298389106',display_name='tempest-TestVolumeBootPattern-server-1298389106',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1298389106',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNC/W23SfZUyUykD+/RvnPe5L4yiaqOIZwhr2x6wMubzv0aJUgMCBBDug36LSArw18K2rZhhyJmbPtRQrPLsQ9v32QcGWNTH4aynBroBlcsIvr6dB/z67zo0JXowDVQS+w==',key_name='tempest-TestVolumeBootPattern-1986080939',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='210837255c8148ec9b482ba3e2551362',ramdisk_id='',reservation_id='r-616xu2d9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1876154436',owner_user_name='tempest-TestVolumeBootPattern-1876154436-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T14:06:26Z,user_data=None,user_id='7c341be2816c43cfa9adb58ee84e942b',uuid=05e80bdd-ad15-4b98-b8ac-a40656f5f717,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02054cb7-cdfb-4f42-bb44-c83648beac1a", "address": "fa:16:3e:f8:70:a5", "network": {"id": "a7f4226b-73fe-4265-ba2c-5d7dcdf154fd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1142462884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210837255c8148ec9b482ba3e2551362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02054cb7-cd", "ovs_interfaceid": "02054cb7-cdfb-4f42-bb44-c83648beac1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 14:06:35 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Converting VIF {"id": "02054cb7-cdfb-4f42-bb44-c83648beac1a", "address": "fa:16:3e:f8:70:a5", "network": {"id": "a7f4226b-73fe-4265-ba2c-5d7dcdf154fd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1142462884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210837255c8148ec9b482ba3e2551362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02054cb7-cd", "ovs_interfaceid": "02054cb7-cdfb-4f42-bb44-c83648beac1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:06:35 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:70:a5,bridge_name='br-int',has_traffic_filtering=True,id=02054cb7-cdfb-4f42-bb44-c83648beac1a,network=Network(a7f4226b-73fe-4265-ba2c-5d7dcdf154fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02054cb7-cd') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:06:35 user nova-compute[72129]: DEBUG os_vif [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:70:a5,bridge_name='br-int',has_traffic_filtering=True,id=02054cb7-cdfb-4f42-bb44-c83648beac1a,network=Network(a7f4226b-73fe-4265-ba2c-5d7dcdf154fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02054cb7-cd') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 14:06:35 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:06:35 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:06:35 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 14:06:35 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:06:35 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap02054cb7-cd, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:06:35 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap02054cb7-cd, col_values=(('external_ids', {'iface-id': '02054cb7-cdfb-4f42-bb44-c83648beac1a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:70:a5', 'vm-uuid': '05e80bdd-ad15-4b98-b8ac-a40656f5f717'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:06:35 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:06:35 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:06:35 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:06:35 user nova-compute[72129]: INFO os_vif [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:70:a5,bridge_name='br-int',has_traffic_filtering=True,id=02054cb7-cdfb-4f42-bb44-c83648beac1a,network=Network(a7f4226b-73fe-4265-ba2c-5d7dcdf154fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02054cb7-cd')
Aug 01 14:06:35 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:06:35 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] No VIF found with MAC fa:16:3e:f8:70:a5, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 14:06:36 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:06:36 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:06:37 user nova-compute[72129]: DEBUG nova.compute.manager [req-b43d4098-88f1-4380-81f1-af84d3169941 req-1a694c4f-f0a1-414c-9052-61d9feee7803 service nova] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] Received event network-vif-plugged-02054cb7-cdfb-4f42-bb44-c83648beac1a {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:06:37 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-b43d4098-88f1-4380-81f1-af84d3169941 req-1a694c4f-f0a1-414c-9052-61d9feee7803 service nova] Acquiring lock "05e80bdd-ad15-4b98-b8ac-a40656f5f717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:06:37 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-b43d4098-88f1-4380-81f1-af84d3169941 req-1a694c4f-f0a1-414c-9052-61d9feee7803 service nova] Lock "05e80bdd-ad15-4b98-b8ac-a40656f5f717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:06:37 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-b43d4098-88f1-4380-81f1-af84d3169941 req-1a694c4f-f0a1-414c-9052-61d9feee7803 service nova] Lock "05e80bdd-ad15-4b98-b8ac-a40656f5f717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:06:37 user nova-compute[72129]: DEBUG nova.compute.manager [req-b43d4098-88f1-4380-81f1-af84d3169941 req-1a694c4f-f0a1-414c-9052-61d9feee7803 service nova] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] No waiting events found dispatching network-vif-plugged-02054cb7-cdfb-4f42-bb44-c83648beac1a {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:06:37 user nova-compute[72129]: WARNING nova.compute.manager [req-b43d4098-88f1-4380-81f1-af84d3169941 req-1a694c4f-f0a1-414c-9052-61d9feee7803 service nova] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] Received unexpected event network-vif-plugged-02054cb7-cdfb-4f42-bb44-c83648beac1a for instance with vm_state building and task_state spawning.
Aug 01 14:06:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:06:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:06:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:06:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:06:37 user nova-compute[72129]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690898782.6040711, 3891b9d3-832d-4ef7-8ebb-970ddd0a387a => Stopped> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:06:37 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] VM Stopped (Lifecycle Event)
Aug 01 14:06:37 user nova-compute[72129]: DEBUG nova.compute.manager [None req-d13b79bc-b34a-48bf-a254-e008acfdb620 None None] [instance: 3891b9d3-832d-4ef7-8ebb-970ddd0a387a] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:06:38 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898798.9344637, 05e80bdd-ad15-4b98-b8ac-a40656f5f717 => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:06:38 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] VM Resumed (Lifecycle Event)
Aug 01 14:06:38 user nova-compute[72129]: DEBUG nova.compute.manager [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] Instance event wait completed in 0 seconds for  {{(pid=72129) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 14:06:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] Guest created on hypervisor {{(pid=72129) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 14:06:38 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] Instance spawned successfully.
Aug 01 14:06:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 14:06:38 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:06:38 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:06:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] Found default for hw_cdrom_bus of ide {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:06:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] Found default for hw_disk_bus of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:06:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] Found default for hw_input_bus of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:06:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] Found default for hw_pointer_model of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:06:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] Found default for hw_video_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:06:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] Found default for hw_vif_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:06:38 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 14:06:38 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898798.9377723, 05e80bdd-ad15-4b98-b8ac-a40656f5f717 => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:06:38 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] VM Started (Lifecycle Event)
Aug 01 14:06:39 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:06:39 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:06:39 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 14:06:39 user nova-compute[72129]: INFO nova.compute.manager [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] Took 4.98 seconds to spawn the instance on the hypervisor.
Aug 01 14:06:39 user nova-compute[72129]: DEBUG nova.compute.manager [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:06:39 user nova-compute[72129]: DEBUG nova.compute.manager [req-116082ff-eec5-401d-8ff3-31d5430df970 req-bb1e08c0-dc73-4c62-bc0e-bc0a9a28dab1 service nova] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] Received event network-vif-plugged-02054cb7-cdfb-4f42-bb44-c83648beac1a {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:06:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-116082ff-eec5-401d-8ff3-31d5430df970 req-bb1e08c0-dc73-4c62-bc0e-bc0a9a28dab1 service nova] Acquiring lock "05e80bdd-ad15-4b98-b8ac-a40656f5f717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:06:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-116082ff-eec5-401d-8ff3-31d5430df970 req-bb1e08c0-dc73-4c62-bc0e-bc0a9a28dab1 service nova] Lock "05e80bdd-ad15-4b98-b8ac-a40656f5f717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:06:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-116082ff-eec5-401d-8ff3-31d5430df970 req-bb1e08c0-dc73-4c62-bc0e-bc0a9a28dab1 service nova] Lock "05e80bdd-ad15-4b98-b8ac-a40656f5f717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:06:39 user nova-compute[72129]: DEBUG nova.compute.manager [req-116082ff-eec5-401d-8ff3-31d5430df970 req-bb1e08c0-dc73-4c62-bc0e-bc0a9a28dab1 service nova] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] No waiting events found dispatching network-vif-plugged-02054cb7-cdfb-4f42-bb44-c83648beac1a {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:06:39 user nova-compute[72129]: WARNING nova.compute.manager [req-116082ff-eec5-401d-8ff3-31d5430df970 req-bb1e08c0-dc73-4c62-bc0e-bc0a9a28dab1 service nova] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] Received unexpected event network-vif-plugged-02054cb7-cdfb-4f42-bb44-c83648beac1a for instance with vm_state building and task_state spawning.
Aug 01 14:06:39 user nova-compute[72129]: INFO nova.compute.manager [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] Took 13.41 seconds to build instance.
Aug 01 14:06:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b32631c9-e21a-4ad0-b5d4-36f7c8139177 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "05e80bdd-ad15-4b98-b8ac-a40656f5f717" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.516s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:06:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "05e80bdd-ad15-4b98-b8ac-a40656f5f717" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 4.174s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:06:39 user nova-compute[72129]: INFO nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 14:06:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "05e80bdd-ad15-4b98-b8ac-a40656f5f717" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:06:40 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-49bd2884-581d-41ee-adf6-058e5ee55143 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Acquiring lock "85062e35-e302-46f7-8d66-24cf9e7199f7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:06:40 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-49bd2884-581d-41ee-adf6-058e5ee55143 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lock "85062e35-e302-46f7-8d66-24cf9e7199f7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:06:40 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-49bd2884-581d-41ee-adf6-058e5ee55143 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Acquiring lock "85062e35-e302-46f7-8d66-24cf9e7199f7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:06:40 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-49bd2884-581d-41ee-adf6-058e5ee55143 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lock "85062e35-e302-46f7-8d66-24cf9e7199f7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:06:40 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-49bd2884-581d-41ee-adf6-058e5ee55143 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lock "85062e35-e302-46f7-8d66-24cf9e7199f7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:06:40 user nova-compute[72129]: INFO nova.compute.manager [None req-49bd2884-581d-41ee-adf6-058e5ee55143 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Terminating instance
Aug 01 14:06:40 user nova-compute[72129]: DEBUG nova.compute.manager [None req-49bd2884-581d-41ee-adf6-058e5ee55143 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Start destroying the instance on the hypervisor. {{(pid=72129) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 14:06:40 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:06:40 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:06:40 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:06:40 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:06:40 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:06:40 user nova-compute[72129]: DEBUG nova.compute.manager [req-6fa8c1e7-11b9-4613-a9de-dec2211a4417 req-c4b9ec2e-6066-4107-a34c-ac97d5ea9f8f service nova] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Received event network-vif-unplugged-b5a06a08-bb00-4551-afd4-09ad16fe0837 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:06:40 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-6fa8c1e7-11b9-4613-a9de-dec2211a4417 req-c4b9ec2e-6066-4107-a34c-ac97d5ea9f8f service nova] Acquiring lock "85062e35-e302-46f7-8d66-24cf9e7199f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:06:40 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-6fa8c1e7-11b9-4613-a9de-dec2211a4417 req-c4b9ec2e-6066-4107-a34c-ac97d5ea9f8f service nova] Lock "85062e35-e302-46f7-8d66-24cf9e7199f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:06:40 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-6fa8c1e7-11b9-4613-a9de-dec2211a4417 req-c4b9ec2e-6066-4107-a34c-ac97d5ea9f8f service nova] Lock "85062e35-e302-46f7-8d66-24cf9e7199f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:06:40 user nova-compute[72129]: DEBUG nova.compute.manager [req-6fa8c1e7-11b9-4613-a9de-dec2211a4417 req-c4b9ec2e-6066-4107-a34c-ac97d5ea9f8f service nova] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] No waiting events found dispatching network-vif-unplugged-b5a06a08-bb00-4551-afd4-09ad16fe0837 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:06:40 user nova-compute[72129]: DEBUG nova.compute.manager [req-6fa8c1e7-11b9-4613-a9de-dec2211a4417 req-c4b9ec2e-6066-4107-a34c-ac97d5ea9f8f service nova] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Received event network-vif-unplugged-b5a06a08-bb00-4551-afd4-09ad16fe0837 for instance with task_state deleting. {{(pid=72129) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 14:06:40 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Instance destroyed successfully.
Aug 01 14:06:40 user nova-compute[72129]: DEBUG nova.objects.instance [None req-49bd2884-581d-41ee-adf6-058e5ee55143 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lazy-loading 'resources' on Instance uuid 85062e35-e302-46f7-8d66-24cf9e7199f7 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:06:40 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-49bd2884-581d-41ee-adf6-058e5ee55143 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:01:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1815756546',display_name='tempest-TestMinimumBasicScenario-server-1815756546',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1815756546',id=27,image_ref='0ffa7332-fe08-47e4-9715-9a8035cfdf9d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPLimLyDA0xdO+mEA2DIQ2NJZ1dYA9kFGcV/3bF0IImHB8xaljK7Jn2z2l098SgZ7DcycdVj15PtLrYlN6satpgWup62s4m5PkQI7r4Vb5rFD2JUNyQuhZ7GwdzOMfUOw==',key_name='tempest-TestMinimumBasicScenario-366479569',keypairs=<?>,launch_index=0,launched_at=2023-08-01T14:01:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='43253b37caa747b090b14c707abf96cf',ramdisk_id='',reservation_id='r-bafc57et',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0ffa7332-fe08-47e4-9715-9a8035cfdf9d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-833844079',owner_user_name='tempest-TestMinimumBasicScenario-833844079-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T14:04:00Z,user_data=None,user_id='8acae20eb69f40c08bbe0799513b95e1',uuid=85062e35-e302-46f7-8d66-24cf9e7199f7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b5a06a08-bb00-4551-afd4-09ad16fe0837", "address": "fa:16:3e:9d:bc:ca", "network": {"id": "a7ec6cc0-140b-446b-ae97-d4aafbc42693", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-397303278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43253b37caa747b090b14c707abf96cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5a06a08-bb", "ovs_interfaceid": "b5a06a08-bb00-4551-afd4-09ad16fe0837", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 14:06:40 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-49bd2884-581d-41ee-adf6-058e5ee55143 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Converting VIF {"id": "b5a06a08-bb00-4551-afd4-09ad16fe0837", "address": "fa:16:3e:9d:bc:ca", "network": {"id": "a7ec6cc0-140b-446b-ae97-d4aafbc42693", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-397303278-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43253b37caa747b090b14c707abf96cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5a06a08-bb", "ovs_interfaceid": "b5a06a08-bb00-4551-afd4-09ad16fe0837", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:06:40 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-49bd2884-581d-41ee-adf6-058e5ee55143 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9d:bc:ca,bridge_name='br-int',has_traffic_filtering=True,id=b5a06a08-bb00-4551-afd4-09ad16fe0837,network=Network(a7ec6cc0-140b-446b-ae97-d4aafbc42693),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5a06a08-bb') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:06:40 user nova-compute[72129]: DEBUG os_vif [None req-49bd2884-581d-41ee-adf6-058e5ee55143 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:bc:ca,bridge_name='br-int',has_traffic_filtering=True,id=b5a06a08-bb00-4551-afd4-09ad16fe0837,network=Network(a7ec6cc0-140b-446b-ae97-d4aafbc42693),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5a06a08-bb') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 14:06:40 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:06:40 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb5a06a08-bb, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:06:40 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:06:40 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:06:40 user nova-compute[72129]: INFO os_vif [None req-49bd2884-581d-41ee-adf6-058e5ee55143 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:bc:ca,bridge_name='br-int',has_traffic_filtering=True,id=b5a06a08-bb00-4551-afd4-09ad16fe0837,network=Network(a7ec6cc0-140b-446b-ae97-d4aafbc42693),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5a06a08-bb')
Aug 01 14:06:40 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-49bd2884-581d-41ee-adf6-058e5ee55143 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Deleting instance files /opt/stack/data/nova/instances/85062e35-e302-46f7-8d66-24cf9e7199f7_del
Aug 01 14:06:40 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-49bd2884-581d-41ee-adf6-058e5ee55143 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Deletion of /opt/stack/data/nova/instances/85062e35-e302-46f7-8d66-24cf9e7199f7_del complete
Aug 01 14:06:41 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:06:41 user nova-compute[72129]: INFO nova.compute.manager [None req-49bd2884-581d-41ee-adf6-058e5ee55143 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 01 14:06:41 user nova-compute[72129]: DEBUG oslo.service.loopingcall [None req-49bd2884-581d-41ee-adf6-058e5ee55143 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72129) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 14:06:41 user nova-compute[72129]: DEBUG nova.compute.manager [-] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Deallocating network for instance {{(pid=72129) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 14:06:41 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] deallocate_for_instance() {{(pid=72129) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 14:06:41 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:06:41 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Took 0.61 seconds to deallocate network for instance.
Aug 01 14:06:41 user nova-compute[72129]: DEBUG nova.compute.manager [req-c193c600-33c3-4caf-b340-d67b52bef574 req-12e6f6dd-d226-45ec-b456-3af91a2e71dc service nova] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Received event network-vif-deleted-b5a06a08-bb00-4551-afd4-09ad16fe0837 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:06:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-49bd2884-581d-41ee-adf6-058e5ee55143 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:06:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-49bd2884-581d-41ee-adf6-058e5ee55143 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:06:42 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-49bd2884-581d-41ee-adf6-058e5ee55143 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:06:42 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-49bd2884-581d-41ee-adf6-058e5ee55143 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:06:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-49bd2884-581d-41ee-adf6-058e5ee55143 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.379s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:06:42 user nova-compute[72129]: INFO nova.scheduler.client.report [None req-49bd2884-581d-41ee-adf6-058e5ee55143 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Deleted allocations for instance 85062e35-e302-46f7-8d66-24cf9e7199f7
Aug 01 14:06:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-49bd2884-581d-41ee-adf6-058e5ee55143 tempest-TestMinimumBasicScenario-833844079 tempest-TestMinimumBasicScenario-833844079-project-member] Lock "85062e35-e302-46f7-8d66-24cf9e7199f7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.088s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:06:42 user nova-compute[72129]: DEBUG nova.compute.manager [req-92e4af7e-177a-49da-9c0d-a061e3698180 req-578dfea8-7e5f-49f1-8519-0f4039c9ee03 service nova] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Received event network-vif-plugged-b5a06a08-bb00-4551-afd4-09ad16fe0837 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:06:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-92e4af7e-177a-49da-9c0d-a061e3698180 req-578dfea8-7e5f-49f1-8519-0f4039c9ee03 service nova] Acquiring lock "85062e35-e302-46f7-8d66-24cf9e7199f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:06:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-92e4af7e-177a-49da-9c0d-a061e3698180 req-578dfea8-7e5f-49f1-8519-0f4039c9ee03 service nova] Lock "85062e35-e302-46f7-8d66-24cf9e7199f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:06:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-92e4af7e-177a-49da-9c0d-a061e3698180 req-578dfea8-7e5f-49f1-8519-0f4039c9ee03 service nova] Lock "85062e35-e302-46f7-8d66-24cf9e7199f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:06:42 user nova-compute[72129]: DEBUG nova.compute.manager [req-92e4af7e-177a-49da-9c0d-a061e3698180 req-578dfea8-7e5f-49f1-8519-0f4039c9ee03 service nova] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] No waiting events found dispatching network-vif-plugged-b5a06a08-bb00-4551-afd4-09ad16fe0837 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:06:42 user nova-compute[72129]: WARNING nova.compute.manager [req-92e4af7e-177a-49da-9c0d-a061e3698180 req-578dfea8-7e5f-49f1-8519-0f4039c9ee03 service nova] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Received unexpected event network-vif-plugged-b5a06a08-bb00-4551-afd4-09ad16fe0837 for instance with vm_state deleted and task_state None.
Aug 01 14:06:45 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:06:49 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:06:50 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:06:50 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:06:50 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72129) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 14:06:50 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:06:50 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:06:50 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72129) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 14:06:50 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:06:50 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:06:50 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:06:51 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:06:51 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Starting heal instance info cache {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 14:06:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "refresh_cache-ea050cd6-60e9-41fd-a35c-05fe63d60e57" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:06:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquired lock "refresh_cache-ea050cd6-60e9-41fd-a35c-05fe63d60e57" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:06:51 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Forcefully refreshing network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 14:06:51 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Updating instance_info_cache with network_info: [{"id": "fe1f3453-e3ae-494c-965a-c20868179163", "address": "fa:16:3e:d8:46:16", "network": {"id": "ce187b11-5e3e-45a9-af0f-0be815ad0a3d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1245856112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0a13467840342f281bd8b8e115eccaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1f3453-e3", "ovs_interfaceid": "fe1f3453-e3ae-494c-965a-c20868179163", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:06:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Releasing lock "refresh_cache-ea050cd6-60e9-41fd-a35c-05fe63d60e57" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:06:51 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Updated the network info_cache for instance {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 14:06:51 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:06:51 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:06:53 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:06:55 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:06:55 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:06:55 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:06:55 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:06:55 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:06:55 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Auditing locally available compute resources for user (node: user) {{(pid=72129) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 14:06:55 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 14:06:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:06:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:06:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:06:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:06:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c43fda3-e098-4c3a-bcd5-14eac019db06/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:06:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c43fda3-e098-4c3a-bcd5-14eac019db06/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:06:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c43fda3-e098-4c3a-bcd5-14eac019db06/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:06:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c43fda3-e098-4c3a-bcd5-14eac019db06/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:06:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53b76ca4-30f0-4fd4-9928-714c7073a490/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:06:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53b76ca4-30f0-4fd4-9928-714c7073a490/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:06:55 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53b76ca4-30f0-4fd4-9928-714c7073a490/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:06:55 user nova-compute[72129]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690898800.9574375, 85062e35-e302-46f7-8d66-24cf9e7199f7 => Stopped> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:06:55 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] VM Stopped (Lifecycle Event)
Aug 01 14:06:55 user nova-compute[72129]: DEBUG nova.compute.manager [None req-15ddd17f-00d4-4fe2-9b12-65d2c3c72cf1 None None] [instance: 85062e35-e302-46f7-8d66-24cf9e7199f7] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:06:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:06:56 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:06:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53b76ca4-30f0-4fd4-9928-714c7073a490/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:06:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:06:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:06:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:06:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:06:56 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 14:06:56 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 14:06:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cf5877-55dd-44ce-9b58-b662afe8e62e/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:06:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cf5877-55dd-44ce-9b58-b662afe8e62e/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:06:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cf5877-55dd-44ce-9b58-b662afe8e62e/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:06:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cf5877-55dd-44ce-9b58-b662afe8e62e/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:06:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea050cd6-60e9-41fd-a35c-05fe63d60e57/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:06:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea050cd6-60e9-41fd-a35c-05fe63d60e57/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:06:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea050cd6-60e9-41fd-a35c-05fe63d60e57/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:06:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea050cd6-60e9-41fd-a35c-05fe63d60e57/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:06:56 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 14:06:57 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:06:57 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:06:57 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Hypervisor/Node resource view: name=user free_ram=7455MB free_disk=25.000614166259766GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72129) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 14:06:57 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:06:57 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:06:57 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 97a5dccf-b499-443a-b332-cfa293a16047 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:06:57 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:06:57 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance d031973f-8f48-43b3-a338-040950103e4c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:06:57 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 53b76ca4-30f0-4fd4-9928-714c7073a490 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:06:57 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance ea050cd6-60e9-41fd-a35c-05fe63d60e57 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:06:57 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance e2cf5877-55dd-44ce-9b58-b662afe8e62e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:06:57 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 0c43fda3-e098-4c3a-bcd5-14eac019db06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:06:57 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance e4a13a50-fe03-41aa-94f4-3431805ff481 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:06:57 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 418f4c53-9dc5-402f-ad21-ac481674b083 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:06:57 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 05e80bdd-ad15-4b98-b8ac-a40656f5f717 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:06:57 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 14:06:57 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 14:06:57 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:06:57 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:06:57 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Compute_service record updated for user:user {{(pid=72129) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 14:06:57 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.465s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:06:58 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-6c928925-c432-41b8-ae28-6d9d3d5df0dd tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Acquiring lock "53b76ca4-30f0-4fd4-9928-714c7073a490" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:06:58 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-6c928925-c432-41b8-ae28-6d9d3d5df0dd tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "53b76ca4-30f0-4fd4-9928-714c7073a490" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:06:58 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-6c928925-c432-41b8-ae28-6d9d3d5df0dd tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Acquiring lock "53b76ca4-30f0-4fd4-9928-714c7073a490-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:06:58 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-6c928925-c432-41b8-ae28-6d9d3d5df0dd tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "53b76ca4-30f0-4fd4-9928-714c7073a490-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:06:58 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-6c928925-c432-41b8-ae28-6d9d3d5df0dd tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "53b76ca4-30f0-4fd4-9928-714c7073a490-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:06:58 user nova-compute[72129]: INFO nova.compute.manager [None req-6c928925-c432-41b8-ae28-6d9d3d5df0dd tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Terminating instance
Aug 01 14:06:58 user nova-compute[72129]: DEBUG nova.compute.manager [None req-6c928925-c432-41b8-ae28-6d9d3d5df0dd tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Start destroying the instance on the hypervisor. {{(pid=72129) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 14:06:58 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:06:58 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:06:58 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:06:58 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:06:59 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Instance destroyed successfully.
Aug 01 14:06:59 user nova-compute[72129]: DEBUG nova.objects.instance [None req-6c928925-c432-41b8-ae28-6d9d3d5df0dd tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lazy-loading 'resources' on Instance uuid 53b76ca4-30f0-4fd4-9928-714c7073a490 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:06:59 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-6c928925-c432-41b8-ae28-6d9d3d5df0dd tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:57:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-850515568',display_name='tempest-AttachVolumeTestJSON-server-850515568',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-850515568',id=20,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMYJypdJqmxJKXNm404Q0Cl0WuuC4kkdldjTIBUyN/EtYQvDQbUuKBkqlwMSJuSlO9CdP4jtMdwoobiqIkSyVtZDYG9OaB7GLwJQRR3hShHH6YafWHv11ydfwe0fTFZOZw==',key_name='tempest-keypair-1711923464',keypairs=<?>,launch_index=0,launched_at=2023-08-01T13:57:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a6120989bad342a4a6fa2a8975f5932f',ramdisk_id='',reservation_id='r-84r01nk5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-55653475',owner_user_name='tempest-AttachVolumeTestJSON-55653475-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T14:05:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13a3c19bbcbb4833abbb2997944a6564',uuid=53b76ca4-30f0-4fd4-9928-714c7073a490,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b7271bae-a440-4d06-87d0-cece38122deb", "address": "fa:16:3e:6b:eb:be", "network": {"id": "b0eb2211-5a6a-4b7e-a119-92a0f0deb947", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1159988670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6120989bad342a4a6fa2a8975f5932f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7271bae-a4", "ovs_interfaceid": "b7271bae-a440-4d06-87d0-cece38122deb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 14:06:59 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-6c928925-c432-41b8-ae28-6d9d3d5df0dd tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Converting VIF {"id": "b7271bae-a440-4d06-87d0-cece38122deb", "address": "fa:16:3e:6b:eb:be", "network": {"id": "b0eb2211-5a6a-4b7e-a119-92a0f0deb947", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1159988670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6120989bad342a4a6fa2a8975f5932f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7271bae-a4", "ovs_interfaceid": "b7271bae-a440-4d06-87d0-cece38122deb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:06:59 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-6c928925-c432-41b8-ae28-6d9d3d5df0dd tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6b:eb:be,bridge_name='br-int',has_traffic_filtering=True,id=b7271bae-a440-4d06-87d0-cece38122deb,network=Network(b0eb2211-5a6a-4b7e-a119-92a0f0deb947),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7271bae-a4') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:06:59 user nova-compute[72129]: DEBUG os_vif [None req-6c928925-c432-41b8-ae28-6d9d3d5df0dd tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:eb:be,bridge_name='br-int',has_traffic_filtering=True,id=b7271bae-a440-4d06-87d0-cece38122deb,network=Network(b0eb2211-5a6a-4b7e-a119-92a0f0deb947),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7271bae-a4') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 14:06:59 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:06:59 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb7271bae-a4, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:06:59 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:06:59 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:06:59 user nova-compute[72129]: INFO os_vif [None req-6c928925-c432-41b8-ae28-6d9d3d5df0dd tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:eb:be,bridge_name='br-int',has_traffic_filtering=True,id=b7271bae-a440-4d06-87d0-cece38122deb,network=Network(b0eb2211-5a6a-4b7e-a119-92a0f0deb947),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7271bae-a4')
Aug 01 14:06:59 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-6c928925-c432-41b8-ae28-6d9d3d5df0dd tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Deleting instance files /opt/stack/data/nova/instances/53b76ca4-30f0-4fd4-9928-714c7073a490_del
Aug 01 14:06:59 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-6c928925-c432-41b8-ae28-6d9d3d5df0dd tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Deletion of /opt/stack/data/nova/instances/53b76ca4-30f0-4fd4-9928-714c7073a490_del complete
Aug 01 14:06:59 user nova-compute[72129]: DEBUG nova.compute.manager [req-86c5e1fe-c3a0-4db2-886c-66d78d5e867f req-a8838fea-2bdb-4f90-ba77-cec12d50785f service nova] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Received event network-vif-unplugged-b7271bae-a440-4d06-87d0-cece38122deb {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:06:59 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-86c5e1fe-c3a0-4db2-886c-66d78d5e867f req-a8838fea-2bdb-4f90-ba77-cec12d50785f service nova] Acquiring lock "53b76ca4-30f0-4fd4-9928-714c7073a490-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:06:59 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-86c5e1fe-c3a0-4db2-886c-66d78d5e867f req-a8838fea-2bdb-4f90-ba77-cec12d50785f service nova] Lock "53b76ca4-30f0-4fd4-9928-714c7073a490-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:06:59 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-86c5e1fe-c3a0-4db2-886c-66d78d5e867f req-a8838fea-2bdb-4f90-ba77-cec12d50785f service nova] Lock "53b76ca4-30f0-4fd4-9928-714c7073a490-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:06:59 user nova-compute[72129]: DEBUG nova.compute.manager [req-86c5e1fe-c3a0-4db2-886c-66d78d5e867f req-a8838fea-2bdb-4f90-ba77-cec12d50785f service nova] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] No waiting events found dispatching network-vif-unplugged-b7271bae-a440-4d06-87d0-cece38122deb {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:06:59 user nova-compute[72129]: DEBUG nova.compute.manager [req-86c5e1fe-c3a0-4db2-886c-66d78d5e867f req-a8838fea-2bdb-4f90-ba77-cec12d50785f service nova] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Received event network-vif-unplugged-b7271bae-a440-4d06-87d0-cece38122deb for instance with task_state deleting. {{(pid=72129) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 14:06:59 user nova-compute[72129]: INFO nova.compute.manager [None req-6c928925-c432-41b8-ae28-6d9d3d5df0dd tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 01 14:06:59 user nova-compute[72129]: DEBUG oslo.service.loopingcall [None req-6c928925-c432-41b8-ae28-6d9d3d5df0dd tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72129) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 14:06:59 user nova-compute[72129]: DEBUG nova.compute.manager [-] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Deallocating network for instance {{(pid=72129) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 14:06:59 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] deallocate_for_instance() {{(pid=72129) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 14:07:00 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:07:00 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Took 1.02 seconds to deallocate network for instance.
Aug 01 14:07:00 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-6c928925-c432-41b8-ae28-6d9d3d5df0dd tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:07:00 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-6c928925-c432-41b8-ae28-6d9d3d5df0dd tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:07:00 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-6c928925-c432-41b8-ae28-6d9d3d5df0dd tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:07:00 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-6c928925-c432-41b8-ae28-6d9d3d5df0dd tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:07:00 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-6c928925-c432-41b8-ae28-6d9d3d5df0dd tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.376s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:07:00 user nova-compute[72129]: INFO nova.scheduler.client.report [None req-6c928925-c432-41b8-ae28-6d9d3d5df0dd tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Deleted allocations for instance 53b76ca4-30f0-4fd4-9928-714c7073a490
Aug 01 14:07:00 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-6c928925-c432-41b8-ae28-6d9d3d5df0dd tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "53b76ca4-30f0-4fd4-9928-714c7073a490" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.481s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:07:01 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:07:01 user nova-compute[72129]: DEBUG nova.compute.manager [req-bd15f38f-a931-4221-9a56-bc26e8263c7c req-931b5351-6f86-43e1-b218-0c1c71cbe989 service nova] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Received event network-vif-plugged-b7271bae-a440-4d06-87d0-cece38122deb {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:07:01 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-bd15f38f-a931-4221-9a56-bc26e8263c7c req-931b5351-6f86-43e1-b218-0c1c71cbe989 service nova] Acquiring lock "53b76ca4-30f0-4fd4-9928-714c7073a490-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:07:01 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-bd15f38f-a931-4221-9a56-bc26e8263c7c req-931b5351-6f86-43e1-b218-0c1c71cbe989 service nova] Lock "53b76ca4-30f0-4fd4-9928-714c7073a490-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:07:01 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-bd15f38f-a931-4221-9a56-bc26e8263c7c req-931b5351-6f86-43e1-b218-0c1c71cbe989 service nova] Lock "53b76ca4-30f0-4fd4-9928-714c7073a490-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:07:01 user nova-compute[72129]: DEBUG nova.compute.manager [req-bd15f38f-a931-4221-9a56-bc26e8263c7c req-931b5351-6f86-43e1-b218-0c1c71cbe989 service nova] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] No waiting events found dispatching network-vif-plugged-b7271bae-a440-4d06-87d0-cece38122deb {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:07:01 user nova-compute[72129]: WARNING nova.compute.manager [req-bd15f38f-a931-4221-9a56-bc26e8263c7c req-931b5351-6f86-43e1-b218-0c1c71cbe989 service nova] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Received unexpected event network-vif-plugged-b7271bae-a440-4d06-87d0-cece38122deb for instance with vm_state deleted and task_state None.
Aug 01 14:07:01 user nova-compute[72129]: DEBUG nova.compute.manager [req-bd15f38f-a931-4221-9a56-bc26e8263c7c req-931b5351-6f86-43e1-b218-0c1c71cbe989 service nova] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Received event network-vif-deleted-b7271bae-a440-4d06-87d0-cece38122deb {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:07:04 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:07:05 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-27caabdf-79bd-4440-975a-b3c3461c85da tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Acquiring lock "ea050cd6-60e9-41fd-a35c-05fe63d60e57" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:07:05 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-27caabdf-79bd-4440-975a-b3c3461c85da tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Lock "ea050cd6-60e9-41fd-a35c-05fe63d60e57" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:07:05 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-27caabdf-79bd-4440-975a-b3c3461c85da tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Acquiring lock "ea050cd6-60e9-41fd-a35c-05fe63d60e57-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:07:05 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-27caabdf-79bd-4440-975a-b3c3461c85da tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Lock "ea050cd6-60e9-41fd-a35c-05fe63d60e57-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:07:05 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-27caabdf-79bd-4440-975a-b3c3461c85da tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Lock "ea050cd6-60e9-41fd-a35c-05fe63d60e57-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:07:05 user nova-compute[72129]: INFO nova.compute.manager [None req-27caabdf-79bd-4440-975a-b3c3461c85da tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Terminating instance
Aug 01 14:07:05 user nova-compute[72129]: DEBUG nova.compute.manager [None req-27caabdf-79bd-4440-975a-b3c3461c85da tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Start destroying the instance on the hypervisor. {{(pid=72129) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 14:07:06 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:07:06 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:07:06 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:07:06 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:07:06 user nova-compute[72129]: DEBUG nova.compute.manager [req-81c01585-862b-4bf2-9a26-6b71e4b0e806 req-beba4c41-844e-45ce-bb3b-2b2dd981aae1 service nova] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Received event network-vif-unplugged-fe1f3453-e3ae-494c-965a-c20868179163 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:07:06 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-81c01585-862b-4bf2-9a26-6b71e4b0e806 req-beba4c41-844e-45ce-bb3b-2b2dd981aae1 service nova] Acquiring lock "ea050cd6-60e9-41fd-a35c-05fe63d60e57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:07:06 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-81c01585-862b-4bf2-9a26-6b71e4b0e806 req-beba4c41-844e-45ce-bb3b-2b2dd981aae1 service nova] Lock "ea050cd6-60e9-41fd-a35c-05fe63d60e57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:07:06 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-81c01585-862b-4bf2-9a26-6b71e4b0e806 req-beba4c41-844e-45ce-bb3b-2b2dd981aae1 service nova] Lock "ea050cd6-60e9-41fd-a35c-05fe63d60e57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:07:06 user nova-compute[72129]: DEBUG nova.compute.manager [req-81c01585-862b-4bf2-9a26-6b71e4b0e806 req-beba4c41-844e-45ce-bb3b-2b2dd981aae1 service nova] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] No waiting events found dispatching network-vif-unplugged-fe1f3453-e3ae-494c-965a-c20868179163 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:07:06 user nova-compute[72129]: DEBUG nova.compute.manager [req-81c01585-862b-4bf2-9a26-6b71e4b0e806 req-beba4c41-844e-45ce-bb3b-2b2dd981aae1 service nova] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Received event network-vif-unplugged-fe1f3453-e3ae-494c-965a-c20868179163 for instance with task_state deleting. {{(pid=72129) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 14:07:06 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:07:06 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Instance destroyed successfully.
Aug 01 14:07:06 user nova-compute[72129]: DEBUG nova.objects.instance [None req-27caabdf-79bd-4440-975a-b3c3461c85da tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Lazy-loading 'resources' on Instance uuid ea050cd6-60e9-41fd-a35c-05fe63d60e57 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:07:06 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-27caabdf-79bd-4440-975a-b3c3461c85da tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:59:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1906674292',display_name='tempest-ServerStableDeviceRescueTest-server-1906674292',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1906674292',id=24,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIloluvmwA40zqhKfuyL8nZt7CgiX8ycwdXiaBEv6UgW1UUaWlsEz3XFkowqJh9nGVbhgatwD83ZWu+nsHtuLJfq7q8QT/aiQlyv0PZxM67apvpWxm9Sutw/U44d43g6fg==',key_name='tempest-keypair-520937592',keypairs=<?>,launch_index=0,launched_at=2023-08-01T14:04:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d0a13467840342f281bd8b8e115eccaf',ramdisk_id='',reservation_id='r-iiig76vr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1490642453',owner_user_name='tempest-ServerStableDeviceRescueTest-1490642453-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T14:05:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f762f3eb1908471eae5197b9aca91734',uuid=ea050cd6-60e9-41fd-a35c-05fe63d60e57,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe1f3453-e3ae-494c-965a-c20868179163", "address": "fa:16:3e:d8:46:16", "network": {"id": "ce187b11-5e3e-45a9-af0f-0be815ad0a3d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1245856112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0a13467840342f281bd8b8e115eccaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1f3453-e3", "ovs_interfaceid": "fe1f3453-e3ae-494c-965a-c20868179163", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 14:07:06 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-27caabdf-79bd-4440-975a-b3c3461c85da tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Converting VIF {"id": "fe1f3453-e3ae-494c-965a-c20868179163", "address": "fa:16:3e:d8:46:16", "network": {"id": "ce187b11-5e3e-45a9-af0f-0be815ad0a3d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1245856112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0a13467840342f281bd8b8e115eccaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe1f3453-e3", "ovs_interfaceid": "fe1f3453-e3ae-494c-965a-c20868179163", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:07:06 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-27caabdf-79bd-4440-975a-b3c3461c85da tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d8:46:16,bridge_name='br-int',has_traffic_filtering=True,id=fe1f3453-e3ae-494c-965a-c20868179163,network=Network(ce187b11-5e3e-45a9-af0f-0be815ad0a3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe1f3453-e3') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:07:06 user nova-compute[72129]: DEBUG os_vif [None req-27caabdf-79bd-4440-975a-b3c3461c85da tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:46:16,bridge_name='br-int',has_traffic_filtering=True,id=fe1f3453-e3ae-494c-965a-c20868179163,network=Network(ce187b11-5e3e-45a9-af0f-0be815ad0a3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe1f3453-e3') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 14:07:06 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:07:06 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe1f3453-e3, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:07:06 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:07:06 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:07:06 user nova-compute[72129]: INFO os_vif [None req-27caabdf-79bd-4440-975a-b3c3461c85da tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:46:16,bridge_name='br-int',has_traffic_filtering=True,id=fe1f3453-e3ae-494c-965a-c20868179163,network=Network(ce187b11-5e3e-45a9-af0f-0be815ad0a3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe1f3453-e3')
Aug 01 14:07:06 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-27caabdf-79bd-4440-975a-b3c3461c85da tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Deleting instance files /opt/stack/data/nova/instances/ea050cd6-60e9-41fd-a35c-05fe63d60e57_del
Aug 01 14:07:06 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-27caabdf-79bd-4440-975a-b3c3461c85da tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Deletion of /opt/stack/data/nova/instances/ea050cd6-60e9-41fd-a35c-05fe63d60e57_del complete
Aug 01 14:07:06 user nova-compute[72129]: INFO nova.compute.manager [None req-27caabdf-79bd-4440-975a-b3c3461c85da tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 01 14:07:06 user nova-compute[72129]: DEBUG oslo.service.loopingcall [None req-27caabdf-79bd-4440-975a-b3c3461c85da tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72129) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 14:07:06 user nova-compute[72129]: DEBUG nova.compute.manager [-] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Deallocating network for instance {{(pid=72129) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 14:07:06 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] deallocate_for_instance() {{(pid=72129) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 14:07:07 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:07:07 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Took 0.93 seconds to deallocate network for instance.
Aug 01 14:07:07 user nova-compute[72129]: DEBUG nova.compute.manager [req-0c598201-329d-4345-a2ca-f9314131e8d6 req-838ffc81-5b03-4f9c-b247-124096c52024 service nova] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Received event network-vif-deleted-fe1f3453-e3ae-494c-965a-c20868179163 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:07:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-27caabdf-79bd-4440-975a-b3c3461c85da tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:07:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-27caabdf-79bd-4440-975a-b3c3461c85da tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:07:08 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-27caabdf-79bd-4440-975a-b3c3461c85da tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:07:08 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-27caabdf-79bd-4440-975a-b3c3461c85da tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:07:08 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-27caabdf-79bd-4440-975a-b3c3461c85da tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.328s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:07:08 user nova-compute[72129]: INFO nova.scheduler.client.report [None req-27caabdf-79bd-4440-975a-b3c3461c85da tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Deleted allocations for instance ea050cd6-60e9-41fd-a35c-05fe63d60e57
Aug 01 14:07:08 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-27caabdf-79bd-4440-975a-b3c3461c85da tempest-ServerStableDeviceRescueTest-1490642453 tempest-ServerStableDeviceRescueTest-1490642453-project-member] Lock "ea050cd6-60e9-41fd-a35c-05fe63d60e57" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.308s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:07:08 user nova-compute[72129]: DEBUG nova.compute.manager [req-f109a33b-6908-4855-b083-8f893e44e2c9 req-cdc67f04-cf40-4ac0-91c5-171c5370636d service nova] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Received event network-vif-plugged-fe1f3453-e3ae-494c-965a-c20868179163 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:07:08 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f109a33b-6908-4855-b083-8f893e44e2c9 req-cdc67f04-cf40-4ac0-91c5-171c5370636d service nova] Acquiring lock "ea050cd6-60e9-41fd-a35c-05fe63d60e57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:07:08 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f109a33b-6908-4855-b083-8f893e44e2c9 req-cdc67f04-cf40-4ac0-91c5-171c5370636d service nova] Lock "ea050cd6-60e9-41fd-a35c-05fe63d60e57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:07:08 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f109a33b-6908-4855-b083-8f893e44e2c9 req-cdc67f04-cf40-4ac0-91c5-171c5370636d service nova] Lock "ea050cd6-60e9-41fd-a35c-05fe63d60e57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:07:08 user nova-compute[72129]: DEBUG nova.compute.manager [req-f109a33b-6908-4855-b083-8f893e44e2c9 req-cdc67f04-cf40-4ac0-91c5-171c5370636d service nova] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] No waiting events found dispatching network-vif-plugged-fe1f3453-e3ae-494c-965a-c20868179163 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:07:08 user nova-compute[72129]: WARNING nova.compute.manager [req-f109a33b-6908-4855-b083-8f893e44e2c9 req-cdc67f04-cf40-4ac0-91c5-171c5370636d service nova] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Received unexpected event network-vif-plugged-fe1f3453-e3ae-494c-965a-c20868179163 for instance with vm_state deleted and task_state None.
Aug 01 14:07:11 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:07:14 user nova-compute[72129]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690898819.158965, 53b76ca4-30f0-4fd4-9928-714c7073a490 => Stopped> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:07:14 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] VM Stopped (Lifecycle Event)
Aug 01 14:07:14 user nova-compute[72129]: DEBUG nova.compute.manager [None req-1de58524-142f-4706-94f9-e0a85715407f None None] [instance: 53b76ca4-30f0-4fd4-9928-714c7073a490] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:07:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Acquiring lock "1e06fb45-d156-451b-9e4d-e3d2fed52c37" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:07:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lock "1e06fb45-d156-451b-9e4d-e3d2fed52c37" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:07:15 user nova-compute[72129]: DEBUG nova.compute.manager [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Starting instance... {{(pid=72129) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 14:07:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:07:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:07:15 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72129) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 14:07:15 user nova-compute[72129]: INFO nova.compute.claims [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Claim successful on node user
Aug 01 14:07:15 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:07:15 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:07:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.382s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:07:15 user nova-compute[72129]: DEBUG nova.compute.manager [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Start building networks asynchronously for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 14:07:15 user nova-compute[72129]: DEBUG nova.compute.manager [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Allocating IP information in the background. {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 14:07:15 user nova-compute[72129]: DEBUG nova.network.neutron [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] allocate_for_instance() {{(pid=72129) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 14:07:15 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 14:07:16 user nova-compute[72129]: DEBUG nova.compute.manager [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Start building block device mappings for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 14:07:16 user nova-compute[72129]: DEBUG nova.policy [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e5630ede467c4c99915b1b2f455ca0fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b724093fa43c4afb9130efa2cfc713d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72129) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 14:07:16 user nova-compute[72129]: DEBUG nova.compute.manager [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Start spawning the instance on the hypervisor. {{(pid=72129) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 14:07:16 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Creating instance directory {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 14:07:16 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Creating image(s)
Aug 01 14:07:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Acquiring lock "/opt/stack/data/nova/instances/1e06fb45-d156-451b-9e4d-e3d2fed52c37/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:07:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lock "/opt/stack/data/nova/instances/1e06fb45-d156-451b-9e4d-e3d2fed52c37/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:07:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lock "/opt/stack/data/nova/instances/1e06fb45-d156-451b-9e4d-e3d2fed52c37/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:07:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:07:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.143s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:07:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Acquiring lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:07:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:07:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:07:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.154s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:07:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/1e06fb45-d156-451b-9e4d-e3d2fed52c37/disk 1073741824 {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:07:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/1e06fb45-d156-451b-9e4d-e3d2fed52c37/disk 1073741824" returned: 0 in 0.056s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:07:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.216s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:07:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:07:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.144s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:07:16 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1e06fb45-d156-451b-9e4d-e3d2fed52c37/disk. size=1073741824 {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 14:07:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e06fb45-d156-451b-9e4d-e3d2fed52c37/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:07:16 user nova-compute[72129]: DEBUG nova.network.neutron [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Successfully created port: 3811b72e-705a-4336-ac66-a0fed51437e4 {{(pid=72129) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 14:07:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:07:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e06fb45-d156-451b-9e4d-e3d2fed52c37/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:07:16 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Cannot resize image /opt/stack/data/nova/instances/1e06fb45-d156-451b-9e4d-e3d2fed52c37/disk to a smaller size. {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 14:07:16 user nova-compute[72129]: DEBUG nova.objects.instance [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lazy-loading 'migration_context' on Instance uuid 1e06fb45-d156-451b-9e4d-e3d2fed52c37 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:07:16 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Created local disks {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 14:07:16 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Ensure instance console log exists: /opt/stack/data/nova/instances/1e06fb45-d156-451b-9e4d-e3d2fed52c37/console.log {{(pid=72129) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 14:07:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:07:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:07:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:07:17 user nova-compute[72129]: DEBUG nova.network.neutron [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Successfully updated port: 3811b72e-705a-4336-ac66-a0fed51437e4 {{(pid=72129) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 14:07:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Acquiring lock "refresh_cache-1e06fb45-d156-451b-9e4d-e3d2fed52c37" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:07:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Acquired lock "refresh_cache-1e06fb45-d156-451b-9e4d-e3d2fed52c37" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:07:17 user nova-compute[72129]: DEBUG nova.network.neutron [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 14:07:17 user nova-compute[72129]: DEBUG nova.compute.manager [req-eaf3ba97-5f0e-473c-8009-c721da949f65 req-391a2284-9e68-43c6-9dff-87d062a16f85 service nova] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Received event network-changed-3811b72e-705a-4336-ac66-a0fed51437e4 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:07:17 user nova-compute[72129]: DEBUG nova.compute.manager [req-eaf3ba97-5f0e-473c-8009-c721da949f65 req-391a2284-9e68-43c6-9dff-87d062a16f85 service nova] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Refreshing instance network info cache due to event network-changed-3811b72e-705a-4336-ac66-a0fed51437e4. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 14:07:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-eaf3ba97-5f0e-473c-8009-c721da949f65 req-391a2284-9e68-43c6-9dff-87d062a16f85 service nova] Acquiring lock "refresh_cache-1e06fb45-d156-451b-9e4d-e3d2fed52c37" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:07:17 user nova-compute[72129]: DEBUG nova.network.neutron [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Instance cache missing network info. {{(pid=72129) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 14:07:17 user nova-compute[72129]: DEBUG nova.network.neutron [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Updating instance_info_cache with network_info: [{"id": "3811b72e-705a-4336-ac66-a0fed51437e4", "address": "fa:16:3e:a3:60:b1", "network": {"id": "ce10dac7-17d0-425a-bfee-70b8220d7871", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1288141476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b724093fa43c4afb9130efa2cfc713d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3811b72e-70", "ovs_interfaceid": "3811b72e-705a-4336-ac66-a0fed51437e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:07:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Releasing lock "refresh_cache-1e06fb45-d156-451b-9e4d-e3d2fed52c37" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:07:17 user nova-compute[72129]: DEBUG nova.compute.manager [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Instance network_info: |[{"id": "3811b72e-705a-4336-ac66-a0fed51437e4", "address": "fa:16:3e:a3:60:b1", "network": {"id": "ce10dac7-17d0-425a-bfee-70b8220d7871", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1288141476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b724093fa43c4afb9130efa2cfc713d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3811b72e-70", "ovs_interfaceid": "3811b72e-705a-4336-ac66-a0fed51437e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 14:07:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-eaf3ba97-5f0e-473c-8009-c721da949f65 req-391a2284-9e68-43c6-9dff-87d062a16f85 service nova] Acquired lock "refresh_cache-1e06fb45-d156-451b-9e4d-e3d2fed52c37" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:07:17 user nova-compute[72129]: DEBUG nova.network.neutron [req-eaf3ba97-5f0e-473c-8009-c721da949f65 req-391a2284-9e68-43c6-9dff-87d062a16f85 service nova] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Refreshing network info cache for port 3811b72e-705a-4336-ac66-a0fed51437e4 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 14:07:17 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Start _get_guest_xml network_info=[{"id": "3811b72e-705a-4336-ac66-a0fed51437e4", "address": "fa:16:3e:a3:60:b1", "network": {"id": "ce10dac7-17d0-425a-bfee-70b8220d7871", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1288141476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b724093fa43c4afb9130efa2cfc713d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3811b72e-70", "ovs_interfaceid": "3811b72e-705a-4336-ac66-a0fed51437e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'image_id': 'b6472c34-1b0f-4034-ba3a-7e8eb5103715'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 14:07:17 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:07:17 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:07:17 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 14:07:17 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] CPU controller missing on host. {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 14:07:17 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 14:07:17 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] CPU controller found on host. {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 14:07:17 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72129) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 14:07:17 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T13:45:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 14:07:17 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Flavor limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 14:07:17 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Image limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 14:07:17 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Flavor pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 14:07:17 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Image pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 14:07:17 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 14:07:17 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 14:07:17 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 14:07:17 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Got 1 possible topologies {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 14:07:17 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 14:07:17 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 14:07:17 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:07:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1528036097',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1528036097',id=33,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIgNnezmd3WUtvMc91uqfFchcd5GoNgjDKdQnSLwhRBanZwsPizFNVNm3dzrcvRZ7hFRKmkWdxbqwDlwVGnI8tIUko9u2VFfHh/iPWhzSPvxCFMeliixeCIv/26AwtF9aQ==',key_name='tempest-keypair-12459561',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b724093fa43c4afb9130efa2cfc713d9',ramdisk_id='',reservation_id='r-29k01a26',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1864942034',owner_user_name='tempest-AttachVolumeShelveTestJSON-1864942034-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T14:07:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e5630ede467c4c99915b1b2f455ca0fb',uuid=1e06fb45-d156-451b-9e4d-e3d2fed52c37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3811b72e-705a-4336-ac66-a0fed51437e4", "address": "fa:16:3e:a3:60:b1", "network": {"id": "ce10dac7-17d0-425a-bfee-70b8220d7871", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1288141476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b724093fa43c4afb9130efa2cfc713d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3811b72e-70", "ovs_interfaceid": "3811b72e-705a-4336-ac66-a0fed51437e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 14:07:17 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Converting VIF {"id": "3811b72e-705a-4336-ac66-a0fed51437e4", "address": "fa:16:3e:a3:60:b1", "network": {"id": "ce10dac7-17d0-425a-bfee-70b8220d7871", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1288141476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b724093fa43c4afb9130efa2cfc713d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3811b72e-70", "ovs_interfaceid": "3811b72e-705a-4336-ac66-a0fed51437e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:07:17 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:60:b1,bridge_name='br-int',has_traffic_filtering=True,id=3811b72e-705a-4336-ac66-a0fed51437e4,network=Network(ce10dac7-17d0-425a-bfee-70b8220d7871),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3811b72e-70') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:07:18 user nova-compute[72129]: DEBUG nova.objects.instance [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lazy-loading 'pci_devices' on Instance uuid 1e06fb45-d156-451b-9e4d-e3d2fed52c37 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:07:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] End _get_guest_xml xml=<domain type="kvm">
Aug 01 14:07:18 user nova-compute[72129]:   <uuid>1e06fb45-d156-451b-9e4d-e3d2fed52c37</uuid>
Aug 01 14:07:18 user nova-compute[72129]:   <name>instance-00000021</name>
Aug 01 14:07:18 user nova-compute[72129]:   <memory>524288</memory>
Aug 01 14:07:18 user nova-compute[72129]:   <vcpu>1</vcpu>
Aug 01 14:07:18 user nova-compute[72129]:   <metadata>
Aug 01 14:07:18 user nova-compute[72129]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 14:07:18 user nova-compute[72129]:       <nova:package version="0.0.0"/>
Aug 01 14:07:18 user nova-compute[72129]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1528036097</nova:name>
Aug 01 14:07:18 user nova-compute[72129]:       <nova:creationTime>2023-08-01 14:07:17</nova:creationTime>
Aug 01 14:07:18 user nova-compute[72129]:       <nova:flavor name="m1.tiny">
Aug 01 14:07:18 user nova-compute[72129]:         <nova:memory>512</nova:memory>
Aug 01 14:07:18 user nova-compute[72129]:         <nova:disk>1</nova:disk>
Aug 01 14:07:18 user nova-compute[72129]:         <nova:swap>0</nova:swap>
Aug 01 14:07:18 user nova-compute[72129]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 14:07:18 user nova-compute[72129]:         <nova:vcpus>1</nova:vcpus>
Aug 01 14:07:18 user nova-compute[72129]:       </nova:flavor>
Aug 01 14:07:18 user nova-compute[72129]:       <nova:owner>
Aug 01 14:07:18 user nova-compute[72129]:         <nova:user uuid="e5630ede467c4c99915b1b2f455ca0fb">tempest-AttachVolumeShelveTestJSON-1864942034-project-member</nova:user>
Aug 01 14:07:18 user nova-compute[72129]:         <nova:project uuid="b724093fa43c4afb9130efa2cfc713d9">tempest-AttachVolumeShelveTestJSON-1864942034</nova:project>
Aug 01 14:07:18 user nova-compute[72129]:       </nova:owner>
Aug 01 14:07:18 user nova-compute[72129]:       <nova:root type="image" uuid="b6472c34-1b0f-4034-ba3a-7e8eb5103715"/>
Aug 01 14:07:18 user nova-compute[72129]:       <nova:ports>
Aug 01 14:07:18 user nova-compute[72129]:         <nova:port uuid="3811b72e-705a-4336-ac66-a0fed51437e4">
Aug 01 14:07:18 user nova-compute[72129]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 01 14:07:18 user nova-compute[72129]:         </nova:port>
Aug 01 14:07:18 user nova-compute[72129]:       </nova:ports>
Aug 01 14:07:18 user nova-compute[72129]:     </nova:instance>
Aug 01 14:07:18 user nova-compute[72129]:   </metadata>
Aug 01 14:07:18 user nova-compute[72129]:   <sysinfo type="smbios">
Aug 01 14:07:18 user nova-compute[72129]:     <system>
Aug 01 14:07:18 user nova-compute[72129]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 14:07:18 user nova-compute[72129]:       <entry name="product">OpenStack Nova</entry>
Aug 01 14:07:18 user nova-compute[72129]:       <entry name="version">0.0.0</entry>
Aug 01 14:07:18 user nova-compute[72129]:       <entry name="serial">1e06fb45-d156-451b-9e4d-e3d2fed52c37</entry>
Aug 01 14:07:18 user nova-compute[72129]:       <entry name="uuid">1e06fb45-d156-451b-9e4d-e3d2fed52c37</entry>
Aug 01 14:07:18 user nova-compute[72129]:       <entry name="family">Virtual Machine</entry>
Aug 01 14:07:18 user nova-compute[72129]:     </system>
Aug 01 14:07:18 user nova-compute[72129]:   </sysinfo>
Aug 01 14:07:18 user nova-compute[72129]:   <os>
Aug 01 14:07:18 user nova-compute[72129]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 14:07:18 user nova-compute[72129]:     <boot dev="hd"/>
Aug 01 14:07:18 user nova-compute[72129]:     <smbios mode="sysinfo"/>
Aug 01 14:07:18 user nova-compute[72129]:   </os>
Aug 01 14:07:18 user nova-compute[72129]:   <features>
Aug 01 14:07:18 user nova-compute[72129]:     <acpi/>
Aug 01 14:07:18 user nova-compute[72129]:     <apic/>
Aug 01 14:07:18 user nova-compute[72129]:     <vmcoreinfo/>
Aug 01 14:07:18 user nova-compute[72129]:   </features>
Aug 01 14:07:18 user nova-compute[72129]:   <clock offset="utc">
Aug 01 14:07:18 user nova-compute[72129]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 14:07:18 user nova-compute[72129]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 14:07:18 user nova-compute[72129]:     <timer name="hpet" present="no"/>
Aug 01 14:07:18 user nova-compute[72129]:   </clock>
Aug 01 14:07:18 user nova-compute[72129]:   <cpu mode="custom" match="exact">
Aug 01 14:07:18 user nova-compute[72129]:     <model>Nehalem</model>
Aug 01 14:07:18 user nova-compute[72129]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 14:07:18 user nova-compute[72129]:   </cpu>
Aug 01 14:07:18 user nova-compute[72129]:   <devices>
Aug 01 14:07:18 user nova-compute[72129]:     <disk type="file" device="disk">
Aug 01 14:07:18 user nova-compute[72129]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 14:07:18 user nova-compute[72129]:       <source file="/opt/stack/data/nova/instances/1e06fb45-d156-451b-9e4d-e3d2fed52c37/disk"/>
Aug 01 14:07:18 user nova-compute[72129]:       <target dev="vda" bus="virtio"/>
Aug 01 14:07:18 user nova-compute[72129]:     </disk>
Aug 01 14:07:18 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 14:07:18 user nova-compute[72129]:       <mac address="fa:16:3e:a3:60:b1"/>
Aug 01 14:07:18 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:07:18 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 14:07:18 user nova-compute[72129]:       <target dev="tap3811b72e-70"/>
Aug 01 14:07:18 user nova-compute[72129]:     </interface>
Aug 01 14:07:18 user nova-compute[72129]:     <serial type="pty">
Aug 01 14:07:18 user nova-compute[72129]:       <log file="/opt/stack/data/nova/instances/1e06fb45-d156-451b-9e4d-e3d2fed52c37/console.log" append="off"/>
Aug 01 14:07:18 user nova-compute[72129]:     </serial>
Aug 01 14:07:18 user nova-compute[72129]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 14:07:18 user nova-compute[72129]:     <video>
Aug 01 14:07:18 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:07:18 user nova-compute[72129]:     </video>
Aug 01 14:07:18 user nova-compute[72129]:     <rng model="virtio">
Aug 01 14:07:18 user nova-compute[72129]:       <backend model="random">/dev/urandom</backend>
Aug 01 14:07:18 user nova-compute[72129]:     </rng>
Aug 01 14:07:18 user nova-compute[72129]:     <controller type="usb" index="0" model="none"/>
Aug 01 14:07:18 user nova-compute[72129]:     <memballoon model="virtio">
Aug 01 14:07:18 user nova-compute[72129]:       <stats period="10"/>
Aug 01 14:07:18 user nova-compute[72129]:     </memballoon>
Aug 01 14:07:18 user nova-compute[72129]:   </devices>
Aug 01 14:07:18 user nova-compute[72129]: </domain>
Aug 01 14:07:18 user nova-compute[72129]:  {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 14:07:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:07:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1528036097',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1528036097',id=33,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIgNnezmd3WUtvMc91uqfFchcd5GoNgjDKdQnSLwhRBanZwsPizFNVNm3dzrcvRZ7hFRKmkWdxbqwDlwVGnI8tIUko9u2VFfHh/iPWhzSPvxCFMeliixeCIv/26AwtF9aQ==',key_name='tempest-keypair-12459561',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b724093fa43c4afb9130efa2cfc713d9',ramdisk_id='',reservation_id='r-29k01a26',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1864942034',owner_user_name='tempest-AttachVolumeShelveTestJSON-1864942034-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T14:07:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e5630ede467c4c99915b1b2f455ca0fb',uuid=1e06fb45-d156-451b-9e4d-e3d2fed52c37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3811b72e-705a-4336-ac66-a0fed51437e4", "address": "fa:16:3e:a3:60:b1", "network": {"id": "ce10dac7-17d0-425a-bfee-70b8220d7871", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1288141476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b724093fa43c4afb9130efa2cfc713d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3811b72e-70", "ovs_interfaceid": "3811b72e-705a-4336-ac66-a0fed51437e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 14:07:18 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Converting VIF {"id": "3811b72e-705a-4336-ac66-a0fed51437e4", "address": "fa:16:3e:a3:60:b1", "network": {"id": "ce10dac7-17d0-425a-bfee-70b8220d7871", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1288141476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b724093fa43c4afb9130efa2cfc713d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3811b72e-70", "ovs_interfaceid": "3811b72e-705a-4336-ac66-a0fed51437e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:07:18 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:60:b1,bridge_name='br-int',has_traffic_filtering=True,id=3811b72e-705a-4336-ac66-a0fed51437e4,network=Network(ce10dac7-17d0-425a-bfee-70b8220d7871),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3811b72e-70') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:07:18 user nova-compute[72129]: DEBUG os_vif [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:60:b1,bridge_name='br-int',has_traffic_filtering=True,id=3811b72e-705a-4336-ac66-a0fed51437e4,network=Network(ce10dac7-17d0-425a-bfee-70b8220d7871),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3811b72e-70') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 14:07:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:07:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:07:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 14:07:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:07:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3811b72e-70, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:07:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3811b72e-70, col_values=(('external_ids', {'iface-id': '3811b72e-705a-4336-ac66-a0fed51437e4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:60:b1', 'vm-uuid': '1e06fb45-d156-451b-9e4d-e3d2fed52c37'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:07:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:07:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:07:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:07:18 user nova-compute[72129]: INFO os_vif [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:60:b1,bridge_name='br-int',has_traffic_filtering=True,id=3811b72e-705a-4336-ac66-a0fed51437e4,network=Network(ce10dac7-17d0-425a-bfee-70b8220d7871),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3811b72e-70')
Aug 01 14:07:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:07:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] No VIF found with MAC fa:16:3e:a3:60:b1, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 14:07:18 user nova-compute[72129]: DEBUG nova.network.neutron [req-eaf3ba97-5f0e-473c-8009-c721da949f65 req-391a2284-9e68-43c6-9dff-87d062a16f85 service nova] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Updated VIF entry in instance network info cache for port 3811b72e-705a-4336-ac66-a0fed51437e4. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 14:07:18 user nova-compute[72129]: DEBUG nova.network.neutron [req-eaf3ba97-5f0e-473c-8009-c721da949f65 req-391a2284-9e68-43c6-9dff-87d062a16f85 service nova] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Updating instance_info_cache with network_info: [{"id": "3811b72e-705a-4336-ac66-a0fed51437e4", "address": "fa:16:3e:a3:60:b1", "network": {"id": "ce10dac7-17d0-425a-bfee-70b8220d7871", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1288141476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b724093fa43c4afb9130efa2cfc713d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3811b72e-70", "ovs_interfaceid": "3811b72e-705a-4336-ac66-a0fed51437e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:07:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-eaf3ba97-5f0e-473c-8009-c721da949f65 req-391a2284-9e68-43c6-9dff-87d062a16f85 service nova] Releasing lock "refresh_cache-1e06fb45-d156-451b-9e4d-e3d2fed52c37" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:07:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:07:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:07:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:07:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:07:19 user nova-compute[72129]: DEBUG nova.compute.manager [req-ab5acb37-e5bd-4292-939f-d5963b4c6a32 req-36c2d9fa-f139-40e0-90c7-70af58e47563 service nova] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Received event network-vif-plugged-3811b72e-705a-4336-ac66-a0fed51437e4 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:07:19 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ab5acb37-e5bd-4292-939f-d5963b4c6a32 req-36c2d9fa-f139-40e0-90c7-70af58e47563 service nova] Acquiring lock "1e06fb45-d156-451b-9e4d-e3d2fed52c37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:07:19 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ab5acb37-e5bd-4292-939f-d5963b4c6a32 req-36c2d9fa-f139-40e0-90c7-70af58e47563 service nova] Lock "1e06fb45-d156-451b-9e4d-e3d2fed52c37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:07:19 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ab5acb37-e5bd-4292-939f-d5963b4c6a32 req-36c2d9fa-f139-40e0-90c7-70af58e47563 service nova] Lock "1e06fb45-d156-451b-9e4d-e3d2fed52c37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:07:19 user nova-compute[72129]: DEBUG nova.compute.manager [req-ab5acb37-e5bd-4292-939f-d5963b4c6a32 req-36c2d9fa-f139-40e0-90c7-70af58e47563 service nova] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] No waiting events found dispatching network-vif-plugged-3811b72e-705a-4336-ac66-a0fed51437e4 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:07:19 user nova-compute[72129]: WARNING nova.compute.manager [req-ab5acb37-e5bd-4292-939f-d5963b4c6a32 req-36c2d9fa-f139-40e0-90c7-70af58e47563 service nova] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Received unexpected event network-vif-plugged-3811b72e-705a-4336-ac66-a0fed51437e4 for instance with vm_state building and task_state spawning.
Aug 01 14:07:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:07:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:07:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:07:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:07:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c31bfaba-7400-47a3-9bbd-d1fef786385f tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Acquiring lock "e2cf5877-55dd-44ce-9b58-b662afe8e62e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:07:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c31bfaba-7400-47a3-9bbd-d1fef786385f tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lock "e2cf5877-55dd-44ce-9b58-b662afe8e62e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:07:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c31bfaba-7400-47a3-9bbd-d1fef786385f tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Acquiring lock "e2cf5877-55dd-44ce-9b58-b662afe8e62e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:07:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c31bfaba-7400-47a3-9bbd-d1fef786385f tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lock "e2cf5877-55dd-44ce-9b58-b662afe8e62e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:07:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c31bfaba-7400-47a3-9bbd-d1fef786385f tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lock "e2cf5877-55dd-44ce-9b58-b662afe8e62e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:07:20 user nova-compute[72129]: INFO nova.compute.manager [None req-c31bfaba-7400-47a3-9bbd-d1fef786385f tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Terminating instance
Aug 01 14:07:20 user nova-compute[72129]: DEBUG nova.compute.manager [None req-c31bfaba-7400-47a3-9bbd-d1fef786385f tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Start destroying the instance on the hypervisor. {{(pid=72129) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 14:07:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:07:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:07:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:07:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:07:20 user nova-compute[72129]: DEBUG nova.compute.manager [req-ce513a05-bcac-46da-b58a-0f406638effe req-86cd94ad-8890-4634-b2cf-c59373803232 service nova] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Received event network-vif-unplugged-ed105f30-6ea8-4e9d-aedc-44a11f2ae5d5 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:07:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ce513a05-bcac-46da-b58a-0f406638effe req-86cd94ad-8890-4634-b2cf-c59373803232 service nova] Acquiring lock "e2cf5877-55dd-44ce-9b58-b662afe8e62e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:07:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ce513a05-bcac-46da-b58a-0f406638effe req-86cd94ad-8890-4634-b2cf-c59373803232 service nova] Lock "e2cf5877-55dd-44ce-9b58-b662afe8e62e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:07:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ce513a05-bcac-46da-b58a-0f406638effe req-86cd94ad-8890-4634-b2cf-c59373803232 service nova] Lock "e2cf5877-55dd-44ce-9b58-b662afe8e62e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:07:20 user nova-compute[72129]: DEBUG nova.compute.manager [req-ce513a05-bcac-46da-b58a-0f406638effe req-86cd94ad-8890-4634-b2cf-c59373803232 service nova] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] No waiting events found dispatching network-vif-unplugged-ed105f30-6ea8-4e9d-aedc-44a11f2ae5d5 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:07:20 user nova-compute[72129]: DEBUG nova.compute.manager [req-ce513a05-bcac-46da-b58a-0f406638effe req-86cd94ad-8890-4634-b2cf-c59373803232 service nova] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Received event network-vif-unplugged-ed105f30-6ea8-4e9d-aedc-44a11f2ae5d5 for instance with task_state deleting. {{(pid=72129) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 14:07:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:07:21 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Instance destroyed successfully.
Aug 01 14:07:21 user nova-compute[72129]: DEBUG nova.objects.instance [None req-c31bfaba-7400-47a3-9bbd-d1fef786385f tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lazy-loading 'resources' on Instance uuid e2cf5877-55dd-44ce-9b58-b662afe8e62e {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:07:21 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-c31bfaba-7400-47a3-9bbd-d1fef786385f tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:00:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1025565412',display_name='tempest-SnapshotDataIntegrityTests-server-1025565412',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1025565412',id=25,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDjD1eqd7I1REZPNLxth25Cri6aMSgVthWL0+MG1EEDyrZmfpc+KmhtStPMOI/tSkvR3AGD/m5FagqQXododlRh29GS9NGtfqWAOnY9Tx+KrD1Mousn2hs2pQivIfX3wgg==',key_name='tempest-keypair-289836616',keypairs=<?>,launch_index=0,launched_at=2023-08-01T14:00:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='822d8992f146492cb98e0f57d42e0571',ramdisk_id='',reservation_id='r-umd0od5q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-846799905',owner_user_name='tempest-SnapshotDataIntegrityTests-846799905-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T14:00:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d537f7656c624f77967c8feed5a351d6',uuid=e2cf5877-55dd-44ce-9b58-b662afe8e62e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ed105f30-6ea8-4e9d-aedc-44a11f2ae5d5", "address": "fa:16:3e:18:48:0e", "network": {"id": "c31f34d8-03c6-40d0-868b-d82fdc9c5169", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1378125554-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "822d8992f146492cb98e0f57d42e0571", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped105f30-6e", "ovs_interfaceid": "ed105f30-6ea8-4e9d-aedc-44a11f2ae5d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 14:07:21 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-c31bfaba-7400-47a3-9bbd-d1fef786385f tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Converting VIF {"id": "ed105f30-6ea8-4e9d-aedc-44a11f2ae5d5", "address": "fa:16:3e:18:48:0e", "network": {"id": "c31f34d8-03c6-40d0-868b-d82fdc9c5169", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1378125554-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "822d8992f146492cb98e0f57d42e0571", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped105f30-6e", "ovs_interfaceid": "ed105f30-6ea8-4e9d-aedc-44a11f2ae5d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:07:21 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-c31bfaba-7400-47a3-9bbd-d1fef786385f tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:18:48:0e,bridge_name='br-int',has_traffic_filtering=True,id=ed105f30-6ea8-4e9d-aedc-44a11f2ae5d5,network=Network(c31f34d8-03c6-40d0-868b-d82fdc9c5169),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped105f30-6e') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:07:21 user nova-compute[72129]: DEBUG os_vif [None req-c31bfaba-7400-47a3-9bbd-d1fef786385f tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:48:0e,bridge_name='br-int',has_traffic_filtering=True,id=ed105f30-6ea8-4e9d-aedc-44a11f2ae5d5,network=Network(c31f34d8-03c6-40d0-868b-d82fdc9c5169),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped105f30-6e') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 14:07:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:07:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=taped105f30-6e, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:07:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:07:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:07:21 user nova-compute[72129]: INFO os_vif [None req-c31bfaba-7400-47a3-9bbd-d1fef786385f tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:48:0e,bridge_name='br-int',has_traffic_filtering=True,id=ed105f30-6ea8-4e9d-aedc-44a11f2ae5d5,network=Network(c31f34d8-03c6-40d0-868b-d82fdc9c5169),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped105f30-6e')
Aug 01 14:07:21 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-c31bfaba-7400-47a3-9bbd-d1fef786385f tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Deleting instance files /opt/stack/data/nova/instances/e2cf5877-55dd-44ce-9b58-b662afe8e62e_del
Aug 01 14:07:21 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-c31bfaba-7400-47a3-9bbd-d1fef786385f tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Deletion of /opt/stack/data/nova/instances/e2cf5877-55dd-44ce-9b58-b662afe8e62e_del complete
Aug 01 14:07:21 user nova-compute[72129]: INFO nova.compute.manager [None req-c31bfaba-7400-47a3-9bbd-d1fef786385f tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 01 14:07:21 user nova-compute[72129]: DEBUG oslo.service.loopingcall [None req-c31bfaba-7400-47a3-9bbd-d1fef786385f tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72129) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 14:07:21 user nova-compute[72129]: DEBUG nova.compute.manager [-] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Deallocating network for instance {{(pid=72129) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 14:07:21 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] deallocate_for_instance() {{(pid=72129) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 14:07:21 user nova-compute[72129]: DEBUG nova.compute.manager [req-161abf51-19ef-40a1-b8db-d34e9f1822c4 req-55e72476-a41c-4f54-9204-e6f9787fb94d service nova] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Received event network-vif-plugged-3811b72e-705a-4336-ac66-a0fed51437e4 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:07:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-161abf51-19ef-40a1-b8db-d34e9f1822c4 req-55e72476-a41c-4f54-9204-e6f9787fb94d service nova] Acquiring lock "1e06fb45-d156-451b-9e4d-e3d2fed52c37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:07:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-161abf51-19ef-40a1-b8db-d34e9f1822c4 req-55e72476-a41c-4f54-9204-e6f9787fb94d service nova] Lock "1e06fb45-d156-451b-9e4d-e3d2fed52c37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:07:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-161abf51-19ef-40a1-b8db-d34e9f1822c4 req-55e72476-a41c-4f54-9204-e6f9787fb94d service nova] Lock "1e06fb45-d156-451b-9e4d-e3d2fed52c37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:07:21 user nova-compute[72129]: DEBUG nova.compute.manager [req-161abf51-19ef-40a1-b8db-d34e9f1822c4 req-55e72476-a41c-4f54-9204-e6f9787fb94d service nova] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] No waiting events found dispatching network-vif-plugged-3811b72e-705a-4336-ac66-a0fed51437e4 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:07:21 user nova-compute[72129]: WARNING nova.compute.manager [req-161abf51-19ef-40a1-b8db-d34e9f1822c4 req-55e72476-a41c-4f54-9204-e6f9787fb94d service nova] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Received unexpected event network-vif-plugged-3811b72e-705a-4336-ac66-a0fed51437e4 for instance with vm_state building and task_state spawning.
Aug 01 14:07:21 user nova-compute[72129]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690898826.749619, ea050cd6-60e9-41fd-a35c-05fe63d60e57 => Stopped> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:07:21 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] VM Stopped (Lifecycle Event)
Aug 01 14:07:21 user nova-compute[72129]: DEBUG nova.compute.manager [None req-56e9fe23-d66b-4c56-919b-9b73f005bba0 None None] [instance: ea050cd6-60e9-41fd-a35c-05fe63d60e57] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:07:21 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898841.8235242, 1e06fb45-d156-451b-9e4d-e3d2fed52c37 => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:07:21 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] VM Resumed (Lifecycle Event)
Aug 01 14:07:21 user nova-compute[72129]: DEBUG nova.compute.manager [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Instance event wait completed in 0 seconds for  {{(pid=72129) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 14:07:21 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Guest created on hypervisor {{(pid=72129) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 14:07:21 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Instance spawned successfully.
Aug 01 14:07:21 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 14:07:21 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:07:21 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:07:21 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Found default for hw_cdrom_bus of ide {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:07:21 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Found default for hw_disk_bus of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:07:21 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Found default for hw_input_bus of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:07:21 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Found default for hw_pointer_model of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:07:21 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Found default for hw_video_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:07:21 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Found default for hw_vif_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:07:21 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 14:07:21 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898841.8282688, 1e06fb45-d156-451b-9e4d-e3d2fed52c37 => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:07:21 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] VM Started (Lifecycle Event)
Aug 01 14:07:21 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:07:21 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:07:21 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 14:07:21 user nova-compute[72129]: INFO nova.compute.manager [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Took 5.81 seconds to spawn the instance on the hypervisor.
Aug 01 14:07:21 user nova-compute[72129]: DEBUG nova.compute.manager [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:07:22 user nova-compute[72129]: INFO nova.compute.manager [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Took 6.57 seconds to build instance.
Aug 01 14:07:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-4dbef070-48d5-4cb9-a49f-0b800f679354 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lock "1e06fb45-d156-451b-9e4d-e3d2fed52c37" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.669s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:07:22 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:07:22 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Took 0.94 seconds to deallocate network for instance.
Aug 01 14:07:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c31bfaba-7400-47a3-9bbd-d1fef786385f tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:07:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c31bfaba-7400-47a3-9bbd-d1fef786385f tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:07:22 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-c31bfaba-7400-47a3-9bbd-d1fef786385f tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:07:22 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-c31bfaba-7400-47a3-9bbd-d1fef786385f tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:07:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c31bfaba-7400-47a3-9bbd-d1fef786385f tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.361s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:07:22 user nova-compute[72129]: INFO nova.scheduler.client.report [None req-c31bfaba-7400-47a3-9bbd-d1fef786385f tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Deleted allocations for instance e2cf5877-55dd-44ce-9b58-b662afe8e62e
Aug 01 14:07:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c31bfaba-7400-47a3-9bbd-d1fef786385f tempest-SnapshotDataIntegrityTests-846799905 tempest-SnapshotDataIntegrityTests-846799905-project-member] Lock "e2cf5877-55dd-44ce-9b58-b662afe8e62e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.425s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:07:22 user nova-compute[72129]: DEBUG nova.compute.manager [req-224be91d-5285-45c5-bdc8-1f0f342beefd req-43a01ea1-f97c-4b2a-bd5b-843b032f1fa6 service nova] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Received event network-vif-plugged-ed105f30-6ea8-4e9d-aedc-44a11f2ae5d5 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:07:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-224be91d-5285-45c5-bdc8-1f0f342beefd req-43a01ea1-f97c-4b2a-bd5b-843b032f1fa6 service nova] Acquiring lock "e2cf5877-55dd-44ce-9b58-b662afe8e62e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:07:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-224be91d-5285-45c5-bdc8-1f0f342beefd req-43a01ea1-f97c-4b2a-bd5b-843b032f1fa6 service nova] Lock "e2cf5877-55dd-44ce-9b58-b662afe8e62e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:07:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-224be91d-5285-45c5-bdc8-1f0f342beefd req-43a01ea1-f97c-4b2a-bd5b-843b032f1fa6 service nova] Lock "e2cf5877-55dd-44ce-9b58-b662afe8e62e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:07:22 user nova-compute[72129]: DEBUG nova.compute.manager [req-224be91d-5285-45c5-bdc8-1f0f342beefd req-43a01ea1-f97c-4b2a-bd5b-843b032f1fa6 service nova] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] No waiting events found dispatching network-vif-plugged-ed105f30-6ea8-4e9d-aedc-44a11f2ae5d5 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:07:22 user nova-compute[72129]: WARNING nova.compute.manager [req-224be91d-5285-45c5-bdc8-1f0f342beefd req-43a01ea1-f97c-4b2a-bd5b-843b032f1fa6 service nova] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Received unexpected event network-vif-plugged-ed105f30-6ea8-4e9d-aedc-44a11f2ae5d5 for instance with vm_state deleted and task_state None.
Aug 01 14:07:23 user nova-compute[72129]: DEBUG nova.compute.manager [req-e4094fcc-d1e0-434d-8a1e-cd844407690f req-1f009733-6fa2-4882-9d07-d4f7d821c6da service nova] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Received event network-vif-deleted-ed105f30-6ea8-4e9d-aedc-44a11f2ae5d5 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:07:24 user nova-compute[72129]: INFO nova.compute.manager [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Rescuing
Aug 01 14:07:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Acquiring lock "refresh_cache-418f4c53-9dc5-402f-ad21-ac481674b083" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:07:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Acquired lock "refresh_cache-418f4c53-9dc5-402f-ad21-ac481674b083" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:07:24 user nova-compute[72129]: DEBUG nova.network.neutron [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 14:07:24 user nova-compute[72129]: DEBUG nova.network.neutron [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Updating instance_info_cache with network_info: [{"id": "df042689-7692-445c-89d8-cc6d908dd216", "address": "fa:16:3e:33:ea:dd", "network": {"id": "59b1e538-8bfe-45ce-ab7b-c5838ab25582", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1129024349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0929886fa54d1c8023793806f10d31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf042689-76", "ovs_interfaceid": "df042689-7692-445c-89d8-cc6d908dd216", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:07:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Releasing lock "refresh_cache-418f4c53-9dc5-402f-ad21-ac481674b083" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:07:24 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:07:24 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:07:25 user nova-compute[72129]: DEBUG nova.compute.manager [req-a5ff1897-5a7e-49c5-9d45-e2868df31d63 req-aafa449f-d6c7-467f-88d6-b51e578d9575 service nova] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Received event network-vif-unplugged-df042689-7692-445c-89d8-cc6d908dd216 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:07:25 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-a5ff1897-5a7e-49c5-9d45-e2868df31d63 req-aafa449f-d6c7-467f-88d6-b51e578d9575 service nova] Acquiring lock "418f4c53-9dc5-402f-ad21-ac481674b083-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:07:25 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-a5ff1897-5a7e-49c5-9d45-e2868df31d63 req-aafa449f-d6c7-467f-88d6-b51e578d9575 service nova] Lock "418f4c53-9dc5-402f-ad21-ac481674b083-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:07:25 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-a5ff1897-5a7e-49c5-9d45-e2868df31d63 req-aafa449f-d6c7-467f-88d6-b51e578d9575 service nova] Lock "418f4c53-9dc5-402f-ad21-ac481674b083-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:07:25 user nova-compute[72129]: DEBUG nova.compute.manager [req-a5ff1897-5a7e-49c5-9d45-e2868df31d63 req-aafa449f-d6c7-467f-88d6-b51e578d9575 service nova] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] No waiting events found dispatching network-vif-unplugged-df042689-7692-445c-89d8-cc6d908dd216 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:07:25 user nova-compute[72129]: WARNING nova.compute.manager [req-a5ff1897-5a7e-49c5-9d45-e2868df31d63 req-aafa449f-d6c7-467f-88d6-b51e578d9575 service nova] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Received unexpected event network-vif-unplugged-df042689-7692-445c-89d8-cc6d908dd216 for instance with vm_state active and task_state rescuing.
Aug 01 14:07:25 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:07:25 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:07:25 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Instance destroyed successfully.
Aug 01 14:07:25 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Attempting a stable device rescue
Aug 01 14:07:25 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72129) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 01 14:07:25 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Instance directory exists: not creating {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 01 14:07:25 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Creating image(s)
Aug 01 14:07:25 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Acquiring lock "/opt/stack/data/nova/instances/418f4c53-9dc5-402f-ad21-ac481674b083/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:07:25 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "/opt/stack/data/nova/instances/418f4c53-9dc5-402f-ad21-ac481674b083/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:07:25 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "/opt/stack/data/nova/instances/418f4c53-9dc5-402f-ad21-ac481674b083/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:07:25 user nova-compute[72129]: DEBUG nova.objects.instance [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lazy-loading 'trusted_certs' on Instance uuid 418f4c53-9dc5-402f-ad21-ac481674b083 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:07:25 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Acquiring lock "b64ff7ed8a7a62c255dad1064c1fa18de0a7b83c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:07:25 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "b64ff7ed8a7a62c255dad1064c1fa18de0a7b83c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b64ff7ed8a7a62c255dad1064c1fa18de0a7b83c.part --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG nova.compute.manager [req-56551672-e899-4da5-a814-45284de7e9d4 req-0adbddb9-5e7d-48e5-bb1d-e9ea2761a00f service nova] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Received event network-vif-plugged-df042689-7692-445c-89d8-cc6d908dd216 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-56551672-e899-4da5-a814-45284de7e9d4 req-0adbddb9-5e7d-48e5-bb1d-e9ea2761a00f service nova] Acquiring lock "418f4c53-9dc5-402f-ad21-ac481674b083-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-56551672-e899-4da5-a814-45284de7e9d4 req-0adbddb9-5e7d-48e5-bb1d-e9ea2761a00f service nova] Lock "418f4c53-9dc5-402f-ad21-ac481674b083-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-56551672-e899-4da5-a814-45284de7e9d4 req-0adbddb9-5e7d-48e5-bb1d-e9ea2761a00f service nova] Lock "418f4c53-9dc5-402f-ad21-ac481674b083-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG nova.compute.manager [req-56551672-e899-4da5-a814-45284de7e9d4 req-0adbddb9-5e7d-48e5-bb1d-e9ea2761a00f service nova] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] No waiting events found dispatching network-vif-plugged-df042689-7692-445c-89d8-cc6d908dd216 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:07:27 user nova-compute[72129]: WARNING nova.compute.manager [req-56551672-e899-4da5-a814-45284de7e9d4 req-0adbddb9-5e7d-48e5-bb1d-e9ea2761a00f service nova] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Received unexpected event network-vif-plugged-df042689-7692-445c-89d8-cc6d908dd216 for instance with vm_state active and task_state rescuing.
Aug 01 14:07:27 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b64ff7ed8a7a62c255dad1064c1fa18de0a7b83c.part --force-share --output=json" returned: 0 in 0.139s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG nova.virt.images [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] e59be025-7aa6-46c3-a8d0-4bd617a4b896 was qcow2, converting to raw {{(pid=72129) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG nova.privsep.utils [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72129) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b64ff7ed8a7a62c255dad1064c1fa18de0a7b83c.part /opt/stack/data/nova/instances/_base/b64ff7ed8a7a62c255dad1064c1fa18de0a7b83c.converted {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b64ff7ed8a7a62c255dad1064c1fa18de0a7b83c.part /opt/stack/data/nova/instances/_base/b64ff7ed8a7a62c255dad1064c1fa18de0a7b83c.converted" returned: 0 in 0.160s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b64ff7ed8a7a62c255dad1064c1fa18de0a7b83c.converted --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b64ff7ed8a7a62c255dad1064c1fa18de0a7b83c.converted --force-share --output=json" returned: 0 in 0.133s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "b64ff7ed8a7a62c255dad1064c1fa18de0a7b83c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.864s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Acquiring lock "b64ff7ed8a7a62c255dad1064c1fa18de0a7b83c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "b64ff7ed8a7a62c255dad1064c1fa18de0a7b83c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b64ff7ed8a7a62c255dad1064c1fa18de0a7b83c --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b64ff7ed8a7a62c255dad1064c1fa18de0a7b83c --force-share --output=json" returned: 0 in 0.133s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b64ff7ed8a7a62c255dad1064c1fa18de0a7b83c,backing_fmt=raw /opt/stack/data/nova/instances/418f4c53-9dc5-402f-ad21-ac481674b083/disk.rescue {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b64ff7ed8a7a62c255dad1064c1fa18de0a7b83c,backing_fmt=raw /opt/stack/data/nova/instances/418f4c53-9dc5-402f-ad21-ac481674b083/disk.rescue" returned: 0 in 0.048s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "b64ff7ed8a7a62c255dad1064c1fa18de0a7b83c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.188s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG nova.objects.instance [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lazy-loading 'migration_context' on Instance uuid 418f4c53-9dc5-402f-ad21-ac481674b083 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Created local disks {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Start _get_guest_xml network_info=[{"id": "df042689-7692-445c-89d8-cc6d908dd216", "address": "fa:16:3e:33:ea:dd", "network": {"id": "59b1e538-8bfe-45ce-ab7b-c5838ab25582", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1129024349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1129024349-network", "vif_mac": "fa:16:3e:33:ea:dd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0929886fa54d1c8023793806f10d31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf042689-76", "ovs_interfaceid": "df042689-7692-445c-89d8-cc6d908dd216", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e59be025-7aa6-46c3-a8d0-4bd617a4b896', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '5d81d68c-d390-43e4-bfea-3eb24d836ed1', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CthoGEYk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '418f4c53-9dc5-402f-ad21-ac481674b083', 'attached_at': '', 'detached_at': '', 'volume_id': '80fd8043-1d68-4b79-b574-464fdf0b8057', 'serial': '80fd8043-1d68-4b79-b574-464fdf0b8057'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG nova.objects.instance [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lazy-loading 'resources' on Instance uuid 418f4c53-9dc5-402f-ad21-ac481674b083 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG nova.objects.instance [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lazy-loading 'numa_topology' on Instance uuid 418f4c53-9dc5-402f-ad21-ac481674b083 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:07:27 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:07:27 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:07:27 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] CPU controller missing on host. {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] CPU controller found on host. {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72129) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T13:45:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Flavor limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Image limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Flavor pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Image pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Got 1 possible topologies {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG nova.objects.instance [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lazy-loading 'vcpu_model' on Instance uuid 418f4c53-9dc5-402f-ad21-ac481674b083 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Calling os-brick to attach iSCSI Volume {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CthoGEYk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:07:27 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:07:27 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:07:27 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:07:27 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:07:27 user nova-compute[72129]: INFO os_brick.initiator.connectors.iscsi [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 14:07:27 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 -p 172.16.0.220:3260 {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 -p 172.16.0.220:3260" returned: 0 in 0.025s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac48f29-f9f6-47b6-b01d-0027a81d0395]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = CthoGEYk\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 01 14:07:27 user nova-compute[72129]: node.name = iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057
Aug 01 14:07:27 user nova-compute[72129]: node.tpgt = -1
Aug 01 14:07:27 user nova-compute[72129]: node.startup = automatic
Aug 01 14:07:27 user nova-compute[72129]: node.leading_login = No
Aug 01 14:07:27 user nova-compute[72129]: iface.iscsi_ifacename = default
Aug 01 14:07:27 user nova-compute[72129]: iface.net_ifacename = <empty>
Aug 01 14:07:27 user nova-compute[72129]: iface.ipaddress = <empty>
Aug 01 14:07:27 user nova-compute[72129]: iface.prefix_len = 0
Aug 01 14:07:27 user nova-compute[72129]: iface.hwaddress = <empty>
Aug 01 14:07:27 user nova-compute[72129]: iface.transport_name = tcp
Aug 01 14:07:27 user nova-compute[72129]: iface.initiatorname = <empty>
Aug 01 14:07:27 user nova-compute[72129]: iface.state = <empty>
Aug 01 14:07:27 user nova-compute[72129]: iface.vlan_id = 0
Aug 01 14:07:27 user nova-compute[72129]: iface.vlan_priority = 0
Aug 01 14:07:27 user nova-compute[72129]: iface.vlan_state = <empty>
Aug 01 14:07:27 user nova-compute[72129]: iface.iface_num = 0
Aug 01 14:07:27 user nova-compute[72129]: iface.mtu = 0
Aug 01 14:07:27 user nova-compute[72129]: iface.port = 0
Aug 01 14:07:27 user nova-compute[72129]: iface.bootproto = <empty>
Aug 01 14:07:27 user nova-compute[72129]: iface.subnet_mask = <empty>
Aug 01 14:07:27 user nova-compute[72129]: iface.gateway = <empty>
Aug 01 14:07:27 user nova-compute[72129]: iface.dhcp_alt_client_id_state = <empty>
Aug 01 14:07:27 user nova-compute[72129]: iface.dhcp_alt_client_id = <empty>
Aug 01 14:07:27 user nova-compute[72129]: iface.dhcp_dns = <empty>
Aug 01 14:07:27 user nova-compute[72129]: iface.dhcp_learn_iqn = <empty>
Aug 01 14:07:27 user nova-compute[72129]: iface.dhcp_req_vendor_id_state = <empty>
Aug 01 14:07:27 user nova-compute[72129]: iface.dhcp_vendor_id_state = <empty>
Aug 01 14:07:27 user nova-compute[72129]: iface.dhcp_vendor_id = <empty>
Aug 01 14:07:27 user nova-compute[72129]: iface.dhcp_slp_da = <empty>
Aug 01 14:07:27 user nova-compute[72129]: iface.fragmentation = <empty>
Aug 01 14:07:27 user nova-compute[72129]: iface.gratuitous_arp = <empty>
Aug 01 14:07:27 user nova-compute[72129]: iface.incoming_forwarding = <empty>
Aug 01 14:07:27 user nova-compute[72129]: iface.tos_state = <empty>
Aug 01 14:07:27 user nova-compute[72129]: iface.tos = 0
Aug 01 14:07:27 user nova-compute[72129]: iface.ttl = 0
Aug 01 14:07:27 user nova-compute[72129]: iface.delayed_ack = <empty>
Aug 01 14:07:27 user nova-compute[72129]: iface.tcp_nagle = <empty>
Aug 01 14:07:27 user nova-compute[72129]: iface.tcp_wsf_state = <empty>
Aug 01 14:07:27 user nova-compute[72129]: iface.tcp_wsf = 0
Aug 01 14:07:27 user nova-compute[72129]: iface.tcp_timer_scale = 0
Aug 01 14:07:27 user nova-compute[72129]: iface.tcp_timestamp = <empty>
Aug 01 14:07:27 user nova-compute[72129]: iface.redirect = <empty>
Aug 01 14:07:27 user nova-compute[72129]: iface.def_task_mgmt_timeout = 0
Aug 01 14:07:27 user nova-compute[72129]: iface.header_digest = <empty>
Aug 01 14:07:27 user nova-compute[72129]: iface.data_digest = <empty>
Aug 01 14:07:27 user nova-compute[72129]: iface.immediate_data = <empty>
Aug 01 14:07:27 user nova-compute[72129]: iface.initial_r2t = <empty>
Aug 01 14:07:27 user nova-compute[72129]: iface.data_seq_inorder = <empty>
Aug 01 14:07:27 user nova-compute[72129]: iface.data_pdu_inorder = <empty>
Aug 01 14:07:27 user nova-compute[72129]: iface.erl = 0
Aug 01 14:07:27 user nova-compute[72129]: iface.max_receive_data_len = 0
Aug 01 14:07:27 user nova-compute[72129]: iface.first_burst_len = 0
Aug 01 14:07:27 user nova-compute[72129]: iface.max_outstanding_r2t = 0
Aug 01 14:07:27 user nova-compute[72129]: iface.max_burst_len = 0
Aug 01 14:07:27 user nova-compute[72129]: iface.chap_auth = <empty>
Aug 01 14:07:27 user nova-compute[72129]: iface.bidi_chap = <empty>
Aug 01 14:07:27 user nova-compute[72129]: iface.strict_login_compliance = <empty>
Aug 01 14:07:27 user nova-compute[72129]: iface.discovery_auth = <empty>
Aug 01 14:07:27 user nova-compute[72129]: iface.discovery_logout = <empty>
Aug 01 14:07:27 user nova-compute[72129]: node.discovery_address = <empty>
Aug 01 14:07:27 user nova-compute[72129]: node.discovery_port = 0
Aug 01 14:07:27 user nova-compute[72129]: node.discovery_type = static
Aug 01 14:07:27 user nova-compute[72129]: node.session.initial_cmdsn = 0
Aug 01 14:07:27 user nova-compute[72129]: node.session.initial_login_retry_max = 8
Aug 01 14:07:27 user nova-compute[72129]: node.session.xmit_thread_priority = -20
Aug 01 14:07:27 user nova-compute[72129]: node.session.cmds_max = 128
Aug 01 14:07:27 user nova-compute[72129]: node.session.queue_depth = 32
Aug 01 14:07:27 user nova-compute[72129]: node.session.nr_sessions = 1
Aug 01 14:07:27 user nova-compute[72129]: node.session.auth.authmethod = CHAP
Aug 01 14:07:27 user nova-compute[72129]: node.session.auth.username = CthoGEYk
Aug 01 14:07:27 user nova-compute[72129]: node.session.auth.password = ***
Aug 01 14:07:27 user nova-compute[72129]: node.session.auth.username_in = <empty>
Aug 01 14:07:27 user nova-compute[72129]: node.session.auth.password_in = <empty>
Aug 01 14:07:27 user nova-compute[72129]: node.session.auth.chap_algs = MD5
Aug 01 14:07:27 user nova-compute[72129]: node.session.timeo.replacement_timeout = 120
Aug 01 14:07:27 user nova-compute[72129]: node.session.err_timeo.abort_timeout = 15
Aug 01 14:07:27 user nova-compute[72129]: node.session.err_timeo.lu_reset_timeout = 30
Aug 01 14:07:27 user nova-compute[72129]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 01 14:07:27 user nova-compute[72129]: node.session.err_timeo.host_reset_timeout = 60
Aug 01 14:07:27 user nova-compute[72129]: node.session.iscsi.FastAbort = Yes
Aug 01 14:07:27 user nova-compute[72129]: node.session.iscsi.InitialR2T = No
Aug 01 14:07:27 user nova-compute[72129]: node.session.iscsi.ImmediateData = Yes
Aug 01 14:07:27 user nova-compute[72129]: node.session.iscsi.FirstBurstLength = 262144
Aug 01 14:07:27 user nova-compute[72129]: node.session.iscsi.MaxBurstLength = 16776192
Aug 01 14:07:27 user nova-compute[72129]: node.session.iscsi.DefaultTime2Retain = 0
Aug 01 14:07:27 user nova-compute[72129]: node.session.iscsi.DefaultTime2Wait = 2
Aug 01 14:07:27 user nova-compute[72129]: node.session.iscsi.MaxConnections = 1
Aug 01 14:07:27 user nova-compute[72129]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 01 14:07:27 user nova-compute[72129]: node.session.iscsi.ERL = 0
Aug 01 14:07:27 user nova-compute[72129]: node.session.scan = manual
Aug 01 14:07:27 user nova-compute[72129]: node.session.reopen_max = 0
Aug 01 14:07:27 user nova-compute[72129]: node.conn[0].address = 172.16.0.220
Aug 01 14:07:27 user nova-compute[72129]: node.conn[0].port = 3260
Aug 01 14:07:27 user nova-compute[72129]: node.conn[0].startup = manual
Aug 01 14:07:27 user nova-compute[72129]: node.conn[0].tcp.window_size = 524288
Aug 01 14:07:27 user nova-compute[72129]: node.conn[0].tcp.type_of_service = 0
Aug 01 14:07:27 user nova-compute[72129]: node.conn[0].timeo.logout_timeout = 15
Aug 01 14:07:27 user nova-compute[72129]: node.conn[0].timeo.login_timeout = 15
Aug 01 14:07:27 user nova-compute[72129]: node.conn[0].timeo.auth_timeout = 45
Aug 01 14:07:27 user nova-compute[72129]: node.conn[0].timeo.noop_out_interval = 5
Aug 01 14:07:27 user nova-compute[72129]: node.conn[0].timeo.noop_out_timeout = 5
Aug 01 14:07:27 user nova-compute[72129]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 01 14:07:27 user nova-compute[72129]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 01 14:07:27 user nova-compute[72129]: node.conn[0].iscsi.HeaderDigest = None
Aug 01 14:07:27 user nova-compute[72129]: node.conn[0].iscsi.DataDigest = None
Aug 01 14:07:27 user nova-compute[72129]: node.conn[0].iscsi.IFMarker = No
Aug 01 14:07:27 user nova-compute[72129]: node.conn[0].iscsi.OFMarker = No
Aug 01 14:07:27 user nova-compute[72129]: # END RECORD
Aug 01 14:07:27 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ea1697-b1bc-4e18-ac7c-731ea7dc5136]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b80106db-80cb-4b3b-bc97-efb08ebab0b7]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CthoGEYk {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CthoGEYk" returned: 0 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eec49f1-103c-4d8a-97a1-9763577b2d1b]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CthoGEYk'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f266e70-1a1b-498a-b97a-911f27546a61]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7ba6fc-d4da-44fe-830c-ff3495da69c7]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:07:27 user nova-compute[72129]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)
Aug 01 14:07:27 user nova-compute[72129]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 (non-flash)
Aug 01 14:07:27 user nova-compute[72129]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 (non-flash)
Aug 01 14:07:27 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:07:27 user nova-compute[72129]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)
Aug 01 14:07:27 user nova-compute[72129]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 (non-flash)
Aug 01 14:07:27 user nova-compute[72129]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 (non-flash)
Aug 01 14:07:27 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.156s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Connected to 172.16.0.220:3260 {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] HCTL ('33', '0', '0', 0) found on session 42 with lun 0 {{(pid=72129) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=72129) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.013s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[938a5a81-0843-49fd-819e-efb02a023338]: (4, ('0 0 0', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Searching for a device in session 42 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CthoGEYk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.180s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] <== connect_volume: return (181ms) {'type': 'block', 'scsi_wwn': '23536333632386639', 'path': '/dev/sdb'} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:07:27 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23536333632386639', 'path': '/dev/sdb'} {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 14:07:28 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:05:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1423869095',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1423869095',id=31,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T14:05:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1e0929886fa54d1c8023793806f10d31',ramdisk_id='',reservation_id='r-677hcku4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1414609013',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T14:05:58Z,user_data=None,user_id='cdb6f66592fe4cdebea02e5f5c1f4a60',uuid=418f4c53-9dc5-402f-ad21-ac481674b083,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "df042689-7692-445c-89d8-cc6d908dd216", "address": "fa:16:3e:33:ea:dd", "network": {"id": "59b1e538-8bfe-45ce-ab7b-c5838ab25582", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1129024349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1129024349-network", "vif_mac": "fa:16:3e:33:ea:dd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0929886fa54d1c8023793806f10d31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf042689-76", "ovs_interfaceid": "df042689-7692-445c-89d8-cc6d908dd216", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 14:07:28 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Converting VIF {"id": "df042689-7692-445c-89d8-cc6d908dd216", "address": "fa:16:3e:33:ea:dd", "network": {"id": "59b1e538-8bfe-45ce-ab7b-c5838ab25582", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1129024349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1129024349-network", "vif_mac": "fa:16:3e:33:ea:dd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0929886fa54d1c8023793806f10d31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf042689-76", "ovs_interfaceid": "df042689-7692-445c-89d8-cc6d908dd216", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:07:28 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:ea:dd,bridge_name='br-int',has_traffic_filtering=True,id=df042689-7692-445c-89d8-cc6d908dd216,network=Network(59b1e538-8bfe-45ce-ab7b-c5838ab25582),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf042689-76') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:07:28 user nova-compute[72129]: DEBUG nova.objects.instance [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lazy-loading 'pci_devices' on Instance uuid 418f4c53-9dc5-402f-ad21-ac481674b083 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:07:28 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] End _get_guest_xml xml=<domain type="kvm">
Aug 01 14:07:28 user nova-compute[72129]:   <uuid>418f4c53-9dc5-402f-ad21-ac481674b083</uuid>
Aug 01 14:07:28 user nova-compute[72129]:   <name>instance-0000001f</name>
Aug 01 14:07:28 user nova-compute[72129]:   <memory>524288</memory>
Aug 01 14:07:28 user nova-compute[72129]:   <vcpu>1</vcpu>
Aug 01 14:07:28 user nova-compute[72129]:   <metadata>
Aug 01 14:07:28 user nova-compute[72129]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 14:07:28 user nova-compute[72129]:       <nova:package version="0.0.0"/>
Aug 01 14:07:28 user nova-compute[72129]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1423869095</nova:name>
Aug 01 14:07:28 user nova-compute[72129]:       <nova:creationTime>2023-08-01 14:07:27</nova:creationTime>
Aug 01 14:07:28 user nova-compute[72129]:       <nova:flavor name="m1.tiny">
Aug 01 14:07:28 user nova-compute[72129]:         <nova:memory>512</nova:memory>
Aug 01 14:07:28 user nova-compute[72129]:         <nova:disk>1</nova:disk>
Aug 01 14:07:28 user nova-compute[72129]:         <nova:swap>0</nova:swap>
Aug 01 14:07:28 user nova-compute[72129]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 14:07:28 user nova-compute[72129]:         <nova:vcpus>1</nova:vcpus>
Aug 01 14:07:28 user nova-compute[72129]:       </nova:flavor>
Aug 01 14:07:28 user nova-compute[72129]:       <nova:owner>
Aug 01 14:07:28 user nova-compute[72129]:         <nova:user uuid="cdb6f66592fe4cdebea02e5f5c1f4a60">tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member</nova:user>
Aug 01 14:07:28 user nova-compute[72129]:         <nova:project uuid="1e0929886fa54d1c8023793806f10d31">tempest-ServerBootFromVolumeStableRescueTest-1414609013</nova:project>
Aug 01 14:07:28 user nova-compute[72129]:       </nova:owner>
Aug 01 14:07:28 user nova-compute[72129]:       <nova:root type="image" uuid="b6472c34-1b0f-4034-ba3a-7e8eb5103715"/>
Aug 01 14:07:28 user nova-compute[72129]:       <nova:ports>
Aug 01 14:07:28 user nova-compute[72129]:         <nova:port uuid="df042689-7692-445c-89d8-cc6d908dd216">
Aug 01 14:07:28 user nova-compute[72129]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 01 14:07:28 user nova-compute[72129]:         </nova:port>
Aug 01 14:07:28 user nova-compute[72129]:       </nova:ports>
Aug 01 14:07:28 user nova-compute[72129]:     </nova:instance>
Aug 01 14:07:28 user nova-compute[72129]:   </metadata>
Aug 01 14:07:28 user nova-compute[72129]:   <sysinfo type="smbios">
Aug 01 14:07:28 user nova-compute[72129]:     <system>
Aug 01 14:07:28 user nova-compute[72129]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 14:07:28 user nova-compute[72129]:       <entry name="product">OpenStack Nova</entry>
Aug 01 14:07:28 user nova-compute[72129]:       <entry name="version">0.0.0</entry>
Aug 01 14:07:28 user nova-compute[72129]:       <entry name="serial">418f4c53-9dc5-402f-ad21-ac481674b083</entry>
Aug 01 14:07:28 user nova-compute[72129]:       <entry name="uuid">418f4c53-9dc5-402f-ad21-ac481674b083</entry>
Aug 01 14:07:28 user nova-compute[72129]:       <entry name="family">Virtual Machine</entry>
Aug 01 14:07:28 user nova-compute[72129]:     </system>
Aug 01 14:07:28 user nova-compute[72129]:   </sysinfo>
Aug 01 14:07:28 user nova-compute[72129]:   <os>
Aug 01 14:07:28 user nova-compute[72129]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 14:07:28 user nova-compute[72129]:     <smbios mode="sysinfo"/>
Aug 01 14:07:28 user nova-compute[72129]:   </os>
Aug 01 14:07:28 user nova-compute[72129]:   <features>
Aug 01 14:07:28 user nova-compute[72129]:     <acpi/>
Aug 01 14:07:28 user nova-compute[72129]:     <apic/>
Aug 01 14:07:28 user nova-compute[72129]:     <vmcoreinfo/>
Aug 01 14:07:28 user nova-compute[72129]:   </features>
Aug 01 14:07:28 user nova-compute[72129]:   <clock offset="utc">
Aug 01 14:07:28 user nova-compute[72129]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 14:07:28 user nova-compute[72129]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 14:07:28 user nova-compute[72129]:     <timer name="hpet" present="no"/>
Aug 01 14:07:28 user nova-compute[72129]:   </clock>
Aug 01 14:07:28 user nova-compute[72129]:   <cpu mode="custom" match="exact">
Aug 01 14:07:28 user nova-compute[72129]:     <model>Nehalem</model>
Aug 01 14:07:28 user nova-compute[72129]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 14:07:28 user nova-compute[72129]:   </cpu>
Aug 01 14:07:28 user nova-compute[72129]:   <devices>
Aug 01 14:07:28 user nova-compute[72129]:     <disk type="block" device="disk">
Aug 01 14:07:28 user nova-compute[72129]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:07:28 user nova-compute[72129]:       <source dev="/dev/sdb"/>
Aug 01 14:07:28 user nova-compute[72129]:       <target dev="vda" bus="virtio"/>
Aug 01 14:07:28 user nova-compute[72129]:       <serial>80fd8043-1d68-4b79-b574-464fdf0b8057</serial>
Aug 01 14:07:28 user nova-compute[72129]:     </disk>
Aug 01 14:07:28 user nova-compute[72129]:     <disk type="file" device="disk">
Aug 01 14:07:28 user nova-compute[72129]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 14:07:28 user nova-compute[72129]:       <source file="/opt/stack/data/nova/instances/418f4c53-9dc5-402f-ad21-ac481674b083/disk.rescue"/>
Aug 01 14:07:28 user nova-compute[72129]:       <target dev="vdb" bus="virtio"/>
Aug 01 14:07:28 user nova-compute[72129]:       <boot order="1"/>
Aug 01 14:07:28 user nova-compute[72129]:     </disk>
Aug 01 14:07:28 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 14:07:28 user nova-compute[72129]:       <mac address="fa:16:3e:33:ea:dd"/>
Aug 01 14:07:28 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:07:28 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 14:07:28 user nova-compute[72129]:       <target dev="tapdf042689-76"/>
Aug 01 14:07:28 user nova-compute[72129]:     </interface>
Aug 01 14:07:28 user nova-compute[72129]:     <serial type="pty">
Aug 01 14:07:28 user nova-compute[72129]:       <log file="/opt/stack/data/nova/instances/418f4c53-9dc5-402f-ad21-ac481674b083/console.log" append="off"/>
Aug 01 14:07:28 user nova-compute[72129]:     </serial>
Aug 01 14:07:28 user nova-compute[72129]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 14:07:28 user nova-compute[72129]:     <video>
Aug 01 14:07:28 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:07:28 user nova-compute[72129]:     </video>
Aug 01 14:07:28 user nova-compute[72129]:     <rng model="virtio">
Aug 01 14:07:28 user nova-compute[72129]:       <backend model="random">/dev/urandom</backend>
Aug 01 14:07:28 user nova-compute[72129]:     </rng>
Aug 01 14:07:28 user nova-compute[72129]:     <controller type="usb" index="0" model="none"/>
Aug 01 14:07:28 user nova-compute[72129]:     <memballoon model="virtio">
Aug 01 14:07:28 user nova-compute[72129]:       <stats period="10"/>
Aug 01 14:07:28 user nova-compute[72129]:     </memballoon>
Aug 01 14:07:28 user nova-compute[72129]:   </devices>
Aug 01 14:07:28 user nova-compute[72129]: </domain>
Aug 01 14:07:28 user nova-compute[72129]:  {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 14:07:28 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Instance destroyed successfully.
Aug 01 14:07:28 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:07:28 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:07:28 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] No VIF found with MAC fa:16:3e:33:ea:dd, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 14:07:29 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:07:29 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:07:29 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:07:29 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:07:29 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:07:29 user nova-compute[72129]: DEBUG nova.compute.manager [req-ab6566aa-1fb6-4b1a-bdbc-452716801553 req-e097ffba-2791-43df-aea1-ed8484b68543 service nova] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Received event network-vif-plugged-df042689-7692-445c-89d8-cc6d908dd216 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:07:29 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ab6566aa-1fb6-4b1a-bdbc-452716801553 req-e097ffba-2791-43df-aea1-ed8484b68543 service nova] Acquiring lock "418f4c53-9dc5-402f-ad21-ac481674b083-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:07:29 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ab6566aa-1fb6-4b1a-bdbc-452716801553 req-e097ffba-2791-43df-aea1-ed8484b68543 service nova] Lock "418f4c53-9dc5-402f-ad21-ac481674b083-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:07:29 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ab6566aa-1fb6-4b1a-bdbc-452716801553 req-e097ffba-2791-43df-aea1-ed8484b68543 service nova] Lock "418f4c53-9dc5-402f-ad21-ac481674b083-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:07:29 user nova-compute[72129]: DEBUG nova.compute.manager [req-ab6566aa-1fb6-4b1a-bdbc-452716801553 req-e097ffba-2791-43df-aea1-ed8484b68543 service nova] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] No waiting events found dispatching network-vif-plugged-df042689-7692-445c-89d8-cc6d908dd216 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:07:29 user nova-compute[72129]: WARNING nova.compute.manager [req-ab6566aa-1fb6-4b1a-bdbc-452716801553 req-e097ffba-2791-43df-aea1-ed8484b68543 service nova] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Received unexpected event network-vif-plugged-df042689-7692-445c-89d8-cc6d908dd216 for instance with vm_state active and task_state rescuing.
Aug 01 14:07:29 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:07:29 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:07:31 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:07:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Removed pending event for 418f4c53-9dc5-402f-ad21-ac481674b083 due to event {{(pid=72129) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 14:07:31 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898851.5083425, 418f4c53-9dc5-402f-ad21-ac481674b083 => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:07:31 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] VM Resumed (Lifecycle Event)
Aug 01 14:07:31 user nova-compute[72129]: DEBUG nova.compute.manager [None req-c1ab7faf-221f-40e6-80a8-358c89a5f7f9 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:07:31 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:07:31 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:07:31 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 01 14:07:31 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898851.5096858, 418f4c53-9dc5-402f-ad21-ac481674b083 => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:07:31 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] VM Started (Lifecycle Event)
Aug 01 14:07:31 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:07:31 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:07:31 user nova-compute[72129]: INFO nova.compute.manager [None req-da73f212-828f-4a0e-a9ee-ab99da3ba030 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Get console output
Aug 01 14:07:31 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 01 14:07:31 user nova-compute[72129]: DEBUG nova.compute.manager [req-bd4d9cac-67b1-4d5d-8286-f5bfd9a742c6 req-de9ff203-c4e1-456c-bd14-370ec5ddeeda service nova] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Received event network-vif-plugged-df042689-7692-445c-89d8-cc6d908dd216 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:07:31 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-bd4d9cac-67b1-4d5d-8286-f5bfd9a742c6 req-de9ff203-c4e1-456c-bd14-370ec5ddeeda service nova] Acquiring lock "418f4c53-9dc5-402f-ad21-ac481674b083-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:07:31 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-bd4d9cac-67b1-4d5d-8286-f5bfd9a742c6 req-de9ff203-c4e1-456c-bd14-370ec5ddeeda service nova] Lock "418f4c53-9dc5-402f-ad21-ac481674b083-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:07:31 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-bd4d9cac-67b1-4d5d-8286-f5bfd9a742c6 req-de9ff203-c4e1-456c-bd14-370ec5ddeeda service nova] Lock "418f4c53-9dc5-402f-ad21-ac481674b083-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:07:31 user nova-compute[72129]: DEBUG nova.compute.manager [req-bd4d9cac-67b1-4d5d-8286-f5bfd9a742c6 req-de9ff203-c4e1-456c-bd14-370ec5ddeeda service nova] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] No waiting events found dispatching network-vif-plugged-df042689-7692-445c-89d8-cc6d908dd216 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:07:31 user nova-compute[72129]: WARNING nova.compute.manager [req-bd4d9cac-67b1-4d5d-8286-f5bfd9a742c6 req-de9ff203-c4e1-456c-bd14-370ec5ddeeda service nova] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Received unexpected event network-vif-plugged-df042689-7692-445c-89d8-cc6d908dd216 for instance with vm_state active and task_state rescuing.
Aug 01 14:07:31 user nova-compute[72129]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Aug 01 14:07:32 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:07:33 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:07:36 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:07:36 user nova-compute[72129]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690898841.1815581, e2cf5877-55dd-44ce-9b58-b662afe8e62e => Stopped> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:07:36 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] VM Stopped (Lifecycle Event)
Aug 01 14:07:36 user nova-compute[72129]: DEBUG nova.compute.manager [None req-b27252e0-b575-43da-ad88-22d38b992100 None None] [instance: e2cf5877-55dd-44ce-9b58-b662afe8e62e] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:07:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:07:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:07:41 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:07:42 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:07:46 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:07:47 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:07:51 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:07:52 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:07:52 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Acquiring lock "e3a73214-dad3-44d1-adc3-312970a919e5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:07:52 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "e3a73214-dad3-44d1-adc3-312970a919e5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:07:52 user nova-compute[72129]: DEBUG nova.compute.manager [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Starting instance... {{(pid=72129) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 14:07:52 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:07:52 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:07:52 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72129) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 14:07:52 user nova-compute[72129]: INFO nova.compute.claims [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Claim successful on node user
Aug 01 14:07:52 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:07:52 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:07:52 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.358s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:07:52 user nova-compute[72129]: DEBUG nova.compute.manager [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Start building networks asynchronously for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 14:07:52 user nova-compute[72129]: DEBUG nova.compute.manager [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Allocating IP information in the background. {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 14:07:52 user nova-compute[72129]: DEBUG nova.network.neutron [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] allocate_for_instance() {{(pid=72129) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 14:07:52 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 14:07:52 user nova-compute[72129]: DEBUG nova.compute.manager [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Start building block device mappings for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 14:07:52 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:07:52 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Starting heal instance info cache {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 14:07:52 user nova-compute[72129]: DEBUG nova.policy [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '13a3c19bbcbb4833abbb2997944a6564', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6120989bad342a4a6fa2a8975f5932f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72129) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 14:07:53 user nova-compute[72129]: DEBUG nova.compute.manager [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Start spawning the instance on the hypervisor. {{(pid=72129) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 14:07:53 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Creating instance directory {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 14:07:53 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Creating image(s)
Aug 01 14:07:53 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Acquiring lock "/opt/stack/data/nova/instances/e3a73214-dad3-44d1-adc3-312970a919e5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:07:53 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "/opt/stack/data/nova/instances/e3a73214-dad3-44d1-adc3-312970a919e5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:07:53 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "/opt/stack/data/nova/instances/e3a73214-dad3-44d1-adc3-312970a919e5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:07:53 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "refresh_cache-e4a13a50-fe03-41aa-94f4-3431805ff481" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:07:53 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquired lock "refresh_cache-e4a13a50-fe03-41aa-94f4-3431805ff481" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:07:53 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Forcefully refreshing network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 14:07:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:07:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.150s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:07:53 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Acquiring lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:07:53 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:07:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:07:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.140s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:07:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/e3a73214-dad3-44d1-adc3-312970a919e5/disk 1073741824 {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:07:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/e3a73214-dad3-44d1-adc3-312970a919e5/disk 1073741824" returned: 0 in 0.054s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:07:53 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:07:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:07:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.136s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:07:53 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e3a73214-dad3-44d1-adc3-312970a919e5/disk. size=1073741824 {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 14:07:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3a73214-dad3-44d1-adc3-312970a919e5/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:07:53 user nova-compute[72129]: DEBUG nova.network.neutron [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Successfully created port: 950fe308-2b8e-4c5a-9a1d-796cf99eef3d {{(pid=72129) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 14:07:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3a73214-dad3-44d1-adc3-312970a919e5/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:07:53 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Cannot resize image /opt/stack/data/nova/instances/e3a73214-dad3-44d1-adc3-312970a919e5/disk to a smaller size. {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 14:07:53 user nova-compute[72129]: DEBUG nova.objects.instance [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lazy-loading 'migration_context' on Instance uuid e3a73214-dad3-44d1-adc3-312970a919e5 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:07:53 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Created local disks {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 14:07:53 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Ensure instance console log exists: /opt/stack/data/nova/instances/e3a73214-dad3-44d1-adc3-312970a919e5/console.log {{(pid=72129) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 14:07:53 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:07:53 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:07:53 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:07:53 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Updating instance_info_cache with network_info: [{"id": "a36283e1-929d-4806-ba5f-175f99f44e98", "address": "fa:16:3e:28:9b:e7", "network": {"id": "4b93ad92-9a3a-4472-ba6c-d215329da98b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-734108983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0e85d9b73a546dc95e0ace26233f2a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36283e1-92", "ovs_interfaceid": "a36283e1-929d-4806-ba5f-175f99f44e98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:07:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Releasing lock "refresh_cache-e4a13a50-fe03-41aa-94f4-3431805ff481" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:07:54 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Updated the network info_cache for instance {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 14:07:54 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:07:54 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:07:54 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:07:54 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:07:54 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:07:54 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:07:54 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72129) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 14:07:54 user nova-compute[72129]: DEBUG nova.network.neutron [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Successfully updated port: 950fe308-2b8e-4c5a-9a1d-796cf99eef3d {{(pid=72129) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 14:07:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Acquiring lock "refresh_cache-e3a73214-dad3-44d1-adc3-312970a919e5" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:07:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Acquired lock "refresh_cache-e3a73214-dad3-44d1-adc3-312970a919e5" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:07:54 user nova-compute[72129]: DEBUG nova.network.neutron [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 14:07:54 user nova-compute[72129]: DEBUG nova.compute.manager [req-f0823fb1-6bd0-4589-8f36-0eb973d7846b req-0be04e13-7c31-49bb-965f-d959a9630fb4 service nova] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Received event network-changed-950fe308-2b8e-4c5a-9a1d-796cf99eef3d {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:07:54 user nova-compute[72129]: DEBUG nova.compute.manager [req-f0823fb1-6bd0-4589-8f36-0eb973d7846b req-0be04e13-7c31-49bb-965f-d959a9630fb4 service nova] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Refreshing instance network info cache due to event network-changed-950fe308-2b8e-4c5a-9a1d-796cf99eef3d. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 14:07:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f0823fb1-6bd0-4589-8f36-0eb973d7846b req-0be04e13-7c31-49bb-965f-d959a9630fb4 service nova] Acquiring lock "refresh_cache-e3a73214-dad3-44d1-adc3-312970a919e5" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:07:54 user nova-compute[72129]: DEBUG nova.network.neutron [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Instance cache missing network info. {{(pid=72129) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 14:07:54 user nova-compute[72129]: DEBUG nova.network.neutron [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Updating instance_info_cache with network_info: [{"id": "950fe308-2b8e-4c5a-9a1d-796cf99eef3d", "address": "fa:16:3e:16:8b:06", "network": {"id": "b0eb2211-5a6a-4b7e-a119-92a0f0deb947", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1159988670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6120989bad342a4a6fa2a8975f5932f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap950fe308-2b", "ovs_interfaceid": "950fe308-2b8e-4c5a-9a1d-796cf99eef3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:07:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Releasing lock "refresh_cache-e3a73214-dad3-44d1-adc3-312970a919e5" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:07:54 user nova-compute[72129]: DEBUG nova.compute.manager [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Instance network_info: |[{"id": "950fe308-2b8e-4c5a-9a1d-796cf99eef3d", "address": "fa:16:3e:16:8b:06", "network": {"id": "b0eb2211-5a6a-4b7e-a119-92a0f0deb947", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1159988670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6120989bad342a4a6fa2a8975f5932f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap950fe308-2b", "ovs_interfaceid": "950fe308-2b8e-4c5a-9a1d-796cf99eef3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 14:07:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f0823fb1-6bd0-4589-8f36-0eb973d7846b req-0be04e13-7c31-49bb-965f-d959a9630fb4 service nova] Acquired lock "refresh_cache-e3a73214-dad3-44d1-adc3-312970a919e5" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:07:54 user nova-compute[72129]: DEBUG nova.network.neutron [req-f0823fb1-6bd0-4589-8f36-0eb973d7846b req-0be04e13-7c31-49bb-965f-d959a9630fb4 service nova] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Refreshing network info cache for port 950fe308-2b8e-4c5a-9a1d-796cf99eef3d {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 14:07:54 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Start _get_guest_xml network_info=[{"id": "950fe308-2b8e-4c5a-9a1d-796cf99eef3d", "address": "fa:16:3e:16:8b:06", "network": {"id": "b0eb2211-5a6a-4b7e-a119-92a0f0deb947", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1159988670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6120989bad342a4a6fa2a8975f5932f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap950fe308-2b", "ovs_interfaceid": "950fe308-2b8e-4c5a-9a1d-796cf99eef3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'image_id': 'b6472c34-1b0f-4034-ba3a-7e8eb5103715'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 14:07:54 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:07:54 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:07:54 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 14:07:54 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] CPU controller missing on host. {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 14:07:54 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 14:07:54 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] CPU controller found on host. {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 14:07:54 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72129) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 14:07:54 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T13:45:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 14:07:54 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Flavor limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 14:07:54 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Image limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 14:07:54 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Flavor pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 14:07:54 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Image pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 14:07:54 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 14:07:54 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 14:07:54 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 14:07:54 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Got 1 possible topologies {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 14:07:54 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 14:07:54 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 14:07:54 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:07:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1014804108',display_name='tempest-AttachVolumeTestJSON-server-1014804108',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1014804108',id=34,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAu3nU2N9ohchIF1XngO4J9SW31e3ZOSF65ANnfIGGdQwH2BqqveO8FRvIrvq8KRyxa42LPgsFWmqzlUofPQET+hDNFSzIqWrY8ftZKPhFra8RIjbSa9LYrvi5kC8wNUbA==',key_name='tempest-keypair-1373369513',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6120989bad342a4a6fa2a8975f5932f',ramdisk_id='',reservation_id='r-mar4dnh6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-55653475',owner_user_name='tempest-AttachVolumeTestJSON-55653475-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T14:07:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13a3c19bbcbb4833abbb2997944a6564',uuid=e3a73214-dad3-44d1-adc3-312970a919e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "950fe308-2b8e-4c5a-9a1d-796cf99eef3d", "address": "fa:16:3e:16:8b:06", "network": {"id": "b0eb2211-5a6a-4b7e-a119-92a0f0deb947", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1159988670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6120989bad342a4a6fa2a8975f5932f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap950fe308-2b", "ovs_interfaceid": "950fe308-2b8e-4c5a-9a1d-796cf99eef3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 14:07:54 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Converting VIF {"id": "950fe308-2b8e-4c5a-9a1d-796cf99eef3d", "address": "fa:16:3e:16:8b:06", "network": {"id": "b0eb2211-5a6a-4b7e-a119-92a0f0deb947", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1159988670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6120989bad342a4a6fa2a8975f5932f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap950fe308-2b", "ovs_interfaceid": "950fe308-2b8e-4c5a-9a1d-796cf99eef3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:07:54 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:8b:06,bridge_name='br-int',has_traffic_filtering=True,id=950fe308-2b8e-4c5a-9a1d-796cf99eef3d,network=Network(b0eb2211-5a6a-4b7e-a119-92a0f0deb947),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap950fe308-2b') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:07:54 user nova-compute[72129]: DEBUG nova.objects.instance [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lazy-loading 'pci_devices' on Instance uuid e3a73214-dad3-44d1-adc3-312970a919e5 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:07:54 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] End _get_guest_xml xml=<domain type="kvm">
Aug 01 14:07:54 user nova-compute[72129]:   <uuid>e3a73214-dad3-44d1-adc3-312970a919e5</uuid>
Aug 01 14:07:54 user nova-compute[72129]:   <name>instance-00000022</name>
Aug 01 14:07:54 user nova-compute[72129]:   <memory>524288</memory>
Aug 01 14:07:54 user nova-compute[72129]:   <vcpu>1</vcpu>
Aug 01 14:07:54 user nova-compute[72129]:   <metadata>
Aug 01 14:07:54 user nova-compute[72129]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 14:07:54 user nova-compute[72129]:       <nova:package version="0.0.0"/>
Aug 01 14:07:54 user nova-compute[72129]:       <nova:name>tempest-AttachVolumeTestJSON-server-1014804108</nova:name>
Aug 01 14:07:54 user nova-compute[72129]:       <nova:creationTime>2023-08-01 14:07:54</nova:creationTime>
Aug 01 14:07:54 user nova-compute[72129]:       <nova:flavor name="m1.tiny">
Aug 01 14:07:54 user nova-compute[72129]:         <nova:memory>512</nova:memory>
Aug 01 14:07:54 user nova-compute[72129]:         <nova:disk>1</nova:disk>
Aug 01 14:07:54 user nova-compute[72129]:         <nova:swap>0</nova:swap>
Aug 01 14:07:54 user nova-compute[72129]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 14:07:54 user nova-compute[72129]:         <nova:vcpus>1</nova:vcpus>
Aug 01 14:07:54 user nova-compute[72129]:       </nova:flavor>
Aug 01 14:07:54 user nova-compute[72129]:       <nova:owner>
Aug 01 14:07:54 user nova-compute[72129]:         <nova:user uuid="13a3c19bbcbb4833abbb2997944a6564">tempest-AttachVolumeTestJSON-55653475-project-member</nova:user>
Aug 01 14:07:54 user nova-compute[72129]:         <nova:project uuid="a6120989bad342a4a6fa2a8975f5932f">tempest-AttachVolumeTestJSON-55653475</nova:project>
Aug 01 14:07:54 user nova-compute[72129]:       </nova:owner>
Aug 01 14:07:54 user nova-compute[72129]:       <nova:root type="image" uuid="b6472c34-1b0f-4034-ba3a-7e8eb5103715"/>
Aug 01 14:07:54 user nova-compute[72129]:       <nova:ports>
Aug 01 14:07:54 user nova-compute[72129]:         <nova:port uuid="950fe308-2b8e-4c5a-9a1d-796cf99eef3d">
Aug 01 14:07:54 user nova-compute[72129]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 01 14:07:54 user nova-compute[72129]:         </nova:port>
Aug 01 14:07:54 user nova-compute[72129]:       </nova:ports>
Aug 01 14:07:54 user nova-compute[72129]:     </nova:instance>
Aug 01 14:07:54 user nova-compute[72129]:   </metadata>
Aug 01 14:07:54 user nova-compute[72129]:   <sysinfo type="smbios">
Aug 01 14:07:54 user nova-compute[72129]:     <system>
Aug 01 14:07:54 user nova-compute[72129]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 14:07:54 user nova-compute[72129]:       <entry name="product">OpenStack Nova</entry>
Aug 01 14:07:54 user nova-compute[72129]:       <entry name="version">0.0.0</entry>
Aug 01 14:07:54 user nova-compute[72129]:       <entry name="serial">e3a73214-dad3-44d1-adc3-312970a919e5</entry>
Aug 01 14:07:54 user nova-compute[72129]:       <entry name="uuid">e3a73214-dad3-44d1-adc3-312970a919e5</entry>
Aug 01 14:07:54 user nova-compute[72129]:       <entry name="family">Virtual Machine</entry>
Aug 01 14:07:54 user nova-compute[72129]:     </system>
Aug 01 14:07:54 user nova-compute[72129]:   </sysinfo>
Aug 01 14:07:54 user nova-compute[72129]:   <os>
Aug 01 14:07:54 user nova-compute[72129]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 14:07:54 user nova-compute[72129]:     <boot dev="hd"/>
Aug 01 14:07:54 user nova-compute[72129]:     <smbios mode="sysinfo"/>
Aug 01 14:07:54 user nova-compute[72129]:   </os>
Aug 01 14:07:54 user nova-compute[72129]:   <features>
Aug 01 14:07:54 user nova-compute[72129]:     <acpi/>
Aug 01 14:07:54 user nova-compute[72129]:     <apic/>
Aug 01 14:07:54 user nova-compute[72129]:     <vmcoreinfo/>
Aug 01 14:07:54 user nova-compute[72129]:   </features>
Aug 01 14:07:54 user nova-compute[72129]:   <clock offset="utc">
Aug 01 14:07:54 user nova-compute[72129]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 14:07:54 user nova-compute[72129]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 14:07:54 user nova-compute[72129]:     <timer name="hpet" present="no"/>
Aug 01 14:07:54 user nova-compute[72129]:   </clock>
Aug 01 14:07:54 user nova-compute[72129]:   <cpu mode="custom" match="exact">
Aug 01 14:07:54 user nova-compute[72129]:     <model>Nehalem</model>
Aug 01 14:07:54 user nova-compute[72129]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 14:07:54 user nova-compute[72129]:   </cpu>
Aug 01 14:07:54 user nova-compute[72129]:   <devices>
Aug 01 14:07:54 user nova-compute[72129]:     <disk type="file" device="disk">
Aug 01 14:07:54 user nova-compute[72129]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 14:07:54 user nova-compute[72129]:       <source file="/opt/stack/data/nova/instances/e3a73214-dad3-44d1-adc3-312970a919e5/disk"/>
Aug 01 14:07:54 user nova-compute[72129]:       <target dev="vda" bus="virtio"/>
Aug 01 14:07:54 user nova-compute[72129]:     </disk>
Aug 01 14:07:54 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 14:07:54 user nova-compute[72129]:       <mac address="fa:16:3e:16:8b:06"/>
Aug 01 14:07:54 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:07:54 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 14:07:54 user nova-compute[72129]:       <target dev="tap950fe308-2b"/>
Aug 01 14:07:54 user nova-compute[72129]:     </interface>
Aug 01 14:07:54 user nova-compute[72129]:     <serial type="pty">
Aug 01 14:07:54 user nova-compute[72129]:       <log file="/opt/stack/data/nova/instances/e3a73214-dad3-44d1-adc3-312970a919e5/console.log" append="off"/>
Aug 01 14:07:54 user nova-compute[72129]:     </serial>
Aug 01 14:07:54 user nova-compute[72129]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 14:07:54 user nova-compute[72129]:     <video>
Aug 01 14:07:54 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:07:54 user nova-compute[72129]:     </video>
Aug 01 14:07:54 user nova-compute[72129]:     <rng model="virtio">
Aug 01 14:07:54 user nova-compute[72129]:       <backend model="random">/dev/urandom</backend>
Aug 01 14:07:54 user nova-compute[72129]:     </rng>
Aug 01 14:07:54 user nova-compute[72129]:     <controller type="usb" index="0" model="none"/>
Aug 01 14:07:54 user nova-compute[72129]:     <memballoon model="virtio">
Aug 01 14:07:54 user nova-compute[72129]:       <stats period="10"/>
Aug 01 14:07:54 user nova-compute[72129]:     </memballoon>
Aug 01 14:07:54 user nova-compute[72129]:   </devices>
Aug 01 14:07:54 user nova-compute[72129]: </domain>
Aug 01 14:07:54 user nova-compute[72129]:  {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 14:07:54 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:07:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1014804108',display_name='tempest-AttachVolumeTestJSON-server-1014804108',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1014804108',id=34,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAu3nU2N9ohchIF1XngO4J9SW31e3ZOSF65ANnfIGGdQwH2BqqveO8FRvIrvq8KRyxa42LPgsFWmqzlUofPQET+hDNFSzIqWrY8ftZKPhFra8RIjbSa9LYrvi5kC8wNUbA==',key_name='tempest-keypair-1373369513',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6120989bad342a4a6fa2a8975f5932f',ramdisk_id='',reservation_id='r-mar4dnh6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-55653475',owner_user_name='tempest-AttachVolumeTestJSON-55653475-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T14:07:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13a3c19bbcbb4833abbb2997944a6564',uuid=e3a73214-dad3-44d1-adc3-312970a919e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "950fe308-2b8e-4c5a-9a1d-796cf99eef3d", "address": "fa:16:3e:16:8b:06", "network": {"id": "b0eb2211-5a6a-4b7e-a119-92a0f0deb947", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1159988670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6120989bad342a4a6fa2a8975f5932f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap950fe308-2b", "ovs_interfaceid": "950fe308-2b8e-4c5a-9a1d-796cf99eef3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 14:07:54 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Converting VIF {"id": "950fe308-2b8e-4c5a-9a1d-796cf99eef3d", "address": "fa:16:3e:16:8b:06", "network": {"id": "b0eb2211-5a6a-4b7e-a119-92a0f0deb947", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1159988670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6120989bad342a4a6fa2a8975f5932f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap950fe308-2b", "ovs_interfaceid": "950fe308-2b8e-4c5a-9a1d-796cf99eef3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:07:54 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:8b:06,bridge_name='br-int',has_traffic_filtering=True,id=950fe308-2b8e-4c5a-9a1d-796cf99eef3d,network=Network(b0eb2211-5a6a-4b7e-a119-92a0f0deb947),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap950fe308-2b') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:07:54 user nova-compute[72129]: DEBUG os_vif [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:8b:06,bridge_name='br-int',has_traffic_filtering=True,id=950fe308-2b8e-4c5a-9a1d-796cf99eef3d,network=Network(b0eb2211-5a6a-4b7e-a119-92a0f0deb947),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap950fe308-2b') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 14:07:54 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:07:54 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:07:54 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 14:07:54 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:07:54 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap950fe308-2b, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:07:54 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap950fe308-2b, col_values=(('external_ids', {'iface-id': '950fe308-2b8e-4c5a-9a1d-796cf99eef3d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:8b:06', 'vm-uuid': 'e3a73214-dad3-44d1-adc3-312970a919e5'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:07:54 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:07:54 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:07:54 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:07:54 user nova-compute[72129]: INFO os_vif [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:8b:06,bridge_name='br-int',has_traffic_filtering=True,id=950fe308-2b8e-4c5a-9a1d-796cf99eef3d,network=Network(b0eb2211-5a6a-4b7e-a119-92a0f0deb947),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap950fe308-2b')
Aug 01 14:07:54 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:07:54 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] No VIF found with MAC fa:16:3e:16:8b:06, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 14:07:55 user nova-compute[72129]: DEBUG nova.network.neutron [req-f0823fb1-6bd0-4589-8f36-0eb973d7846b req-0be04e13-7c31-49bb-965f-d959a9630fb4 service nova] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Updated VIF entry in instance network info cache for port 950fe308-2b8e-4c5a-9a1d-796cf99eef3d. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 14:07:55 user nova-compute[72129]: DEBUG nova.network.neutron [req-f0823fb1-6bd0-4589-8f36-0eb973d7846b req-0be04e13-7c31-49bb-965f-d959a9630fb4 service nova] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Updating instance_info_cache with network_info: [{"id": "950fe308-2b8e-4c5a-9a1d-796cf99eef3d", "address": "fa:16:3e:16:8b:06", "network": {"id": "b0eb2211-5a6a-4b7e-a119-92a0f0deb947", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1159988670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6120989bad342a4a6fa2a8975f5932f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap950fe308-2b", "ovs_interfaceid": "950fe308-2b8e-4c5a-9a1d-796cf99eef3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:07:55 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f0823fb1-6bd0-4589-8f36-0eb973d7846b req-0be04e13-7c31-49bb-965f-d959a9630fb4 service nova] Releasing lock "refresh_cache-e3a73214-dad3-44d1-adc3-312970a919e5" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:07:56 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:07:56 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:07:56 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:07:56 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:07:56 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:07:56 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Auditing locally available compute resources for user (node: user) {{(pid=72129) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 14:07:56 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:07:56 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:07:56 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:07:56 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:07:56 user nova-compute[72129]: DEBUG nova.compute.manager [req-fc89657e-28d4-443f-b9a3-bbb6dec55792 req-64c0e275-2d01-4d12-8ba3-dd03819adf10 service nova] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Received event network-vif-plugged-950fe308-2b8e-4c5a-9a1d-796cf99eef3d {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:07:56 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-fc89657e-28d4-443f-b9a3-bbb6dec55792 req-64c0e275-2d01-4d12-8ba3-dd03819adf10 service nova] Acquiring lock "e3a73214-dad3-44d1-adc3-312970a919e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:07:56 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-fc89657e-28d4-443f-b9a3-bbb6dec55792 req-64c0e275-2d01-4d12-8ba3-dd03819adf10 service nova] Lock "e3a73214-dad3-44d1-adc3-312970a919e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:07:56 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-fc89657e-28d4-443f-b9a3-bbb6dec55792 req-64c0e275-2d01-4d12-8ba3-dd03819adf10 service nova] Lock "e3a73214-dad3-44d1-adc3-312970a919e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:07:56 user nova-compute[72129]: DEBUG nova.compute.manager [req-fc89657e-28d4-443f-b9a3-bbb6dec55792 req-64c0e275-2d01-4d12-8ba3-dd03819adf10 service nova] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] No waiting events found dispatching network-vif-plugged-950fe308-2b8e-4c5a-9a1d-796cf99eef3d {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:07:56 user nova-compute[72129]: WARNING nova.compute.manager [req-fc89657e-28d4-443f-b9a3-bbb6dec55792 req-64c0e275-2d01-4d12-8ba3-dd03819adf10 service nova] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Received unexpected event network-vif-plugged-950fe308-2b8e-4c5a-9a1d-796cf99eef3d for instance with vm_state building and task_state spawning.
Aug 01 14:07:56 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 14:07:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:07:56 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:07:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:07:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:07:57 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:07:57 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3a73214-dad3-44d1-adc3-312970a919e5/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:07:57 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3a73214-dad3-44d1-adc3-312970a919e5/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:07:57 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3a73214-dad3-44d1-adc3-312970a919e5/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:07:57 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3a73214-dad3-44d1-adc3-312970a919e5/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:07:57 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c43fda3-e098-4c3a-bcd5-14eac019db06/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:07:57 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c43fda3-e098-4c3a-bcd5-14eac019db06/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:07:57 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c43fda3-e098-4c3a-bcd5-14eac019db06/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:07:57 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c43fda3-e098-4c3a-bcd5-14eac019db06/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:07:57 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:07:57 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:07:57 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:07:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:07:58 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 14:07:58 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 14:07:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e06fb45-d156-451b-9e4d-e3d2fed52c37/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:07:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e06fb45-d156-451b-9e4d-e3d2fed52c37/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:07:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e06fb45-d156-451b-9e4d-e3d2fed52c37/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:07:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e06fb45-d156-451b-9e4d-e3d2fed52c37/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:07:58 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 14:07:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/418f4c53-9dc5-402f-ad21-ac481674b083/disk.rescue --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:07:58 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898878.402882, e3a73214-dad3-44d1-adc3-312970a919e5 => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:07:58 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] VM Resumed (Lifecycle Event)
Aug 01 14:07:58 user nova-compute[72129]: DEBUG nova.compute.manager [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Instance event wait completed in 0 seconds for  {{(pid=72129) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 14:07:58 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Guest created on hypervisor {{(pid=72129) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 14:07:58 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Instance spawned successfully.
Aug 01 14:07:58 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 14:07:58 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:07:58 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Found default for hw_cdrom_bus of ide {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:07:58 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Found default for hw_disk_bus of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:07:58 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Found default for hw_input_bus of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:07:58 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Found default for hw_pointer_model of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:07:58 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Found default for hw_video_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:07:58 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Found default for hw_vif_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:07:58 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:07:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/418f4c53-9dc5-402f-ad21-ac481674b083/disk.rescue --force-share --output=json" returned: 0 in 0.152s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:07:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/418f4c53-9dc5-402f-ad21-ac481674b083/disk.rescue --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:07:58 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 14:07:58 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898878.403423, e3a73214-dad3-44d1-adc3-312970a919e5 => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:07:58 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] VM Started (Lifecycle Event)
Aug 01 14:07:58 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:07:58 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:07:58 user nova-compute[72129]: DEBUG nova.compute.manager [req-a4830e8b-c332-4a30-8108-b69b775cf681 req-335312a7-645c-4bc2-b92e-b70a51ec9eeb service nova] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Received event network-vif-plugged-950fe308-2b8e-4c5a-9a1d-796cf99eef3d {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:07:58 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-a4830e8b-c332-4a30-8108-b69b775cf681 req-335312a7-645c-4bc2-b92e-b70a51ec9eeb service nova] Acquiring lock "e3a73214-dad3-44d1-adc3-312970a919e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:07:58 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-a4830e8b-c332-4a30-8108-b69b775cf681 req-335312a7-645c-4bc2-b92e-b70a51ec9eeb service nova] Lock "e3a73214-dad3-44d1-adc3-312970a919e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:07:58 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-a4830e8b-c332-4a30-8108-b69b775cf681 req-335312a7-645c-4bc2-b92e-b70a51ec9eeb service nova] Lock "e3a73214-dad3-44d1-adc3-312970a919e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:07:58 user nova-compute[72129]: DEBUG nova.compute.manager [req-a4830e8b-c332-4a30-8108-b69b775cf681 req-335312a7-645c-4bc2-b92e-b70a51ec9eeb service nova] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] No waiting events found dispatching network-vif-plugged-950fe308-2b8e-4c5a-9a1d-796cf99eef3d {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:07:58 user nova-compute[72129]: WARNING nova.compute.manager [req-a4830e8b-c332-4a30-8108-b69b775cf681 req-335312a7-645c-4bc2-b92e-b70a51ec9eeb service nova] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Received unexpected event network-vif-plugged-950fe308-2b8e-4c5a-9a1d-796cf99eef3d for instance with vm_state building and task_state spawning.
Aug 01 14:07:58 user nova-compute[72129]: INFO nova.compute.manager [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Took 5.54 seconds to spawn the instance on the hypervisor.
Aug 01 14:07:58 user nova-compute[72129]: DEBUG nova.compute.manager [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:07:58 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 14:07:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/418f4c53-9dc5-402f-ad21-ac481674b083/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:07:59 user nova-compute[72129]: INFO nova.compute.manager [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Took 6.62 seconds to build instance.
Aug 01 14:07:59 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:07:59 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:07:59 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Hypervisor/Node resource view: name=user free_ram=7737MB free_disk=25.078636169433594GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72129) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 14:07:59 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:07:59 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:07:59 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-ac9ed30d-dbe0-4a14-ac6c-d1606dd1781e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "e3a73214-dad3-44d1-adc3-312970a919e5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.709s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:07:59 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 97a5dccf-b499-443a-b332-cfa293a16047 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:07:59 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:07:59 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance d031973f-8f48-43b3-a338-040950103e4c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:07:59 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 0c43fda3-e098-4c3a-bcd5-14eac019db06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:07:59 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance e4a13a50-fe03-41aa-94f4-3431805ff481 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:07:59 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 418f4c53-9dc5-402f-ad21-ac481674b083 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:07:59 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 05e80bdd-ad15-4b98-b8ac-a40656f5f717 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:07:59 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 1e06fb45-d156-451b-9e4d-e3d2fed52c37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:07:59 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance e3a73214-dad3-44d1-adc3-312970a919e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:07:59 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 14:07:59 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 14:07:59 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:07:59 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:07:59 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Compute_service record updated for user:user {{(pid=72129) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 14:07:59 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.451s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:07:59 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:08:00 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:08:01 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:08:04 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:08:04 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:08:06 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:08:09 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:08:11 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:08:11 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:08:14 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:08:14 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:08:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:08:18 user nova-compute[72129]: DEBUG nova.compute.manager [req-2515aa60-d7e1-4577-b3c4-4aa735b77e03 req-1de159af-eebf-49d0-b0c5-58077960aa5a service nova] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] Received event network-changed-02054cb7-cdfb-4f42-bb44-c83648beac1a {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:08:18 user nova-compute[72129]: DEBUG nova.compute.manager [req-2515aa60-d7e1-4577-b3c4-4aa735b77e03 req-1de159af-eebf-49d0-b0c5-58077960aa5a service nova] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] Refreshing instance network info cache due to event network-changed-02054cb7-cdfb-4f42-bb44-c83648beac1a. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 14:08:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-2515aa60-d7e1-4577-b3c4-4aa735b77e03 req-1de159af-eebf-49d0-b0c5-58077960aa5a service nova] Acquiring lock "refresh_cache-05e80bdd-ad15-4b98-b8ac-a40656f5f717" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:08:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-2515aa60-d7e1-4577-b3c4-4aa735b77e03 req-1de159af-eebf-49d0-b0c5-58077960aa5a service nova] Acquired lock "refresh_cache-05e80bdd-ad15-4b98-b8ac-a40656f5f717" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:08:18 user nova-compute[72129]: DEBUG nova.network.neutron [req-2515aa60-d7e1-4577-b3c4-4aa735b77e03 req-1de159af-eebf-49d0-b0c5-58077960aa5a service nova] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] Refreshing network info cache for port 02054cb7-cdfb-4f42-bb44-c83648beac1a {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 14:08:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b6e2b98f-9f97-4f95-8570-25c6d23aa977 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Acquiring lock "05e80bdd-ad15-4b98-b8ac-a40656f5f717" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:08:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b6e2b98f-9f97-4f95-8570-25c6d23aa977 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "05e80bdd-ad15-4b98-b8ac-a40656f5f717" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:08:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b6e2b98f-9f97-4f95-8570-25c6d23aa977 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Acquiring lock "05e80bdd-ad15-4b98-b8ac-a40656f5f717-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:08:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b6e2b98f-9f97-4f95-8570-25c6d23aa977 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "05e80bdd-ad15-4b98-b8ac-a40656f5f717-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:08:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b6e2b98f-9f97-4f95-8570-25c6d23aa977 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "05e80bdd-ad15-4b98-b8ac-a40656f5f717-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:08:18 user nova-compute[72129]: INFO nova.compute.manager [None req-b6e2b98f-9f97-4f95-8570-25c6d23aa977 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] Terminating instance
Aug 01 14:08:18 user nova-compute[72129]: DEBUG nova.compute.manager [None req-b6e2b98f-9f97-4f95-8570-25c6d23aa977 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] Start destroying the instance on the hypervisor. {{(pid=72129) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 14:08:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:08:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:08:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:08:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:08:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:08:19 user nova-compute[72129]: DEBUG nova.network.neutron [req-2515aa60-d7e1-4577-b3c4-4aa735b77e03 req-1de159af-eebf-49d0-b0c5-58077960aa5a service nova] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] Updated VIF entry in instance network info cache for port 02054cb7-cdfb-4f42-bb44-c83648beac1a. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 14:08:19 user nova-compute[72129]: DEBUG nova.network.neutron [req-2515aa60-d7e1-4577-b3c4-4aa735b77e03 req-1de159af-eebf-49d0-b0c5-58077960aa5a service nova] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] Updating instance_info_cache with network_info: [{"id": "02054cb7-cdfb-4f42-bb44-c83648beac1a", "address": "fa:16:3e:f8:70:a5", "network": {"id": "a7f4226b-73fe-4265-ba2c-5d7dcdf154fd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1142462884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210837255c8148ec9b482ba3e2551362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02054cb7-cd", "ovs_interfaceid": "02054cb7-cdfb-4f42-bb44-c83648beac1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:08:19 user nova-compute[72129]: DEBUG nova.compute.manager [req-d5587f0d-0a6b-432d-bcc0-0ebd3d581591 req-8c99e8b8-590c-42a2-8fad-226317d90b61 service nova] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] Received event network-vif-unplugged-02054cb7-cdfb-4f42-bb44-c83648beac1a {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:08:19 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-d5587f0d-0a6b-432d-bcc0-0ebd3d581591 req-8c99e8b8-590c-42a2-8fad-226317d90b61 service nova] Acquiring lock "05e80bdd-ad15-4b98-b8ac-a40656f5f717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:08:19 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-d5587f0d-0a6b-432d-bcc0-0ebd3d581591 req-8c99e8b8-590c-42a2-8fad-226317d90b61 service nova] Lock "05e80bdd-ad15-4b98-b8ac-a40656f5f717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:08:19 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-d5587f0d-0a6b-432d-bcc0-0ebd3d581591 req-8c99e8b8-590c-42a2-8fad-226317d90b61 service nova] Lock "05e80bdd-ad15-4b98-b8ac-a40656f5f717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:08:19 user nova-compute[72129]: DEBUG nova.compute.manager [req-d5587f0d-0a6b-432d-bcc0-0ebd3d581591 req-8c99e8b8-590c-42a2-8fad-226317d90b61 service nova] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] No waiting events found dispatching network-vif-unplugged-02054cb7-cdfb-4f42-bb44-c83648beac1a {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:08:19 user nova-compute[72129]: DEBUG nova.compute.manager [req-d5587f0d-0a6b-432d-bcc0-0ebd3d581591 req-8c99e8b8-590c-42a2-8fad-226317d90b61 service nova] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] Received event network-vif-unplugged-02054cb7-cdfb-4f42-bb44-c83648beac1a for instance with task_state deleting. {{(pid=72129) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 14:08:19 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-2515aa60-d7e1-4577-b3c4-4aa735b77e03 req-1de159af-eebf-49d0-b0c5-58077960aa5a service nova] Releasing lock "refresh_cache-05e80bdd-ad15-4b98-b8ac-a40656f5f717" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:08:19 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] Instance destroyed successfully.
Aug 01 14:08:19 user nova-compute[72129]: DEBUG nova.objects.instance [None req-b6e2b98f-9f97-4f95-8570-25c6d23aa977 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lazy-loading 'resources' on Instance uuid 05e80bdd-ad15-4b98-b8ac-a40656f5f717 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:08:19 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-b6e2b98f-9f97-4f95-8570-25c6d23aa977 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:06:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1298389106',display_name='tempest-TestVolumeBootPattern-server-1298389106',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1298389106',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNC/W23SfZUyUykD+/RvnPe5L4yiaqOIZwhr2x6wMubzv0aJUgMCBBDug36LSArw18K2rZhhyJmbPtRQrPLsQ9v32QcGWNTH4aynBroBlcsIvr6dB/z67zo0JXowDVQS+w==',key_name='tempest-TestVolumeBootPattern-1986080939',keypairs=<?>,launch_index=0,launched_at=2023-08-01T14:06:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='210837255c8148ec9b482ba3e2551362',ramdisk_id='',reservation_id='r-616xu2d9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1876154436',owner_user_name='tempest-TestVolumeBootPattern-1876154436-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T14:06:39Z,user_data=None,user_id='7c341be2816c43cfa9adb58ee84e942b',uuid=05e80bdd-ad15-4b98-b8ac-a40656f5f717,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "02054cb7-cdfb-4f42-bb44-c83648beac1a", "address": "fa:16:3e:f8:70:a5", "network": {"id": "a7f4226b-73fe-4265-ba2c-5d7dcdf154fd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1142462884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210837255c8148ec9b482ba3e2551362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02054cb7-cd", "ovs_interfaceid": "02054cb7-cdfb-4f42-bb44-c83648beac1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 14:08:19 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-b6e2b98f-9f97-4f95-8570-25c6d23aa977 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Converting VIF {"id": "02054cb7-cdfb-4f42-bb44-c83648beac1a", "address": "fa:16:3e:f8:70:a5", "network": {"id": "a7f4226b-73fe-4265-ba2c-5d7dcdf154fd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1142462884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210837255c8148ec9b482ba3e2551362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02054cb7-cd", "ovs_interfaceid": "02054cb7-cdfb-4f42-bb44-c83648beac1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:08:19 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-b6e2b98f-9f97-4f95-8570-25c6d23aa977 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:70:a5,bridge_name='br-int',has_traffic_filtering=True,id=02054cb7-cdfb-4f42-bb44-c83648beac1a,network=Network(a7f4226b-73fe-4265-ba2c-5d7dcdf154fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02054cb7-cd') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:08:19 user nova-compute[72129]: DEBUG os_vif [None req-b6e2b98f-9f97-4f95-8570-25c6d23aa977 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:70:a5,bridge_name='br-int',has_traffic_filtering=True,id=02054cb7-cdfb-4f42-bb44-c83648beac1a,network=Network(a7f4226b-73fe-4265-ba2c-5d7dcdf154fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02054cb7-cd') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 14:08:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:08:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap02054cb7-cd, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:08:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:08:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:08:19 user nova-compute[72129]: INFO os_vif [None req-b6e2b98f-9f97-4f95-8570-25c6d23aa977 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:70:a5,bridge_name='br-int',has_traffic_filtering=True,id=02054cb7-cdfb-4f42-bb44-c83648beac1a,network=Network(a7f4226b-73fe-4265-ba2c-5d7dcdf154fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02054cb7-cd')
Aug 01 14:08:19 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6e2b98f-9f97-4f95-8570-25c6d23aa977 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] calling os-brick to detach iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 14:08:19 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e2b98f-9f97-4f95-8570-25c6d23aa977 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, {'target_iqns': ['iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pedDTuLS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:08:19 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-b6e2b98f-9f97-4f95-8570-25c6d23aa977 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:08:19 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-b6e2b98f-9f97-4f95-8570-25c6d23aa977 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:08:19 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-b6e2b98f-9f97-4f95-8570-25c6d23aa977 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:08:19 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e2b98f-9f97-4f95-8570-25c6d23aa977 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883', 0)] {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 14:08:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:08:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:08:19 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed54315d-2ee8-4910-ab5a-b465354c72e3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:08:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:08:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:08:19 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36cb28b-fc30-4270-bf0a-9994782a4b88]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:08:19 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e2b98f-9f97-4f95-8570-25c6d23aa977 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:08:19 user nova-compute[72129]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)
Aug 01 14:08:19 user nova-compute[72129]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 (non-flash)
Aug 01 14:08:19 user nova-compute[72129]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 (non-flash)
Aug 01 14:08:19 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:08:19 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e2b98f-9f97-4f95-8570-25c6d23aa977 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:08:19 user nova-compute[72129]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)
Aug 01 14:08:19 user nova-compute[72129]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 (non-flash)
Aug 01 14:08:19 user nova-compute[72129]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 (non-flash)
Aug 01 14:08:19 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:08:19 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e2b98f-9f97-4f95-8570-25c6d23aa977 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f28102a7eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883'): ({'sdd'}, set())}) {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 14:08:19 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-b6e2b98f-9f97-4f95-8570-25c6d23aa977 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Removing single pathed devices sdd {{(pid=72129) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 14:08:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:08:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:08:19 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[37611414-6e77-4fcc-b343-11715dfcffa5]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:08:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:08:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:08:19 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20cb964-2b04-4e59-a57a-03f2bd4e6bbc]: (4, ('ok\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:08:19 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-b6e2b98f-9f97-4f95-8570-25c6d23aa977 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Flushing IO for device /dev/sdd {{(pid=72129) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 14:08:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:08:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:08:19 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eada239-7565-4569-bb45-b931b9ba6d03]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:08:19 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-b6e2b98f-9f97-4f95-8570-25c6d23aa977 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72129) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 14:08:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:08:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:08:19 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9be664-f3a3-4bd6-949a-f8985d6e62f5]: (4, ('1', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:08:19 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-b6e2b98f-9f97-4f95-8570-25c6d23aa977 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 14:08:19 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-b6e2b98f-9f97-4f95-8570-25c6d23aa977 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] SCSI volumes sdd have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 14:08:19 user nova-compute[72129]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_5aa03bbf', '/dev/disk/by-id/scsi-1SCST_BIO5aa03bbf-7dc814f1398f5070', '/dev/disk/by-id/scsi-23764633831346631') {{(pid=82887) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 01 14:08:19 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[60bc69d2-10bd-4839-9888-08175edd9444]: (4, None) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:08:19 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e2b98f-9f97-4f95-8570-25c6d23aa977 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883')] {{(pid=72129) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 14:08:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:08:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:08:19 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a619caf4-7696-4e05-aeef-02edca7d5a2e]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:08:19 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e2b98f-9f97-4f95-8570-25c6d23aa977 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:08:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 -p 172.16.0.220:3260 --logout {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:08:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:08:19 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20f9d8a-3f0c-42be-a03d-4f4f4e6ce2c6]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:08:19 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e2b98f-9f97-4f95-8570-25c6d23aa977 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883, portal: 172.16.0.220,3260]
Aug 01 14:08:19 user nova-compute[72129]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883, portal: 172.16.0.220,3260] successful.
Aug 01 14:08:19 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:08:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 -p 172.16.0.220:3260 --op delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:08:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:08:19 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f56b95-a233-45f8-8c80-34989305b60f]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:08:19 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e2b98f-9f97-4f95-8570-25c6d23aa977 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:08:19 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-b6e2b98f-9f97-4f95-8570-25c6d23aa977 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:08:19 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e2b98f-9f97-4f95-8570-25c6d23aa977 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] <== disconnect_volume: return (339ms) None {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:08:19 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6e2b98f-9f97-4f95-8570-25c6d23aa977 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] Disconnected iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 14:08:19 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-b6e2b98f-9f97-4f95-8570-25c6d23aa977 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] Deleting instance files /opt/stack/data/nova/instances/05e80bdd-ad15-4b98-b8ac-a40656f5f717_del
Aug 01 14:08:19 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-b6e2b98f-9f97-4f95-8570-25c6d23aa977 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] Deletion of /opt/stack/data/nova/instances/05e80bdd-ad15-4b98-b8ac-a40656f5f717_del complete
Aug 01 14:08:19 user nova-compute[72129]: INFO nova.compute.manager [None req-b6e2b98f-9f97-4f95-8570-25c6d23aa977 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] Took 1.24 seconds to destroy the instance on the hypervisor.
Aug 01 14:08:19 user nova-compute[72129]: DEBUG oslo.service.loopingcall [None req-b6e2b98f-9f97-4f95-8570-25c6d23aa977 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72129) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 14:08:19 user nova-compute[72129]: DEBUG nova.compute.manager [-] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] Deallocating network for instance {{(pid=72129) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 14:08:19 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] deallocate_for_instance() {{(pid=72129) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 14:08:20 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:08:20 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] Took 0.81 seconds to deallocate network for instance.
Aug 01 14:08:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:08:21 user nova-compute[72129]: DEBUG nova.compute.manager [req-a44b1760-30a7-430f-b820-641e591bc128 req-219658df-dff8-4c77-9c21-194790e4b3e9 service nova] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] Received event network-vif-plugged-02054cb7-cdfb-4f42-bb44-c83648beac1a {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:08:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-a44b1760-30a7-430f-b820-641e591bc128 req-219658df-dff8-4c77-9c21-194790e4b3e9 service nova] Acquiring lock "05e80bdd-ad15-4b98-b8ac-a40656f5f717-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:08:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-a44b1760-30a7-430f-b820-641e591bc128 req-219658df-dff8-4c77-9c21-194790e4b3e9 service nova] Lock "05e80bdd-ad15-4b98-b8ac-a40656f5f717-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:08:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-a44b1760-30a7-430f-b820-641e591bc128 req-219658df-dff8-4c77-9c21-194790e4b3e9 service nova] Lock "05e80bdd-ad15-4b98-b8ac-a40656f5f717-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:08:21 user nova-compute[72129]: DEBUG nova.compute.manager [req-a44b1760-30a7-430f-b820-641e591bc128 req-219658df-dff8-4c77-9c21-194790e4b3e9 service nova] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] No waiting events found dispatching network-vif-plugged-02054cb7-cdfb-4f42-bb44-c83648beac1a {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:08:21 user nova-compute[72129]: WARNING nova.compute.manager [req-a44b1760-30a7-430f-b820-641e591bc128 req-219658df-dff8-4c77-9c21-194790e4b3e9 service nova] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] Received unexpected event network-vif-plugged-02054cb7-cdfb-4f42-bb44-c83648beac1a for instance with vm_state active and task_state deleting.
Aug 01 14:08:21 user nova-compute[72129]: DEBUG nova.compute.manager [req-a44b1760-30a7-430f-b820-641e591bc128 req-219658df-dff8-4c77-9c21-194790e4b3e9 service nova] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] Received event network-vif-deleted-02054cb7-cdfb-4f42-bb44-c83648beac1a {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:08:21 user nova-compute[72129]: INFO nova.compute.manager [None req-b6e2b98f-9f97-4f95-8570-25c6d23aa977 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] Took 0.79 seconds to detach 1 volumes for instance.
Aug 01 14:08:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b6e2b98f-9f97-4f95-8570-25c6d23aa977 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:08:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b6e2b98f-9f97-4f95-8570-25c6d23aa977 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:08:21 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-b6e2b98f-9f97-4f95-8570-25c6d23aa977 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:08:21 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-b6e2b98f-9f97-4f95-8570-25c6d23aa977 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:08:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b6e2b98f-9f97-4f95-8570-25c6d23aa977 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.307s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:08:22 user nova-compute[72129]: INFO nova.scheduler.client.report [None req-b6e2b98f-9f97-4f95-8570-25c6d23aa977 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Deleted allocations for instance 05e80bdd-ad15-4b98-b8ac-a40656f5f717
Aug 01 14:08:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b6e2b98f-9f97-4f95-8570-25c6d23aa977 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "05e80bdd-ad15-4b98-b8ac-a40656f5f717" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.623s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:08:24 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:08:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:08:29 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:08:32 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-64f6ccd0-e4e9-4ea4-ba54-291185f2cf44 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Acquiring lock "e4a13a50-fe03-41aa-94f4-3431805ff481" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:08:32 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-64f6ccd0-e4e9-4ea4-ba54-291185f2cf44 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "e4a13a50-fe03-41aa-94f4-3431805ff481" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:08:32 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-64f6ccd0-e4e9-4ea4-ba54-291185f2cf44 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Acquiring lock "e4a13a50-fe03-41aa-94f4-3431805ff481-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:08:32 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-64f6ccd0-e4e9-4ea4-ba54-291185f2cf44 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "e4a13a50-fe03-41aa-94f4-3431805ff481-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:08:32 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-64f6ccd0-e4e9-4ea4-ba54-291185f2cf44 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "e4a13a50-fe03-41aa-94f4-3431805ff481-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:08:32 user nova-compute[72129]: INFO nova.compute.manager [None req-64f6ccd0-e4e9-4ea4-ba54-291185f2cf44 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Terminating instance
Aug 01 14:08:32 user nova-compute[72129]: DEBUG nova.compute.manager [None req-64f6ccd0-e4e9-4ea4-ba54-291185f2cf44 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Start destroying the instance on the hypervisor. {{(pid=72129) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 14:08:32 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:08:32 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:08:32 user nova-compute[72129]: DEBUG nova.compute.manager [req-161020dd-5b63-4c8e-a418-25300c9b19e5 req-5ca01194-4a25-4e06-9b59-4dadbfd05b34 service nova] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Received event network-vif-unplugged-a36283e1-929d-4806-ba5f-175f99f44e98 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:08:32 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-161020dd-5b63-4c8e-a418-25300c9b19e5 req-5ca01194-4a25-4e06-9b59-4dadbfd05b34 service nova] Acquiring lock "e4a13a50-fe03-41aa-94f4-3431805ff481-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:08:32 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-161020dd-5b63-4c8e-a418-25300c9b19e5 req-5ca01194-4a25-4e06-9b59-4dadbfd05b34 service nova] Lock "e4a13a50-fe03-41aa-94f4-3431805ff481-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:08:32 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-161020dd-5b63-4c8e-a418-25300c9b19e5 req-5ca01194-4a25-4e06-9b59-4dadbfd05b34 service nova] Lock "e4a13a50-fe03-41aa-94f4-3431805ff481-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:08:32 user nova-compute[72129]: DEBUG nova.compute.manager [req-161020dd-5b63-4c8e-a418-25300c9b19e5 req-5ca01194-4a25-4e06-9b59-4dadbfd05b34 service nova] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] No waiting events found dispatching network-vif-unplugged-a36283e1-929d-4806-ba5f-175f99f44e98 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:08:32 user nova-compute[72129]: DEBUG nova.compute.manager [req-161020dd-5b63-4c8e-a418-25300c9b19e5 req-5ca01194-4a25-4e06-9b59-4dadbfd05b34 service nova] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Received event network-vif-unplugged-a36283e1-929d-4806-ba5f-175f99f44e98 for instance with task_state deleting. {{(pid=72129) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 14:08:32 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:08:32 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:08:33 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Instance destroyed successfully.
Aug 01 14:08:33 user nova-compute[72129]: DEBUG nova.objects.instance [None req-64f6ccd0-e4e9-4ea4-ba54-291185f2cf44 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lazy-loading 'resources' on Instance uuid e4a13a50-fe03-41aa-94f4-3431805ff481 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:08:33 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-64f6ccd0-e4e9-4ea4-ba54-291185f2cf44 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:01:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-320688111',display_name='tempest-ServerActionsTestOtherA-server-320688111',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-320688111',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMKxgVYWQdVKRLV+QIEDxsF4RC9I5wENeCwXhryJ2sr+8oNRgK2W8XmwhDYsUxLBCXzQXdaopDtUa2pfT9PfB2oRmI83WPjT6V3uSmwDrvE9fHgGK0Xxc5yPsVieUvlqoA==',key_name='tempest-keypair-1687158208',keypairs=<?>,launch_index=0,launched_at=2023-08-01T14:04:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b0e85d9b73a546dc95e0ace26233f2a7',ramdisk_id='',reservation_id='r-t03cme4n',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1440097443',owner_user_name='tempest-ServerActionsTestOtherA-1440097443-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T14:05:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f35620862694e7295f782ab15e290a8',uuid=e4a13a50-fe03-41aa-94f4-3431805ff481,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a36283e1-929d-4806-ba5f-175f99f44e98", "address": "fa:16:3e:28:9b:e7", "network": {"id": "4b93ad92-9a3a-4472-ba6c-d215329da98b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-734108983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0e85d9b73a546dc95e0ace26233f2a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36283e1-92", "ovs_interfaceid": "a36283e1-929d-4806-ba5f-175f99f44e98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 14:08:33 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-64f6ccd0-e4e9-4ea4-ba54-291185f2cf44 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Converting VIF {"id": "a36283e1-929d-4806-ba5f-175f99f44e98", "address": "fa:16:3e:28:9b:e7", "network": {"id": "4b93ad92-9a3a-4472-ba6c-d215329da98b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-734108983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0e85d9b73a546dc95e0ace26233f2a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa36283e1-92", "ovs_interfaceid": "a36283e1-929d-4806-ba5f-175f99f44e98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:08:33 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-64f6ccd0-e4e9-4ea4-ba54-291185f2cf44 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:9b:e7,bridge_name='br-int',has_traffic_filtering=True,id=a36283e1-929d-4806-ba5f-175f99f44e98,network=Network(4b93ad92-9a3a-4472-ba6c-d215329da98b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa36283e1-92') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:08:33 user nova-compute[72129]: DEBUG os_vif [None req-64f6ccd0-e4e9-4ea4-ba54-291185f2cf44 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:9b:e7,bridge_name='br-int',has_traffic_filtering=True,id=a36283e1-929d-4806-ba5f-175f99f44e98,network=Network(4b93ad92-9a3a-4472-ba6c-d215329da98b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa36283e1-92') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 14:08:33 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:08:33 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa36283e1-92, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:08:33 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:08:33 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:08:33 user nova-compute[72129]: INFO os_vif [None req-64f6ccd0-e4e9-4ea4-ba54-291185f2cf44 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:9b:e7,bridge_name='br-int',has_traffic_filtering=True,id=a36283e1-929d-4806-ba5f-175f99f44e98,network=Network(4b93ad92-9a3a-4472-ba6c-d215329da98b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa36283e1-92')
Aug 01 14:08:33 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64f6ccd0-e4e9-4ea4-ba54-291185f2cf44 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] calling os-brick to detach iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 14:08:33 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-64f6ccd0-e4e9-4ea4-ba54-291185f2cf44 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, {'target_iqns': ['iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jnqFwdQU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:08:33 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-64f6ccd0-e4e9-4ea4-ba54-291185f2cf44 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:08:33 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-64f6ccd0-e4e9-4ea4-ba54-291185f2cf44 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:08:33 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-64f6ccd0-e4e9-4ea4-ba54-291185f2cf44 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:08:33 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-64f6ccd0-e4e9-4ea4-ba54-291185f2cf44 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8', 0)] {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 14:08:33 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:08:33 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:08:33 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3035a71-f376-4989-8441-1a4c2b527541]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:08:33 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:08:33 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:08:33 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7feecc-a78a-4a04-9fc6-15f49fec4d93]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:08:33 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-64f6ccd0-e4e9-4ea4-ba54-291185f2cf44 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:08:33 user nova-compute[72129]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)
Aug 01 14:08:33 user nova-compute[72129]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 (non-flash)
Aug 01 14:08:33 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:08:33 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-64f6ccd0-e4e9-4ea4-ba54-291185f2cf44 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:08:33 user nova-compute[72129]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 (non-flash)
Aug 01 14:08:33 user nova-compute[72129]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 (non-flash)
Aug 01 14:08:33 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:08:33 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-64f6ccd0-e4e9-4ea4-ba54-291185f2cf44 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f28203cfa30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8'): ({'sdf'}, set())}) {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 14:08:33 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-64f6ccd0-e4e9-4ea4-ba54-291185f2cf44 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Removing single pathed devices sdf {{(pid=72129) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 14:08:33 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:08:33 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:08:33 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb88828b-a2e9-496a-bcab-5b00a1544f9d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:08:33 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:08:33 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:08:33 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3bf6a6d-e3bd-41a5-9252-783aad0c5963]: (4, ('ok\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:08:33 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-64f6ccd0-e4e9-4ea4-ba54-291185f2cf44 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Flushing IO for device /dev/sdf {{(pid=72129) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 14:08:33 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:08:33 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:08:33 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a283b61e-01d8-422a-b401-7ea0a56258dc]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:08:33 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-64f6ccd0-e4e9-4ea4-ba54-291185f2cf44 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72129) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 14:08:33 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:08:33 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.066s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:08:33 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b7e35d-5ce4-40cd-b8c2-1ed32abc8af8]: (4, ('1', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:08:33 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-64f6ccd0-e4e9-4ea4-ba54-291185f2cf44 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 14:08:33 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-64f6ccd0-e4e9-4ea4-ba54-291185f2cf44 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] SCSI volumes sdf have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 14:08:33 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-64f6ccd0-e4e9-4ea4-ba54-291185f2cf44 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8')] {{(pid=72129) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 14:08:33 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:08:33 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:08:33 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc600733-8d92-43f8-bb63-828b53488014]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:08:33 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-64f6ccd0-e4e9-4ea4-ba54-291185f2cf44 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:08:33 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 -p 172.16.0.220:3260 --logout {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:08:33 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:08:33 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ce6c39-31f6-4b4e-a928-c2c80c2c7fe8]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:08:33 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-64f6ccd0-e4e9-4ea4-ba54-291185f2cf44 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8, portal: 172.16.0.220,3260]
Aug 01 14:08:33 user nova-compute[72129]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8, portal: 172.16.0.220,3260] successful.
Aug 01 14:08:33 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:08:33 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 -p 172.16.0.220:3260 --op delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:08:33 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58507a4b-e017-48d8-aeb1-8036a2a2a0a8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:08:33 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d311d0c7-c615-408d-a630-190ddffb4338]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:08:33 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-64f6ccd0-e4e9-4ea4-ba54-291185f2cf44 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:08:33 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-64f6ccd0-e4e9-4ea4-ba54-291185f2cf44 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:08:33 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-64f6ccd0-e4e9-4ea4-ba54-291185f2cf44 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] <== disconnect_volume: return (321ms) None {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:08:33 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64f6ccd0-e4e9-4ea4-ba54-291185f2cf44 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Disconnected iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 14:08:33 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-64f6ccd0-e4e9-4ea4-ba54-291185f2cf44 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Deleting instance files /opt/stack/data/nova/instances/e4a13a50-fe03-41aa-94f4-3431805ff481_del
Aug 01 14:08:33 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-64f6ccd0-e4e9-4ea4-ba54-291185f2cf44 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Deletion of /opt/stack/data/nova/instances/e4a13a50-fe03-41aa-94f4-3431805ff481_del complete
Aug 01 14:08:33 user nova-compute[72129]: INFO nova.compute.manager [None req-64f6ccd0-e4e9-4ea4-ba54-291185f2cf44 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Took 1.32 seconds to destroy the instance on the hypervisor.
Aug 01 14:08:33 user nova-compute[72129]: DEBUG oslo.service.loopingcall [None req-64f6ccd0-e4e9-4ea4-ba54-291185f2cf44 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72129) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 14:08:33 user nova-compute[72129]: DEBUG nova.compute.manager [-] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Deallocating network for instance {{(pid=72129) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 14:08:33 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] deallocate_for_instance() {{(pid=72129) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 14:08:34 user nova-compute[72129]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690898899.3425875, 05e80bdd-ad15-4b98-b8ac-a40656f5f717 => Stopped> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:08:34 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] VM Stopped (Lifecycle Event)
Aug 01 14:08:34 user nova-compute[72129]: DEBUG nova.compute.manager [None req-a086b4eb-2fdb-48b3-99bf-5d1066fb99b1 None None] [instance: 05e80bdd-ad15-4b98-b8ac-a40656f5f717] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:08:34 user nova-compute[72129]: DEBUG nova.compute.manager [req-134eb1f6-12ae-42f3-9342-8af1ebebf287 req-5d7546ff-3ba5-4f05-a077-972e6975c81d service nova] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Received event network-vif-plugged-a36283e1-929d-4806-ba5f-175f99f44e98 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:08:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-134eb1f6-12ae-42f3-9342-8af1ebebf287 req-5d7546ff-3ba5-4f05-a077-972e6975c81d service nova] Acquiring lock "e4a13a50-fe03-41aa-94f4-3431805ff481-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:08:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-134eb1f6-12ae-42f3-9342-8af1ebebf287 req-5d7546ff-3ba5-4f05-a077-972e6975c81d service nova] Lock "e4a13a50-fe03-41aa-94f4-3431805ff481-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:08:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-134eb1f6-12ae-42f3-9342-8af1ebebf287 req-5d7546ff-3ba5-4f05-a077-972e6975c81d service nova] Lock "e4a13a50-fe03-41aa-94f4-3431805ff481-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:08:34 user nova-compute[72129]: DEBUG nova.compute.manager [req-134eb1f6-12ae-42f3-9342-8af1ebebf287 req-5d7546ff-3ba5-4f05-a077-972e6975c81d service nova] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] No waiting events found dispatching network-vif-plugged-a36283e1-929d-4806-ba5f-175f99f44e98 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:08:34 user nova-compute[72129]: WARNING nova.compute.manager [req-134eb1f6-12ae-42f3-9342-8af1ebebf287 req-5d7546ff-3ba5-4f05-a077-972e6975c81d service nova] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Received unexpected event network-vif-plugged-a36283e1-929d-4806-ba5f-175f99f44e98 for instance with vm_state active and task_state deleting.
Aug 01 14:08:34 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:08:34 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Took 1.12 seconds to deallocate network for instance.
Aug 01 14:08:34 user nova-compute[72129]: DEBUG nova.compute.manager [req-71350a57-b900-4d23-a32e-2e5ee9207997 req-9a1acb02-9e1b-4b74-a822-06ebb0d7e0c2 service nova] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Received event network-vif-deleted-a36283e1-929d-4806-ba5f-175f99f44e98 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:08:34 user nova-compute[72129]: INFO nova.compute.manager [req-71350a57-b900-4d23-a32e-2e5ee9207997 req-9a1acb02-9e1b-4b74-a822-06ebb0d7e0c2 service nova] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Neutron deleted interface a36283e1-929d-4806-ba5f-175f99f44e98; detaching it from the instance and deleting it from the info cache
Aug 01 14:08:34 user nova-compute[72129]: DEBUG nova.network.neutron [req-71350a57-b900-4d23-a32e-2e5ee9207997 req-9a1acb02-9e1b-4b74-a822-06ebb0d7e0c2 service nova] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:08:34 user nova-compute[72129]: DEBUG nova.compute.manager [req-71350a57-b900-4d23-a32e-2e5ee9207997 req-9a1acb02-9e1b-4b74-a822-06ebb0d7e0c2 service nova] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Detach interface failed, port_id=a36283e1-929d-4806-ba5f-175f99f44e98, reason: Instance e4a13a50-fe03-41aa-94f4-3431805ff481 could not be found. {{(pid=72129) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 14:08:35 user nova-compute[72129]: INFO nova.compute.manager [None req-64f6ccd0-e4e9-4ea4-ba54-291185f2cf44 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Took 0.78 seconds to detach 1 volumes for instance.
Aug 01 14:08:35 user nova-compute[72129]: DEBUG nova.compute.manager [None req-64f6ccd0-e4e9-4ea4-ba54-291185f2cf44 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Deleting volume: 58507a4b-e017-48d8-aeb1-8036a2a2a0a8 {{(pid=72129) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 01 14:08:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-64f6ccd0-e4e9-4ea4-ba54-291185f2cf44 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:08:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-64f6ccd0-e4e9-4ea4-ba54-291185f2cf44 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:08:36 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-64f6ccd0-e4e9-4ea4-ba54-291185f2cf44 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:08:36 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-64f6ccd0-e4e9-4ea4-ba54-291185f2cf44 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:08:36 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-64f6ccd0-e4e9-4ea4-ba54-291185f2cf44 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.336s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:08:36 user nova-compute[72129]: INFO nova.scheduler.client.report [None req-64f6ccd0-e4e9-4ea4-ba54-291185f2cf44 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Deleted allocations for instance e4a13a50-fe03-41aa-94f4-3431805ff481
Aug 01 14:08:36 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-64f6ccd0-e4e9-4ea4-ba54-291185f2cf44 tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "e4a13a50-fe03-41aa-94f4-3431805ff481" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.065s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:08:38 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:08:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:08:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:08:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72129) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 14:08:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:08:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:08:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:08:48 user nova-compute[72129]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690898913.1441543, e4a13a50-fe03-41aa-94f4-3431805ff481 => Stopped> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:08:48 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] VM Stopped (Lifecycle Event)
Aug 01 14:08:48 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9927da9a-45d8-4572-bae9-d6a6e49f6378 None None] [instance: e4a13a50-fe03-41aa-94f4-3431805ff481] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:08:48 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:08:50 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:08:50 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72129) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 14:08:51 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:08:51 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Starting heal instance info cache {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 14:08:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "refresh_cache-0c43fda3-e098-4c3a-bcd5-14eac019db06" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:08:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquired lock "refresh_cache-0c43fda3-e098-4c3a-bcd5-14eac019db06" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:08:51 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Forcefully refreshing network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 14:08:51 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Updating instance_info_cache with network_info: [{"id": "42cfd021-0c3b-4c75-8758-1cf73c652fa4", "address": "fa:16:3e:d5:f1:da", "network": {"id": "59b1e538-8bfe-45ce-ab7b-c5838ab25582", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1129024349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0929886fa54d1c8023793806f10d31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42cfd021-0c", "ovs_interfaceid": "42cfd021-0c3b-4c75-8758-1cf73c652fa4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:08:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Releasing lock "refresh_cache-0c43fda3-e098-4c3a-bcd5-14eac019db06" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:08:51 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Updated the network info_cache for instance {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 14:08:52 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:08:53 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:08:53 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:08:53 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:08:53 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:08:54 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:08:54 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:08:57 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:08:57 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:08:57 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:08:57 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:08:57 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Auditing locally available compute resources for user (node: user) {{(pid=72129) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 14:08:57 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 14:08:57 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:08:57 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:08:57 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:08:57 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:08:57 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3a73214-dad3-44d1-adc3-312970a919e5/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:08:57 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3a73214-dad3-44d1-adc3-312970a919e5/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:08:57 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3a73214-dad3-44d1-adc3-312970a919e5/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:08:57 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3a73214-dad3-44d1-adc3-312970a919e5/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:08:57 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c43fda3-e098-4c3a-bcd5-14eac019db06/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:08:57 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c43fda3-e098-4c3a-bcd5-14eac019db06/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:08:57 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c43fda3-e098-4c3a-bcd5-14eac019db06/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:08:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c43fda3-e098-4c3a-bcd5-14eac019db06/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:08:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:08:58 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:08:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:08:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:08:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:08:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e06fb45-d156-451b-9e4d-e3d2fed52c37/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:08:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e06fb45-d156-451b-9e4d-e3d2fed52c37/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:08:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e06fb45-d156-451b-9e4d-e3d2fed52c37/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:08:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e06fb45-d156-451b-9e4d-e3d2fed52c37/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:08:58 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 14:08:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/418f4c53-9dc5-402f-ad21-ac481674b083/disk.rescue --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:08:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/418f4c53-9dc5-402f-ad21-ac481674b083/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:08:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/418f4c53-9dc5-402f-ad21-ac481674b083/disk.rescue --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:08:59 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/418f4c53-9dc5-402f-ad21-ac481674b083/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:08:59 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:08:59 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:08:59 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Hypervisor/Node resource view: name=user free_ram=7984MB free_disk=25.03780746459961GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72129) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 14:08:59 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:08:59 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:08:59 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 97a5dccf-b499-443a-b332-cfa293a16047 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:08:59 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:08:59 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance d031973f-8f48-43b3-a338-040950103e4c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:08:59 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 0c43fda3-e098-4c3a-bcd5-14eac019db06 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:08:59 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 418f4c53-9dc5-402f-ad21-ac481674b083 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:08:59 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 1e06fb45-d156-451b-9e4d-e3d2fed52c37 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:08:59 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance e3a73214-dad3-44d1-adc3-312970a919e5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:08:59 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 14:08:59 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 14:08:59 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:08:59 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:09:00 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Compute_service record updated for user:user {{(pid=72129) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 14:09:00 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.524s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:09:03 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:09:06 user nova-compute[72129]: DEBUG nova.compute.manager [req-0921480c-3cb5-4c93-bd91-cbf3e8b4ddf8 req-37ae6967-1347-4e43-86aa-460e5766a282 service nova] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Received event network-changed-3811b72e-705a-4336-ac66-a0fed51437e4 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:09:06 user nova-compute[72129]: DEBUG nova.compute.manager [req-0921480c-3cb5-4c93-bd91-cbf3e8b4ddf8 req-37ae6967-1347-4e43-86aa-460e5766a282 service nova] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Refreshing instance network info cache due to event network-changed-3811b72e-705a-4336-ac66-a0fed51437e4. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 14:09:06 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-0921480c-3cb5-4c93-bd91-cbf3e8b4ddf8 req-37ae6967-1347-4e43-86aa-460e5766a282 service nova] Acquiring lock "refresh_cache-1e06fb45-d156-451b-9e4d-e3d2fed52c37" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:09:06 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-0921480c-3cb5-4c93-bd91-cbf3e8b4ddf8 req-37ae6967-1347-4e43-86aa-460e5766a282 service nova] Acquired lock "refresh_cache-1e06fb45-d156-451b-9e4d-e3d2fed52c37" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:09:06 user nova-compute[72129]: DEBUG nova.network.neutron [req-0921480c-3cb5-4c93-bd91-cbf3e8b4ddf8 req-37ae6967-1347-4e43-86aa-460e5766a282 service nova] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Refreshing network info cache for port 3811b72e-705a-4336-ac66-a0fed51437e4 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 14:09:07 user nova-compute[72129]: DEBUG nova.network.neutron [req-0921480c-3cb5-4c93-bd91-cbf3e8b4ddf8 req-37ae6967-1347-4e43-86aa-460e5766a282 service nova] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Updated VIF entry in instance network info cache for port 3811b72e-705a-4336-ac66-a0fed51437e4. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 14:09:07 user nova-compute[72129]: DEBUG nova.network.neutron [req-0921480c-3cb5-4c93-bd91-cbf3e8b4ddf8 req-37ae6967-1347-4e43-86aa-460e5766a282 service nova] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Updating instance_info_cache with network_info: [{"id": "3811b72e-705a-4336-ac66-a0fed51437e4", "address": "fa:16:3e:a3:60:b1", "network": {"id": "ce10dac7-17d0-425a-bfee-70b8220d7871", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1288141476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b724093fa43c4afb9130efa2cfc713d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3811b72e-70", "ovs_interfaceid": "3811b72e-705a-4336-ac66-a0fed51437e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:09:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-0921480c-3cb5-4c93-bd91-cbf3e8b4ddf8 req-37ae6967-1347-4e43-86aa-460e5766a282 service nova] Releasing lock "refresh_cache-1e06fb45-d156-451b-9e4d-e3d2fed52c37" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:09:08 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:09:10 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Acquiring lock "71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:09:10 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:09:10 user nova-compute[72129]: DEBUG nova.compute.manager [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Starting instance... {{(pid=72129) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 14:09:10 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:09:10 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:09:10 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72129) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 14:09:10 user nova-compute[72129]: INFO nova.compute.claims [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Claim successful on node user
Aug 01 14:09:10 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:09:10 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:09:10 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.450s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:09:10 user nova-compute[72129]: DEBUG nova.compute.manager [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Start building networks asynchronously for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 14:09:10 user nova-compute[72129]: DEBUG nova.compute.manager [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Allocating IP information in the background. {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 14:09:10 user nova-compute[72129]: DEBUG nova.network.neutron [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] allocate_for_instance() {{(pid=72129) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 14:09:10 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 14:09:10 user nova-compute[72129]: DEBUG nova.compute.manager [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Start building block device mappings for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 14:09:11 user nova-compute[72129]: INFO nova.virt.block_device [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Booting with volume becf1ccd-4c86-418e-a9eb-be3cb1fff883 at /dev/vda
Aug 01 14:09:11 user nova-compute[72129]: DEBUG nova.policy [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7c341be2816c43cfa9adb58ee84e942b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '210837255c8148ec9b482ba3e2551362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72129) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 14:09:11 user nova-compute[72129]: DEBUG os_brick.utils [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:09:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:09:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:09:11 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44899ba-d187-49c3-895d-56ebbde3e323]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f9b449c2cd3d\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:09:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:09:11 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:09:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:09:11 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[306f49f4-3e6a-449e-b0d8-04200e52f7bc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:09:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:09:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:09:11 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[f64dd751-4834-44dc-b8d1-6a24ec18ffa7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:09:11 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a175a3e9-8dc5-4aa5-88d8-c51e3c25da87]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:09:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Running cmd (subprocess): nvme version {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:09:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] 'nvme version' failed. Not Retrying. {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 14:09:11 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] nvme not present on system {{(pid=72129) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 14:09:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:09:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 14:09:11 user nova-compute[72129]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 14:09:11 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a1db9a-1c74-4c0f-8c82-6a3c81603c5a]: (4, '') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:09:11 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72129) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 14:09:11 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 14:09:11 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] LIGHTOS: no hostnqn found. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 14:09:11 user nova-compute[72129]: DEBUG os_brick.utils [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] <== get_connector_properties: return (164ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f9b449c2cd3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:09:11 user nova-compute[72129]: DEBUG nova.virt.block_device [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Updating existing volume attachment record: ec63e749-ead0-4365-80f4-bb985d8ceae6 {{(pid=72129) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 14:09:11 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-03cf878d-27b7-4136-b03c-6b42428cabb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Acquiring lock "1e06fb45-d156-451b-9e4d-e3d2fed52c37" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:09:11 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-03cf878d-27b7-4136-b03c-6b42428cabb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lock "1e06fb45-d156-451b-9e4d-e3d2fed52c37" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:09:11 user nova-compute[72129]: INFO nova.compute.manager [None req-03cf878d-27b7-4136-b03c-6b42428cabb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Shelving
Aug 01 14:09:11 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:09:11 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:09:11 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:09:11 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:09:11 user nova-compute[72129]: DEBUG nova.network.neutron [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Successfully created port: a5aad1a2-0499-4725-9837-ee171ff0b048 {{(pid=72129) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 14:09:11 user nova-compute[72129]: DEBUG nova.compute.manager [req-77a8f8c2-c3cb-4de8-b590-af6f367dddb8 req-7e448696-1b58-46b6-ab3a-8c1faca9b73b service nova] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Received event network-vif-unplugged-3811b72e-705a-4336-ac66-a0fed51437e4 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:09:11 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-77a8f8c2-c3cb-4de8-b590-af6f367dddb8 req-7e448696-1b58-46b6-ab3a-8c1faca9b73b service nova] Acquiring lock "1e06fb45-d156-451b-9e4d-e3d2fed52c37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:09:11 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-77a8f8c2-c3cb-4de8-b590-af6f367dddb8 req-7e448696-1b58-46b6-ab3a-8c1faca9b73b service nova] Lock "1e06fb45-d156-451b-9e4d-e3d2fed52c37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:09:11 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-77a8f8c2-c3cb-4de8-b590-af6f367dddb8 req-7e448696-1b58-46b6-ab3a-8c1faca9b73b service nova] Lock "1e06fb45-d156-451b-9e4d-e3d2fed52c37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:09:11 user nova-compute[72129]: DEBUG nova.compute.manager [req-77a8f8c2-c3cb-4de8-b590-af6f367dddb8 req-7e448696-1b58-46b6-ab3a-8c1faca9b73b service nova] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] No waiting events found dispatching network-vif-unplugged-3811b72e-705a-4336-ac66-a0fed51437e4 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:09:11 user nova-compute[72129]: WARNING nova.compute.manager [req-77a8f8c2-c3cb-4de8-b590-af6f367dddb8 req-7e448696-1b58-46b6-ab3a-8c1faca9b73b service nova] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Received unexpected event network-vif-unplugged-3811b72e-705a-4336-ac66-a0fed51437e4 for instance with vm_state active and task_state shelving.
Aug 01 14:09:12 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:09:12 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:09:12 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Instance destroyed successfully.
Aug 01 14:09:12 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-03cf878d-27b7-4136-b03c-6b42428cabb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Beginning cold snapshot process
Aug 01 14:09:12 user nova-compute[72129]: DEBUG nova.privsep.utils [None req-03cf878d-27b7-4136-b03c-6b42428cabb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72129) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 14:09:12 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-03cf878d-27b7-4136-b03c-6b42428cabb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/1e06fb45-d156-451b-9e4d-e3d2fed52c37/disk /opt/stack/data/nova/instances/snapshots/tmpy6x_mg1h/9d793d562e3f47f2a60af6419fd9bf76 {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:09:12 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-03cf878d-27b7-4136-b03c-6b42428cabb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/1e06fb45-d156-451b-9e4d-e3d2fed52c37/disk /opt/stack/data/nova/instances/snapshots/tmpy6x_mg1h/9d793d562e3f47f2a60af6419fd9bf76" returned: 0 in 0.333s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:09:12 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-03cf878d-27b7-4136-b03c-6b42428cabb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Snapshot extracted, beginning image upload
Aug 01 14:09:12 user nova-compute[72129]: DEBUG nova.network.neutron [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Successfully updated port: a5aad1a2-0499-4725-9837-ee171ff0b048 {{(pid=72129) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 14:09:12 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Acquiring lock "refresh_cache-71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:09:12 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Acquired lock "refresh_cache-71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:09:12 user nova-compute[72129]: DEBUG nova.network.neutron [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 14:09:12 user nova-compute[72129]: DEBUG nova.network.neutron [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Instance cache missing network info. {{(pid=72129) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 14:09:13 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:09:13 user nova-compute[72129]: DEBUG nova.network.neutron [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Updating instance_info_cache with network_info: [{"id": "a5aad1a2-0499-4725-9837-ee171ff0b048", "address": "fa:16:3e:0d:87:39", "network": {"id": "a7f4226b-73fe-4265-ba2c-5d7dcdf154fd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1142462884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210837255c8148ec9b482ba3e2551362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5aad1a2-04", "ovs_interfaceid": "a5aad1a2-0499-4725-9837-ee171ff0b048", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:09:13 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Releasing lock "refresh_cache-71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:09:13 user nova-compute[72129]: DEBUG nova.compute.manager [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Instance network_info: |[{"id": "a5aad1a2-0499-4725-9837-ee171ff0b048", "address": "fa:16:3e:0d:87:39", "network": {"id": "a7f4226b-73fe-4265-ba2c-5d7dcdf154fd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1142462884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210837255c8148ec9b482ba3e2551362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5aad1a2-04", "ovs_interfaceid": "a5aad1a2-0499-4725-9837-ee171ff0b048", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 14:09:14 user nova-compute[72129]: DEBUG nova.compute.manager [req-29f71fe9-8cc8-492a-b02d-ef3640d16ad8 req-84773e51-8aaf-4504-b4fe-41d9d91d33ef service nova] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Received event network-vif-plugged-3811b72e-705a-4336-ac66-a0fed51437e4 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:09:14 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-29f71fe9-8cc8-492a-b02d-ef3640d16ad8 req-84773e51-8aaf-4504-b4fe-41d9d91d33ef service nova] Acquiring lock "1e06fb45-d156-451b-9e4d-e3d2fed52c37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:09:14 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-29f71fe9-8cc8-492a-b02d-ef3640d16ad8 req-84773e51-8aaf-4504-b4fe-41d9d91d33ef service nova] Lock "1e06fb45-d156-451b-9e4d-e3d2fed52c37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:09:14 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-29f71fe9-8cc8-492a-b02d-ef3640d16ad8 req-84773e51-8aaf-4504-b4fe-41d9d91d33ef service nova] Lock "1e06fb45-d156-451b-9e4d-e3d2fed52c37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:09:14 user nova-compute[72129]: DEBUG nova.compute.manager [req-29f71fe9-8cc8-492a-b02d-ef3640d16ad8 req-84773e51-8aaf-4504-b4fe-41d9d91d33ef service nova] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] No waiting events found dispatching network-vif-plugged-3811b72e-705a-4336-ac66-a0fed51437e4 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:09:14 user nova-compute[72129]: WARNING nova.compute.manager [req-29f71fe9-8cc8-492a-b02d-ef3640d16ad8 req-84773e51-8aaf-4504-b4fe-41d9d91d33ef service nova] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Received unexpected event network-vif-plugged-3811b72e-705a-4336-ac66-a0fed51437e4 for instance with vm_state active and task_state shelving_image_uploading.
Aug 01 14:09:14 user nova-compute[72129]: DEBUG nova.compute.manager [req-29f71fe9-8cc8-492a-b02d-ef3640d16ad8 req-84773e51-8aaf-4504-b4fe-41d9d91d33ef service nova] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Received event network-changed-a5aad1a2-0499-4725-9837-ee171ff0b048 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:09:14 user nova-compute[72129]: DEBUG nova.compute.manager [req-29f71fe9-8cc8-492a-b02d-ef3640d16ad8 req-84773e51-8aaf-4504-b4fe-41d9d91d33ef service nova] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Refreshing instance network info cache due to event network-changed-a5aad1a2-0499-4725-9837-ee171ff0b048. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 14:09:14 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-29f71fe9-8cc8-492a-b02d-ef3640d16ad8 req-84773e51-8aaf-4504-b4fe-41d9d91d33ef service nova] Acquiring lock "refresh_cache-71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:09:14 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-29f71fe9-8cc8-492a-b02d-ef3640d16ad8 req-84773e51-8aaf-4504-b4fe-41d9d91d33ef service nova] Acquired lock "refresh_cache-71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:09:14 user nova-compute[72129]: DEBUG nova.network.neutron [req-29f71fe9-8cc8-492a-b02d-ef3640d16ad8 req-84773e51-8aaf-4504-b4fe-41d9d91d33ef service nova] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Refreshing network info cache for port a5aad1a2-0499-4725-9837-ee171ff0b048 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 14:09:14 user nova-compute[72129]: DEBUG nova.network.neutron [req-29f71fe9-8cc8-492a-b02d-ef3640d16ad8 req-84773e51-8aaf-4504-b4fe-41d9d91d33ef service nova] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Updated VIF entry in instance network info cache for port a5aad1a2-0499-4725-9837-ee171ff0b048. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 14:09:14 user nova-compute[72129]: DEBUG nova.network.neutron [req-29f71fe9-8cc8-492a-b02d-ef3640d16ad8 req-84773e51-8aaf-4504-b4fe-41d9d91d33ef service nova] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Updating instance_info_cache with network_info: [{"id": "a5aad1a2-0499-4725-9837-ee171ff0b048", "address": "fa:16:3e:0d:87:39", "network": {"id": "a7f4226b-73fe-4265-ba2c-5d7dcdf154fd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1142462884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210837255c8148ec9b482ba3e2551362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5aad1a2-04", "ovs_interfaceid": "a5aad1a2-0499-4725-9837-ee171ff0b048", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:09:14 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-29f71fe9-8cc8-492a-b02d-ef3640d16ad8 req-84773e51-8aaf-4504-b4fe-41d9d91d33ef service nova] Releasing lock "refresh_cache-71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:09:15 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-03cf878d-27b7-4136-b03c-6b42428cabb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Snapshot image upload complete
Aug 01 14:09:15 user nova-compute[72129]: DEBUG nova.compute.manager [None req-03cf878d-27b7-4136-b03c-6b42428cabb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:09:15 user nova-compute[72129]: INFO nova.compute.manager [None req-03cf878d-27b7-4136-b03c-6b42428cabb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Shelve offloading
Aug 01 14:09:15 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Instance destroyed successfully.
Aug 01 14:09:15 user nova-compute[72129]: DEBUG nova.compute.manager [None req-03cf878d-27b7-4136-b03c-6b42428cabb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:09:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-03cf878d-27b7-4136-b03c-6b42428cabb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Acquiring lock "refresh_cache-1e06fb45-d156-451b-9e4d-e3d2fed52c37" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:09:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-03cf878d-27b7-4136-b03c-6b42428cabb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Acquired lock "refresh_cache-1e06fb45-d156-451b-9e4d-e3d2fed52c37" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:09:15 user nova-compute[72129]: DEBUG nova.network.neutron [None req-03cf878d-27b7-4136-b03c-6b42428cabb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 14:09:15 user nova-compute[72129]: INFO nova.compute.manager [None req-97a0ec58-5e97-4f61-8f4e-8bfa4da51796 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Unrescuing
Aug 01 14:09:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-97a0ec58-5e97-4f61-8f4e-8bfa4da51796 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Acquiring lock "refresh_cache-418f4c53-9dc5-402f-ad21-ac481674b083" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:09:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-97a0ec58-5e97-4f61-8f4e-8bfa4da51796 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Acquired lock "refresh_cache-418f4c53-9dc5-402f-ad21-ac481674b083" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:09:15 user nova-compute[72129]: DEBUG nova.network.neutron [None req-97a0ec58-5e97-4f61-8f4e-8bfa4da51796 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 14:09:15 user nova-compute[72129]: DEBUG nova.network.neutron [None req-03cf878d-27b7-4136-b03c-6b42428cabb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Updating instance_info_cache with network_info: [{"id": "3811b72e-705a-4336-ac66-a0fed51437e4", "address": "fa:16:3e:a3:60:b1", "network": {"id": "ce10dac7-17d0-425a-bfee-70b8220d7871", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1288141476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b724093fa43c4afb9130efa2cfc713d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3811b72e-70", "ovs_interfaceid": "3811b72e-705a-4336-ac66-a0fed51437e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:09:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-03cf878d-27b7-4136-b03c-6b42428cabb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Releasing lock "refresh_cache-1e06fb45-d156-451b-9e4d-e3d2fed52c37" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:09:15 user nova-compute[72129]: DEBUG nova.network.neutron [None req-97a0ec58-5e97-4f61-8f4e-8bfa4da51796 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Updating instance_info_cache with network_info: [{"id": "df042689-7692-445c-89d8-cc6d908dd216", "address": "fa:16:3e:33:ea:dd", "network": {"id": "59b1e538-8bfe-45ce-ab7b-c5838ab25582", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1129024349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0929886fa54d1c8023793806f10d31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf042689-76", "ovs_interfaceid": "df042689-7692-445c-89d8-cc6d908dd216", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:09:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-97a0ec58-5e97-4f61-8f4e-8bfa4da51796 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Releasing lock "refresh_cache-418f4c53-9dc5-402f-ad21-ac481674b083" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:09:16 user nova-compute[72129]: DEBUG nova.objects.instance [None req-97a0ec58-5e97-4f61-8f4e-8bfa4da51796 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lazy-loading 'flavor' on Instance uuid 418f4c53-9dc5-402f-ad21-ac481674b083 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:09:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:09:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:09:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:09:16 user nova-compute[72129]: DEBUG nova.compute.manager [req-f4402f7e-6ac2-4d92-9090-1866f6264149 req-70150a20-dcf0-4a0d-9eec-674c2b59770d service nova] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Received event network-vif-unplugged-df042689-7692-445c-89d8-cc6d908dd216 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:09:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f4402f7e-6ac2-4d92-9090-1866f6264149 req-70150a20-dcf0-4a0d-9eec-674c2b59770d service nova] Acquiring lock "418f4c53-9dc5-402f-ad21-ac481674b083-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:09:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f4402f7e-6ac2-4d92-9090-1866f6264149 req-70150a20-dcf0-4a0d-9eec-674c2b59770d service nova] Lock "418f4c53-9dc5-402f-ad21-ac481674b083-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:09:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f4402f7e-6ac2-4d92-9090-1866f6264149 req-70150a20-dcf0-4a0d-9eec-674c2b59770d service nova] Lock "418f4c53-9dc5-402f-ad21-ac481674b083-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:09:16 user nova-compute[72129]: DEBUG nova.compute.manager [req-f4402f7e-6ac2-4d92-9090-1866f6264149 req-70150a20-dcf0-4a0d-9eec-674c2b59770d service nova] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] No waiting events found dispatching network-vif-unplugged-df042689-7692-445c-89d8-cc6d908dd216 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:09:16 user nova-compute[72129]: WARNING nova.compute.manager [req-f4402f7e-6ac2-4d92-9090-1866f6264149 req-70150a20-dcf0-4a0d-9eec-674c2b59770d service nova] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Received unexpected event network-vif-unplugged-df042689-7692-445c-89d8-cc6d908dd216 for instance with vm_state rescued and task_state unrescuing.
Aug 01 14:09:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:09:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:09:16 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Instance destroyed successfully.
Aug 01 14:09:16 user nova-compute[72129]: DEBUG nova.objects.instance [None req-03cf878d-27b7-4136-b03c-6b42428cabb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lazy-loading 'resources' on Instance uuid 1e06fb45-d156-451b-9e4d-e3d2fed52c37 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:09:16 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-03cf878d-27b7-4136-b03c-6b42428cabb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:07:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1528036097',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1528036097',id=33,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIgNnezmd3WUtvMc91uqfFchcd5GoNgjDKdQnSLwhRBanZwsPizFNVNm3dzrcvRZ7hFRKmkWdxbqwDlwVGnI8tIUko9u2VFfHh/iPWhzSPvxCFMeliixeCIv/26AwtF9aQ==',key_name='tempest-keypair-12459561',keypairs=<?>,launch_index=0,launched_at=2023-08-01T14:07:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b724093fa43c4afb9130efa2cfc713d9',ramdisk_id='',reservation_id='r-29k01a26',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1864942034',owner_user_name='tempest-AttachVolumeShelveTestJSON-1864942034-project-member',shelved_at='2023-08-01T14:09:15.134491',shelved_host='user',shelved_image_id='bcf2b967-a2ef-4852-b6b4-156c8364bc4f'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T14:09:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e5630ede467c4c99915b1b2f455ca0fb',uuid=1e06fb45-d156-451b-9e4d-e3d2fed52c37,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "3811b72e-705a-4336-ac66-a0fed51437e4", "address": "fa:16:3e:a3:60:b1", "network": {"id": "ce10dac7-17d0-425a-bfee-70b8220d7871", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1288141476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b724093fa43c4afb9130efa2cfc713d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3811b72e-70", "ovs_interfaceid": "3811b72e-705a-4336-ac66-a0fed51437e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 14:09:16 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-03cf878d-27b7-4136-b03c-6b42428cabb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Converting VIF {"id": "3811b72e-705a-4336-ac66-a0fed51437e4", "address": "fa:16:3e:a3:60:b1", "network": {"id": "ce10dac7-17d0-425a-bfee-70b8220d7871", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1288141476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b724093fa43c4afb9130efa2cfc713d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3811b72e-70", "ovs_interfaceid": "3811b72e-705a-4336-ac66-a0fed51437e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:09:16 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-03cf878d-27b7-4136-b03c-6b42428cabb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:60:b1,bridge_name='br-int',has_traffic_filtering=True,id=3811b72e-705a-4336-ac66-a0fed51437e4,network=Network(ce10dac7-17d0-425a-bfee-70b8220d7871),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3811b72e-70') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:09:16 user nova-compute[72129]: DEBUG os_vif [None req-03cf878d-27b7-4136-b03c-6b42428cabb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:60:b1,bridge_name='br-int',has_traffic_filtering=True,id=3811b72e-705a-4336-ac66-a0fed51437e4,network=Network(ce10dac7-17d0-425a-bfee-70b8220d7871),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3811b72e-70') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 14:09:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:09:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3811b72e-70, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:09:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:09:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:09:16 user nova-compute[72129]: DEBUG nova.compute.manager [req-b9687136-7e8e-4c86-a024-ce5efdd93457 req-a0871542-75f8-4213-b864-6706f508b4d9 service nova] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Received event network-changed-3811b72e-705a-4336-ac66-a0fed51437e4 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:09:16 user nova-compute[72129]: DEBUG nova.compute.manager [req-b9687136-7e8e-4c86-a024-ce5efdd93457 req-a0871542-75f8-4213-b864-6706f508b4d9 service nova] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Refreshing instance network info cache due to event network-changed-3811b72e-705a-4336-ac66-a0fed51437e4. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 14:09:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-b9687136-7e8e-4c86-a024-ce5efdd93457 req-a0871542-75f8-4213-b864-6706f508b4d9 service nova] Acquiring lock "refresh_cache-1e06fb45-d156-451b-9e4d-e3d2fed52c37" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:09:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-b9687136-7e8e-4c86-a024-ce5efdd93457 req-a0871542-75f8-4213-b864-6706f508b4d9 service nova] Acquired lock "refresh_cache-1e06fb45-d156-451b-9e4d-e3d2fed52c37" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:09:16 user nova-compute[72129]: DEBUG nova.network.neutron [req-b9687136-7e8e-4c86-a024-ce5efdd93457 req-a0871542-75f8-4213-b864-6706f508b4d9 service nova] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Refreshing network info cache for port 3811b72e-705a-4336-ac66-a0fed51437e4 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 14:09:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:09:16 user nova-compute[72129]: INFO os_vif [None req-03cf878d-27b7-4136-b03c-6b42428cabb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:60:b1,bridge_name='br-int',has_traffic_filtering=True,id=3811b72e-705a-4336-ac66-a0fed51437e4,network=Network(ce10dac7-17d0-425a-bfee-70b8220d7871),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3811b72e-70')
Aug 01 14:09:16 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-03cf878d-27b7-4136-b03c-6b42428cabb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Deleting instance files /opt/stack/data/nova/instances/1e06fb45-d156-451b-9e4d-e3d2fed52c37_del
Aug 01 14:09:16 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-03cf878d-27b7-4136-b03c-6b42428cabb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Deletion of /opt/stack/data/nova/instances/1e06fb45-d156-451b-9e4d-e3d2fed52c37_del complete
Aug 01 14:09:16 user nova-compute[72129]: INFO nova.scheduler.client.report [None req-03cf878d-27b7-4136-b03c-6b42428cabb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Deleted allocations for instance 1e06fb45-d156-451b-9e4d-e3d2fed52c37
Aug 01 14:09:16 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Instance destroyed successfully.
Aug 01 14:09:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-03cf878d-27b7-4136-b03c-6b42428cabb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:09:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-03cf878d-27b7-4136-b03c-6b42428cabb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:09:16 user nova-compute[72129]: DEBUG nova.objects.instance [None req-03cf878d-27b7-4136-b03c-6b42428cabb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lazy-loading 'numa_topology' on Instance uuid 1e06fb45-d156-451b-9e4d-e3d2fed52c37 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:09:17 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-03cf878d-27b7-4136-b03c-6b42428cabb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:09:17 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-03cf878d-27b7-4136-b03c-6b42428cabb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:09:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-03cf878d-27b7-4136-b03c-6b42428cabb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.339s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:09:17 user nova-compute[72129]: DEBUG nova.network.neutron [req-b9687136-7e8e-4c86-a024-ce5efdd93457 req-a0871542-75f8-4213-b864-6706f508b4d9 service nova] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Updated VIF entry in instance network info cache for port 3811b72e-705a-4336-ac66-a0fed51437e4. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 14:09:17 user nova-compute[72129]: DEBUG nova.network.neutron [req-b9687136-7e8e-4c86-a024-ce5efdd93457 req-a0871542-75f8-4213-b864-6706f508b4d9 service nova] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Updating instance_info_cache with network_info: [{"id": "3811b72e-705a-4336-ac66-a0fed51437e4", "address": "fa:16:3e:a3:60:b1", "network": {"id": "ce10dac7-17d0-425a-bfee-70b8220d7871", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1288141476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b724093fa43c4afb9130efa2cfc713d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap3811b72e-70", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:09:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-b9687136-7e8e-4c86-a024-ce5efdd93457 req-a0871542-75f8-4213-b864-6706f508b4d9 service nova] Releasing lock "refresh_cache-1e06fb45-d156-451b-9e4d-e3d2fed52c37" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:09:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-03cf878d-27b7-4136-b03c-6b42428cabb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lock "1e06fb45-d156-451b-9e4d-e3d2fed52c37" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.628s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:09:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:09:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:09:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:09:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:09:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:09:18 user nova-compute[72129]: DEBUG nova.compute.manager [req-3977d09b-4095-4d8c-9f11-815b4cca7c96 req-9cd40f04-18b4-4670-b091-bcb9e24e3284 service nova] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Received event network-vif-plugged-df042689-7692-445c-89d8-cc6d908dd216 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:09:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-3977d09b-4095-4d8c-9f11-815b4cca7c96 req-9cd40f04-18b4-4670-b091-bcb9e24e3284 service nova] Acquiring lock "418f4c53-9dc5-402f-ad21-ac481674b083-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:09:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-3977d09b-4095-4d8c-9f11-815b4cca7c96 req-9cd40f04-18b4-4670-b091-bcb9e24e3284 service nova] Lock "418f4c53-9dc5-402f-ad21-ac481674b083-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:09:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-3977d09b-4095-4d8c-9f11-815b4cca7c96 req-9cd40f04-18b4-4670-b091-bcb9e24e3284 service nova] Lock "418f4c53-9dc5-402f-ad21-ac481674b083-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:09:18 user nova-compute[72129]: DEBUG nova.compute.manager [req-3977d09b-4095-4d8c-9f11-815b4cca7c96 req-9cd40f04-18b4-4670-b091-bcb9e24e3284 service nova] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] No waiting events found dispatching network-vif-plugged-df042689-7692-445c-89d8-cc6d908dd216 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:09:18 user nova-compute[72129]: WARNING nova.compute.manager [req-3977d09b-4095-4d8c-9f11-815b4cca7c96 req-9cd40f04-18b4-4670-b091-bcb9e24e3284 service nova] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Received unexpected event network-vif-plugged-df042689-7692-445c-89d8-cc6d908dd216 for instance with vm_state rescued and task_state unrescuing.
Aug 01 14:09:18 user nova-compute[72129]: DEBUG nova.compute.manager [req-3977d09b-4095-4d8c-9f11-815b4cca7c96 req-9cd40f04-18b4-4670-b091-bcb9e24e3284 service nova] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Received event network-vif-plugged-df042689-7692-445c-89d8-cc6d908dd216 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:09:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-3977d09b-4095-4d8c-9f11-815b4cca7c96 req-9cd40f04-18b4-4670-b091-bcb9e24e3284 service nova] Acquiring lock "418f4c53-9dc5-402f-ad21-ac481674b083-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:09:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-3977d09b-4095-4d8c-9f11-815b4cca7c96 req-9cd40f04-18b4-4670-b091-bcb9e24e3284 service nova] Lock "418f4c53-9dc5-402f-ad21-ac481674b083-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:09:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-3977d09b-4095-4d8c-9f11-815b4cca7c96 req-9cd40f04-18b4-4670-b091-bcb9e24e3284 service nova] Lock "418f4c53-9dc5-402f-ad21-ac481674b083-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:09:18 user nova-compute[72129]: DEBUG nova.compute.manager [req-3977d09b-4095-4d8c-9f11-815b4cca7c96 req-9cd40f04-18b4-4670-b091-bcb9e24e3284 service nova] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] No waiting events found dispatching network-vif-plugged-df042689-7692-445c-89d8-cc6d908dd216 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:09:18 user nova-compute[72129]: WARNING nova.compute.manager [req-3977d09b-4095-4d8c-9f11-815b4cca7c96 req-9cd40f04-18b4-4670-b091-bcb9e24e3284 service nova] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Received unexpected event network-vif-plugged-df042689-7692-445c-89d8-cc6d908dd216 for instance with vm_state rescued and task_state unrescuing.
Aug 01 14:09:20 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Removed pending event for 418f4c53-9dc5-402f-ad21-ac481674b083 due to event {{(pid=72129) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 14:09:20 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898960.212901, 418f4c53-9dc5-402f-ad21-ac481674b083 => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:09:20 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] VM Resumed (Lifecycle Event)
Aug 01 14:09:20 user nova-compute[72129]: DEBUG nova.compute.manager [None req-97a0ec58-5e97-4f61-8f4e-8bfa4da51796 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:09:20 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:09:20 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:09:20 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 01 14:09:20 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898960.2148843, 418f4c53-9dc5-402f-ad21-ac481674b083 => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:09:20 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] VM Started (Lifecycle Event)
Aug 01 14:09:20 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:09:20 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:09:20 user nova-compute[72129]: DEBUG nova.compute.manager [req-8540aa60-12f6-4287-9646-66bd7d04aafa req-e34a5841-1fe8-4de5-bb4c-944df629caff service nova] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Received event network-vif-plugged-df042689-7692-445c-89d8-cc6d908dd216 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:09:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-8540aa60-12f6-4287-9646-66bd7d04aafa req-e34a5841-1fe8-4de5-bb4c-944df629caff service nova] Acquiring lock "418f4c53-9dc5-402f-ad21-ac481674b083-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:09:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-8540aa60-12f6-4287-9646-66bd7d04aafa req-e34a5841-1fe8-4de5-bb4c-944df629caff service nova] Lock "418f4c53-9dc5-402f-ad21-ac481674b083-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:09:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-8540aa60-12f6-4287-9646-66bd7d04aafa req-e34a5841-1fe8-4de5-bb4c-944df629caff service nova] Lock "418f4c53-9dc5-402f-ad21-ac481674b083-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:09:20 user nova-compute[72129]: DEBUG nova.compute.manager [req-8540aa60-12f6-4287-9646-66bd7d04aafa req-e34a5841-1fe8-4de5-bb4c-944df629caff service nova] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] No waiting events found dispatching network-vif-plugged-df042689-7692-445c-89d8-cc6d908dd216 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:09:20 user nova-compute[72129]: WARNING nova.compute.manager [req-8540aa60-12f6-4287-9646-66bd7d04aafa req-e34a5841-1fe8-4de5-bb4c-944df629caff service nova] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Received unexpected event network-vif-plugged-df042689-7692-445c-89d8-cc6d908dd216 for instance with vm_state active and task_state None.
Aug 01 14:09:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:09:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:09:23 user nova-compute[72129]: DEBUG nova.compute.manager [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Start spawning the instance on the hypervisor. {{(pid=72129) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 14:09:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Creating instance directory {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 14:09:23 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Creating image(s)
Aug 01 14:09:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Did not create local disks {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 14:09:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Ensure instance console log exists: /opt/stack/data/nova/instances/71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d/console.log {{(pid=72129) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 14:09:23 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:09:23 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:09:23 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:09:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Start _get_guest_xml network_info=[{"id": "a5aad1a2-0499-4725-9837-ee171ff0b048", "address": "fa:16:3e:0d:87:39", "network": {"id": "a7f4226b-73fe-4265-ba2c-5d7dcdf154fd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1142462884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210837255c8148ec9b482ba3e2551362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5aad1a2-04", "ovs_interfaceid": "a5aad1a2-0499-4725-9837-ee171ff0b048", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': 'ec63e749-ead0-4365-80f4-bb985d8ceae6', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pedDTuLS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d', 'attached_at': '', 'detached_at': '', 'volume_id': 'becf1ccd-4c86-418e-a9eb-be3cb1fff883', 'serial': 'becf1ccd-4c86-418e-a9eb-be3cb1fff883'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 14:09:23 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:09:23 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:09:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 14:09:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] CPU controller missing on host. {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 14:09:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 14:09:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] CPU controller found on host. {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 14:09:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72129) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 14:09:23 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T13:45:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 14:09:23 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Flavor limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 14:09:23 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Image limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 14:09:23 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Flavor pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 14:09:23 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Image pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 14:09:23 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 14:09:23 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 14:09:23 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 14:09:23 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Got 1 possible topologies {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 14:09:23 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 14:09:23 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 14:09:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Calling os-brick to attach iSCSI Volume {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 14:09:23 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pedDTuLS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:09:23 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:09:23 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:09:23 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:09:23 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:09:23 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:09:23 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:09:23 user nova-compute[72129]: INFO os_brick.initiator.connectors.iscsi [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 14:09:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 -p 172.16.0.220:3260 {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:09:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:09:23 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[914d8db0-95b8-4f86-a9eb-8cf8272fcf92]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:09:23 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 14:09:23 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:09:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 -p 172.16.0.220:3260 --interface default --op new {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:09:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:09:23 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[799ac3f4-8c23-40f3-9921-b1d5793dd81e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883] added\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:09:23 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883] added
Aug 01 14:09:23 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:09:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:09:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:09:23 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9402814-dc8e-4b80-91ea-a38226fabf2b]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:09:23 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:09:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:09:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:09:23 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[2765ecfb-5932-446b-99d9-84450e39bddb]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:09:23 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:09:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pedDTuLS {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:09:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pedDTuLS" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:09:23 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e68cd8-6603-4218-be38-b39bce119a1b]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:09:23 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pedDTuLS'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:09:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:09:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:09:23 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b3d984-3b9d-4d40-bb5e-fadeb989c275]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:09:23 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:09:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:09:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:09:23 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad0790b-b68e-4514-a795-11c8e4044a5e]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:09:23 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:09:23 user nova-compute[72129]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 (non-flash)
Aug 01 14:09:23 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:09:23 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:09:23 user nova-compute[72129]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 (non-flash)
Aug 01 14:09:23 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:09:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 -p 172.16.0.220:3260 --login {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:09:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:09:24 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71e3ccd-4b4a-46ad-810a-3a6168f7fc21]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:09:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883, portal: 172.16.0.220,3260]
Aug 01 14:09:24 user nova-compute[72129]: Login to [iface: default, target: iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883, portal: 172.16.0.220,3260] successful.
Aug 01 14:09:24 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:09:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:09:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:09:24 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2fbcfe2-6a74-49ea-b9c7-a201054c7a9b]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:09:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:09:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:09:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:09:24 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e25ccf1-d665-4a5a-b9ae-84dc76043e7d]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:09:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:09:24 user nova-compute[72129]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 (non-flash)
Aug 01 14:09:24 user nova-compute[72129]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 (non-flash)
Aug 01 14:09:24 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:09:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:09:24 user nova-compute[72129]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 (non-flash)
Aug 01 14:09:24 user nova-compute[72129]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 (non-flash)
Aug 01 14:09:24 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:09:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:09:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Connected to 172.16.0.220:3260 {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 14:09:24 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] HCTL ('35', '-', '-', 0) found on session 45 with lun 0 {{(pid=72129) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 14:09:24 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72129) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 14:09:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:09:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:09:24 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[752983ba-8bcb-47aa-b54e-58a9cdeb9edb]: (4, ('- - 0', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:09:24 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Searching for a device in session 45 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 14:09:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pedDTuLS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 14:09:25 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:09:25 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '23764633831346631', 'path': '/dev/sdd'} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:09:25 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23764633831346631', 'path': '/dev/sdd'} {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 14:09:25 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:09:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-23799228',display_name='tempest-TestVolumeBootPattern-server-23799228',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-23799228',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNC/W23SfZUyUykD+/RvnPe5L4yiaqOIZwhr2x6wMubzv0aJUgMCBBDug36LSArw18K2rZhhyJmbPtRQrPLsQ9v32QcGWNTH4aynBroBlcsIvr6dB/z67zo0JXowDVQS+w==',key_name='tempest-TestVolumeBootPattern-1986080939',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='210837255c8148ec9b482ba3e2551362',ramdisk_id='',reservation_id='r-8mdi9x81',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1876154436',owner_user_name='tempest-TestVolumeBootPattern-1876154436-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T14:09:11Z,user_data=None,user_id='7c341be2816c43cfa9adb58ee84e942b',uuid=71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a5aad1a2-0499-4725-9837-ee171ff0b048", "address": "fa:16:3e:0d:87:39", "network": {"id": "a7f4226b-73fe-4265-ba2c-5d7dcdf154fd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1142462884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210837255c8148ec9b482ba3e2551362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5aad1a2-04", "ovs_interfaceid": "a5aad1a2-0499-4725-9837-ee171ff0b048", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 14:09:25 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Converting VIF {"id": "a5aad1a2-0499-4725-9837-ee171ff0b048", "address": "fa:16:3e:0d:87:39", "network": {"id": "a7f4226b-73fe-4265-ba2c-5d7dcdf154fd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1142462884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210837255c8148ec9b482ba3e2551362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5aad1a2-04", "ovs_interfaceid": "a5aad1a2-0499-4725-9837-ee171ff0b048", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:09:25 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:87:39,bridge_name='br-int',has_traffic_filtering=True,id=a5aad1a2-0499-4725-9837-ee171ff0b048,network=Network(a7f4226b-73fe-4265-ba2c-5d7dcdf154fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5aad1a2-04') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:09:25 user nova-compute[72129]: DEBUG nova.objects.instance [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lazy-loading 'pci_devices' on Instance uuid 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:09:25 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] End _get_guest_xml xml=<domain type="kvm">
Aug 01 14:09:25 user nova-compute[72129]:   <uuid>71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d</uuid>
Aug 01 14:09:25 user nova-compute[72129]:   <name>instance-00000023</name>
Aug 01 14:09:25 user nova-compute[72129]:   <memory>524288</memory>
Aug 01 14:09:25 user nova-compute[72129]:   <vcpu>1</vcpu>
Aug 01 14:09:25 user nova-compute[72129]:   <metadata>
Aug 01 14:09:25 user nova-compute[72129]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 14:09:25 user nova-compute[72129]:       <nova:package version="0.0.0"/>
Aug 01 14:09:25 user nova-compute[72129]:       <nova:name>tempest-TestVolumeBootPattern-server-23799228</nova:name>
Aug 01 14:09:25 user nova-compute[72129]:       <nova:creationTime>2023-08-01 14:09:23</nova:creationTime>
Aug 01 14:09:25 user nova-compute[72129]:       <nova:flavor name="m1.tiny">
Aug 01 14:09:25 user nova-compute[72129]:         <nova:memory>512</nova:memory>
Aug 01 14:09:25 user nova-compute[72129]:         <nova:disk>1</nova:disk>
Aug 01 14:09:25 user nova-compute[72129]:         <nova:swap>0</nova:swap>
Aug 01 14:09:25 user nova-compute[72129]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 14:09:25 user nova-compute[72129]:         <nova:vcpus>1</nova:vcpus>
Aug 01 14:09:25 user nova-compute[72129]:       </nova:flavor>
Aug 01 14:09:25 user nova-compute[72129]:       <nova:owner>
Aug 01 14:09:25 user nova-compute[72129]:         <nova:user uuid="7c341be2816c43cfa9adb58ee84e942b">tempest-TestVolumeBootPattern-1876154436-project-member</nova:user>
Aug 01 14:09:25 user nova-compute[72129]:         <nova:project uuid="210837255c8148ec9b482ba3e2551362">tempest-TestVolumeBootPattern-1876154436</nova:project>
Aug 01 14:09:25 user nova-compute[72129]:       </nova:owner>
Aug 01 14:09:25 user nova-compute[72129]:       <nova:ports>
Aug 01 14:09:25 user nova-compute[72129]:         <nova:port uuid="a5aad1a2-0499-4725-9837-ee171ff0b048">
Aug 01 14:09:25 user nova-compute[72129]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 01 14:09:25 user nova-compute[72129]:         </nova:port>
Aug 01 14:09:25 user nova-compute[72129]:       </nova:ports>
Aug 01 14:09:25 user nova-compute[72129]:     </nova:instance>
Aug 01 14:09:25 user nova-compute[72129]:   </metadata>
Aug 01 14:09:25 user nova-compute[72129]:   <sysinfo type="smbios">
Aug 01 14:09:25 user nova-compute[72129]:     <system>
Aug 01 14:09:25 user nova-compute[72129]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 14:09:25 user nova-compute[72129]:       <entry name="product">OpenStack Nova</entry>
Aug 01 14:09:25 user nova-compute[72129]:       <entry name="version">0.0.0</entry>
Aug 01 14:09:25 user nova-compute[72129]:       <entry name="serial">71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d</entry>
Aug 01 14:09:25 user nova-compute[72129]:       <entry name="uuid">71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d</entry>
Aug 01 14:09:25 user nova-compute[72129]:       <entry name="family">Virtual Machine</entry>
Aug 01 14:09:25 user nova-compute[72129]:     </system>
Aug 01 14:09:25 user nova-compute[72129]:   </sysinfo>
Aug 01 14:09:25 user nova-compute[72129]:   <os>
Aug 01 14:09:25 user nova-compute[72129]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 14:09:25 user nova-compute[72129]:     <boot dev="hd"/>
Aug 01 14:09:25 user nova-compute[72129]:     <smbios mode="sysinfo"/>
Aug 01 14:09:25 user nova-compute[72129]:   </os>
Aug 01 14:09:25 user nova-compute[72129]:   <features>
Aug 01 14:09:25 user nova-compute[72129]:     <acpi/>
Aug 01 14:09:25 user nova-compute[72129]:     <apic/>
Aug 01 14:09:25 user nova-compute[72129]:     <vmcoreinfo/>
Aug 01 14:09:25 user nova-compute[72129]:   </features>
Aug 01 14:09:25 user nova-compute[72129]:   <clock offset="utc">
Aug 01 14:09:25 user nova-compute[72129]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 14:09:25 user nova-compute[72129]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 14:09:25 user nova-compute[72129]:     <timer name="hpet" present="no"/>
Aug 01 14:09:25 user nova-compute[72129]:   </clock>
Aug 01 14:09:25 user nova-compute[72129]:   <cpu mode="custom" match="exact">
Aug 01 14:09:25 user nova-compute[72129]:     <model>Nehalem</model>
Aug 01 14:09:25 user nova-compute[72129]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 14:09:25 user nova-compute[72129]:   </cpu>
Aug 01 14:09:25 user nova-compute[72129]:   <devices>
Aug 01 14:09:25 user nova-compute[72129]:     <disk type="block" device="disk">
Aug 01 14:09:25 user nova-compute[72129]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:09:25 user nova-compute[72129]:       <source dev="/dev/sdd"/>
Aug 01 14:09:25 user nova-compute[72129]:       <target dev="vda" bus="virtio"/>
Aug 01 14:09:25 user nova-compute[72129]:       <serial>becf1ccd-4c86-418e-a9eb-be3cb1fff883</serial>
Aug 01 14:09:25 user nova-compute[72129]:     </disk>
Aug 01 14:09:25 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 14:09:25 user nova-compute[72129]:       <mac address="fa:16:3e:0d:87:39"/>
Aug 01 14:09:25 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:09:25 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 14:09:25 user nova-compute[72129]:       <target dev="tapa5aad1a2-04"/>
Aug 01 14:09:25 user nova-compute[72129]:     </interface>
Aug 01 14:09:25 user nova-compute[72129]:     <serial type="pty">
Aug 01 14:09:25 user nova-compute[72129]:       <log file="/opt/stack/data/nova/instances/71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d/console.log" append="off"/>
Aug 01 14:09:25 user nova-compute[72129]:     </serial>
Aug 01 14:09:25 user nova-compute[72129]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 14:09:25 user nova-compute[72129]:     <video>
Aug 01 14:09:25 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:09:25 user nova-compute[72129]:     </video>
Aug 01 14:09:25 user nova-compute[72129]:     <rng model="virtio">
Aug 01 14:09:25 user nova-compute[72129]:       <backend model="random">/dev/urandom</backend>
Aug 01 14:09:25 user nova-compute[72129]:     </rng>
Aug 01 14:09:25 user nova-compute[72129]:     <controller type="usb" index="0" model="none"/>
Aug 01 14:09:25 user nova-compute[72129]:     <memballoon model="virtio">
Aug 01 14:09:25 user nova-compute[72129]:       <stats period="10"/>
Aug 01 14:09:25 user nova-compute[72129]:     </memballoon>
Aug 01 14:09:25 user nova-compute[72129]:   </devices>
Aug 01 14:09:25 user nova-compute[72129]: </domain>
Aug 01 14:09:25 user nova-compute[72129]:  {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 14:09:25 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:09:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-23799228',display_name='tempest-TestVolumeBootPattern-server-23799228',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-23799228',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNC/W23SfZUyUykD+/RvnPe5L4yiaqOIZwhr2x6wMubzv0aJUgMCBBDug36LSArw18K2rZhhyJmbPtRQrPLsQ9v32QcGWNTH4aynBroBlcsIvr6dB/z67zo0JXowDVQS+w==',key_name='tempest-TestVolumeBootPattern-1986080939',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='210837255c8148ec9b482ba3e2551362',ramdisk_id='',reservation_id='r-8mdi9x81',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1876154436',owner_user_name='tempest-TestVolumeBootPattern-1876154436-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T14:09:11Z,user_data=None,user_id='7c341be2816c43cfa9adb58ee84e942b',uuid=71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a5aad1a2-0499-4725-9837-ee171ff0b048", "address": "fa:16:3e:0d:87:39", "network": {"id": "a7f4226b-73fe-4265-ba2c-5d7dcdf154fd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1142462884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210837255c8148ec9b482ba3e2551362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5aad1a2-04", "ovs_interfaceid": "a5aad1a2-0499-4725-9837-ee171ff0b048", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 14:09:25 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Converting VIF {"id": "a5aad1a2-0499-4725-9837-ee171ff0b048", "address": "fa:16:3e:0d:87:39", "network": {"id": "a7f4226b-73fe-4265-ba2c-5d7dcdf154fd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1142462884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210837255c8148ec9b482ba3e2551362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5aad1a2-04", "ovs_interfaceid": "a5aad1a2-0499-4725-9837-ee171ff0b048", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:09:25 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:87:39,bridge_name='br-int',has_traffic_filtering=True,id=a5aad1a2-0499-4725-9837-ee171ff0b048,network=Network(a7f4226b-73fe-4265-ba2c-5d7dcdf154fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5aad1a2-04') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:09:25 user nova-compute[72129]: DEBUG os_vif [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:87:39,bridge_name='br-int',has_traffic_filtering=True,id=a5aad1a2-0499-4725-9837-ee171ff0b048,network=Network(a7f4226b-73fe-4265-ba2c-5d7dcdf154fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5aad1a2-04') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 14:09:25 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:09:25 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:09:25 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 14:09:25 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:09:25 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa5aad1a2-04, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:09:25 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa5aad1a2-04, col_values=(('external_ids', {'iface-id': 'a5aad1a2-0499-4725-9837-ee171ff0b048', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:87:39', 'vm-uuid': '71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:09:25 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:09:25 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:09:25 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:09:25 user nova-compute[72129]: INFO os_vif [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:87:39,bridge_name='br-int',has_traffic_filtering=True,id=a5aad1a2-0499-4725-9837-ee171ff0b048,network=Network(a7f4226b-73fe-4265-ba2c-5d7dcdf154fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5aad1a2-04')
Aug 01 14:09:25 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:09:25 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] No VIF found with MAC fa:16:3e:0d:87:39, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 14:09:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:09:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:09:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:09:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:09:26 user nova-compute[72129]: DEBUG nova.compute.manager [req-17c092a4-d5cc-4d97-8cbf-5d9a78583a5d req-de62c700-66be-4a68-b256-beb00dca8db8 service nova] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Received event network-vif-plugged-a5aad1a2-0499-4725-9837-ee171ff0b048 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:09:26 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-17c092a4-d5cc-4d97-8cbf-5d9a78583a5d req-de62c700-66be-4a68-b256-beb00dca8db8 service nova] Acquiring lock "71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:09:26 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-17c092a4-d5cc-4d97-8cbf-5d9a78583a5d req-de62c700-66be-4a68-b256-beb00dca8db8 service nova] Lock "71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:09:26 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-17c092a4-d5cc-4d97-8cbf-5d9a78583a5d req-de62c700-66be-4a68-b256-beb00dca8db8 service nova] Lock "71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:09:26 user nova-compute[72129]: DEBUG nova.compute.manager [req-17c092a4-d5cc-4d97-8cbf-5d9a78583a5d req-de62c700-66be-4a68-b256-beb00dca8db8 service nova] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] No waiting events found dispatching network-vif-plugged-a5aad1a2-0499-4725-9837-ee171ff0b048 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:09:26 user nova-compute[72129]: WARNING nova.compute.manager [req-17c092a4-d5cc-4d97-8cbf-5d9a78583a5d req-de62c700-66be-4a68-b256-beb00dca8db8 service nova] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Received unexpected event network-vif-plugged-a5aad1a2-0499-4725-9837-ee171ff0b048 for instance with vm_state building and task_state spawning.
Aug 01 14:09:27 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:09:27 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:09:27 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:09:27 user nova-compute[72129]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690898952.286174, 1e06fb45-d156-451b-9e4d-e3d2fed52c37 => Stopped> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:09:27 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] VM Stopped (Lifecycle Event)
Aug 01 14:09:27 user nova-compute[72129]: DEBUG nova.compute.manager [None req-bb7fb5f3-0cd4-43f2-b8c4-742c8fec079e None None] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:09:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b5886b43-bcbb-4580-9cb3-91216044699f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Acquiring lock "97a5dccf-b499-443a-b332-cfa293a16047" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:09:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b5886b43-bcbb-4580-9cb3-91216044699f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "97a5dccf-b499-443a-b332-cfa293a16047" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:09:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b5886b43-bcbb-4580-9cb3-91216044699f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Acquiring lock "97a5dccf-b499-443a-b332-cfa293a16047-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:09:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b5886b43-bcbb-4580-9cb3-91216044699f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "97a5dccf-b499-443a-b332-cfa293a16047-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:09:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b5886b43-bcbb-4580-9cb3-91216044699f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "97a5dccf-b499-443a-b332-cfa293a16047-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:09:27 user nova-compute[72129]: INFO nova.compute.manager [None req-b5886b43-bcbb-4580-9cb3-91216044699f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Terminating instance
Aug 01 14:09:27 user nova-compute[72129]: DEBUG nova.compute.manager [None req-b5886b43-bcbb-4580-9cb3-91216044699f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Start destroying the instance on the hypervisor. {{(pid=72129) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 14:09:27 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:09:27 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:09:27 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:09:27 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:09:27 user nova-compute[72129]: DEBUG nova.compute.manager [req-3119733c-b2e1-4e2e-9681-044e7454c737 req-2ab80ae3-86e1-4a5b-9f7c-f09f47444a06 service nova] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Received event network-vif-unplugged-4871bc74-6594-49e6-a6ef-343bc3800742 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:09:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-3119733c-b2e1-4e2e-9681-044e7454c737 req-2ab80ae3-86e1-4a5b-9f7c-f09f47444a06 service nova] Acquiring lock "97a5dccf-b499-443a-b332-cfa293a16047-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:09:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-3119733c-b2e1-4e2e-9681-044e7454c737 req-2ab80ae3-86e1-4a5b-9f7c-f09f47444a06 service nova] Lock "97a5dccf-b499-443a-b332-cfa293a16047-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:09:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-3119733c-b2e1-4e2e-9681-044e7454c737 req-2ab80ae3-86e1-4a5b-9f7c-f09f47444a06 service nova] Lock "97a5dccf-b499-443a-b332-cfa293a16047-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:09:27 user nova-compute[72129]: DEBUG nova.compute.manager [req-3119733c-b2e1-4e2e-9681-044e7454c737 req-2ab80ae3-86e1-4a5b-9f7c-f09f47444a06 service nova] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] No waiting events found dispatching network-vif-unplugged-4871bc74-6594-49e6-a6ef-343bc3800742 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:09:27 user nova-compute[72129]: DEBUG nova.compute.manager [req-3119733c-b2e1-4e2e-9681-044e7454c737 req-2ab80ae3-86e1-4a5b-9f7c-f09f47444a06 service nova] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Received event network-vif-unplugged-4871bc74-6594-49e6-a6ef-343bc3800742 for instance with task_state deleting. {{(pid=72129) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 14:09:28 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Instance destroyed successfully.
Aug 01 14:09:28 user nova-compute[72129]: DEBUG nova.objects.instance [None req-b5886b43-bcbb-4580-9cb3-91216044699f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lazy-loading 'resources' on Instance uuid 97a5dccf-b499-443a-b332-cfa293a16047 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:09:28 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-b5886b43-bcbb-4580-9cb3-91216044699f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T13:53:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1047779358',display_name='tempest-ServerActionsTestOtherA-server-1597969023',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1047779358',id=14,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMKxgVYWQdVKRLV+QIEDxsF4RC9I5wENeCwXhryJ2sr+8oNRgK2W8XmwhDYsUxLBCXzQXdaopDtUa2pfT9PfB2oRmI83WPjT6V3uSmwDrvE9fHgGK0Xxc5yPsVieUvlqoA==',key_name='tempest-keypair-1687158208',keypairs=<?>,launch_index=0,launched_at=2023-08-01T13:57:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b0e85d9b73a546dc95e0ace26233f2a7',ramdisk_id='',reservation_id='r-hn67ks7n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1440097443',owner_user_name='tempest-ServerActionsTestOtherA-1440097443-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T13:57:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f35620862694e7295f782ab15e290a8',uuid=97a5dccf-b499-443a-b332-cfa293a16047,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4871bc74-6594-49e6-a6ef-343bc3800742", "address": "fa:16:3e:a3:52:a2", "network": {"id": "4b93ad92-9a3a-4472-ba6c-d215329da98b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-734108983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0e85d9b73a546dc95e0ace26233f2a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4871bc74-65", "ovs_interfaceid": "4871bc74-6594-49e6-a6ef-343bc3800742", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 14:09:28 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-b5886b43-bcbb-4580-9cb3-91216044699f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Converting VIF {"id": "4871bc74-6594-49e6-a6ef-343bc3800742", "address": "fa:16:3e:a3:52:a2", "network": {"id": "4b93ad92-9a3a-4472-ba6c-d215329da98b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-734108983-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0e85d9b73a546dc95e0ace26233f2a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4871bc74-65", "ovs_interfaceid": "4871bc74-6594-49e6-a6ef-343bc3800742", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:09:28 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-b5886b43-bcbb-4580-9cb3-91216044699f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a3:52:a2,bridge_name='br-int',has_traffic_filtering=True,id=4871bc74-6594-49e6-a6ef-343bc3800742,network=Network(4b93ad92-9a3a-4472-ba6c-d215329da98b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4871bc74-65') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:09:28 user nova-compute[72129]: DEBUG os_vif [None req-b5886b43-bcbb-4580-9cb3-91216044699f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:52:a2,bridge_name='br-int',has_traffic_filtering=True,id=4871bc74-6594-49e6-a6ef-343bc3800742,network=Network(4b93ad92-9a3a-4472-ba6c-d215329da98b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4871bc74-65') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 14:09:28 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:09:28 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4871bc74-65, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:09:28 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:09:28 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:09:28 user nova-compute[72129]: INFO os_vif [None req-b5886b43-bcbb-4580-9cb3-91216044699f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:52:a2,bridge_name='br-int',has_traffic_filtering=True,id=4871bc74-6594-49e6-a6ef-343bc3800742,network=Network(4b93ad92-9a3a-4472-ba6c-d215329da98b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4871bc74-65')
Aug 01 14:09:28 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-b5886b43-bcbb-4580-9cb3-91216044699f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Deleting instance files /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047_del
Aug 01 14:09:28 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-b5886b43-bcbb-4580-9cb3-91216044699f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Deletion of /opt/stack/data/nova/instances/97a5dccf-b499-443a-b332-cfa293a16047_del complete
Aug 01 14:09:28 user nova-compute[72129]: INFO nova.compute.manager [None req-b5886b43-bcbb-4580-9cb3-91216044699f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 01 14:09:28 user nova-compute[72129]: DEBUG oslo.service.loopingcall [None req-b5886b43-bcbb-4580-9cb3-91216044699f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72129) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 14:09:28 user nova-compute[72129]: DEBUG nova.compute.manager [-] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Deallocating network for instance {{(pid=72129) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 14:09:28 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] deallocate_for_instance() {{(pid=72129) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 14:09:28 user nova-compute[72129]: DEBUG nova.compute.manager [req-4fd92dfc-b59d-4f41-bf38-ecfe40e25cb2 req-b4a0ce90-95d4-4db8-8db5-b966e2ce1893 service nova] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Received event network-vif-plugged-a5aad1a2-0499-4725-9837-ee171ff0b048 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:09:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-4fd92dfc-b59d-4f41-bf38-ecfe40e25cb2 req-b4a0ce90-95d4-4db8-8db5-b966e2ce1893 service nova] Acquiring lock "71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:09:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-4fd92dfc-b59d-4f41-bf38-ecfe40e25cb2 req-b4a0ce90-95d4-4db8-8db5-b966e2ce1893 service nova] Lock "71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:09:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-4fd92dfc-b59d-4f41-bf38-ecfe40e25cb2 req-b4a0ce90-95d4-4db8-8db5-b966e2ce1893 service nova] Lock "71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:09:28 user nova-compute[72129]: DEBUG nova.compute.manager [req-4fd92dfc-b59d-4f41-bf38-ecfe40e25cb2 req-b4a0ce90-95d4-4db8-8db5-b966e2ce1893 service nova] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] No waiting events found dispatching network-vif-plugged-a5aad1a2-0499-4725-9837-ee171ff0b048 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:09:28 user nova-compute[72129]: WARNING nova.compute.manager [req-4fd92dfc-b59d-4f41-bf38-ecfe40e25cb2 req-b4a0ce90-95d4-4db8-8db5-b966e2ce1893 service nova] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Received unexpected event network-vif-plugged-a5aad1a2-0499-4725-9837-ee171ff0b048 for instance with vm_state building and task_state spawning.
Aug 01 14:09:28 user nova-compute[72129]: DEBUG nova.compute.manager [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Instance event wait completed in 0 seconds for  {{(pid=72129) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 14:09:28 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Guest created on hypervisor {{(pid=72129) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 14:09:28 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898968.9069111, 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:09:28 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] VM Resumed (Lifecycle Event)
Aug 01 14:09:28 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Instance spawned successfully.
Aug 01 14:09:28 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 14:09:28 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:09:28 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:09:28 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 14:09:28 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690898968.9071307, 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:09:28 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] VM Started (Lifecycle Event)
Aug 01 14:09:28 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Found default for hw_cdrom_bus of ide {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:09:28 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Found default for hw_disk_bus of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:09:28 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Found default for hw_input_bus of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:09:28 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Found default for hw_pointer_model of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:09:28 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Found default for hw_video_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:09:28 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Found default for hw_vif_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:09:29 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:09:29 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:09:29 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 14:09:29 user nova-compute[72129]: INFO nova.compute.manager [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Took 5.34 seconds to spawn the instance on the hypervisor.
Aug 01 14:09:29 user nova-compute[72129]: DEBUG nova.compute.manager [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:09:29 user nova-compute[72129]: INFO nova.compute.manager [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Took 18.81 seconds to build instance.
Aug 01 14:09:29 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-0f8b9098-85f0-412f-b229-1fbc248dbe90 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.919s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:09:29 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:09:29 user nova-compute[72129]: DEBUG nova.compute.manager [req-4b1d4c24-c63d-4060-ad12-352dec90671d req-c4c5eb7b-3127-4b79-8c73-725ee6dec481 service nova] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Received event network-vif-deleted-4871bc74-6594-49e6-a6ef-343bc3800742 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:09:29 user nova-compute[72129]: INFO nova.compute.manager [req-4b1d4c24-c63d-4060-ad12-352dec90671d req-c4c5eb7b-3127-4b79-8c73-725ee6dec481 service nova] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Neutron deleted interface 4871bc74-6594-49e6-a6ef-343bc3800742; detaching it from the instance and deleting it from the info cache
Aug 01 14:09:29 user nova-compute[72129]: DEBUG nova.network.neutron [req-4b1d4c24-c63d-4060-ad12-352dec90671d req-c4c5eb7b-3127-4b79-8c73-725ee6dec481 service nova] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:09:29 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Took 0.75 seconds to deallocate network for instance.
Aug 01 14:09:29 user nova-compute[72129]: DEBUG nova.compute.manager [req-4b1d4c24-c63d-4060-ad12-352dec90671d req-c4c5eb7b-3127-4b79-8c73-725ee6dec481 service nova] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Detach interface failed, port_id=4871bc74-6594-49e6-a6ef-343bc3800742, reason: Instance 97a5dccf-b499-443a-b332-cfa293a16047 could not be found. {{(pid=72129) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 14:09:29 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b5886b43-bcbb-4580-9cb3-91216044699f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:09:29 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b5886b43-bcbb-4580-9cb3-91216044699f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:09:29 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-b5886b43-bcbb-4580-9cb3-91216044699f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:09:29 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-b5886b43-bcbb-4580-9cb3-91216044699f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:09:29 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b5886b43-bcbb-4580-9cb3-91216044699f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.286s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:09:29 user nova-compute[72129]: INFO nova.scheduler.client.report [None req-b5886b43-bcbb-4580-9cb3-91216044699f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Deleted allocations for instance 97a5dccf-b499-443a-b332-cfa293a16047
Aug 01 14:09:29 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b5886b43-bcbb-4580-9cb3-91216044699f tempest-ServerActionsTestOtherA-1440097443 tempest-ServerActionsTestOtherA-1440097443-project-member] Lock "97a5dccf-b499-443a-b332-cfa293a16047" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.174s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:09:30 user nova-compute[72129]: DEBUG nova.compute.manager [req-50fe0524-f55f-42ff-ae96-d12c1953702d req-18c26443-5fe6-41c9-bc9e-4b0e6f27ea2b service nova] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Received event network-vif-plugged-4871bc74-6594-49e6-a6ef-343bc3800742 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:09:30 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-50fe0524-f55f-42ff-ae96-d12c1953702d req-18c26443-5fe6-41c9-bc9e-4b0e6f27ea2b service nova] Acquiring lock "97a5dccf-b499-443a-b332-cfa293a16047-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:09:30 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-50fe0524-f55f-42ff-ae96-d12c1953702d req-18c26443-5fe6-41c9-bc9e-4b0e6f27ea2b service nova] Lock "97a5dccf-b499-443a-b332-cfa293a16047-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:09:30 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-50fe0524-f55f-42ff-ae96-d12c1953702d req-18c26443-5fe6-41c9-bc9e-4b0e6f27ea2b service nova] Lock "97a5dccf-b499-443a-b332-cfa293a16047-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:09:30 user nova-compute[72129]: DEBUG nova.compute.manager [req-50fe0524-f55f-42ff-ae96-d12c1953702d req-18c26443-5fe6-41c9-bc9e-4b0e6f27ea2b service nova] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] No waiting events found dispatching network-vif-plugged-4871bc74-6594-49e6-a6ef-343bc3800742 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:09:30 user nova-compute[72129]: WARNING nova.compute.manager [req-50fe0524-f55f-42ff-ae96-d12c1953702d req-18c26443-5fe6-41c9-bc9e-4b0e6f27ea2b service nova] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Received unexpected event network-vif-plugged-4871bc74-6594-49e6-a6ef-343bc3800742 for instance with vm_state deleted and task_state None.
Aug 01 14:09:31 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:09:33 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:09:36 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:09:38 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:09:41 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:09:43 user nova-compute[72129]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690898968.4269295, 97a5dccf-b499-443a-b332-cfa293a16047 => Stopped> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:09:43 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] VM Stopped (Lifecycle Event)
Aug 01 14:09:43 user nova-compute[72129]: DEBUG nova.compute.manager [None req-d0700d11-e4ad-47a2-ae51-6c4669e3961e None None] [instance: 97a5dccf-b499-443a-b332-cfa293a16047] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:09:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:09:44 user nova-compute[72129]: DEBUG nova.compute.manager [req-01801534-75eb-4b6b-b83f-d350cb877b6d req-9b3f5ebd-8347-47ea-aaab-7732e0814d62 service nova] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Received event network-changed-950fe308-2b8e-4c5a-9a1d-796cf99eef3d {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:09:44 user nova-compute[72129]: DEBUG nova.compute.manager [req-01801534-75eb-4b6b-b83f-d350cb877b6d req-9b3f5ebd-8347-47ea-aaab-7732e0814d62 service nova] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Refreshing instance network info cache due to event network-changed-950fe308-2b8e-4c5a-9a1d-796cf99eef3d. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 14:09:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-01801534-75eb-4b6b-b83f-d350cb877b6d req-9b3f5ebd-8347-47ea-aaab-7732e0814d62 service nova] Acquiring lock "refresh_cache-e3a73214-dad3-44d1-adc3-312970a919e5" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:09:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-01801534-75eb-4b6b-b83f-d350cb877b6d req-9b3f5ebd-8347-47ea-aaab-7732e0814d62 service nova] Acquired lock "refresh_cache-e3a73214-dad3-44d1-adc3-312970a919e5" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:09:44 user nova-compute[72129]: DEBUG nova.network.neutron [req-01801534-75eb-4b6b-b83f-d350cb877b6d req-9b3f5ebd-8347-47ea-aaab-7732e0814d62 service nova] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Refreshing network info cache for port 950fe308-2b8e-4c5a-9a1d-796cf99eef3d {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 14:09:44 user nova-compute[72129]: DEBUG nova.network.neutron [req-01801534-75eb-4b6b-b83f-d350cb877b6d req-9b3f5ebd-8347-47ea-aaab-7732e0814d62 service nova] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Updated VIF entry in instance network info cache for port 950fe308-2b8e-4c5a-9a1d-796cf99eef3d. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 14:09:44 user nova-compute[72129]: DEBUG nova.network.neutron [req-01801534-75eb-4b6b-b83f-d350cb877b6d req-9b3f5ebd-8347-47ea-aaab-7732e0814d62 service nova] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Updating instance_info_cache with network_info: [{"id": "950fe308-2b8e-4c5a-9a1d-796cf99eef3d", "address": "fa:16:3e:16:8b:06", "network": {"id": "b0eb2211-5a6a-4b7e-a119-92a0f0deb947", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1159988670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6120989bad342a4a6fa2a8975f5932f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap950fe308-2b", "ovs_interfaceid": "950fe308-2b8e-4c5a-9a1d-796cf99eef3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:09:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-01801534-75eb-4b6b-b83f-d350cb877b6d req-9b3f5ebd-8347-47ea-aaab-7732e0814d62 service nova] Releasing lock "refresh_cache-e3a73214-dad3-44d1-adc3-312970a919e5" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:09:46 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:09:47 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-fd8a252f-15dc-41ec-aaa3-dfa74ff0b47e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Acquiring lock "e3a73214-dad3-44d1-adc3-312970a919e5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:09:47 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-fd8a252f-15dc-41ec-aaa3-dfa74ff0b47e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "e3a73214-dad3-44d1-adc3-312970a919e5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:09:47 user nova-compute[72129]: DEBUG nova.objects.instance [None req-fd8a252f-15dc-41ec-aaa3-dfa74ff0b47e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lazy-loading 'flavor' on Instance uuid e3a73214-dad3-44d1-adc3-312970a919e5 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:09:47 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-fd8a252f-15dc-41ec-aaa3-dfa74ff0b47e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "e3a73214-dad3-44d1-adc3-312970a919e5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:09:48 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-fd8a252f-15dc-41ec-aaa3-dfa74ff0b47e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Acquiring lock "e3a73214-dad3-44d1-adc3-312970a919e5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:09:48 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-fd8a252f-15dc-41ec-aaa3-dfa74ff0b47e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "e3a73214-dad3-44d1-adc3-312970a919e5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:09:48 user nova-compute[72129]: INFO nova.compute.manager [None req-fd8a252f-15dc-41ec-aaa3-dfa74ff0b47e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Attaching volume 7d2edd53-4294-44e1-8c0e-145f38bdeed0 to /dev/vdb
Aug 01 14:09:48 user nova-compute[72129]: DEBUG os_brick.utils [None req-fd8a252f-15dc-41ec-aaa3-dfa74ff0b47e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:09:48 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:09:48 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:09:48 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9f6f34-ba27-4996-a051-a2166b36b09c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f9b449c2cd3d\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:09:48 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:09:48 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:09:48 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[cddf8377-3a02-457e-a1d7-4ca96f32a9fc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:09:48 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:09:48 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:09:48 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[524a76ad-cd1f-4aa4-9e3b-3e36557790dd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:09:48 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb8769c-49fd-429d-b251-70798f94dd19]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:09:48 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-fd8a252f-15dc-41ec-aaa3-dfa74ff0b47e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Running cmd (subprocess): nvme version {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:09:48 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-fd8a252f-15dc-41ec-aaa3-dfa74ff0b47e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] 'nvme version' failed. Not Retrying. {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 14:09:48 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fd8a252f-15dc-41ec-aaa3-dfa74ff0b47e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] nvme not present on system {{(pid=72129) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 14:09:48 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:09:48 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 14:09:48 user nova-compute[72129]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 14:09:48 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[253b3fda-7b5c-4354-91e0-127a89b5a03d]: (4, '') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:09:48 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-fd8a252f-15dc-41ec-aaa3-dfa74ff0b47e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72129) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 14:09:48 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-fd8a252f-15dc-41ec-aaa3-dfa74ff0b47e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 14:09:48 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-fd8a252f-15dc-41ec-aaa3-dfa74ff0b47e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] LIGHTOS: no hostnqn found. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 14:09:48 user nova-compute[72129]: DEBUG os_brick.utils [None req-fd8a252f-15dc-41ec-aaa3-dfa74ff0b47e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f9b449c2cd3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:09:48 user nova-compute[72129]: DEBUG nova.virt.block_device [None req-fd8a252f-15dc-41ec-aaa3-dfa74ff0b47e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Updating existing volume attachment record: 2db3dcfb-e6bc-4a94-8de2-056af9267765 {{(pid=72129) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 14:09:48 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:09:51 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:09:53 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:09:53 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Starting heal instance info cache {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 14:09:53 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Rebuilding the list of instances to heal {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 14:09:53 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "refresh_cache-0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:09:53 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquired lock "refresh_cache-0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:09:53 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Forcefully refreshing network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 14:09:53 user nova-compute[72129]: DEBUG nova.objects.instance [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lazy-loading 'info_cache' on Instance uuid 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:09:53 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:09:53 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Updating instance_info_cache with network_info: [{"id": "d4f68f78-6df9-41b7-8d32-27f55f224683", "address": "fa:16:3e:23:49:b3", "network": {"id": "59b1e538-8bfe-45ce-ab7b-c5838ab25582", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1129024349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0929886fa54d1c8023793806f10d31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f68f78-6d", "ovs_interfaceid": "d4f68f78-6df9-41b7-8d32-27f55f224683", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:09:53 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Releasing lock "refresh_cache-0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:09:53 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Updated the network info_cache for instance {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 14:09:53 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:09:53 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:09:53 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72129) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 14:09:54 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:09:54 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:09:55 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:09:55 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:09:56 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:09:56 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:09:56 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd8a252f-15dc-41ec-aaa3-dfa74ff0b47e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Calling os-brick to attach iSCSI Volume {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 14:09:56 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8a252f-15dc-41ec-aaa3-dfa74ff0b47e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7d2edd53-4294-44e1-8c0e-145f38bdeed0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HqYpQeCS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:09:56 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-fd8a252f-15dc-41ec-aaa3-dfa74ff0b47e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:09:56 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-fd8a252f-15dc-41ec-aaa3-dfa74ff0b47e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:09:56 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-fd8a252f-15dc-41ec-aaa3-dfa74ff0b47e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:09:56 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-fd8a252f-15dc-41ec-aaa3-dfa74ff0b47e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:09:56 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-fd8a252f-15dc-41ec-aaa3-dfa74ff0b47e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d2edd53-4294-44e1-8c0e-145f38bdeed0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:09:56 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-fd8a252f-15dc-41ec-aaa3-dfa74ff0b47e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d2edd53-4294-44e1-8c0e-145f38bdeed0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:09:56 user nova-compute[72129]: INFO os_brick.initiator.connectors.iscsi [None req-fd8a252f-15dc-41ec-aaa3-dfa74ff0b47e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 14:09:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d2edd53-4294-44e1-8c0e-145f38bdeed0 -p 172.16.0.220:3260 {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:09:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d2edd53-4294-44e1-8c0e-145f38bdeed0 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:09:56 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51108bf-0227-443b-9517-448a443ca93b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:09:56 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8a252f-15dc-41ec-aaa3-dfa74ff0b47e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 14:09:56 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:09:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d2edd53-4294-44e1-8c0e-145f38bdeed0 -p 172.16.0.220:3260 --interface default --op new {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:09:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d2edd53-4294-44e1-8c0e-145f38bdeed0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:09:56 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e41fa4-dbba-43a5-b4bf-392169255573]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7d2edd53-4294-44e1-8c0e-145f38bdeed0] added\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:09:56 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8a252f-15dc-41ec-aaa3-dfa74ff0b47e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7d2edd53-4294-44e1-8c0e-145f38bdeed0] added
Aug 01 14:09:56 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:09:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d2edd53-4294-44e1-8c0e-145f38bdeed0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:09:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d2edd53-4294-44e1-8c0e-145f38bdeed0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:09:56 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb86914-728a-4a4d-9f0f-07765d57258a]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:09:56 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8a252f-15dc-41ec-aaa3-dfa74ff0b47e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:09:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d2edd53-4294-44e1-8c0e-145f38bdeed0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:09:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d2edd53-4294-44e1-8c0e-145f38bdeed0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:09:56 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[de39a30d-5171-4883-90fd-976192a9ce90]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:09:56 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8a252f-15dc-41ec-aaa3-dfa74ff0b47e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:09:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d2edd53-4294-44e1-8c0e-145f38bdeed0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HqYpQeCS {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:09:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d2edd53-4294-44e1-8c0e-145f38bdeed0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HqYpQeCS" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:09:56 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[155fbcdc-1750-49a4-978b-044a741a9047]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:09:56 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8a252f-15dc-41ec-aaa3-dfa74ff0b47e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HqYpQeCS'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:09:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d2edd53-4294-44e1-8c0e-145f38bdeed0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:09:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d2edd53-4294-44e1-8c0e-145f38bdeed0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:09:56 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0cf33ea-7762-41e0-af0d-c65ef9853aa4]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:09:56 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8a252f-15dc-41ec-aaa3-dfa74ff0b47e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:09:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:09:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:09:56 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac16857-7c87-4142-bd2a-fb4deeeec6cd]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36250716-f9fe-4c6e-8fac-cf3988b48ece (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09638671-1c3f-44c9-97d0-e9c48dc7f808 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:09:56 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8a252f-15dc-41ec-aaa3-dfa74ff0b47e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:09:56 user nova-compute[72129]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 (non-flash)
Aug 01 14:09:56 user nova-compute[72129]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 (non-flash)
Aug 01 14:09:56 user nova-compute[72129]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36250716-f9fe-4c6e-8fac-cf3988b48ece (non-flash)
Aug 01 14:09:56 user nova-compute[72129]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09638671-1c3f-44c9-97d0-e9c48dc7f808 (non-flash)
Aug 01 14:09:56 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:09:56 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8a252f-15dc-41ec-aaa3-dfa74ff0b47e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:09:56 user nova-compute[72129]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 (non-flash)
Aug 01 14:09:56 user nova-compute[72129]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 (non-flash)
Aug 01 14:09:56 user nova-compute[72129]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36250716-f9fe-4c6e-8fac-cf3988b48ece (non-flash)
Aug 01 14:09:56 user nova-compute[72129]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09638671-1c3f-44c9-97d0-e9c48dc7f808 (non-flash)
Aug 01 14:09:56 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:09:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d2edd53-4294-44e1-8c0e-145f38bdeed0 -p 172.16.0.220:3260 --login {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:09:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d2edd53-4294-44e1-8c0e-145f38bdeed0 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:09:56 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d0b1d7-5a3d-4f06-8461-acf8a48d4b86]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7d2edd53-4294-44e1-8c0e-145f38bdeed0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7d2edd53-4294-44e1-8c0e-145f38bdeed0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:09:56 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8a252f-15dc-41ec-aaa3-dfa74ff0b47e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7d2edd53-4294-44e1-8c0e-145f38bdeed0, portal: 172.16.0.220,3260]
Aug 01 14:09:56 user nova-compute[72129]: Login to [iface: default, target: iqn.2010-10.org.openstack:7d2edd53-4294-44e1-8c0e-145f38bdeed0, portal: 172.16.0.220,3260] successful.
Aug 01 14:09:56 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:09:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d2edd53-4294-44e1-8c0e-145f38bdeed0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:09:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d2edd53-4294-44e1-8c0e-145f38bdeed0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:09:56 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d48900-f54b-4ec1-9b2b-96f6f82c11ef]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:09:56 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8a252f-15dc-41ec-aaa3-dfa74ff0b47e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:09:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:09:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:09:56 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[5839dc86-e632-4856-b759-cb153274961c]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36250716-f9fe-4c6e-8fac-cf3988b48ece (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09638671-1c3f-44c9-97d0-e9c48dc7f808 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2edd53-4294-44e1-8c0e-145f38bdeed0 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:09:56 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8a252f-15dc-41ec-aaa3-dfa74ff0b47e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:09:56 user nova-compute[72129]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 (non-flash)
Aug 01 14:09:56 user nova-compute[72129]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 (non-flash)
Aug 01 14:09:56 user nova-compute[72129]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36250716-f9fe-4c6e-8fac-cf3988b48ece (non-flash)
Aug 01 14:09:56 user nova-compute[72129]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09638671-1c3f-44c9-97d0-e9c48dc7f808 (non-flash)
Aug 01 14:09:56 user nova-compute[72129]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2edd53-4294-44e1-8c0e-145f38bdeed0 (non-flash)
Aug 01 14:09:56 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:09:56 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8a252f-15dc-41ec-aaa3-dfa74ff0b47e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:09:56 user nova-compute[72129]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 (non-flash)
Aug 01 14:09:56 user nova-compute[72129]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 (non-flash)
Aug 01 14:09:56 user nova-compute[72129]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36250716-f9fe-4c6e-8fac-cf3988b48ece (non-flash)
Aug 01 14:09:56 user nova-compute[72129]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09638671-1c3f-44c9-97d0-e9c48dc7f808 (non-flash)
Aug 01 14:09:56 user nova-compute[72129]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2edd53-4294-44e1-8c0e-145f38bdeed0 (non-flash)
Aug 01 14:09:56 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:09:56 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-fd8a252f-15dc-41ec-aaa3-dfa74ff0b47e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d2edd53-4294-44e1-8c0e-145f38bdeed0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:09:56 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8a252f-15dc-41ec-aaa3-dfa74ff0b47e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Connected to 172.16.0.220:3260 {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 14:09:56 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-fd8a252f-15dc-41ec-aaa3-dfa74ff0b47e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] HCTL ('38', '-', '-', 0) found on session 48 with lun 0 {{(pid=72129) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 14:09:56 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-fd8a252f-15dc-41ec-aaa3-dfa74ff0b47e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72129) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 14:09:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:09:56 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:09:56 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a27762-a8a8-4997-91a4-e2ab3e361e39]: (4, ('- - 0', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:09:56 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-fd8a252f-15dc-41ec-aaa3-dfa74ff0b47e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Searching for a device in session 48 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 14:09:56 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8a252f-15dc-41ec-aaa3-dfa74ff0b47e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HqYpQeCS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 14:09:56 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:09:57 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:09:57 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:09:57 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:09:57 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:09:57 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Auditing locally available compute resources for user (node: user) {{(pid=72129) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 14:09:57 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 14:09:57 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:09:57 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:09:57 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:09:57 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:09:57 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3a73214-dad3-44d1-adc3-312970a919e5/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:09:57 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3a73214-dad3-44d1-adc3-312970a919e5/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:09:57 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3a73214-dad3-44d1-adc3-312970a919e5/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:09:57 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-fd8a252f-15dc-41ec-aaa3-dfa74ff0b47e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:09:57 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd8a252f-15dc-41ec-aaa3-dfa74ff0b47e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '26238313839306231', 'path': '/dev/sdg'} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:09:57 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd8a252f-15dc-41ec-aaa3-dfa74ff0b47e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26238313839306231', 'path': '/dev/sdg'} {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 14:09:57 user nova-compute[72129]: DEBUG nova.objects.instance [None req-fd8a252f-15dc-41ec-aaa3-dfa74ff0b47e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lazy-loading 'flavor' on Instance uuid e3a73214-dad3-44d1-adc3-312970a919e5 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:09:57 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-fd8a252f-15dc-41ec-aaa3-dfa74ff0b47e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 14:09:57 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:09:57 user nova-compute[72129]:   <source dev="/dev/sdg"/>
Aug 01 14:09:57 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 14:09:57 user nova-compute[72129]:   <serial>7d2edd53-4294-44e1-8c0e-145f38bdeed0</serial>
Aug 01 14:09:57 user nova-compute[72129]: </disk>
Aug 01 14:09:57 user nova-compute[72129]:  {{(pid=72129) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 14:09:57 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3a73214-dad3-44d1-adc3-312970a919e5/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:09:57 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c43fda3-e098-4c3a-bcd5-14eac019db06/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:09:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c43fda3-e098-4c3a-bcd5-14eac019db06/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:09:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c43fda3-e098-4c3a-bcd5-14eac019db06/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:09:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c43fda3-e098-4c3a-bcd5-14eac019db06/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:09:58 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 14:09:58 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 14:09:58 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:09:58 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-fd8a252f-15dc-41ec-aaa3-dfa74ff0b47e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:09:58 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-fd8a252f-15dc-41ec-aaa3-dfa74ff0b47e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:09:58 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-fd8a252f-15dc-41ec-aaa3-dfa74ff0b47e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] No VIF found with MAC fa:16:3e:16:8b:06, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 14:09:58 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:09:58 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:09:58 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Hypervisor/Node resource view: name=user free_ram=8024MB free_disk=25.03429412841797GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72129) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 14:09:58 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:09:58 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:09:58 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:09:58 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance d031973f-8f48-43b3-a338-040950103e4c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:09:58 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 0c43fda3-e098-4c3a-bcd5-14eac019db06 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:09:58 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 418f4c53-9dc5-402f-ad21-ac481674b083 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:09:58 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance e3a73214-dad3-44d1-adc3-312970a919e5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:09:58 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:09:58 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 14:09:58 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 14:09:58 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-fd8a252f-15dc-41ec-aaa3-dfa74ff0b47e tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "e3a73214-dad3-44d1-adc3-312970a919e5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.839s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:09:59 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:09:59 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:09:59 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Compute_service record updated for user:user {{(pid=72129) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 14:09:59 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.413s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:10:01 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:10:03 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:10:03 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9526f06a-a390-48c0-8310-cd1b7dfac6f3 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Acquiring lock "e3a73214-dad3-44d1-adc3-312970a919e5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:10:03 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9526f06a-a390-48c0-8310-cd1b7dfac6f3 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "e3a73214-dad3-44d1-adc3-312970a919e5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:10:03 user nova-compute[72129]: DEBUG nova.objects.instance [None req-9526f06a-a390-48c0-8310-cd1b7dfac6f3 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lazy-loading 'flavor' on Instance uuid e3a73214-dad3-44d1-adc3-312970a919e5 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:10:03 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9526f06a-a390-48c0-8310-cd1b7dfac6f3 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "e3a73214-dad3-44d1-adc3-312970a919e5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:10:03 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9526f06a-a390-48c0-8310-cd1b7dfac6f3 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Acquiring lock "e3a73214-dad3-44d1-adc3-312970a919e5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:10:03 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9526f06a-a390-48c0-8310-cd1b7dfac6f3 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "e3a73214-dad3-44d1-adc3-312970a919e5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:10:03 user nova-compute[72129]: INFO nova.compute.manager [None req-9526f06a-a390-48c0-8310-cd1b7dfac6f3 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Attaching volume 945c6cd8-9048-4880-b1f8-6d1ca591b594 to /dev/vdc
Aug 01 14:10:03 user nova-compute[72129]: DEBUG os_brick.utils [None req-9526f06a-a390-48c0-8310-cd1b7dfac6f3 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:10:03 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:10:04 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:10:04 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c44f20-53e3-44cd-8722-e6a99fae8bba]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f9b449c2cd3d\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:10:04 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:10:04 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:10:04 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[038c69b2-5799-480a-a2bf-7f94444ce26f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:10:04 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:10:04 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:10:04 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e457d58-a2eb-4e70-8f84-443b5338d08f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:10:04 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f85703-cb6e-4879-bfde-cbe3bc1e4836]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:10:04 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-9526f06a-a390-48c0-8310-cd1b7dfac6f3 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Running cmd (subprocess): nvme version {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:10:04 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-9526f06a-a390-48c0-8310-cd1b7dfac6f3 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] 'nvme version' failed. Not Retrying. {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 14:10:04 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9526f06a-a390-48c0-8310-cd1b7dfac6f3 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] nvme not present on system {{(pid=72129) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 14:10:04 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:10:04 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 14:10:04 user nova-compute[72129]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 14:10:04 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[35541941-1e7c-43e2-8ef3-b265fd418b8d]: (4, '') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:10:04 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-9526f06a-a390-48c0-8310-cd1b7dfac6f3 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72129) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 14:10:04 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-9526f06a-a390-48c0-8310-cd1b7dfac6f3 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 14:10:04 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-9526f06a-a390-48c0-8310-cd1b7dfac6f3 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] LIGHTOS: no hostnqn found. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 14:10:04 user nova-compute[72129]: DEBUG os_brick.utils [None req-9526f06a-a390-48c0-8310-cd1b7dfac6f3 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f9b449c2cd3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:10:04 user nova-compute[72129]: DEBUG nova.virt.block_device [None req-9526f06a-a390-48c0-8310-cd1b7dfac6f3 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Updating existing volume attachment record: 2626997e-cc2c-427c-9258-734a4fbd1190 {{(pid=72129) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 14:10:08 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:10:11 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9526f06a-a390-48c0-8310-cd1b7dfac6f3 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Calling os-brick to attach iSCSI Volume {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 14:10:11 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9526f06a-a390-48c0-8310-cd1b7dfac6f3 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:945c6cd8-9048-4880-b1f8-6d1ca591b594'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MqYgHVSJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:10:11 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-9526f06a-a390-48c0-8310-cd1b7dfac6f3 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:10:11 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-9526f06a-a390-48c0-8310-cd1b7dfac6f3 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:10:11 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-9526f06a-a390-48c0-8310-cd1b7dfac6f3 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:10:11 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-9526f06a-a390-48c0-8310-cd1b7dfac6f3 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:10:11 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-9526f06a-a390-48c0-8310-cd1b7dfac6f3 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:945c6cd8-9048-4880-b1f8-6d1ca591b594" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:10:11 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-9526f06a-a390-48c0-8310-cd1b7dfac6f3 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:945c6cd8-9048-4880-b1f8-6d1ca591b594" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:10:11 user nova-compute[72129]: INFO os_brick.initiator.connectors.iscsi [None req-9526f06a-a390-48c0-8310-cd1b7dfac6f3 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 14:10:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:945c6cd8-9048-4880-b1f8-6d1ca591b594 -p 172.16.0.220:3260 {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:10:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:945c6cd8-9048-4880-b1f8-6d1ca591b594 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:10:11 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e622fd-7092-4d5c-911f-ebc51b3a5c41]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:10:11 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9526f06a-a390-48c0-8310-cd1b7dfac6f3 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 14:10:11 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:10:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:945c6cd8-9048-4880-b1f8-6d1ca591b594 -p 172.16.0.220:3260 --interface default --op new {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:10:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:945c6cd8-9048-4880-b1f8-6d1ca591b594 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:10:11 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ffd32c8-944d-47bc-a753-9a7628a64a4c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:945c6cd8-9048-4880-b1f8-6d1ca591b594] added\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:10:11 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9526f06a-a390-48c0-8310-cd1b7dfac6f3 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:945c6cd8-9048-4880-b1f8-6d1ca591b594] added
Aug 01 14:10:11 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:10:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:945c6cd8-9048-4880-b1f8-6d1ca591b594 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:10:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:945c6cd8-9048-4880-b1f8-6d1ca591b594 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:10:11 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cee0cf5-de62-44a9-bbb6-1deb025e2d2b]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:10:11 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9526f06a-a390-48c0-8310-cd1b7dfac6f3 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:10:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:945c6cd8-9048-4880-b1f8-6d1ca591b594 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:10:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:945c6cd8-9048-4880-b1f8-6d1ca591b594 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:10:11 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ed5419-3ba5-4659-8ce3-701b90b16071]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:10:11 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9526f06a-a390-48c0-8310-cd1b7dfac6f3 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:10:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:945c6cd8-9048-4880-b1f8-6d1ca591b594 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MqYgHVSJ {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:10:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:945c6cd8-9048-4880-b1f8-6d1ca591b594 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MqYgHVSJ" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:10:11 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9f6a7e-db69-40fa-a0b0-8a3aacdb8408]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:10:11 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9526f06a-a390-48c0-8310-cd1b7dfac6f3 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MqYgHVSJ'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:10:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:945c6cd8-9048-4880-b1f8-6d1ca591b594 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:10:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:945c6cd8-9048-4880-b1f8-6d1ca591b594 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:10:11 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee18718-e8eb-44c3-bef2-7b4529177765]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:10:11 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9526f06a-a390-48c0-8310-cd1b7dfac6f3 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:10:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:10:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:10:11 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[10bd703e-d8b4-45a4-b74c-080c5ccbac9a]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2edd53-4294-44e1-8c0e-145f38bdeed0 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:10:11 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9526f06a-a390-48c0-8310-cd1b7dfac6f3 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:10:11 user nova-compute[72129]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 (non-flash)
Aug 01 14:10:11 user nova-compute[72129]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 (non-flash)
Aug 01 14:10:11 user nova-compute[72129]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2edd53-4294-44e1-8c0e-145f38bdeed0 (non-flash)
Aug 01 14:10:11 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:10:11 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9526f06a-a390-48c0-8310-cd1b7dfac6f3 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:10:11 user nova-compute[72129]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 (non-flash)
Aug 01 14:10:11 user nova-compute[72129]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 (non-flash)
Aug 01 14:10:11 user nova-compute[72129]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2edd53-4294-44e1-8c0e-145f38bdeed0 (non-flash)
Aug 01 14:10:11 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:10:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:945c6cd8-9048-4880-b1f8-6d1ca591b594 -p 172.16.0.220:3260 --login {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:10:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:945c6cd8-9048-4880-b1f8-6d1ca591b594 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:10:11 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[461ea41b-c2ba-4586-b8c0-3b50e863ad3a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:945c6cd8-9048-4880-b1f8-6d1ca591b594, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:945c6cd8-9048-4880-b1f8-6d1ca591b594, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:10:11 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9526f06a-a390-48c0-8310-cd1b7dfac6f3 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:945c6cd8-9048-4880-b1f8-6d1ca591b594, portal: 172.16.0.220,3260]
Aug 01 14:10:11 user nova-compute[72129]: Login to [iface: default, target: iqn.2010-10.org.openstack:945c6cd8-9048-4880-b1f8-6d1ca591b594, portal: 172.16.0.220,3260] successful.
Aug 01 14:10:11 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:10:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:945c6cd8-9048-4880-b1f8-6d1ca591b594 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:10:12 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:945c6cd8-9048-4880-b1f8-6d1ca591b594 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:10:12 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f9077e5-075c-488f-8e02-4edfefb2f1b0]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:10:12 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9526f06a-a390-48c0-8310-cd1b7dfac6f3 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:10:12 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:10:12 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:10:12 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a617732-6cbd-4b04-b072-3da1b0a957f7]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2edd53-4294-44e1-8c0e-145f38bdeed0 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:945c6cd8-9048-4880-b1f8-6d1ca591b594 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:10:12 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9526f06a-a390-48c0-8310-cd1b7dfac6f3 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:10:12 user nova-compute[72129]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 (non-flash)
Aug 01 14:10:12 user nova-compute[72129]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 (non-flash)
Aug 01 14:10:12 user nova-compute[72129]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2edd53-4294-44e1-8c0e-145f38bdeed0 (non-flash)
Aug 01 14:10:12 user nova-compute[72129]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:945c6cd8-9048-4880-b1f8-6d1ca591b594 (non-flash)
Aug 01 14:10:12 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:10:12 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9526f06a-a390-48c0-8310-cd1b7dfac6f3 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:10:12 user nova-compute[72129]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 (non-flash)
Aug 01 14:10:12 user nova-compute[72129]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 (non-flash)
Aug 01 14:10:12 user nova-compute[72129]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2edd53-4294-44e1-8c0e-145f38bdeed0 (non-flash)
Aug 01 14:10:12 user nova-compute[72129]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:945c6cd8-9048-4880-b1f8-6d1ca591b594 (non-flash)
Aug 01 14:10:12 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:10:12 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-9526f06a-a390-48c0-8310-cd1b7dfac6f3 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:945c6cd8-9048-4880-b1f8-6d1ca591b594" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:10:12 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9526f06a-a390-48c0-8310-cd1b7dfac6f3 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Connected to 172.16.0.220:3260 {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 14:10:12 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-9526f06a-a390-48c0-8310-cd1b7dfac6f3 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] HCTL ('36', '-', '-', 0) found on session 49 with lun 0 {{(pid=72129) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 14:10:12 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-9526f06a-a390-48c0-8310-cd1b7dfac6f3 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72129) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 14:10:12 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:10:12 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:10:12 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4e52eb-b060-40a6-b4e6-5a044b33e8f4]: (4, ('- - 0', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:10:12 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-9526f06a-a390-48c0-8310-cd1b7dfac6f3 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Searching for a device in session 49 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 14:10:12 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9526f06a-a390-48c0-8310-cd1b7dfac6f3 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MqYgHVSJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 14:10:13 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-9526f06a-a390-48c0-8310-cd1b7dfac6f3 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:10:13 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9526f06a-a390-48c0-8310-cd1b7dfac6f3 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '23234393832316638', 'path': '/dev/sde'} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:10:13 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9526f06a-a390-48c0-8310-cd1b7dfac6f3 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234393832316638', 'path': '/dev/sde'} {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 14:10:13 user nova-compute[72129]: DEBUG nova.objects.instance [None req-9526f06a-a390-48c0-8310-cd1b7dfac6f3 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lazy-loading 'flavor' on Instance uuid e3a73214-dad3-44d1-adc3-312970a919e5 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:10:13 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-9526f06a-a390-48c0-8310-cd1b7dfac6f3 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 14:10:13 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:10:13 user nova-compute[72129]:   <source dev="/dev/sde"/>
Aug 01 14:10:13 user nova-compute[72129]:   <target dev="vdc" bus="virtio"/>
Aug 01 14:10:13 user nova-compute[72129]:   <serial>945c6cd8-9048-4880-b1f8-6d1ca591b594</serial>
Aug 01 14:10:13 user nova-compute[72129]: </disk>
Aug 01 14:10:13 user nova-compute[72129]:  {{(pid=72129) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 14:10:13 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9526f06a-a390-48c0-8310-cd1b7dfac6f3 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:10:13 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9526f06a-a390-48c0-8310-cd1b7dfac6f3 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:10:13 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9526f06a-a390-48c0-8310-cd1b7dfac6f3 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:10:13 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9526f06a-a390-48c0-8310-cd1b7dfac6f3 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] No VIF found with MAC fa:16:3e:16:8b:06, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 14:10:13 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9526f06a-a390-48c0-8310-cd1b7dfac6f3 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "e3a73214-dad3-44d1-adc3-312970a919e5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.777s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:10:13 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:10:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-547a53d9-a001-4741-920a-a7e795c54595 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Acquiring lock "e3a73214-dad3-44d1-adc3-312970a919e5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:10:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-547a53d9-a001-4741-920a-a7e795c54595 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "e3a73214-dad3-44d1-adc3-312970a919e5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:10:15 user nova-compute[72129]: INFO nova.compute.manager [None req-547a53d9-a001-4741-920a-a7e795c54595 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Detaching volume 7d2edd53-4294-44e1-8c0e-145f38bdeed0
Aug 01 14:10:15 user nova-compute[72129]: INFO nova.virt.block_device [None req-547a53d9-a001-4741-920a-a7e795c54595 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Attempting to driver detach volume 7d2edd53-4294-44e1-8c0e-145f38bdeed0 from mountpoint /dev/vdb
Aug 01 14:10:15 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-547a53d9-a001-4741-920a-a7e795c54595 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Attempting to detach device vdb from instance e3a73214-dad3-44d1-adc3-312970a919e5 from the persistent domain config. {{(pid=72129) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 14:10:15 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-547a53d9-a001-4741-920a-a7e795c54595 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 14:10:15 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:10:15 user nova-compute[72129]:   <source dev="/dev/sdg"/>
Aug 01 14:10:15 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 14:10:15 user nova-compute[72129]:   <serial>7d2edd53-4294-44e1-8c0e-145f38bdeed0</serial>
Aug 01 14:10:15 user nova-compute[72129]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 14:10:15 user nova-compute[72129]: </disk>
Aug 01 14:10:15 user nova-compute[72129]:  {{(pid=72129) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 14:10:15 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-547a53d9-a001-4741-920a-a7e795c54595 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Successfully detached device vdb from instance e3a73214-dad3-44d1-adc3-312970a919e5 from the persistent domain config.
Aug 01 14:10:15 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-547a53d9-a001-4741-920a-a7e795c54595 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e3a73214-dad3-44d1-adc3-312970a919e5 from the live domain config. {{(pid=72129) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 14:10:15 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-547a53d9-a001-4741-920a-a7e795c54595 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 14:10:15 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:10:15 user nova-compute[72129]:   <source dev="/dev/sdg"/>
Aug 01 14:10:15 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 14:10:15 user nova-compute[72129]:   <serial>7d2edd53-4294-44e1-8c0e-145f38bdeed0</serial>
Aug 01 14:10:15 user nova-compute[72129]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 14:10:15 user nova-compute[72129]: </disk>
Aug 01 14:10:15 user nova-compute[72129]:  {{(pid=72129) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 14:10:15 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Received event <DeviceRemovedEvent: 1690899015.8418827, e3a73214-dad3-44d1-adc3-312970a919e5 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72129) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 14:10:15 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-547a53d9-a001-4741-920a-a7e795c54595 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e3a73214-dad3-44d1-adc3-312970a919e5 {{(pid=72129) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 14:10:15 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-547a53d9-a001-4741-920a-a7e795c54595 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Successfully detached device vdb from instance e3a73214-dad3-44d1-adc3-312970a919e5 from the live domain config.
Aug 01 14:10:15 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-547a53d9-a001-4741-920a-a7e795c54595 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] calling os-brick to detach iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 14:10:15 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-547a53d9-a001-4741-920a-a7e795c54595 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, {'target_iqns': ['iqn.2010-10.org.openstack:7d2edd53-4294-44e1-8c0e-145f38bdeed0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HqYpQeCS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:10:15 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-547a53d9-a001-4741-920a-a7e795c54595 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:10:15 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-547a53d9-a001-4741-920a-a7e795c54595 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:10:15 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-547a53d9-a001-4741-920a-a7e795c54595 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:10:15 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-547a53d9-a001-4741-920a-a7e795c54595 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d2edd53-4294-44e1-8c0e-145f38bdeed0', 0)] {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 14:10:15 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:10:15 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:10:15 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f28697-1a6c-46d8-9d14-bff913de06e6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d2edd53-4294-44e1-8c0e-145f38bdeed0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:945c6cd8-9048-4880-b1f8-6d1ca591b594\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:10:15 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:10:15 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:10:15 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63b01e7-8790-4faa-8575-5e31dcf7dd7d]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2edd53-4294-44e1-8c0e-145f38bdeed0 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:945c6cd8-9048-4880-b1f8-6d1ca591b594 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:10:15 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-547a53d9-a001-4741-920a-a7e795c54595 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:10:15 user nova-compute[72129]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 (non-flash)
Aug 01 14:10:15 user nova-compute[72129]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 (non-flash)
Aug 01 14:10:15 user nova-compute[72129]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2edd53-4294-44e1-8c0e-145f38bdeed0 (non-flash)
Aug 01 14:10:15 user nova-compute[72129]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:945c6cd8-9048-4880-b1f8-6d1ca591b594 (non-flash)
Aug 01 14:10:15 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:10:15 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-547a53d9-a001-4741-920a-a7e795c54595 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:10:15 user nova-compute[72129]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 (non-flash)
Aug 01 14:10:15 user nova-compute[72129]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 (non-flash)
Aug 01 14:10:15 user nova-compute[72129]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d2edd53-4294-44e1-8c0e-145f38bdeed0 (non-flash)
Aug 01 14:10:15 user nova-compute[72129]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:945c6cd8-9048-4880-b1f8-6d1ca591b594 (non-flash)
Aug 01 14:10:15 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:10:15 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-547a53d9-a001-4741-920a-a7e795c54595 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2810422200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d2edd53-4294-44e1-8c0e-145f38bdeed0'): ({'sdg'}, set())}) {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 14:10:15 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-547a53d9-a001-4741-920a-a7e795c54595 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Removing single pathed devices sdg {{(pid=72129) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 14:10:15 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:10:15 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:10:15 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea83e45-3d29-4411-9a2b-928ba490aa2e]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:10:15 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:10:15 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:10:15 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d4d706-a902-4edc-b438-d13224a65e8d]: (4, ('ok\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:10:15 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-547a53d9-a001-4741-920a-a7e795c54595 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Flushing IO for device /dev/sdg {{(pid=72129) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 14:10:15 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:10:15 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:10:15 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[30171aa4-6234-4e13-b866-5ff8a4c5d65f]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:10:15 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-547a53d9-a001-4741-920a-a7e795c54595 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72129) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 14:10:15 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:10:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.052s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:10:16 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[034b0e03-92ff-4076-90d0-2c7e0a2bdf70]: (4, ('1', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:10:16 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-547a53d9-a001-4741-920a-a7e795c54595 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 14:10:16 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-547a53d9-a001-4741-920a-a7e795c54595 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] SCSI volumes sdg have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 14:10:16 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-547a53d9-a001-4741-920a-a7e795c54595 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d2edd53-4294-44e1-8c0e-145f38bdeed0')] {{(pid=72129) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 14:10:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d2edd53-4294-44e1-8c0e-145f38bdeed0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:10:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d2edd53-4294-44e1-8c0e-145f38bdeed0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:10:16 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dbdfc5e-374a-4fea-8549-6f8e4a4b585a]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:10:16 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-547a53d9-a001-4741-920a-a7e795c54595 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:10:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d2edd53-4294-44e1-8c0e-145f38bdeed0 -p 172.16.0.220:3260 --logout {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:10:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d2edd53-4294-44e1-8c0e-145f38bdeed0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:10:16 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7ddb62-1bcf-4880-964a-c921442a6618]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:7d2edd53-4294-44e1-8c0e-145f38bdeed0, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:7d2edd53-4294-44e1-8c0e-145f38bdeed0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:10:16 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-547a53d9-a001-4741-920a-a7e795c54595 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:7d2edd53-4294-44e1-8c0e-145f38bdeed0, portal: 172.16.0.220,3260]
Aug 01 14:10:16 user nova-compute[72129]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:7d2edd53-4294-44e1-8c0e-145f38bdeed0, portal: 172.16.0.220,3260] successful.
Aug 01 14:10:16 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:10:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d2edd53-4294-44e1-8c0e-145f38bdeed0 -p 172.16.0.220:3260 --op delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:10:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d2edd53-4294-44e1-8c0e-145f38bdeed0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:10:16 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[262a2f30-d63a-4305-bc6b-96c0d266a3c4]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:10:16 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-547a53d9-a001-4741-920a-a7e795c54595 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:10:16 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-547a53d9-a001-4741-920a-a7e795c54595 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:10:16 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-547a53d9-a001-4741-920a-a7e795c54595 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] <== disconnect_volume: return (301ms) None {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:10:16 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-547a53d9-a001-4741-920a-a7e795c54595 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Disconnected iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 14:10:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:10:16 user nova-compute[72129]: DEBUG nova.objects.instance [None req-547a53d9-a001-4741-920a-a7e795c54595 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lazy-loading 'flavor' on Instance uuid e3a73214-dad3-44d1-adc3-312970a919e5 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:10:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-547a53d9-a001-4741-920a-a7e795c54595 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "e3a73214-dad3-44d1-adc3-312970a919e5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.654s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:10:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-1f656129-a102-4c65-a7da-b8b8bca51e06 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Acquiring lock "e3a73214-dad3-44d1-adc3-312970a919e5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:10:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-1f656129-a102-4c65-a7da-b8b8bca51e06 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "e3a73214-dad3-44d1-adc3-312970a919e5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:10:17 user nova-compute[72129]: INFO nova.compute.manager [None req-1f656129-a102-4c65-a7da-b8b8bca51e06 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Detaching volume 945c6cd8-9048-4880-b1f8-6d1ca591b594
Aug 01 14:10:17 user nova-compute[72129]: INFO nova.virt.block_device [None req-1f656129-a102-4c65-a7da-b8b8bca51e06 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Attempting to driver detach volume 945c6cd8-9048-4880-b1f8-6d1ca591b594 from mountpoint /dev/vdc
Aug 01 14:10:17 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-1f656129-a102-4c65-a7da-b8b8bca51e06 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Attempting to detach device vdc from instance e3a73214-dad3-44d1-adc3-312970a919e5 from the persistent domain config. {{(pid=72129) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 14:10:17 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-1f656129-a102-4c65-a7da-b8b8bca51e06 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 14:10:17 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:10:17 user nova-compute[72129]:   <source dev="/dev/sde"/>
Aug 01 14:10:17 user nova-compute[72129]:   <target dev="vdc" bus="virtio"/>
Aug 01 14:10:17 user nova-compute[72129]:   <serial>945c6cd8-9048-4880-b1f8-6d1ca591b594</serial>
Aug 01 14:10:17 user nova-compute[72129]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 01 14:10:17 user nova-compute[72129]: </disk>
Aug 01 14:10:17 user nova-compute[72129]:  {{(pid=72129) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 14:10:17 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-1f656129-a102-4c65-a7da-b8b8bca51e06 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Successfully detached device vdc from instance e3a73214-dad3-44d1-adc3-312970a919e5 from the persistent domain config.
Aug 01 14:10:17 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-1f656129-a102-4c65-a7da-b8b8bca51e06 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance e3a73214-dad3-44d1-adc3-312970a919e5 from the live domain config. {{(pid=72129) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 14:10:17 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-1f656129-a102-4c65-a7da-b8b8bca51e06 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 14:10:17 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:10:17 user nova-compute[72129]:   <source dev="/dev/sde"/>
Aug 01 14:10:17 user nova-compute[72129]:   <target dev="vdc" bus="virtio"/>
Aug 01 14:10:17 user nova-compute[72129]:   <serial>945c6cd8-9048-4880-b1f8-6d1ca591b594</serial>
Aug 01 14:10:17 user nova-compute[72129]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 01 14:10:17 user nova-compute[72129]: </disk>
Aug 01 14:10:17 user nova-compute[72129]:  {{(pid=72129) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 14:10:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Received event <DeviceRemovedEvent: 1690899018.2737496, e3a73214-dad3-44d1-adc3-312970a919e5 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72129) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 14:10:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-1f656129-a102-4c65-a7da-b8b8bca51e06 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance e3a73214-dad3-44d1-adc3-312970a919e5 {{(pid=72129) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 14:10:18 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-1f656129-a102-4c65-a7da-b8b8bca51e06 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Successfully detached device vdc from instance e3a73214-dad3-44d1-adc3-312970a919e5 from the live domain config.
Aug 01 14:10:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f656129-a102-4c65-a7da-b8b8bca51e06 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] calling os-brick to detach iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 14:10:18 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f656129-a102-4c65-a7da-b8b8bca51e06 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, {'target_iqns': ['iqn.2010-10.org.openstack:945c6cd8-9048-4880-b1f8-6d1ca591b594'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MqYgHVSJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:10:18 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-1f656129-a102-4c65-a7da-b8b8bca51e06 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:10:18 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-1f656129-a102-4c65-a7da-b8b8bca51e06 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:10:18 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-1f656129-a102-4c65-a7da-b8b8bca51e06 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:10:18 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f656129-a102-4c65-a7da-b8b8bca51e06 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:945c6cd8-9048-4880-b1f8-6d1ca591b594', 0)] {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 14:10:18 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:10:18 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:10:18 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a89197e-c6d5-447d-abc2-91bb4da9696e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:945c6cd8-9048-4880-b1f8-6d1ca591b594\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:10:18 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:10:18 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:10:18 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d54393c-a977-4267-8129-fd15ef58244d]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:945c6cd8-9048-4880-b1f8-6d1ca591b594 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:10:18 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f656129-a102-4c65-a7da-b8b8bca51e06 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:10:18 user nova-compute[72129]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 (non-flash)
Aug 01 14:10:18 user nova-compute[72129]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 (non-flash)
Aug 01 14:10:18 user nova-compute[72129]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:945c6cd8-9048-4880-b1f8-6d1ca591b594 (non-flash)
Aug 01 14:10:18 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:10:18 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f656129-a102-4c65-a7da-b8b8bca51e06 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:10:18 user nova-compute[72129]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 (non-flash)
Aug 01 14:10:18 user nova-compute[72129]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 (non-flash)
Aug 01 14:10:18 user nova-compute[72129]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:945c6cd8-9048-4880-b1f8-6d1ca591b594 (non-flash)
Aug 01 14:10:18 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:10:18 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f656129-a102-4c65-a7da-b8b8bca51e06 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f282dfdd120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:945c6cd8-9048-4880-b1f8-6d1ca591b594'): ({'sde'}, set())}) {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 14:10:18 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-1f656129-a102-4c65-a7da-b8b8bca51e06 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Removing single pathed devices sde {{(pid=72129) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 14:10:18 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:10:18 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:10:18 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c97adb-3a10-4739-823d-d7c7b91597a0]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:10:18 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:10:18 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:10:18 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f61899-b890-4860-85ec-21e9499b53b1]: (4, ('ok\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:10:18 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-1f656129-a102-4c65-a7da-b8b8bca51e06 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Flushing IO for device /dev/sde {{(pid=72129) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 14:10:18 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:10:18 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:10:18 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff785b6e-d718-4df9-ac7a-24b9f2a79c9b]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:10:18 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-1f656129-a102-4c65-a7da-b8b8bca51e06 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72129) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 14:10:18 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:10:18 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:10:18 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e419a3-f001-4a6f-988e-1bc944f7d1f7]: (4, ('1', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:10:18 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-1f656129-a102-4c65-a7da-b8b8bca51e06 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 14:10:18 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-1f656129-a102-4c65-a7da-b8b8bca51e06 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] SCSI volumes sde have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 14:10:18 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f656129-a102-4c65-a7da-b8b8bca51e06 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:945c6cd8-9048-4880-b1f8-6d1ca591b594')] {{(pid=72129) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 14:10:18 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:945c6cd8-9048-4880-b1f8-6d1ca591b594 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:10:18 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:945c6cd8-9048-4880-b1f8-6d1ca591b594 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:10:18 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0634569-e645-40d4-b384-411d221ff2a1]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:10:18 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f656129-a102-4c65-a7da-b8b8bca51e06 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:10:18 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:945c6cd8-9048-4880-b1f8-6d1ca591b594 -p 172.16.0.220:3260 --logout {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:10:18 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:945c6cd8-9048-4880-b1f8-6d1ca591b594 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:10:18 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9f8734-9a61-4af9-b7ec-f4bae772e7e3]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:945c6cd8-9048-4880-b1f8-6d1ca591b594, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:945c6cd8-9048-4880-b1f8-6d1ca591b594, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:10:18 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f656129-a102-4c65-a7da-b8b8bca51e06 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:945c6cd8-9048-4880-b1f8-6d1ca591b594, portal: 172.16.0.220,3260]
Aug 01 14:10:18 user nova-compute[72129]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:945c6cd8-9048-4880-b1f8-6d1ca591b594, portal: 172.16.0.220,3260] successful.
Aug 01 14:10:18 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:10:18 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:945c6cd8-9048-4880-b1f8-6d1ca591b594 -p 172.16.0.220:3260 --op delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:10:18 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:945c6cd8-9048-4880-b1f8-6d1ca591b594 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:10:18 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb1e7a3-2062-49e8-b035-73a7ecb61d2b]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:10:18 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f656129-a102-4c65-a7da-b8b8bca51e06 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:10:18 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-1f656129-a102-4c65-a7da-b8b8bca51e06 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.272s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:10:18 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f656129-a102-4c65-a7da-b8b8bca51e06 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] <== disconnect_volume: return (274ms) None {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:10:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f656129-a102-4c65-a7da-b8b8bca51e06 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Disconnected iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 14:10:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:10:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:10:19 user nova-compute[72129]: DEBUG nova.objects.instance [None req-1f656129-a102-4c65-a7da-b8b8bca51e06 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lazy-loading 'flavor' on Instance uuid e3a73214-dad3-44d1-adc3-312970a919e5 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:10:19 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-1f656129-a102-4c65-a7da-b8b8bca51e06 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "e3a73214-dad3-44d1-adc3-312970a919e5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.577s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:10:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-1d6e637e-43c8-4e3a-9c50-9832f7590dc7 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Acquiring lock "e3a73214-dad3-44d1-adc3-312970a919e5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:10:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-1d6e637e-43c8-4e3a-9c50-9832f7590dc7 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "e3a73214-dad3-44d1-adc3-312970a919e5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:10:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-1d6e637e-43c8-4e3a-9c50-9832f7590dc7 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Acquiring lock "e3a73214-dad3-44d1-adc3-312970a919e5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:10:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-1d6e637e-43c8-4e3a-9c50-9832f7590dc7 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "e3a73214-dad3-44d1-adc3-312970a919e5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:10:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-1d6e637e-43c8-4e3a-9c50-9832f7590dc7 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "e3a73214-dad3-44d1-adc3-312970a919e5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:10:20 user nova-compute[72129]: INFO nova.compute.manager [None req-1d6e637e-43c8-4e3a-9c50-9832f7590dc7 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Terminating instance
Aug 01 14:10:20 user nova-compute[72129]: DEBUG nova.compute.manager [None req-1d6e637e-43c8-4e3a-9c50-9832f7590dc7 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Start destroying the instance on the hypervisor. {{(pid=72129) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 14:10:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:10:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:10:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:10:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:10:20 user nova-compute[72129]: DEBUG nova.compute.manager [req-1d20c2e2-c212-4cad-b86b-bc7fb2be4373 req-9fc2ee4e-d0cd-471a-a1a9-318917443d03 service nova] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Received event network-vif-unplugged-950fe308-2b8e-4c5a-9a1d-796cf99eef3d {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:10:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-1d20c2e2-c212-4cad-b86b-bc7fb2be4373 req-9fc2ee4e-d0cd-471a-a1a9-318917443d03 service nova] Acquiring lock "e3a73214-dad3-44d1-adc3-312970a919e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:10:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-1d20c2e2-c212-4cad-b86b-bc7fb2be4373 req-9fc2ee4e-d0cd-471a-a1a9-318917443d03 service nova] Lock "e3a73214-dad3-44d1-adc3-312970a919e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:10:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-1d20c2e2-c212-4cad-b86b-bc7fb2be4373 req-9fc2ee4e-d0cd-471a-a1a9-318917443d03 service nova] Lock "e3a73214-dad3-44d1-adc3-312970a919e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:10:20 user nova-compute[72129]: DEBUG nova.compute.manager [req-1d20c2e2-c212-4cad-b86b-bc7fb2be4373 req-9fc2ee4e-d0cd-471a-a1a9-318917443d03 service nova] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] No waiting events found dispatching network-vif-unplugged-950fe308-2b8e-4c5a-9a1d-796cf99eef3d {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:10:20 user nova-compute[72129]: DEBUG nova.compute.manager [req-1d20c2e2-c212-4cad-b86b-bc7fb2be4373 req-9fc2ee4e-d0cd-471a-a1a9-318917443d03 service nova] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Received event network-vif-unplugged-950fe308-2b8e-4c5a-9a1d-796cf99eef3d for instance with task_state deleting. {{(pid=72129) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 14:10:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:10:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:10:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:10:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:10:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:10:21 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Instance destroyed successfully.
Aug 01 14:10:21 user nova-compute[72129]: DEBUG nova.objects.instance [None req-1d6e637e-43c8-4e3a-9c50-9832f7590dc7 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lazy-loading 'resources' on Instance uuid e3a73214-dad3-44d1-adc3-312970a919e5 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:10:21 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-1d6e637e-43c8-4e3a-9c50-9832f7590dc7 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:07:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1014804108',display_name='tempest-AttachVolumeTestJSON-server-1014804108',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1014804108',id=34,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAu3nU2N9ohchIF1XngO4J9SW31e3ZOSF65ANnfIGGdQwH2BqqveO8FRvIrvq8KRyxa42LPgsFWmqzlUofPQET+hDNFSzIqWrY8ftZKPhFra8RIjbSa9LYrvi5kC8wNUbA==',key_name='tempest-keypair-1373369513',keypairs=<?>,launch_index=0,launched_at=2023-08-01T14:07:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a6120989bad342a4a6fa2a8975f5932f',ramdisk_id='',reservation_id='r-mar4dnh6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-55653475',owner_user_name='tempest-AttachVolumeTestJSON-55653475-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T14:07:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13a3c19bbcbb4833abbb2997944a6564',uuid=e3a73214-dad3-44d1-adc3-312970a919e5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "950fe308-2b8e-4c5a-9a1d-796cf99eef3d", "address": "fa:16:3e:16:8b:06", "network": {"id": "b0eb2211-5a6a-4b7e-a119-92a0f0deb947", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1159988670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6120989bad342a4a6fa2a8975f5932f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap950fe308-2b", "ovs_interfaceid": "950fe308-2b8e-4c5a-9a1d-796cf99eef3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 14:10:21 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-1d6e637e-43c8-4e3a-9c50-9832f7590dc7 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Converting VIF {"id": "950fe308-2b8e-4c5a-9a1d-796cf99eef3d", "address": "fa:16:3e:16:8b:06", "network": {"id": "b0eb2211-5a6a-4b7e-a119-92a0f0deb947", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1159988670-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6120989bad342a4a6fa2a8975f5932f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap950fe308-2b", "ovs_interfaceid": "950fe308-2b8e-4c5a-9a1d-796cf99eef3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:10:21 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-1d6e637e-43c8-4e3a-9c50-9832f7590dc7 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:8b:06,bridge_name='br-int',has_traffic_filtering=True,id=950fe308-2b8e-4c5a-9a1d-796cf99eef3d,network=Network(b0eb2211-5a6a-4b7e-a119-92a0f0deb947),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap950fe308-2b') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:10:21 user nova-compute[72129]: DEBUG os_vif [None req-1d6e637e-43c8-4e3a-9c50-9832f7590dc7 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:8b:06,bridge_name='br-int',has_traffic_filtering=True,id=950fe308-2b8e-4c5a-9a1d-796cf99eef3d,network=Network(b0eb2211-5a6a-4b7e-a119-92a0f0deb947),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap950fe308-2b') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 14:10:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:10:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap950fe308-2b, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:10:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:10:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:10:21 user nova-compute[72129]: INFO os_vif [None req-1d6e637e-43c8-4e3a-9c50-9832f7590dc7 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:8b:06,bridge_name='br-int',has_traffic_filtering=True,id=950fe308-2b8e-4c5a-9a1d-796cf99eef3d,network=Network(b0eb2211-5a6a-4b7e-a119-92a0f0deb947),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap950fe308-2b')
Aug 01 14:10:21 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-1d6e637e-43c8-4e3a-9c50-9832f7590dc7 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Deleting instance files /opt/stack/data/nova/instances/e3a73214-dad3-44d1-adc3-312970a919e5_del
Aug 01 14:10:21 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-1d6e637e-43c8-4e3a-9c50-9832f7590dc7 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Deletion of /opt/stack/data/nova/instances/e3a73214-dad3-44d1-adc3-312970a919e5_del complete
Aug 01 14:10:21 user nova-compute[72129]: INFO nova.compute.manager [None req-1d6e637e-43c8-4e3a-9c50-9832f7590dc7 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 01 14:10:21 user nova-compute[72129]: DEBUG oslo.service.loopingcall [None req-1d6e637e-43c8-4e3a-9c50-9832f7590dc7 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72129) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 14:10:21 user nova-compute[72129]: DEBUG nova.compute.manager [-] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Deallocating network for instance {{(pid=72129) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 14:10:21 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] deallocate_for_instance() {{(pid=72129) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 14:10:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:10:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:10:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:10:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:10:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:10:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:10:22 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:10:22 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Took 1.38 seconds to deallocate network for instance.
Aug 01 14:10:22 user nova-compute[72129]: DEBUG nova.compute.manager [req-92a3636b-f78f-422b-bc46-2e055ceec1d8 req-8a6007cc-2d6f-4d68-9b8e-96136c7a3240 service nova] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Received event network-vif-deleted-950fe308-2b8e-4c5a-9a1d-796cf99eef3d {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:10:22 user nova-compute[72129]: INFO nova.compute.manager [req-92a3636b-f78f-422b-bc46-2e055ceec1d8 req-8a6007cc-2d6f-4d68-9b8e-96136c7a3240 service nova] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Neutron deleted interface 950fe308-2b8e-4c5a-9a1d-796cf99eef3d; detaching it from the instance and deleting it from the info cache
Aug 01 14:10:22 user nova-compute[72129]: DEBUG nova.network.neutron [req-92a3636b-f78f-422b-bc46-2e055ceec1d8 req-8a6007cc-2d6f-4d68-9b8e-96136c7a3240 service nova] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:10:22 user nova-compute[72129]: DEBUG nova.compute.manager [req-92a3636b-f78f-422b-bc46-2e055ceec1d8 req-8a6007cc-2d6f-4d68-9b8e-96136c7a3240 service nova] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Detach interface failed, port_id=950fe308-2b8e-4c5a-9a1d-796cf99eef3d, reason: Instance e3a73214-dad3-44d1-adc3-312970a919e5 could not be found. {{(pid=72129) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 14:10:22 user nova-compute[72129]: DEBUG nova.compute.manager [req-ca0f4382-1607-469c-9c34-40ecb83f01d2 req-f5bc8f3c-bc90-40fa-9617-b2aca6074fda service nova] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Received event network-vif-plugged-950fe308-2b8e-4c5a-9a1d-796cf99eef3d {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:10:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ca0f4382-1607-469c-9c34-40ecb83f01d2 req-f5bc8f3c-bc90-40fa-9617-b2aca6074fda service nova] Acquiring lock "e3a73214-dad3-44d1-adc3-312970a919e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:10:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ca0f4382-1607-469c-9c34-40ecb83f01d2 req-f5bc8f3c-bc90-40fa-9617-b2aca6074fda service nova] Lock "e3a73214-dad3-44d1-adc3-312970a919e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:10:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ca0f4382-1607-469c-9c34-40ecb83f01d2 req-f5bc8f3c-bc90-40fa-9617-b2aca6074fda service nova] Lock "e3a73214-dad3-44d1-adc3-312970a919e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:10:22 user nova-compute[72129]: DEBUG nova.compute.manager [req-ca0f4382-1607-469c-9c34-40ecb83f01d2 req-f5bc8f3c-bc90-40fa-9617-b2aca6074fda service nova] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] No waiting events found dispatching network-vif-plugged-950fe308-2b8e-4c5a-9a1d-796cf99eef3d {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:10:22 user nova-compute[72129]: WARNING nova.compute.manager [req-ca0f4382-1607-469c-9c34-40ecb83f01d2 req-f5bc8f3c-bc90-40fa-9617-b2aca6074fda service nova] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Received unexpected event network-vif-plugged-950fe308-2b8e-4c5a-9a1d-796cf99eef3d for instance with vm_state active and task_state deleting.
Aug 01 14:10:22 user nova-compute[72129]: DEBUG nova.compute.manager [req-ca0f4382-1607-469c-9c34-40ecb83f01d2 req-f5bc8f3c-bc90-40fa-9617-b2aca6074fda service nova] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Received event network-vif-plugged-950fe308-2b8e-4c5a-9a1d-796cf99eef3d {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:10:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ca0f4382-1607-469c-9c34-40ecb83f01d2 req-f5bc8f3c-bc90-40fa-9617-b2aca6074fda service nova] Acquiring lock "e3a73214-dad3-44d1-adc3-312970a919e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:10:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ca0f4382-1607-469c-9c34-40ecb83f01d2 req-f5bc8f3c-bc90-40fa-9617-b2aca6074fda service nova] Lock "e3a73214-dad3-44d1-adc3-312970a919e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:10:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ca0f4382-1607-469c-9c34-40ecb83f01d2 req-f5bc8f3c-bc90-40fa-9617-b2aca6074fda service nova] Lock "e3a73214-dad3-44d1-adc3-312970a919e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:10:22 user nova-compute[72129]: DEBUG nova.compute.manager [req-ca0f4382-1607-469c-9c34-40ecb83f01d2 req-f5bc8f3c-bc90-40fa-9617-b2aca6074fda service nova] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] No waiting events found dispatching network-vif-plugged-950fe308-2b8e-4c5a-9a1d-796cf99eef3d {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:10:22 user nova-compute[72129]: WARNING nova.compute.manager [req-ca0f4382-1607-469c-9c34-40ecb83f01d2 req-f5bc8f3c-bc90-40fa-9617-b2aca6074fda service nova] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Received unexpected event network-vif-plugged-950fe308-2b8e-4c5a-9a1d-796cf99eef3d for instance with vm_state active and task_state deleting.
Aug 01 14:10:22 user nova-compute[72129]: DEBUG nova.compute.manager [req-ca0f4382-1607-469c-9c34-40ecb83f01d2 req-f5bc8f3c-bc90-40fa-9617-b2aca6074fda service nova] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Received event network-vif-plugged-950fe308-2b8e-4c5a-9a1d-796cf99eef3d {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:10:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ca0f4382-1607-469c-9c34-40ecb83f01d2 req-f5bc8f3c-bc90-40fa-9617-b2aca6074fda service nova] Acquiring lock "e3a73214-dad3-44d1-adc3-312970a919e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:10:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ca0f4382-1607-469c-9c34-40ecb83f01d2 req-f5bc8f3c-bc90-40fa-9617-b2aca6074fda service nova] Lock "e3a73214-dad3-44d1-adc3-312970a919e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:10:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ca0f4382-1607-469c-9c34-40ecb83f01d2 req-f5bc8f3c-bc90-40fa-9617-b2aca6074fda service nova] Lock "e3a73214-dad3-44d1-adc3-312970a919e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:10:22 user nova-compute[72129]: DEBUG nova.compute.manager [req-ca0f4382-1607-469c-9c34-40ecb83f01d2 req-f5bc8f3c-bc90-40fa-9617-b2aca6074fda service nova] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] No waiting events found dispatching network-vif-plugged-950fe308-2b8e-4c5a-9a1d-796cf99eef3d {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:10:22 user nova-compute[72129]: WARNING nova.compute.manager [req-ca0f4382-1607-469c-9c34-40ecb83f01d2 req-f5bc8f3c-bc90-40fa-9617-b2aca6074fda service nova] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Received unexpected event network-vif-plugged-950fe308-2b8e-4c5a-9a1d-796cf99eef3d for instance with vm_state active and task_state deleting.
Aug 01 14:10:22 user nova-compute[72129]: DEBUG nova.compute.manager [req-ca0f4382-1607-469c-9c34-40ecb83f01d2 req-f5bc8f3c-bc90-40fa-9617-b2aca6074fda service nova] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Received event network-vif-unplugged-950fe308-2b8e-4c5a-9a1d-796cf99eef3d {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:10:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ca0f4382-1607-469c-9c34-40ecb83f01d2 req-f5bc8f3c-bc90-40fa-9617-b2aca6074fda service nova] Acquiring lock "e3a73214-dad3-44d1-adc3-312970a919e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:10:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ca0f4382-1607-469c-9c34-40ecb83f01d2 req-f5bc8f3c-bc90-40fa-9617-b2aca6074fda service nova] Lock "e3a73214-dad3-44d1-adc3-312970a919e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:10:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ca0f4382-1607-469c-9c34-40ecb83f01d2 req-f5bc8f3c-bc90-40fa-9617-b2aca6074fda service nova] Lock "e3a73214-dad3-44d1-adc3-312970a919e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:10:22 user nova-compute[72129]: DEBUG nova.compute.manager [req-ca0f4382-1607-469c-9c34-40ecb83f01d2 req-f5bc8f3c-bc90-40fa-9617-b2aca6074fda service nova] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] No waiting events found dispatching network-vif-unplugged-950fe308-2b8e-4c5a-9a1d-796cf99eef3d {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:10:22 user nova-compute[72129]: DEBUG nova.compute.manager [req-ca0f4382-1607-469c-9c34-40ecb83f01d2 req-f5bc8f3c-bc90-40fa-9617-b2aca6074fda service nova] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Received event network-vif-unplugged-950fe308-2b8e-4c5a-9a1d-796cf99eef3d for instance with task_state deleting. {{(pid=72129) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 14:10:22 user nova-compute[72129]: DEBUG nova.compute.manager [req-ca0f4382-1607-469c-9c34-40ecb83f01d2 req-f5bc8f3c-bc90-40fa-9617-b2aca6074fda service nova] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Received event network-vif-plugged-950fe308-2b8e-4c5a-9a1d-796cf99eef3d {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:10:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ca0f4382-1607-469c-9c34-40ecb83f01d2 req-f5bc8f3c-bc90-40fa-9617-b2aca6074fda service nova] Acquiring lock "e3a73214-dad3-44d1-adc3-312970a919e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:10:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ca0f4382-1607-469c-9c34-40ecb83f01d2 req-f5bc8f3c-bc90-40fa-9617-b2aca6074fda service nova] Lock "e3a73214-dad3-44d1-adc3-312970a919e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:10:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ca0f4382-1607-469c-9c34-40ecb83f01d2 req-f5bc8f3c-bc90-40fa-9617-b2aca6074fda service nova] Lock "e3a73214-dad3-44d1-adc3-312970a919e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:10:22 user nova-compute[72129]: DEBUG nova.compute.manager [req-ca0f4382-1607-469c-9c34-40ecb83f01d2 req-f5bc8f3c-bc90-40fa-9617-b2aca6074fda service nova] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] No waiting events found dispatching network-vif-plugged-950fe308-2b8e-4c5a-9a1d-796cf99eef3d {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:10:22 user nova-compute[72129]: WARNING nova.compute.manager [req-ca0f4382-1607-469c-9c34-40ecb83f01d2 req-f5bc8f3c-bc90-40fa-9617-b2aca6074fda service nova] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Received unexpected event network-vif-plugged-950fe308-2b8e-4c5a-9a1d-796cf99eef3d for instance with vm_state active and task_state deleting.
Aug 01 14:10:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-1d6e637e-43c8-4e3a-9c50-9832f7590dc7 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:10:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-1d6e637e-43c8-4e3a-9c50-9832f7590dc7 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:10:22 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-1d6e637e-43c8-4e3a-9c50-9832f7590dc7 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:10:22 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-1d6e637e-43c8-4e3a-9c50-9832f7590dc7 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:10:23 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-1d6e637e-43c8-4e3a-9c50-9832f7590dc7 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.223s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:10:23 user nova-compute[72129]: INFO nova.scheduler.client.report [None req-1d6e637e-43c8-4e3a-9c50-9832f7590dc7 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Deleted allocations for instance e3a73214-dad3-44d1-adc3-312970a919e5
Aug 01 14:10:23 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-1d6e637e-43c8-4e3a-9c50-9832f7590dc7 tempest-AttachVolumeTestJSON-55653475 tempest-AttachVolumeTestJSON-55653475-project-member] Lock "e3a73214-dad3-44d1-adc3-312970a919e5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.777s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:10:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:10:31 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:10:31 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:10:31 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72129) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 14:10:31 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:10:31 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:10:31 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:10:36 user nova-compute[72129]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690899021.1550379, e3a73214-dad3-44d1-adc3-312970a919e5 => Stopped> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:10:36 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] VM Stopped (Lifecycle Event)
Aug 01 14:10:36 user nova-compute[72129]: DEBUG nova.compute.manager [None req-67c8bdd3-f2c6-441b-a567-74a70f2ad0b1 None None] [instance: e3a73214-dad3-44d1-adc3-312970a919e5] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:10:36 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:10:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:10:41 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:10:41 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:10:46 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:10:46 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Acquiring lock "9c31c5b8-5485-4603-853a-8b7ef7efa843" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:10:46 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Lock "9c31c5b8-5485-4603-853a-8b7ef7efa843" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:10:46 user nova-compute[72129]: DEBUG nova.compute.manager [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] [instance: 9c31c5b8-5485-4603-853a-8b7ef7efa843] Starting instance... {{(pid=72129) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 14:10:46 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:10:46 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:10:46 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72129) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 14:10:46 user nova-compute[72129]: INFO nova.compute.claims [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] [instance: 9c31c5b8-5485-4603-853a-8b7ef7efa843] Claim successful on node user
Aug 01 14:10:47 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:10:47 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:10:47 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.302s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:10:47 user nova-compute[72129]: DEBUG nova.compute.manager [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] [instance: 9c31c5b8-5485-4603-853a-8b7ef7efa843] Start building networks asynchronously for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 14:10:47 user nova-compute[72129]: DEBUG nova.compute.manager [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] [instance: 9c31c5b8-5485-4603-853a-8b7ef7efa843] Allocating IP information in the background. {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 14:10:47 user nova-compute[72129]: DEBUG nova.network.neutron [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] [instance: 9c31c5b8-5485-4603-853a-8b7ef7efa843] allocate_for_instance() {{(pid=72129) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 14:10:47 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] [instance: 9c31c5b8-5485-4603-853a-8b7ef7efa843] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 14:10:47 user nova-compute[72129]: DEBUG nova.compute.manager [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] [instance: 9c31c5b8-5485-4603-853a-8b7ef7efa843] Start building block device mappings for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 14:10:47 user nova-compute[72129]: DEBUG nova.policy [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aef0a4c176f4428d941f9d922b17ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0854d064104497b8b0413ff9ff74a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72129) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 14:10:47 user nova-compute[72129]: DEBUG nova.compute.manager [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] [instance: 9c31c5b8-5485-4603-853a-8b7ef7efa843] Start spawning the instance on the hypervisor. {{(pid=72129) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 14:10:47 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] [instance: 9c31c5b8-5485-4603-853a-8b7ef7efa843] Creating instance directory {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 14:10:47 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] [instance: 9c31c5b8-5485-4603-853a-8b7ef7efa843] Creating image(s)
Aug 01 14:10:47 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Acquiring lock "/opt/stack/data/nova/instances/9c31c5b8-5485-4603-853a-8b7ef7efa843/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:10:47 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Lock "/opt/stack/data/nova/instances/9c31c5b8-5485-4603-853a-8b7ef7efa843/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:10:47 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Lock "/opt/stack/data/nova/instances/9c31c5b8-5485-4603-853a-8b7ef7efa843/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:10:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:10:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.141s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:10:47 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Acquiring lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:10:47 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:10:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:10:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.138s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:10:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/9c31c5b8-5485-4603-853a-8b7ef7efa843/disk 1073741824 {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:10:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/9c31c5b8-5485-4603-853a-8b7ef7efa843/disk 1073741824" returned: 0 in 0.057s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:10:47 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.204s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:10:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:10:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.137s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:10:47 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9c31c5b8-5485-4603-853a-8b7ef7efa843/disk. size=1073741824 {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 14:10:47 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c31c5b8-5485-4603-853a-8b7ef7efa843/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:10:47 user nova-compute[72129]: DEBUG nova.network.neutron [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] [instance: 9c31c5b8-5485-4603-853a-8b7ef7efa843] Successfully created port: 063c7c09-178e-47eb-92e2-76003c6356a3 {{(pid=72129) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 14:10:48 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c31c5b8-5485-4603-853a-8b7ef7efa843/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:10:48 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Cannot resize image /opt/stack/data/nova/instances/9c31c5b8-5485-4603-853a-8b7ef7efa843/disk to a smaller size. {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 14:10:48 user nova-compute[72129]: DEBUG nova.objects.instance [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Lazy-loading 'migration_context' on Instance uuid 9c31c5b8-5485-4603-853a-8b7ef7efa843 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:10:48 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] [instance: 9c31c5b8-5485-4603-853a-8b7ef7efa843] Created local disks {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 14:10:48 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] [instance: 9c31c5b8-5485-4603-853a-8b7ef7efa843] Ensure instance console log exists: /opt/stack/data/nova/instances/9c31c5b8-5485-4603-853a-8b7ef7efa843/console.log {{(pid=72129) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 14:10:48 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:10:48 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:10:48 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:10:48 user nova-compute[72129]: DEBUG nova.network.neutron [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] [instance: 9c31c5b8-5485-4603-853a-8b7ef7efa843] Successfully updated port: 063c7c09-178e-47eb-92e2-76003c6356a3 {{(pid=72129) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 14:10:48 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Acquiring lock "refresh_cache-9c31c5b8-5485-4603-853a-8b7ef7efa843" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:10:48 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Acquired lock "refresh_cache-9c31c5b8-5485-4603-853a-8b7ef7efa843" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:10:48 user nova-compute[72129]: DEBUG nova.network.neutron [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] [instance: 9c31c5b8-5485-4603-853a-8b7ef7efa843] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 14:10:48 user nova-compute[72129]: DEBUG nova.network.neutron [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] [instance: 9c31c5b8-5485-4603-853a-8b7ef7efa843] Instance cache missing network info. {{(pid=72129) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 14:10:48 user nova-compute[72129]: DEBUG nova.compute.manager [req-4742ee4e-93ba-4152-89d5-ee337ebcf370 req-082020cc-b869-40d1-9a63-5f906d4fc537 service nova] [instance: 9c31c5b8-5485-4603-853a-8b7ef7efa843] Received event network-changed-063c7c09-178e-47eb-92e2-76003c6356a3 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:10:48 user nova-compute[72129]: DEBUG nova.compute.manager [req-4742ee4e-93ba-4152-89d5-ee337ebcf370 req-082020cc-b869-40d1-9a63-5f906d4fc537 service nova] [instance: 9c31c5b8-5485-4603-853a-8b7ef7efa843] Refreshing instance network info cache due to event network-changed-063c7c09-178e-47eb-92e2-76003c6356a3. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 14:10:48 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-4742ee4e-93ba-4152-89d5-ee337ebcf370 req-082020cc-b869-40d1-9a63-5f906d4fc537 service nova] Acquiring lock "refresh_cache-9c31c5b8-5485-4603-853a-8b7ef7efa843" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:10:49 user nova-compute[72129]: DEBUG nova.network.neutron [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] [instance: 9c31c5b8-5485-4603-853a-8b7ef7efa843] Updating instance_info_cache with network_info: [{"id": "063c7c09-178e-47eb-92e2-76003c6356a3", "address": "fa:16:3e:35:5a:1a", "network": {"id": "1fc5fd20-6ca3-45f2-93ee-ac80e3311897", "bridge": "br-int", "label": "tempest-VolumesActionsTest-878643555-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e0854d064104497b8b0413ff9ff74a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap063c7c09-17", "ovs_interfaceid": "063c7c09-178e-47eb-92e2-76003c6356a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:10:49 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Releasing lock "refresh_cache-9c31c5b8-5485-4603-853a-8b7ef7efa843" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:10:49 user nova-compute[72129]: DEBUG nova.compute.manager [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] [instance: 9c31c5b8-5485-4603-853a-8b7ef7efa843] Instance network_info: |[{"id": "063c7c09-178e-47eb-92e2-76003c6356a3", "address": "fa:16:3e:35:5a:1a", "network": {"id": "1fc5fd20-6ca3-45f2-93ee-ac80e3311897", "bridge": "br-int", "label": "tempest-VolumesActionsTest-878643555-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e0854d064104497b8b0413ff9ff74a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap063c7c09-17", "ovs_interfaceid": "063c7c09-178e-47eb-92e2-76003c6356a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 14:10:49 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-4742ee4e-93ba-4152-89d5-ee337ebcf370 req-082020cc-b869-40d1-9a63-5f906d4fc537 service nova] Acquired lock "refresh_cache-9c31c5b8-5485-4603-853a-8b7ef7efa843" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:10:49 user nova-compute[72129]: DEBUG nova.network.neutron [req-4742ee4e-93ba-4152-89d5-ee337ebcf370 req-082020cc-b869-40d1-9a63-5f906d4fc537 service nova] [instance: 9c31c5b8-5485-4603-853a-8b7ef7efa843] Refreshing network info cache for port 063c7c09-178e-47eb-92e2-76003c6356a3 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 14:10:49 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] [instance: 9c31c5b8-5485-4603-853a-8b7ef7efa843] Start _get_guest_xml network_info=[{"id": "063c7c09-178e-47eb-92e2-76003c6356a3", "address": "fa:16:3e:35:5a:1a", "network": {"id": "1fc5fd20-6ca3-45f2-93ee-ac80e3311897", "bridge": "br-int", "label": "tempest-VolumesActionsTest-878643555-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e0854d064104497b8b0413ff9ff74a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap063c7c09-17", "ovs_interfaceid": "063c7c09-178e-47eb-92e2-76003c6356a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'image_id': 'b6472c34-1b0f-4034-ba3a-7e8eb5103715'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 14:10:49 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:10:49 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:10:49 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 14:10:49 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] CPU controller missing on host. {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 14:10:49 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 14:10:49 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] CPU controller found on host. {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 14:10:49 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72129) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 14:10:49 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T13:45:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 14:10:49 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Flavor limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 14:10:49 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Image limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 14:10:49 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Flavor pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 14:10:49 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Image pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 14:10:49 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 14:10:49 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 14:10:49 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 14:10:49 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Got 1 possible topologies {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 14:10:49 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 14:10:49 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 14:10:49 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:10:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-759872205',display_name='tempest-VolumesActionsTest-instance-759872205',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-759872205',id=36,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e0854d064104497b8b0413ff9ff74a9',ramdisk_id='',reservation_id='r-add0tbut',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2013737032',owner_user_name='tempest-VolumesActionsTest-2013737032-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T14:10:47Z,user_data=None,user_id='aef0a4c176f4428d941f9d922b17ea93',uuid=9c31c5b8-5485-4603-853a-8b7ef7efa843,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "063c7c09-178e-47eb-92e2-76003c6356a3", "address": "fa:16:3e:35:5a:1a", "network": {"id": "1fc5fd20-6ca3-45f2-93ee-ac80e3311897", "bridge": "br-int", "label": "tempest-VolumesActionsTest-878643555-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e0854d064104497b8b0413ff9ff74a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap063c7c09-17", "ovs_interfaceid": "063c7c09-178e-47eb-92e2-76003c6356a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 14:10:49 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Converting VIF {"id": "063c7c09-178e-47eb-92e2-76003c6356a3", "address": "fa:16:3e:35:5a:1a", "network": {"id": "1fc5fd20-6ca3-45f2-93ee-ac80e3311897", "bridge": "br-int", "label": "tempest-VolumesActionsTest-878643555-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e0854d064104497b8b0413ff9ff74a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap063c7c09-17", "ovs_interfaceid": "063c7c09-178e-47eb-92e2-76003c6356a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:10:49 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:5a:1a,bridge_name='br-int',has_traffic_filtering=True,id=063c7c09-178e-47eb-92e2-76003c6356a3,network=Network(1fc5fd20-6ca3-45f2-93ee-ac80e3311897),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap063c7c09-17') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:10:49 user nova-compute[72129]: DEBUG nova.objects.instance [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Lazy-loading 'pci_devices' on Instance uuid 9c31c5b8-5485-4603-853a-8b7ef7efa843 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:10:49 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] [instance: 9c31c5b8-5485-4603-853a-8b7ef7efa843] End _get_guest_xml xml=<domain type="kvm">
Aug 01 14:10:49 user nova-compute[72129]:   <uuid>9c31c5b8-5485-4603-853a-8b7ef7efa843</uuid>
Aug 01 14:10:49 user nova-compute[72129]:   <name>instance-00000024</name>
Aug 01 14:10:49 user nova-compute[72129]:   <memory>524288</memory>
Aug 01 14:10:49 user nova-compute[72129]:   <vcpu>1</vcpu>
Aug 01 14:10:49 user nova-compute[72129]:   <metadata>
Aug 01 14:10:49 user nova-compute[72129]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 14:10:49 user nova-compute[72129]:       <nova:package version="0.0.0"/>
Aug 01 14:10:49 user nova-compute[72129]:       <nova:name>tempest-VolumesActionsTest-instance-759872205</nova:name>
Aug 01 14:10:49 user nova-compute[72129]:       <nova:creationTime>2023-08-01 14:10:49</nova:creationTime>
Aug 01 14:10:49 user nova-compute[72129]:       <nova:flavor name="m1.tiny">
Aug 01 14:10:49 user nova-compute[72129]:         <nova:memory>512</nova:memory>
Aug 01 14:10:49 user nova-compute[72129]:         <nova:disk>1</nova:disk>
Aug 01 14:10:49 user nova-compute[72129]:         <nova:swap>0</nova:swap>
Aug 01 14:10:49 user nova-compute[72129]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 14:10:49 user nova-compute[72129]:         <nova:vcpus>1</nova:vcpus>
Aug 01 14:10:49 user nova-compute[72129]:       </nova:flavor>
Aug 01 14:10:49 user nova-compute[72129]:       <nova:owner>
Aug 01 14:10:49 user nova-compute[72129]:         <nova:user uuid="aef0a4c176f4428d941f9d922b17ea93">tempest-VolumesActionsTest-2013737032-project-member</nova:user>
Aug 01 14:10:49 user nova-compute[72129]:         <nova:project uuid="2e0854d064104497b8b0413ff9ff74a9">tempest-VolumesActionsTest-2013737032</nova:project>
Aug 01 14:10:49 user nova-compute[72129]:       </nova:owner>
Aug 01 14:10:49 user nova-compute[72129]:       <nova:root type="image" uuid="b6472c34-1b0f-4034-ba3a-7e8eb5103715"/>
Aug 01 14:10:49 user nova-compute[72129]:       <nova:ports>
Aug 01 14:10:49 user nova-compute[72129]:         <nova:port uuid="063c7c09-178e-47eb-92e2-76003c6356a3">
Aug 01 14:10:49 user nova-compute[72129]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 01 14:10:49 user nova-compute[72129]:         </nova:port>
Aug 01 14:10:49 user nova-compute[72129]:       </nova:ports>
Aug 01 14:10:49 user nova-compute[72129]:     </nova:instance>
Aug 01 14:10:49 user nova-compute[72129]:   </metadata>
Aug 01 14:10:49 user nova-compute[72129]:   <sysinfo type="smbios">
Aug 01 14:10:49 user nova-compute[72129]:     <system>
Aug 01 14:10:49 user nova-compute[72129]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 14:10:49 user nova-compute[72129]:       <entry name="product">OpenStack Nova</entry>
Aug 01 14:10:49 user nova-compute[72129]:       <entry name="version">0.0.0</entry>
Aug 01 14:10:49 user nova-compute[72129]:       <entry name="serial">9c31c5b8-5485-4603-853a-8b7ef7efa843</entry>
Aug 01 14:10:49 user nova-compute[72129]:       <entry name="uuid">9c31c5b8-5485-4603-853a-8b7ef7efa843</entry>
Aug 01 14:10:49 user nova-compute[72129]:       <entry name="family">Virtual Machine</entry>
Aug 01 14:10:49 user nova-compute[72129]:     </system>
Aug 01 14:10:49 user nova-compute[72129]:   </sysinfo>
Aug 01 14:10:49 user nova-compute[72129]:   <os>
Aug 01 14:10:49 user nova-compute[72129]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 14:10:49 user nova-compute[72129]:     <boot dev="hd"/>
Aug 01 14:10:49 user nova-compute[72129]:     <smbios mode="sysinfo"/>
Aug 01 14:10:49 user nova-compute[72129]:   </os>
Aug 01 14:10:49 user nova-compute[72129]:   <features>
Aug 01 14:10:49 user nova-compute[72129]:     <acpi/>
Aug 01 14:10:49 user nova-compute[72129]:     <apic/>
Aug 01 14:10:49 user nova-compute[72129]:     <vmcoreinfo/>
Aug 01 14:10:49 user nova-compute[72129]:   </features>
Aug 01 14:10:49 user nova-compute[72129]:   <clock offset="utc">
Aug 01 14:10:49 user nova-compute[72129]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 14:10:49 user nova-compute[72129]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 14:10:49 user nova-compute[72129]:     <timer name="hpet" present="no"/>
Aug 01 14:10:49 user nova-compute[72129]:   </clock>
Aug 01 14:10:49 user nova-compute[72129]:   <cpu mode="custom" match="exact">
Aug 01 14:10:49 user nova-compute[72129]:     <model>Nehalem</model>
Aug 01 14:10:49 user nova-compute[72129]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 14:10:49 user nova-compute[72129]:   </cpu>
Aug 01 14:10:49 user nova-compute[72129]:   <devices>
Aug 01 14:10:49 user nova-compute[72129]:     <disk type="file" device="disk">
Aug 01 14:10:49 user nova-compute[72129]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 14:10:49 user nova-compute[72129]:       <source file="/opt/stack/data/nova/instances/9c31c5b8-5485-4603-853a-8b7ef7efa843/disk"/>
Aug 01 14:10:49 user nova-compute[72129]:       <target dev="vda" bus="virtio"/>
Aug 01 14:10:49 user nova-compute[72129]:     </disk>
Aug 01 14:10:49 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 14:10:49 user nova-compute[72129]:       <mac address="fa:16:3e:35:5a:1a"/>
Aug 01 14:10:49 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:10:49 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 14:10:49 user nova-compute[72129]:       <target dev="tap063c7c09-17"/>
Aug 01 14:10:49 user nova-compute[72129]:     </interface>
Aug 01 14:10:49 user nova-compute[72129]:     <serial type="pty">
Aug 01 14:10:49 user nova-compute[72129]:       <log file="/opt/stack/data/nova/instances/9c31c5b8-5485-4603-853a-8b7ef7efa843/console.log" append="off"/>
Aug 01 14:10:49 user nova-compute[72129]:     </serial>
Aug 01 14:10:49 user nova-compute[72129]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 14:10:49 user nova-compute[72129]:     <video>
Aug 01 14:10:49 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:10:49 user nova-compute[72129]:     </video>
Aug 01 14:10:49 user nova-compute[72129]:     <rng model="virtio">
Aug 01 14:10:49 user nova-compute[72129]:       <backend model="random">/dev/urandom</backend>
Aug 01 14:10:49 user nova-compute[72129]:     </rng>
Aug 01 14:10:49 user nova-compute[72129]:     <controller type="usb" index="0" model="none"/>
Aug 01 14:10:49 user nova-compute[72129]:     <memballoon model="virtio">
Aug 01 14:10:49 user nova-compute[72129]:       <stats period="10"/>
Aug 01 14:10:49 user nova-compute[72129]:     </memballoon>
Aug 01 14:10:49 user nova-compute[72129]:   </devices>
Aug 01 14:10:49 user nova-compute[72129]: </domain>
Aug 01 14:10:49 user nova-compute[72129]:  {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 14:10:49 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:10:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-759872205',display_name='tempest-VolumesActionsTest-instance-759872205',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-759872205',id=36,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e0854d064104497b8b0413ff9ff74a9',ramdisk_id='',reservation_id='r-add0tbut',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2013737032',owner_user_name='tempest-VolumesActionsTest-2013737032-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T14:10:47Z,user_data=None,user_id='aef0a4c176f4428d941f9d922b17ea93',uuid=9c31c5b8-5485-4603-853a-8b7ef7efa843,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "063c7c09-178e-47eb-92e2-76003c6356a3", "address": "fa:16:3e:35:5a:1a", "network": {"id": "1fc5fd20-6ca3-45f2-93ee-ac80e3311897", "bridge": "br-int", "label": "tempest-VolumesActionsTest-878643555-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e0854d064104497b8b0413ff9ff74a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap063c7c09-17", "ovs_interfaceid": "063c7c09-178e-47eb-92e2-76003c6356a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 14:10:49 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Converting VIF {"id": "063c7c09-178e-47eb-92e2-76003c6356a3", "address": "fa:16:3e:35:5a:1a", "network": {"id": "1fc5fd20-6ca3-45f2-93ee-ac80e3311897", "bridge": "br-int", "label": "tempest-VolumesActionsTest-878643555-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e0854d064104497b8b0413ff9ff74a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap063c7c09-17", "ovs_interfaceid": "063c7c09-178e-47eb-92e2-76003c6356a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:10:49 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:5a:1a,bridge_name='br-int',has_traffic_filtering=True,id=063c7c09-178e-47eb-92e2-76003c6356a3,network=Network(1fc5fd20-6ca3-45f2-93ee-ac80e3311897),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap063c7c09-17') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:10:49 user nova-compute[72129]: DEBUG os_vif [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:5a:1a,bridge_name='br-int',has_traffic_filtering=True,id=063c7c09-178e-47eb-92e2-76003c6356a3,network=Network(1fc5fd20-6ca3-45f2-93ee-ac80e3311897),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap063c7c09-17') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 14:10:49 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:10:49 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:10:49 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 14:10:49 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:10:49 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap063c7c09-17, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:10:49 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap063c7c09-17, col_values=(('external_ids', {'iface-id': '063c7c09-178e-47eb-92e2-76003c6356a3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:5a:1a', 'vm-uuid': '9c31c5b8-5485-4603-853a-8b7ef7efa843'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:10:49 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:10:49 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:10:49 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:10:49 user nova-compute[72129]: INFO os_vif [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:5a:1a,bridge_name='br-int',has_traffic_filtering=True,id=063c7c09-178e-47eb-92e2-76003c6356a3,network=Network(1fc5fd20-6ca3-45f2-93ee-ac80e3311897),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap063c7c09-17')
Aug 01 14:10:49 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:10:49 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] No VIF found with MAC fa:16:3e:35:5a:1a, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 14:10:49 user nova-compute[72129]: DEBUG nova.network.neutron [req-4742ee4e-93ba-4152-89d5-ee337ebcf370 req-082020cc-b869-40d1-9a63-5f906d4fc537 service nova] [instance: 9c31c5b8-5485-4603-853a-8b7ef7efa843] Updated VIF entry in instance network info cache for port 063c7c09-178e-47eb-92e2-76003c6356a3. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 14:10:49 user nova-compute[72129]: DEBUG nova.network.neutron [req-4742ee4e-93ba-4152-89d5-ee337ebcf370 req-082020cc-b869-40d1-9a63-5f906d4fc537 service nova] [instance: 9c31c5b8-5485-4603-853a-8b7ef7efa843] Updating instance_info_cache with network_info: [{"id": "063c7c09-178e-47eb-92e2-76003c6356a3", "address": "fa:16:3e:35:5a:1a", "network": {"id": "1fc5fd20-6ca3-45f2-93ee-ac80e3311897", "bridge": "br-int", "label": "tempest-VolumesActionsTest-878643555-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e0854d064104497b8b0413ff9ff74a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap063c7c09-17", "ovs_interfaceid": "063c7c09-178e-47eb-92e2-76003c6356a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:10:49 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-4742ee4e-93ba-4152-89d5-ee337ebcf370 req-082020cc-b869-40d1-9a63-5f906d4fc537 service nova] Releasing lock "refresh_cache-9c31c5b8-5485-4603-853a-8b7ef7efa843" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:10:50 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:10:50 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:10:50 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:10:50 user nova-compute[72129]: DEBUG nova.compute.manager [req-a582a333-eda6-4f0f-ae95-c56563a81788 req-f90bce46-eb4b-45dc-9a5d-11e08eb56864 service nova] [instance: 9c31c5b8-5485-4603-853a-8b7ef7efa843] Received event network-vif-plugged-063c7c09-178e-47eb-92e2-76003c6356a3 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:10:50 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-a582a333-eda6-4f0f-ae95-c56563a81788 req-f90bce46-eb4b-45dc-9a5d-11e08eb56864 service nova] Acquiring lock "9c31c5b8-5485-4603-853a-8b7ef7efa843-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:10:50 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-a582a333-eda6-4f0f-ae95-c56563a81788 req-f90bce46-eb4b-45dc-9a5d-11e08eb56864 service nova] Lock "9c31c5b8-5485-4603-853a-8b7ef7efa843-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:10:50 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-a582a333-eda6-4f0f-ae95-c56563a81788 req-f90bce46-eb4b-45dc-9a5d-11e08eb56864 service nova] Lock "9c31c5b8-5485-4603-853a-8b7ef7efa843-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:10:50 user nova-compute[72129]: DEBUG nova.compute.manager [req-a582a333-eda6-4f0f-ae95-c56563a81788 req-f90bce46-eb4b-45dc-9a5d-11e08eb56864 service nova] [instance: 9c31c5b8-5485-4603-853a-8b7ef7efa843] No waiting events found dispatching network-vif-plugged-063c7c09-178e-47eb-92e2-76003c6356a3 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:10:50 user nova-compute[72129]: WARNING nova.compute.manager [req-a582a333-eda6-4f0f-ae95-c56563a81788 req-f90bce46-eb4b-45dc-9a5d-11e08eb56864 service nova] [instance: 9c31c5b8-5485-4603-853a-8b7ef7efa843] Received unexpected event network-vif-plugged-063c7c09-178e-47eb-92e2-76003c6356a3 for instance with vm_state building and task_state spawning.
Aug 01 14:10:51 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:10:51 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:10:51 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:10:51 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:10:51 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:10:52 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:10:52 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72129) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 14:10:52 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690899052.647803, 9c31c5b8-5485-4603-853a-8b7ef7efa843 => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:10:52 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 9c31c5b8-5485-4603-853a-8b7ef7efa843] VM Resumed (Lifecycle Event)
Aug 01 14:10:52 user nova-compute[72129]: DEBUG nova.compute.manager [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] [instance: 9c31c5b8-5485-4603-853a-8b7ef7efa843] Instance event wait completed in 0 seconds for  {{(pid=72129) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 14:10:52 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] [instance: 9c31c5b8-5485-4603-853a-8b7ef7efa843] Guest created on hypervisor {{(pid=72129) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 14:10:52 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 9c31c5b8-5485-4603-853a-8b7ef7efa843] Instance spawned successfully.
Aug 01 14:10:52 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] [instance: 9c31c5b8-5485-4603-853a-8b7ef7efa843] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 14:10:52 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 9c31c5b8-5485-4603-853a-8b7ef7efa843] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:10:52 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 9c31c5b8-5485-4603-853a-8b7ef7efa843] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:10:52 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] [instance: 9c31c5b8-5485-4603-853a-8b7ef7efa843] Found default for hw_cdrom_bus of ide {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:10:52 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] [instance: 9c31c5b8-5485-4603-853a-8b7ef7efa843] Found default for hw_disk_bus of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:10:52 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] [instance: 9c31c5b8-5485-4603-853a-8b7ef7efa843] Found default for hw_input_bus of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:10:52 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] [instance: 9c31c5b8-5485-4603-853a-8b7ef7efa843] Found default for hw_pointer_model of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:10:52 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] [instance: 9c31c5b8-5485-4603-853a-8b7ef7efa843] Found default for hw_video_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:10:52 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] [instance: 9c31c5b8-5485-4603-853a-8b7ef7efa843] Found default for hw_vif_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:10:52 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 9c31c5b8-5485-4603-853a-8b7ef7efa843] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 14:10:52 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690899052.649747, 9c31c5b8-5485-4603-853a-8b7ef7efa843 => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:10:52 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 9c31c5b8-5485-4603-853a-8b7ef7efa843] VM Started (Lifecycle Event)
Aug 01 14:10:52 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 9c31c5b8-5485-4603-853a-8b7ef7efa843] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:10:52 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 9c31c5b8-5485-4603-853a-8b7ef7efa843] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:10:52 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 9c31c5b8-5485-4603-853a-8b7ef7efa843] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 14:10:52 user nova-compute[72129]: INFO nova.compute.manager [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] [instance: 9c31c5b8-5485-4603-853a-8b7ef7efa843] Took 5.33 seconds to spawn the instance on the hypervisor.
Aug 01 14:10:52 user nova-compute[72129]: DEBUG nova.compute.manager [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] [instance: 9c31c5b8-5485-4603-853a-8b7ef7efa843] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:10:52 user nova-compute[72129]: DEBUG nova.compute.manager [req-8b8b83f2-6cf9-432f-ac15-82ce507ffae6 req-9acbf623-1cb6-42d8-a7e5-c26fb41aab62 service nova] [instance: 9c31c5b8-5485-4603-853a-8b7ef7efa843] Received event network-vif-plugged-063c7c09-178e-47eb-92e2-76003c6356a3 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:10:52 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-8b8b83f2-6cf9-432f-ac15-82ce507ffae6 req-9acbf623-1cb6-42d8-a7e5-c26fb41aab62 service nova] Acquiring lock "9c31c5b8-5485-4603-853a-8b7ef7efa843-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:10:52 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-8b8b83f2-6cf9-432f-ac15-82ce507ffae6 req-9acbf623-1cb6-42d8-a7e5-c26fb41aab62 service nova] Lock "9c31c5b8-5485-4603-853a-8b7ef7efa843-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:10:52 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-8b8b83f2-6cf9-432f-ac15-82ce507ffae6 req-9acbf623-1cb6-42d8-a7e5-c26fb41aab62 service nova] Lock "9c31c5b8-5485-4603-853a-8b7ef7efa843-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:10:52 user nova-compute[72129]: DEBUG nova.compute.manager [req-8b8b83f2-6cf9-432f-ac15-82ce507ffae6 req-9acbf623-1cb6-42d8-a7e5-c26fb41aab62 service nova] [instance: 9c31c5b8-5485-4603-853a-8b7ef7efa843] No waiting events found dispatching network-vif-plugged-063c7c09-178e-47eb-92e2-76003c6356a3 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:10:52 user nova-compute[72129]: WARNING nova.compute.manager [req-8b8b83f2-6cf9-432f-ac15-82ce507ffae6 req-9acbf623-1cb6-42d8-a7e5-c26fb41aab62 service nova] [instance: 9c31c5b8-5485-4603-853a-8b7ef7efa843] Received unexpected event network-vif-plugged-063c7c09-178e-47eb-92e2-76003c6356a3 for instance with vm_state building and task_state spawning.
Aug 01 14:10:52 user nova-compute[72129]: INFO nova.compute.manager [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] [instance: 9c31c5b8-5485-4603-853a-8b7ef7efa843] Took 5.94 seconds to build instance.
Aug 01 14:10:52 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-86ae69dd-0180-4371-a290-c9dd7c423efe tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Lock "9c31c5b8-5485-4603-853a-8b7ef7efa843" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.052s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:10:53 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:10:53 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Starting heal instance info cache {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 14:10:53 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "refresh_cache-d031973f-8f48-43b3-a338-040950103e4c" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:10:53 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquired lock "refresh_cache-d031973f-8f48-43b3-a338-040950103e4c" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:10:53 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: d031973f-8f48-43b3-a338-040950103e4c] Forcefully refreshing network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 14:10:53 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: d031973f-8f48-43b3-a338-040950103e4c] Updating instance_info_cache with network_info: [{"id": "a978f40a-6406-423f-81f7-1e8077b43fd5", "address": "fa:16:3e:09:fd:e5", "network": {"id": "59b1e538-8bfe-45ce-ab7b-c5838ab25582", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1129024349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0929886fa54d1c8023793806f10d31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa978f40a-64", "ovs_interfaceid": "a978f40a-6406-423f-81f7-1e8077b43fd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:10:53 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Releasing lock "refresh_cache-d031973f-8f48-43b3-a338-040950103e4c" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:10:53 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: d031973f-8f48-43b3-a338-040950103e4c] Updated the network info_cache for instance {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 14:10:54 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:10:54 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:10:55 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:10:56 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:10:56 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:10:56 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:10:56 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:10:58 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:10:58 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:10:58 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:10:58 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:10:58 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:10:58 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Auditing locally available compute resources for user (node: user) {{(pid=72129) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 14:10:58 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 14:10:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:10:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:10:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:10:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:10:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c43fda3-e098-4c3a-bcd5-14eac019db06/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:10:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c43fda3-e098-4c3a-bcd5-14eac019db06/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:10:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c43fda3-e098-4c3a-bcd5-14eac019db06/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:10:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c43fda3-e098-4c3a-bcd5-14eac019db06/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:10:58 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 14:10:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c31c5b8-5485-4603-853a-8b7ef7efa843/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:10:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c31c5b8-5485-4603-853a-8b7ef7efa843/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:10:58 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c31c5b8-5485-4603-853a-8b7ef7efa843/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:10:59 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c31c5b8-5485-4603-853a-8b7ef7efa843/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:10:59 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 14:10:59 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:10:59 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:10:59 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:10:59 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Hypervisor/Node resource view: name=user free_ram=8293MB free_disk=25.05755615234375GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72129) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 14:10:59 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:10:59 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:10:59 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:10:59 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance d031973f-8f48-43b3-a338-040950103e4c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:10:59 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 0c43fda3-e098-4c3a-bcd5-14eac019db06 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:10:59 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 418f4c53-9dc5-402f-ad21-ac481674b083 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:10:59 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:10:59 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 9c31c5b8-5485-4603-853a-8b7ef7efa843 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:10:59 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 14:10:59 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 14:10:59 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Refreshing inventories for resource provider c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 14:10:59 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Updating ProviderTree inventory for provider c2f345c3-9b82-4164-b21d-1eef8e661842 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 14:10:59 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Updating inventory in ProviderTree for provider c2f345c3-9b82-4164-b21d-1eef8e661842 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 14:10:59 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Refreshing aggregate associations for resource provider c2f345c3-9b82-4164-b21d-1eef8e661842, aggregates: None {{(pid=72129) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 14:10:59 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Refreshing trait associations for resource provider c2f345c3-9b82-4164-b21d-1eef8e661842, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE {{(pid=72129) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 14:11:00 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:11:00 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:11:00 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Compute_service record updated for user:user {{(pid=72129) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 14:11:00 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.600s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:11:02 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:11:02 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72129) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 14:11:02 user nova-compute[72129]: DEBUG nova.compute.manager [req-f9979e09-ce1b-4e82-8ec1-ac75275184fb req-ec130c98-a429-435a-bfdd-32df45f78135 service nova] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Received event network-changed-a5aad1a2-0499-4725-9837-ee171ff0b048 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:11:02 user nova-compute[72129]: DEBUG nova.compute.manager [req-f9979e09-ce1b-4e82-8ec1-ac75275184fb req-ec130c98-a429-435a-bfdd-32df45f78135 service nova] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Refreshing instance network info cache due to event network-changed-a5aad1a2-0499-4725-9837-ee171ff0b048. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 14:11:02 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f9979e09-ce1b-4e82-8ec1-ac75275184fb req-ec130c98-a429-435a-bfdd-32df45f78135 service nova] Acquiring lock "refresh_cache-71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:11:02 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f9979e09-ce1b-4e82-8ec1-ac75275184fb req-ec130c98-a429-435a-bfdd-32df45f78135 service nova] Acquired lock "refresh_cache-71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:11:02 user nova-compute[72129]: DEBUG nova.network.neutron [req-f9979e09-ce1b-4e82-8ec1-ac75275184fb req-ec130c98-a429-435a-bfdd-32df45f78135 service nova] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Refreshing network info cache for port a5aad1a2-0499-4725-9837-ee171ff0b048 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 14:11:03 user nova-compute[72129]: DEBUG nova.network.neutron [req-f9979e09-ce1b-4e82-8ec1-ac75275184fb req-ec130c98-a429-435a-bfdd-32df45f78135 service nova] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Updated VIF entry in instance network info cache for port a5aad1a2-0499-4725-9837-ee171ff0b048. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 14:11:03 user nova-compute[72129]: DEBUG nova.network.neutron [req-f9979e09-ce1b-4e82-8ec1-ac75275184fb req-ec130c98-a429-435a-bfdd-32df45f78135 service nova] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Updating instance_info_cache with network_info: [{"id": "a5aad1a2-0499-4725-9837-ee171ff0b048", "address": "fa:16:3e:0d:87:39", "network": {"id": "a7f4226b-73fe-4265-ba2c-5d7dcdf154fd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1142462884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210837255c8148ec9b482ba3e2551362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5aad1a2-04", "ovs_interfaceid": "a5aad1a2-0499-4725-9837-ee171ff0b048", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:11:03 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f9979e09-ce1b-4e82-8ec1-ac75275184fb req-ec130c98-a429-435a-bfdd-32df45f78135 service nova] Releasing lock "refresh_cache-71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:11:04 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Acquiring lock "1e06fb45-d156-451b-9e4d-e3d2fed52c37" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:11:04 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lock "1e06fb45-d156-451b-9e4d-e3d2fed52c37" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:11:04 user nova-compute[72129]: INFO nova.compute.manager [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Unshelving
Aug 01 14:11:04 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:11:04 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:11:04 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:11:04 user nova-compute[72129]: DEBUG nova.objects.instance [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lazy-loading 'pci_requests' on Instance uuid 1e06fb45-d156-451b-9e4d-e3d2fed52c37 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:11:04 user nova-compute[72129]: DEBUG nova.objects.instance [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lazy-loading 'numa_topology' on Instance uuid 1e06fb45-d156-451b-9e4d-e3d2fed52c37 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:11:04 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72129) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 14:11:04 user nova-compute[72129]: INFO nova.compute.claims [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Claim successful on node user
Aug 01 14:11:04 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:11:04 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:11:04 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.364s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:11:04 user nova-compute[72129]: INFO nova.network.neutron [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Updating port 3811b72e-705a-4336-ac66-a0fed51437e4 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 01 14:11:05 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Acquiring lock "refresh_cache-1e06fb45-d156-451b-9e4d-e3d2fed52c37" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:11:05 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Acquired lock "refresh_cache-1e06fb45-d156-451b-9e4d-e3d2fed52c37" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:11:05 user nova-compute[72129]: DEBUG nova.network.neutron [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 14:11:05 user nova-compute[72129]: DEBUG nova.compute.manager [req-98665257-0a21-4594-b25e-cb56636d926a req-3027a8b6-84c8-4100-8b96-6d2a1c8ceb85 service nova] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Received event network-changed-3811b72e-705a-4336-ac66-a0fed51437e4 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:11:05 user nova-compute[72129]: DEBUG nova.compute.manager [req-98665257-0a21-4594-b25e-cb56636d926a req-3027a8b6-84c8-4100-8b96-6d2a1c8ceb85 service nova] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Refreshing instance network info cache due to event network-changed-3811b72e-705a-4336-ac66-a0fed51437e4. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 14:11:05 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-98665257-0a21-4594-b25e-cb56636d926a req-3027a8b6-84c8-4100-8b96-6d2a1c8ceb85 service nova] Acquiring lock "refresh_cache-1e06fb45-d156-451b-9e4d-e3d2fed52c37" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:11:06 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:11:06 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-3d1bbdcb-d9b6-4356-b081-1ea07940a6ae tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Acquiring lock "418f4c53-9dc5-402f-ad21-ac481674b083" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:11:06 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-3d1bbdcb-d9b6-4356-b081-1ea07940a6ae tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "418f4c53-9dc5-402f-ad21-ac481674b083" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:11:06 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-3d1bbdcb-d9b6-4356-b081-1ea07940a6ae tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Acquiring lock "418f4c53-9dc5-402f-ad21-ac481674b083-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:11:06 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-3d1bbdcb-d9b6-4356-b081-1ea07940a6ae tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "418f4c53-9dc5-402f-ad21-ac481674b083-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:11:06 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-3d1bbdcb-d9b6-4356-b081-1ea07940a6ae tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "418f4c53-9dc5-402f-ad21-ac481674b083-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:11:06 user nova-compute[72129]: INFO nova.compute.manager [None req-3d1bbdcb-d9b6-4356-b081-1ea07940a6ae tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Terminating instance
Aug 01 14:11:06 user nova-compute[72129]: DEBUG nova.compute.manager [None req-3d1bbdcb-d9b6-4356-b081-1ea07940a6ae tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Start destroying the instance on the hypervisor. {{(pid=72129) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 14:11:06 user nova-compute[72129]: DEBUG nova.network.neutron [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Updating instance_info_cache with network_info: [{"id": "3811b72e-705a-4336-ac66-a0fed51437e4", "address": "fa:16:3e:a3:60:b1", "network": {"id": "ce10dac7-17d0-425a-bfee-70b8220d7871", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1288141476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b724093fa43c4afb9130efa2cfc713d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3811b72e-70", "ovs_interfaceid": "3811b72e-705a-4336-ac66-a0fed51437e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:11:06 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Releasing lock "refresh_cache-1e06fb45-d156-451b-9e4d-e3d2fed52c37" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:11:06 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Creating instance directory {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 14:11:06 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Creating image(s)
Aug 01 14:11:06 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Acquiring lock "/opt/stack/data/nova/instances/1e06fb45-d156-451b-9e4d-e3d2fed52c37/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:11:06 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lock "/opt/stack/data/nova/instances/1e06fb45-d156-451b-9e4d-e3d2fed52c37/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:11:06 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lock "/opt/stack/data/nova/instances/1e06fb45-d156-451b-9e4d-e3d2fed52c37/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:11:06 user nova-compute[72129]: DEBUG nova.objects.instance [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1e06fb45-d156-451b-9e4d-e3d2fed52c37 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:11:06 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:11:06 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-98665257-0a21-4594-b25e-cb56636d926a req-3027a8b6-84c8-4100-8b96-6d2a1c8ceb85 service nova] Acquired lock "refresh_cache-1e06fb45-d156-451b-9e4d-e3d2fed52c37" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:11:06 user nova-compute[72129]: DEBUG nova.network.neutron [req-98665257-0a21-4594-b25e-cb56636d926a req-3027a8b6-84c8-4100-8b96-6d2a1c8ceb85 service nova] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Refreshing network info cache for port 3811b72e-705a-4336-ac66-a0fed51437e4 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 14:11:06 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Acquiring lock "d29a7563eb5bfa925c0d90feb1007a113b5ce7a9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:11:06 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lock "d29a7563eb5bfa925c0d90feb1007a113b5ce7a9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:11:06 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:11:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d29a7563eb5bfa925c0d90feb1007a113b5ce7a9.part --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:11:07 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:11:07 user nova-compute[72129]: DEBUG nova.compute.manager [req-bf7014f1-36e8-47e3-9b11-504aa96c395c req-1bb72349-e947-4329-b7ee-3e13bb1124b0 service nova] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Received event network-vif-unplugged-df042689-7692-445c-89d8-cc6d908dd216 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:11:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-bf7014f1-36e8-47e3-9b11-504aa96c395c req-1bb72349-e947-4329-b7ee-3e13bb1124b0 service nova] Acquiring lock "418f4c53-9dc5-402f-ad21-ac481674b083-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:11:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-bf7014f1-36e8-47e3-9b11-504aa96c395c req-1bb72349-e947-4329-b7ee-3e13bb1124b0 service nova] Lock "418f4c53-9dc5-402f-ad21-ac481674b083-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:11:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-bf7014f1-36e8-47e3-9b11-504aa96c395c req-1bb72349-e947-4329-b7ee-3e13bb1124b0 service nova] Lock "418f4c53-9dc5-402f-ad21-ac481674b083-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:11:07 user nova-compute[72129]: DEBUG nova.compute.manager [req-bf7014f1-36e8-47e3-9b11-504aa96c395c req-1bb72349-e947-4329-b7ee-3e13bb1124b0 service nova] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] No waiting events found dispatching network-vif-unplugged-df042689-7692-445c-89d8-cc6d908dd216 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:11:07 user nova-compute[72129]: DEBUG nova.compute.manager [req-bf7014f1-36e8-47e3-9b11-504aa96c395c req-1bb72349-e947-4329-b7ee-3e13bb1124b0 service nova] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Received event network-vif-unplugged-df042689-7692-445c-89d8-cc6d908dd216 for instance with task_state deleting. {{(pid=72129) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 14:11:07 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Instance destroyed successfully.
Aug 01 14:11:07 user nova-compute[72129]: DEBUG nova.objects.instance [None req-3d1bbdcb-d9b6-4356-b081-1ea07940a6ae tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lazy-loading 'resources' on Instance uuid 418f4c53-9dc5-402f-ad21-ac481674b083 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:11:07 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-3d1bbdcb-d9b6-4356-b081-1ea07940a6ae tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:05:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1423869095',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1423869095',id=31,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T14:07:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1e0929886fa54d1c8023793806f10d31',ramdisk_id='',reservation_id='r-677hcku4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1414609013',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T14:09:20Z,user_data=None,user_id='cdb6f66592fe4cdebea02e5f5c1f4a60',uuid=418f4c53-9dc5-402f-ad21-ac481674b083,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "df042689-7692-445c-89d8-cc6d908dd216", "address": "fa:16:3e:33:ea:dd", "network": {"id": "59b1e538-8bfe-45ce-ab7b-c5838ab25582", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1129024349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0929886fa54d1c8023793806f10d31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf042689-76", "ovs_interfaceid": "df042689-7692-445c-89d8-cc6d908dd216", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 14:11:07 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-3d1bbdcb-d9b6-4356-b081-1ea07940a6ae tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Converting VIF {"id": "df042689-7692-445c-89d8-cc6d908dd216", "address": "fa:16:3e:33:ea:dd", "network": {"id": "59b1e538-8bfe-45ce-ab7b-c5838ab25582", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1129024349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0929886fa54d1c8023793806f10d31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf042689-76", "ovs_interfaceid": "df042689-7692-445c-89d8-cc6d908dd216", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:11:07 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-3d1bbdcb-d9b6-4356-b081-1ea07940a6ae tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:ea:dd,bridge_name='br-int',has_traffic_filtering=True,id=df042689-7692-445c-89d8-cc6d908dd216,network=Network(59b1e538-8bfe-45ce-ab7b-c5838ab25582),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf042689-76') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:11:07 user nova-compute[72129]: DEBUG os_vif [None req-3d1bbdcb-d9b6-4356-b081-1ea07940a6ae tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:ea:dd,bridge_name='br-int',has_traffic_filtering=True,id=df042689-7692-445c-89d8-cc6d908dd216,network=Network(59b1e538-8bfe-45ce-ab7b-c5838ab25582),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf042689-76') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 14:11:07 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:11:07 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdf042689-76, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:11:07 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:11:07 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:11:07 user nova-compute[72129]: INFO os_vif [None req-3d1bbdcb-d9b6-4356-b081-1ea07940a6ae tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:ea:dd,bridge_name='br-int',has_traffic_filtering=True,id=df042689-7692-445c-89d8-cc6d908dd216,network=Network(59b1e538-8bfe-45ce-ab7b-c5838ab25582),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf042689-76')
Aug 01 14:11:07 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d1bbdcb-d9b6-4356-b081-1ea07940a6ae tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] calling os-brick to detach iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 14:11:07 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d1bbdcb-d9b6-4356-b081-1ea07940a6ae tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, {'target_iqns': ['iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CthoGEYk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:11:07 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-3d1bbdcb-d9b6-4356-b081-1ea07940a6ae tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:11:07 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-3d1bbdcb-d9b6-4356-b081-1ea07940a6ae tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:11:07 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-3d1bbdcb-d9b6-4356-b081-1ea07940a6ae tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:11:07 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d1bbdcb-d9b6-4356-b081-1ea07940a6ae tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057', 0)] {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 14:11:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:11:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:11:07 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[e162d6dd-453d-4812-ba7e-e77de16e5284]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:11:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:11:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d29a7563eb5bfa925c0d90feb1007a113b5ce7a9.part --force-share --output=json" returned: 0 in 0.156s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:11:07 user nova-compute[72129]: DEBUG nova.virt.images [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] bcf2b967-a2ef-4852-b6b4-156c8364bc4f was qcow2, converting to raw {{(pid=72129) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 14:11:07 user nova-compute[72129]: DEBUG nova.privsep.utils [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72129) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 14:11:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d29a7563eb5bfa925c0d90feb1007a113b5ce7a9.part /opt/stack/data/nova/instances/_base/d29a7563eb5bfa925c0d90feb1007a113b5ce7a9.converted {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:11:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:11:07 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[53888444-1597-4113-a3bb-220a1377cc51]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:11:07 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d1bbdcb-d9b6-4356-b081-1ea07940a6ae tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:11:07 user nova-compute[72129]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 (non-flash)
Aug 01 14:11:07 user nova-compute[72129]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 (non-flash)
Aug 01 14:11:07 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:11:07 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d1bbdcb-d9b6-4356-b081-1ea07940a6ae tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:11:07 user nova-compute[72129]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 (non-flash)
Aug 01 14:11:07 user nova-compute[72129]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 (non-flash)
Aug 01 14:11:07 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:11:07 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d1bbdcb-d9b6-4356-b081-1ea07940a6ae tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f28105b8ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057'): ({'sdb'}, set())}) {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 14:11:07 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-3d1bbdcb-d9b6-4356-b081-1ea07940a6ae tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Removing single pathed devices sdb {{(pid=72129) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 14:11:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:11:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:11:07 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[981f4bd8-a47f-401a-8fae-80bdbc06c2be]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:11:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:11:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:11:07 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[943a88d0-2a51-4b45-b28c-e55946dda1b5]: (4, ('ok\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:11:07 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-3d1bbdcb-d9b6-4356-b081-1ea07940a6ae tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Flushing IO for device /dev/sdb {{(pid=72129) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 14:11:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:11:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:11:07 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8ce88a-a015-4f56-a3ed-7a70a2813525]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:11:07 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-3d1bbdcb-d9b6-4356-b081-1ea07940a6ae tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72129) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 14:11:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:11:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d29a7563eb5bfa925c0d90feb1007a113b5ce7a9.part /opt/stack/data/nova/instances/_base/d29a7563eb5bfa925c0d90feb1007a113b5ce7a9.converted" returned: 0 in 0.294s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:11:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d29a7563eb5bfa925c0d90feb1007a113b5ce7a9.converted --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:11:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.169s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:11:08 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[882aac6a-e25f-406e-914b-459f6fc89fa2]: (4, ('1', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:11:08 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-3d1bbdcb-d9b6-4356-b081-1ea07940a6ae tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 14:11:08 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-3d1bbdcb-d9b6-4356-b081-1ea07940a6ae tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] SCSI volumes sdb have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 14:11:08 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d1bbdcb-d9b6-4356-b081-1ea07940a6ae tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057')] {{(pid=72129) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 14:11:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:11:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:11:08 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49be033-4b5b-4369-9b1b-dc9c03eb1fc4]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:11:08 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d1bbdcb-d9b6-4356-b081-1ea07940a6ae tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:11:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 -p 172.16.0.220:3260 --logout {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:11:08 user nova-compute[72129]: DEBUG nova.network.neutron [req-98665257-0a21-4594-b25e-cb56636d926a req-3027a8b6-84c8-4100-8b96-6d2a1c8ceb85 service nova] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Updated VIF entry in instance network info cache for port 3811b72e-705a-4336-ac66-a0fed51437e4. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 14:11:08 user nova-compute[72129]: DEBUG nova.network.neutron [req-98665257-0a21-4594-b25e-cb56636d926a req-3027a8b6-84c8-4100-8b96-6d2a1c8ceb85 service nova] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Updating instance_info_cache with network_info: [{"id": "3811b72e-705a-4336-ac66-a0fed51437e4", "address": "fa:16:3e:a3:60:b1", "network": {"id": "ce10dac7-17d0-425a-bfee-70b8220d7871", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1288141476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b724093fa43c4afb9130efa2cfc713d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3811b72e-70", "ovs_interfaceid": "3811b72e-705a-4336-ac66-a0fed51437e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:11:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:11:08 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf14437-0e1d-4daf-8b91-d66cd6186f2b]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:11:08 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d1bbdcb-d9b6-4356-b081-1ea07940a6ae tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057, portal: 172.16.0.220,3260]
Aug 01 14:11:08 user nova-compute[72129]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057, portal: 172.16.0.220,3260] successful.
Aug 01 14:11:08 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:11:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 -p 172.16.0.220:3260 --op delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:11:08 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-98665257-0a21-4594-b25e-cb56636d926a req-3027a8b6-84c8-4100-8b96-6d2a1c8ceb85 service nova] Releasing lock "refresh_cache-1e06fb45-d156-451b-9e4d-e3d2fed52c37" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:11:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d29a7563eb5bfa925c0d90feb1007a113b5ce7a9.converted --force-share --output=json" returned: 0 in 0.156s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:11:08 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lock "d29a7563eb5bfa925c0d90feb1007a113b5ce7a9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.547s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:11:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d29a7563eb5bfa925c0d90feb1007a113b5ce7a9 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:11:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80fd8043-1d68-4b79-b574-464fdf0b8057 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:11:08 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ca0031-c1cb-4d10-ad94-79a88b2dc0f7]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:11:08 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d1bbdcb-d9b6-4356-b081-1ea07940a6ae tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:11:08 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-3d1bbdcb-d9b6-4356-b081-1ea07940a6ae tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.556s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:11:08 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d1bbdcb-d9b6-4356-b081-1ea07940a6ae tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] <== disconnect_volume: return (558ms) None {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:11:08 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d1bbdcb-d9b6-4356-b081-1ea07940a6ae tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Disconnected iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 14:11:08 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-3d1bbdcb-d9b6-4356-b081-1ea07940a6ae tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Deleting instance files /opt/stack/data/nova/instances/418f4c53-9dc5-402f-ad21-ac481674b083_del
Aug 01 14:11:08 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-3d1bbdcb-d9b6-4356-b081-1ea07940a6ae tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Deletion of /opt/stack/data/nova/instances/418f4c53-9dc5-402f-ad21-ac481674b083_del complete
Aug 01 14:11:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d29a7563eb5bfa925c0d90feb1007a113b5ce7a9 --force-share --output=json" returned: 0 in 0.202s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:11:08 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Acquiring lock "d29a7563eb5bfa925c0d90feb1007a113b5ce7a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:11:08 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lock "d29a7563eb5bfa925c0d90feb1007a113b5ce7a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:11:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d29a7563eb5bfa925c0d90feb1007a113b5ce7a9 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:11:08 user nova-compute[72129]: INFO nova.compute.manager [None req-3d1bbdcb-d9b6-4356-b081-1ea07940a6ae tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Took 1.90 seconds to destroy the instance on the hypervisor.
Aug 01 14:11:08 user nova-compute[72129]: DEBUG oslo.service.loopingcall [None req-3d1bbdcb-d9b6-4356-b081-1ea07940a6ae tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72129) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 14:11:08 user nova-compute[72129]: DEBUG nova.compute.manager [-] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Deallocating network for instance {{(pid=72129) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 14:11:08 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] deallocate_for_instance() {{(pid=72129) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 14:11:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d29a7563eb5bfa925c0d90feb1007a113b5ce7a9 --force-share --output=json" returned: 0 in 0.139s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:11:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d29a7563eb5bfa925c0d90feb1007a113b5ce7a9,backing_fmt=raw /opt/stack/data/nova/instances/1e06fb45-d156-451b-9e4d-e3d2fed52c37/disk 1073741824 {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:11:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d29a7563eb5bfa925c0d90feb1007a113b5ce7a9,backing_fmt=raw /opt/stack/data/nova/instances/1e06fb45-d156-451b-9e4d-e3d2fed52c37/disk 1073741824" returned: 0 in 0.056s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:11:08 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lock "d29a7563eb5bfa925c0d90feb1007a113b5ce7a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:11:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d29a7563eb5bfa925c0d90feb1007a113b5ce7a9 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:11:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d29a7563eb5bfa925c0d90feb1007a113b5ce7a9 --force-share --output=json" returned: 0 in 0.136s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:11:08 user nova-compute[72129]: DEBUG nova.objects.instance [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lazy-loading 'migration_context' on Instance uuid 1e06fb45-d156-451b-9e4d-e3d2fed52c37 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:11:08 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Rebasing disk image.
Aug 01 14:11:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:11:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.138s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:11:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 -F raw /opt/stack/data/nova/instances/1e06fb45-d156-451b-9e4d-e3d2fed52c37/disk {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:11:08 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:11:08 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Took 0.53 seconds to deallocate network for instance.
Aug 01 14:11:08 user nova-compute[72129]: DEBUG nova.compute.manager [req-d9ee9f52-5e41-43e0-95f3-efbc837bccbb req-6af61f23-8ea1-4077-90a6-49f7f9c485c6 service nova] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Received event network-vif-deleted-df042689-7692-445c-89d8-cc6d908dd216 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:11:08 user nova-compute[72129]: INFO nova.compute.manager [req-d9ee9f52-5e41-43e0-95f3-efbc837bccbb req-6af61f23-8ea1-4077-90a6-49f7f9c485c6 service nova] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Neutron deleted interface df042689-7692-445c-89d8-cc6d908dd216; detaching it from the instance and deleting it from the info cache
Aug 01 14:11:08 user nova-compute[72129]: DEBUG nova.network.neutron [req-d9ee9f52-5e41-43e0-95f3-efbc837bccbb req-6af61f23-8ea1-4077-90a6-49f7f9c485c6 service nova] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:11:08 user nova-compute[72129]: DEBUG nova.compute.manager [req-d9ee9f52-5e41-43e0-95f3-efbc837bccbb req-6af61f23-8ea1-4077-90a6-49f7f9c485c6 service nova] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Detach interface failed, port_id=df042689-7692-445c-89d8-cc6d908dd216, reason: Instance 418f4c53-9dc5-402f-ad21-ac481674b083 could not be found. {{(pid=72129) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 14:11:09 user nova-compute[72129]: DEBUG nova.compute.manager [req-1e190e1a-7670-4ece-96ab-e329c4cf5b27 req-371ada23-469b-44f1-af3c-5b621f43ae56 service nova] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Received event network-vif-plugged-df042689-7692-445c-89d8-cc6d908dd216 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:11:09 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-1e190e1a-7670-4ece-96ab-e329c4cf5b27 req-371ada23-469b-44f1-af3c-5b621f43ae56 service nova] Acquiring lock "418f4c53-9dc5-402f-ad21-ac481674b083-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:11:09 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-1e190e1a-7670-4ece-96ab-e329c4cf5b27 req-371ada23-469b-44f1-af3c-5b621f43ae56 service nova] Lock "418f4c53-9dc5-402f-ad21-ac481674b083-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:11:09 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-1e190e1a-7670-4ece-96ab-e329c4cf5b27 req-371ada23-469b-44f1-af3c-5b621f43ae56 service nova] Lock "418f4c53-9dc5-402f-ad21-ac481674b083-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:11:09 user nova-compute[72129]: DEBUG nova.compute.manager [req-1e190e1a-7670-4ece-96ab-e329c4cf5b27 req-371ada23-469b-44f1-af3c-5b621f43ae56 service nova] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] No waiting events found dispatching network-vif-plugged-df042689-7692-445c-89d8-cc6d908dd216 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:11:09 user nova-compute[72129]: WARNING nova.compute.manager [req-1e190e1a-7670-4ece-96ab-e329c4cf5b27 req-371ada23-469b-44f1-af3c-5b621f43ae56 service nova] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Received unexpected event network-vif-plugged-df042689-7692-445c-89d8-cc6d908dd216 for instance with vm_state active and task_state deleting.
Aug 01 14:11:09 user nova-compute[72129]: INFO nova.compute.manager [None req-3d1bbdcb-d9b6-4356-b081-1ea07940a6ae tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Took 0.73 seconds to detach 1 volumes for instance.
Aug 01 14:11:09 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-3d1bbdcb-d9b6-4356-b081-1ea07940a6ae tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:11:09 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-3d1bbdcb-d9b6-4356-b081-1ea07940a6ae tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:11:09 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-3d1bbdcb-d9b6-4356-b081-1ea07940a6ae tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:11:09 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-3d1bbdcb-d9b6-4356-b081-1ea07940a6ae tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:11:10 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-3d1bbdcb-d9b6-4356-b081-1ea07940a6ae tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.454s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:11:10 user nova-compute[72129]: INFO nova.scheduler.client.report [None req-3d1bbdcb-d9b6-4356-b081-1ea07940a6ae tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Deleted allocations for instance 418f4c53-9dc5-402f-ad21-ac481674b083
Aug 01 14:11:10 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-3d1bbdcb-d9b6-4356-b081-1ea07940a6ae tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "418f4c53-9dc5-402f-ad21-ac481674b083" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.855s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:11:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 -F raw /opt/stack/data/nova/instances/1e06fb45-d156-451b-9e4d-e3d2fed52c37/disk" returned: 0 in 2.369s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:11:11 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Created local disks {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 14:11:11 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Ensure instance console log exists: /opt/stack/data/nova/instances/1e06fb45-d156-451b-9e4d-e3d2fed52c37/console.log {{(pid=72129) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 14:11:11 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:11:11 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:11:11 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:11:11 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Start _get_guest_xml network_info=[{"id": "3811b72e-705a-4336-ac66-a0fed51437e4", "address": "fa:16:3e:a3:60:b1", "network": {"id": "ce10dac7-17d0-425a-bfee-70b8220d7871", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1288141476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b724093fa43c4afb9130efa2cfc713d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3811b72e-70", "ovs_interfaceid": "3811b72e-705a-4336-ac66-a0fed51437e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='26e8ef9c1330550d4438e868fbfca98a',container_format='bare',created_at=2023-08-01T14:09:12Z,direct_url=<?>,disk_format='qcow2',id=bcf2b967-a2ef-4852-b6b4-156c8364bc4f,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1528036097-shelved',owner='b724093fa43c4afb9130efa2cfc713d9',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-01T14:09:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'image_id': 'b6472c34-1b0f-4034-ba3a-7e8eb5103715'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 14:11:11 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:11:11 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:11:11 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:11:11 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 14:11:11 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] CPU controller missing on host. {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 14:11:11 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 14:11:11 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] CPU controller found on host. {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 14:11:11 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72129) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 14:11:11 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T13:45:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='26e8ef9c1330550d4438e868fbfca98a',container_format='bare',created_at=2023-08-01T14:09:12Z,direct_url=<?>,disk_format='qcow2',id=bcf2b967-a2ef-4852-b6b4-156c8364bc4f,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1528036097-shelved',owner='b724093fa43c4afb9130efa2cfc713d9',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-01T14:09:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 14:11:11 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Flavor limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 14:11:11 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Image limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 14:11:11 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Flavor pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 14:11:11 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Image pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 14:11:11 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 14:11:11 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 14:11:11 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 14:11:11 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Got 1 possible topologies {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 14:11:11 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 14:11:11 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 14:11:11 user nova-compute[72129]: DEBUG nova.objects.instance [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1e06fb45-d156-451b-9e4d-e3d2fed52c37 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:11:11 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T14:07:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1528036097',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1528036097',id=33,image_ref='bcf2b967-a2ef-4852-b6b4-156c8364bc4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-12459561',keypairs=<?>,launch_index=0,launched_at=2023-08-01T14:07:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b724093fa43c4afb9130efa2cfc713d9',ramdisk_id='',reservation_id='r-29k01a26',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1864942034',owner_user_name='tempest-AttachVolumeShelveTestJSON-1864942034-project-member',shelved_at='2023-08-01T14:09:15.134491',shelved_host='user',shelved_image_id='bcf2b967-a2ef-4852-b6b4-156c8364bc4f'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T14:11:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e5630ede467c4c99915b1b2f455ca0fb',uuid=1e06fb45-d156-451b-9e4d-e3d2fed52c37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "3811b72e-705a-4336-ac66-a0fed51437e4", "address": "fa:16:3e:a3:60:b1", "network": {"id": "ce10dac7-17d0-425a-bfee-70b8220d7871", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1288141476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b724093fa43c4afb9130efa2cfc713d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3811b72e-70", "ovs_interfaceid": "3811b72e-705a-4336-ac66-a0fed51437e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 14:11:11 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Converting VIF {"id": "3811b72e-705a-4336-ac66-a0fed51437e4", "address": "fa:16:3e:a3:60:b1", "network": {"id": "ce10dac7-17d0-425a-bfee-70b8220d7871", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1288141476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b724093fa43c4afb9130efa2cfc713d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3811b72e-70", "ovs_interfaceid": "3811b72e-705a-4336-ac66-a0fed51437e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:11:11 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:60:b1,bridge_name='br-int',has_traffic_filtering=True,id=3811b72e-705a-4336-ac66-a0fed51437e4,network=Network(ce10dac7-17d0-425a-bfee-70b8220d7871),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3811b72e-70') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:11:11 user nova-compute[72129]: DEBUG nova.objects.instance [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lazy-loading 'pci_devices' on Instance uuid 1e06fb45-d156-451b-9e4d-e3d2fed52c37 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:11:11 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] End _get_guest_xml xml=<domain type="kvm">
Aug 01 14:11:11 user nova-compute[72129]:   <uuid>1e06fb45-d156-451b-9e4d-e3d2fed52c37</uuid>
Aug 01 14:11:11 user nova-compute[72129]:   <name>instance-00000021</name>
Aug 01 14:11:11 user nova-compute[72129]:   <memory>524288</memory>
Aug 01 14:11:11 user nova-compute[72129]:   <vcpu>1</vcpu>
Aug 01 14:11:11 user nova-compute[72129]:   <metadata>
Aug 01 14:11:11 user nova-compute[72129]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 14:11:11 user nova-compute[72129]:       <nova:package version="0.0.0"/>
Aug 01 14:11:11 user nova-compute[72129]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1528036097</nova:name>
Aug 01 14:11:11 user nova-compute[72129]:       <nova:creationTime>2023-08-01 14:11:11</nova:creationTime>
Aug 01 14:11:11 user nova-compute[72129]:       <nova:flavor name="m1.tiny">
Aug 01 14:11:11 user nova-compute[72129]:         <nova:memory>512</nova:memory>
Aug 01 14:11:11 user nova-compute[72129]:         <nova:disk>1</nova:disk>
Aug 01 14:11:11 user nova-compute[72129]:         <nova:swap>0</nova:swap>
Aug 01 14:11:11 user nova-compute[72129]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 14:11:11 user nova-compute[72129]:         <nova:vcpus>1</nova:vcpus>
Aug 01 14:11:11 user nova-compute[72129]:       </nova:flavor>
Aug 01 14:11:11 user nova-compute[72129]:       <nova:owner>
Aug 01 14:11:11 user nova-compute[72129]:         <nova:user uuid="e5630ede467c4c99915b1b2f455ca0fb">tempest-AttachVolumeShelveTestJSON-1864942034-project-member</nova:user>
Aug 01 14:11:11 user nova-compute[72129]:         <nova:project uuid="b724093fa43c4afb9130efa2cfc713d9">tempest-AttachVolumeShelveTestJSON-1864942034</nova:project>
Aug 01 14:11:11 user nova-compute[72129]:       </nova:owner>
Aug 01 14:11:11 user nova-compute[72129]:       <nova:root type="image" uuid="bcf2b967-a2ef-4852-b6b4-156c8364bc4f"/>
Aug 01 14:11:11 user nova-compute[72129]:       <nova:ports>
Aug 01 14:11:11 user nova-compute[72129]:         <nova:port uuid="3811b72e-705a-4336-ac66-a0fed51437e4">
Aug 01 14:11:11 user nova-compute[72129]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 01 14:11:11 user nova-compute[72129]:         </nova:port>
Aug 01 14:11:11 user nova-compute[72129]:       </nova:ports>
Aug 01 14:11:11 user nova-compute[72129]:     </nova:instance>
Aug 01 14:11:11 user nova-compute[72129]:   </metadata>
Aug 01 14:11:11 user nova-compute[72129]:   <sysinfo type="smbios">
Aug 01 14:11:11 user nova-compute[72129]:     <system>
Aug 01 14:11:11 user nova-compute[72129]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 14:11:11 user nova-compute[72129]:       <entry name="product">OpenStack Nova</entry>
Aug 01 14:11:11 user nova-compute[72129]:       <entry name="version">0.0.0</entry>
Aug 01 14:11:11 user nova-compute[72129]:       <entry name="serial">1e06fb45-d156-451b-9e4d-e3d2fed52c37</entry>
Aug 01 14:11:11 user nova-compute[72129]:       <entry name="uuid">1e06fb45-d156-451b-9e4d-e3d2fed52c37</entry>
Aug 01 14:11:11 user nova-compute[72129]:       <entry name="family">Virtual Machine</entry>
Aug 01 14:11:11 user nova-compute[72129]:     </system>
Aug 01 14:11:11 user nova-compute[72129]:   </sysinfo>
Aug 01 14:11:11 user nova-compute[72129]:   <os>
Aug 01 14:11:11 user nova-compute[72129]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 14:11:11 user nova-compute[72129]:     <boot dev="hd"/>
Aug 01 14:11:11 user nova-compute[72129]:     <smbios mode="sysinfo"/>
Aug 01 14:11:11 user nova-compute[72129]:   </os>
Aug 01 14:11:11 user nova-compute[72129]:   <features>
Aug 01 14:11:11 user nova-compute[72129]:     <acpi/>
Aug 01 14:11:11 user nova-compute[72129]:     <apic/>
Aug 01 14:11:11 user nova-compute[72129]:     <vmcoreinfo/>
Aug 01 14:11:11 user nova-compute[72129]:   </features>
Aug 01 14:11:11 user nova-compute[72129]:   <clock offset="utc">
Aug 01 14:11:11 user nova-compute[72129]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 14:11:11 user nova-compute[72129]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 14:11:11 user nova-compute[72129]:     <timer name="hpet" present="no"/>
Aug 01 14:11:11 user nova-compute[72129]:   </clock>
Aug 01 14:11:11 user nova-compute[72129]:   <cpu mode="custom" match="exact">
Aug 01 14:11:11 user nova-compute[72129]:     <model>Nehalem</model>
Aug 01 14:11:11 user nova-compute[72129]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 14:11:11 user nova-compute[72129]:   </cpu>
Aug 01 14:11:11 user nova-compute[72129]:   <devices>
Aug 01 14:11:11 user nova-compute[72129]:     <disk type="file" device="disk">
Aug 01 14:11:11 user nova-compute[72129]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 14:11:11 user nova-compute[72129]:       <source file="/opt/stack/data/nova/instances/1e06fb45-d156-451b-9e4d-e3d2fed52c37/disk"/>
Aug 01 14:11:11 user nova-compute[72129]:       <target dev="vda" bus="virtio"/>
Aug 01 14:11:11 user nova-compute[72129]:     </disk>
Aug 01 14:11:11 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 14:11:11 user nova-compute[72129]:       <mac address="fa:16:3e:a3:60:b1"/>
Aug 01 14:11:11 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:11:11 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 14:11:11 user nova-compute[72129]:       <target dev="tap3811b72e-70"/>
Aug 01 14:11:11 user nova-compute[72129]:     </interface>
Aug 01 14:11:11 user nova-compute[72129]:     <serial type="pty">
Aug 01 14:11:11 user nova-compute[72129]:       <log file="/opt/stack/data/nova/instances/1e06fb45-d156-451b-9e4d-e3d2fed52c37/console.log" append="off"/>
Aug 01 14:11:11 user nova-compute[72129]:     </serial>
Aug 01 14:11:11 user nova-compute[72129]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 14:11:11 user nova-compute[72129]:     <video>
Aug 01 14:11:11 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:11:11 user nova-compute[72129]:     </video>
Aug 01 14:11:11 user nova-compute[72129]:     <rng model="virtio">
Aug 01 14:11:11 user nova-compute[72129]:       <backend model="random">/dev/urandom</backend>
Aug 01 14:11:11 user nova-compute[72129]:     </rng>
Aug 01 14:11:11 user nova-compute[72129]:     <controller type="usb" index="0" model="none"/>
Aug 01 14:11:11 user nova-compute[72129]:     <memballoon model="virtio">
Aug 01 14:11:11 user nova-compute[72129]:       <stats period="10"/>
Aug 01 14:11:11 user nova-compute[72129]:     </memballoon>
Aug 01 14:11:11 user nova-compute[72129]:   </devices>
Aug 01 14:11:11 user nova-compute[72129]: </domain>
Aug 01 14:11:11 user nova-compute[72129]:  {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 14:11:11 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T14:07:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1528036097',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1528036097',id=33,image_ref='bcf2b967-a2ef-4852-b6b4-156c8364bc4f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-12459561',keypairs=<?>,launch_index=0,launched_at=2023-08-01T14:07:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b724093fa43c4afb9130efa2cfc713d9',ramdisk_id='',reservation_id='r-29k01a26',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1864942034',owner_user_name='tempest-AttachVolumeShelveTestJSON-1864942034-project-member',shelved_at='2023-08-01T14:09:15.134491',shelved_host='user',shelved_image_id='bcf2b967-a2ef-4852-b6b4-156c8364bc4f'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T14:11:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e5630ede467c4c99915b1b2f455ca0fb',uuid=1e06fb45-d156-451b-9e4d-e3d2fed52c37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "3811b72e-705a-4336-ac66-a0fed51437e4", "address": "fa:16:3e:a3:60:b1", "network": {"id": "ce10dac7-17d0-425a-bfee-70b8220d7871", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1288141476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b724093fa43c4afb9130efa2cfc713d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3811b72e-70", "ovs_interfaceid": "3811b72e-705a-4336-ac66-a0fed51437e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 14:11:11 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Converting VIF {"id": "3811b72e-705a-4336-ac66-a0fed51437e4", "address": "fa:16:3e:a3:60:b1", "network": {"id": "ce10dac7-17d0-425a-bfee-70b8220d7871", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1288141476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b724093fa43c4afb9130efa2cfc713d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3811b72e-70", "ovs_interfaceid": "3811b72e-705a-4336-ac66-a0fed51437e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:11:11 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:60:b1,bridge_name='br-int',has_traffic_filtering=True,id=3811b72e-705a-4336-ac66-a0fed51437e4,network=Network(ce10dac7-17d0-425a-bfee-70b8220d7871),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3811b72e-70') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:11:11 user nova-compute[72129]: DEBUG os_vif [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:60:b1,bridge_name='br-int',has_traffic_filtering=True,id=3811b72e-705a-4336-ac66-a0fed51437e4,network=Network(ce10dac7-17d0-425a-bfee-70b8220d7871),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3811b72e-70') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 14:11:11 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:11:11 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:11:11 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 14:11:11 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:11:11 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3811b72e-70, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:11:11 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3811b72e-70, col_values=(('external_ids', {'iface-id': '3811b72e-705a-4336-ac66-a0fed51437e4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:60:b1', 'vm-uuid': '1e06fb45-d156-451b-9e4d-e3d2fed52c37'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:11:11 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:11:11 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:11:11 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:11:11 user nova-compute[72129]: INFO os_vif [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:60:b1,bridge_name='br-int',has_traffic_filtering=True,id=3811b72e-705a-4336-ac66-a0fed51437e4,network=Network(ce10dac7-17d0-425a-bfee-70b8220d7871),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3811b72e-70')
Aug 01 14:11:11 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:11:11 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] No VIF found with MAC fa:16:3e:a3:60:b1, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 14:11:12 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:11:12 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:11:12 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:11:12 user nova-compute[72129]: DEBUG nova.compute.manager [req-d9284f25-e5ef-40de-934a-84cc24d7caae req-70f0dafa-7a05-4359-ae1d-aeb3e23600d7 service nova] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Received event network-vif-plugged-3811b72e-705a-4336-ac66-a0fed51437e4 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:11:12 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-d9284f25-e5ef-40de-934a-84cc24d7caae req-70f0dafa-7a05-4359-ae1d-aeb3e23600d7 service nova] Acquiring lock "1e06fb45-d156-451b-9e4d-e3d2fed52c37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:11:12 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-d9284f25-e5ef-40de-934a-84cc24d7caae req-70f0dafa-7a05-4359-ae1d-aeb3e23600d7 service nova] Lock "1e06fb45-d156-451b-9e4d-e3d2fed52c37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:11:12 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-d9284f25-e5ef-40de-934a-84cc24d7caae req-70f0dafa-7a05-4359-ae1d-aeb3e23600d7 service nova] Lock "1e06fb45-d156-451b-9e4d-e3d2fed52c37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:11:12 user nova-compute[72129]: DEBUG nova.compute.manager [req-d9284f25-e5ef-40de-934a-84cc24d7caae req-70f0dafa-7a05-4359-ae1d-aeb3e23600d7 service nova] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] No waiting events found dispatching network-vif-plugged-3811b72e-705a-4336-ac66-a0fed51437e4 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:11:12 user nova-compute[72129]: WARNING nova.compute.manager [req-d9284f25-e5ef-40de-934a-84cc24d7caae req-70f0dafa-7a05-4359-ae1d-aeb3e23600d7 service nova] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Received unexpected event network-vif-plugged-3811b72e-705a-4336-ac66-a0fed51437e4 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 01 14:11:13 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:11:13 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:11:13 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:11:13 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:11:14 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:11:14 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Acquiring lock "fc0c1916-fd16-4379-9739-bcb03643b42e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:11:14 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "fc0c1916-fd16-4379-9739-bcb03643b42e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:11:14 user nova-compute[72129]: DEBUG nova.compute.manager [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Starting instance... {{(pid=72129) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 14:11:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:11:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:11:15 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72129) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 14:11:15 user nova-compute[72129]: INFO nova.compute.claims [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Claim successful on node user
Aug 01 14:11:15 user nova-compute[72129]: DEBUG nova.compute.manager [req-6a070cad-85e3-4fcb-bbc8-08ce227c3eb6 req-7aadd2d0-82e2-4cdd-ad00-6721e92cd45b service nova] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Received event network-vif-plugged-3811b72e-705a-4336-ac66-a0fed51437e4 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:11:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-6a070cad-85e3-4fcb-bbc8-08ce227c3eb6 req-7aadd2d0-82e2-4cdd-ad00-6721e92cd45b service nova] Acquiring lock "1e06fb45-d156-451b-9e4d-e3d2fed52c37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:11:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-6a070cad-85e3-4fcb-bbc8-08ce227c3eb6 req-7aadd2d0-82e2-4cdd-ad00-6721e92cd45b service nova] Lock "1e06fb45-d156-451b-9e4d-e3d2fed52c37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:11:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-6a070cad-85e3-4fcb-bbc8-08ce227c3eb6 req-7aadd2d0-82e2-4cdd-ad00-6721e92cd45b service nova] Lock "1e06fb45-d156-451b-9e4d-e3d2fed52c37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:11:15 user nova-compute[72129]: DEBUG nova.compute.manager [req-6a070cad-85e3-4fcb-bbc8-08ce227c3eb6 req-7aadd2d0-82e2-4cdd-ad00-6721e92cd45b service nova] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] No waiting events found dispatching network-vif-plugged-3811b72e-705a-4336-ac66-a0fed51437e4 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:11:15 user nova-compute[72129]: WARNING nova.compute.manager [req-6a070cad-85e3-4fcb-bbc8-08ce227c3eb6 req-7aadd2d0-82e2-4cdd-ad00-6721e92cd45b service nova] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Received unexpected event network-vif-plugged-3811b72e-705a-4336-ac66-a0fed51437e4 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 01 14:11:15 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690899075.1636696, 1e06fb45-d156-451b-9e4d-e3d2fed52c37 => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:11:15 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] VM Resumed (Lifecycle Event)
Aug 01 14:11:15 user nova-compute[72129]: DEBUG nova.compute.manager [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Instance event wait completed in 0 seconds for  {{(pid=72129) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 14:11:15 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Guest created on hypervisor {{(pid=72129) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 14:11:15 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Instance spawned successfully.
Aug 01 14:11:15 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:11:15 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:11:15 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 14:11:15 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690899075.168976, 1e06fb45-d156-451b-9e4d-e3d2fed52c37 => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:11:15 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] VM Started (Lifecycle Event)
Aug 01 14:11:15 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:11:15 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:11:15 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 14:11:15 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:11:15 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:11:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.384s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:11:15 user nova-compute[72129]: DEBUG nova.compute.manager [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Start building networks asynchronously for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 14:11:15 user nova-compute[72129]: DEBUG nova.compute.manager [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:11:15 user nova-compute[72129]: DEBUG nova.compute.manager [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Allocating IP information in the background. {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 14:11:15 user nova-compute[72129]: DEBUG nova.network.neutron [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] allocate_for_instance() {{(pid=72129) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 14:11:15 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 14:11:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-06d6a2b5-4fe3-40ed-abf4-c7caa740ebb2 tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lock "1e06fb45-d156-451b-9e4d-e3d2fed52c37" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.091s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:11:15 user nova-compute[72129]: DEBUG nova.compute.manager [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Start building block device mappings for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 14:11:15 user nova-compute[72129]: DEBUG nova.policy [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7c341be2816c43cfa9adb58ee84e942b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '210837255c8148ec9b482ba3e2551362', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72129) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 14:11:15 user nova-compute[72129]: INFO nova.virt.block_device [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Booting with volume f9b58b04-6855-4ece-b021-cba7a3a62f4b at /dev/vda
Aug 01 14:11:15 user nova-compute[72129]: DEBUG os_brick.utils [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:11:15 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:11:15 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:11:15 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[1113465b-5e2a-4607-b90e-1cb221a699cf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f9b449c2cd3d\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:11:15 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:11:15 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:11:15 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[5096abbb-b407-4265-90c9-263200649d66]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:11:15 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:11:15 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:11:15 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b517b4-4312-4229-8e9c-cfb734a91d80]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:11:15 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ec8658-622e-48b1-a8f0-804486c78bea]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:11:15 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Running cmd (subprocess): nvme version {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:11:15 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] 'nvme version' failed. Not Retrying. {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 14:11:15 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] nvme not present on system {{(pid=72129) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 14:11:15 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:11:15 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 14:11:15 user nova-compute[72129]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 14:11:15 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7425af6-8453-4475-b2b0-4d42966d63f4]: (4, '') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:11:15 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72129) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 14:11:15 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 14:11:15 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] LIGHTOS: no hostnqn found. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 14:11:15 user nova-compute[72129]: DEBUG os_brick.utils [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f9b449c2cd3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:11:15 user nova-compute[72129]: DEBUG nova.virt.block_device [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Updating existing volume attachment record: 301c7d5f-23f6-4fcf-ba76-1a3dbf845baf {{(pid=72129) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 14:11:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:11:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:11:16 user nova-compute[72129]: DEBUG nova.network.neutron [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Successfully created port: 06b5806a-5009-4492-ab48-159cae6c002e {{(pid=72129) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 14:11:17 user nova-compute[72129]: DEBUG nova.network.neutron [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Successfully updated port: 06b5806a-5009-4492-ab48-159cae6c002e {{(pid=72129) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 14:11:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Acquiring lock "refresh_cache-fc0c1916-fd16-4379-9739-bcb03643b42e" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:11:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Acquired lock "refresh_cache-fc0c1916-fd16-4379-9739-bcb03643b42e" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:11:17 user nova-compute[72129]: DEBUG nova.network.neutron [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 14:11:17 user nova-compute[72129]: DEBUG nova.compute.manager [req-ad6bc9d9-2d18-4766-905b-102606bbd1ef req-1171a2fa-b017-400d-975c-f5493fa9c80a service nova] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Received event network-changed-06b5806a-5009-4492-ab48-159cae6c002e {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:11:17 user nova-compute[72129]: DEBUG nova.compute.manager [req-ad6bc9d9-2d18-4766-905b-102606bbd1ef req-1171a2fa-b017-400d-975c-f5493fa9c80a service nova] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Refreshing instance network info cache due to event network-changed-06b5806a-5009-4492-ab48-159cae6c002e. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 14:11:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ad6bc9d9-2d18-4766-905b-102606bbd1ef req-1171a2fa-b017-400d-975c-f5493fa9c80a service nova] Acquiring lock "refresh_cache-fc0c1916-fd16-4379-9739-bcb03643b42e" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:11:17 user nova-compute[72129]: DEBUG nova.network.neutron [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Instance cache missing network info. {{(pid=72129) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 14:11:17 user nova-compute[72129]: DEBUG nova.network.neutron [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Updating instance_info_cache with network_info: [{"id": "06b5806a-5009-4492-ab48-159cae6c002e", "address": "fa:16:3e:b6:04:68", "network": {"id": "a7f4226b-73fe-4265-ba2c-5d7dcdf154fd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1142462884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210837255c8148ec9b482ba3e2551362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06b5806a-50", "ovs_interfaceid": "06b5806a-5009-4492-ab48-159cae6c002e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:11:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Releasing lock "refresh_cache-fc0c1916-fd16-4379-9739-bcb03643b42e" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:11:17 user nova-compute[72129]: DEBUG nova.compute.manager [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Instance network_info: |[{"id": "06b5806a-5009-4492-ab48-159cae6c002e", "address": "fa:16:3e:b6:04:68", "network": {"id": "a7f4226b-73fe-4265-ba2c-5d7dcdf154fd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1142462884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210837255c8148ec9b482ba3e2551362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06b5806a-50", "ovs_interfaceid": "06b5806a-5009-4492-ab48-159cae6c002e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 14:11:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ad6bc9d9-2d18-4766-905b-102606bbd1ef req-1171a2fa-b017-400d-975c-f5493fa9c80a service nova] Acquired lock "refresh_cache-fc0c1916-fd16-4379-9739-bcb03643b42e" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:11:17 user nova-compute[72129]: DEBUG nova.network.neutron [req-ad6bc9d9-2d18-4766-905b-102606bbd1ef req-1171a2fa-b017-400d-975c-f5493fa9c80a service nova] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Refreshing network info cache for port 06b5806a-5009-4492-ab48-159cae6c002e {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 14:11:18 user nova-compute[72129]: DEBUG nova.network.neutron [req-ad6bc9d9-2d18-4766-905b-102606bbd1ef req-1171a2fa-b017-400d-975c-f5493fa9c80a service nova] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Updated VIF entry in instance network info cache for port 06b5806a-5009-4492-ab48-159cae6c002e. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 14:11:18 user nova-compute[72129]: DEBUG nova.network.neutron [req-ad6bc9d9-2d18-4766-905b-102606bbd1ef req-1171a2fa-b017-400d-975c-f5493fa9c80a service nova] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Updating instance_info_cache with network_info: [{"id": "06b5806a-5009-4492-ab48-159cae6c002e", "address": "fa:16:3e:b6:04:68", "network": {"id": "a7f4226b-73fe-4265-ba2c-5d7dcdf154fd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1142462884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210837255c8148ec9b482ba3e2551362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06b5806a-50", "ovs_interfaceid": "06b5806a-5009-4492-ab48-159cae6c002e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:11:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ad6bc9d9-2d18-4766-905b-102606bbd1ef req-1171a2fa-b017-400d-975c-f5493fa9c80a service nova] Releasing lock "refresh_cache-fc0c1916-fd16-4379-9739-bcb03643b42e" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:11:19 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:11:19 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Cleaning up deleted instances {{(pid=72129) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 14:11:19 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] There are 0 instances to clean {{(pid=72129) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 14:11:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:11:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:11:22 user nova-compute[72129]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690899067.270988, 418f4c53-9dc5-402f-ad21-ac481674b083 => Stopped> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:11:22 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] VM Stopped (Lifecycle Event)
Aug 01 14:11:22 user nova-compute[72129]: DEBUG nova.compute.manager [None req-27e1fb90-9843-4e90-9ef7-ff14535cc6dc None None] [instance: 418f4c53-9dc5-402f-ad21-ac481674b083] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:11:23 user nova-compute[72129]: DEBUG nova.compute.manager [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Start spawning the instance on the hypervisor. {{(pid=72129) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 14:11:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Creating instance directory {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 14:11:23 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Creating image(s)
Aug 01 14:11:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Did not create local disks {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 14:11:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Ensure instance console log exists: /opt/stack/data/nova/instances/fc0c1916-fd16-4379-9739-bcb03643b42e/console.log {{(pid=72129) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 14:11:23 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:11:23 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:11:23 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:11:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Start _get_guest_xml network_info=[{"id": "06b5806a-5009-4492-ab48-159cae6c002e", "address": "fa:16:3e:b6:04:68", "network": {"id": "a7f4226b-73fe-4265-ba2c-5d7dcdf154fd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1142462884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210837255c8148ec9b482ba3e2551362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06b5806a-50", "ovs_interfaceid": "06b5806a-5009-4492-ab48-159cae6c002e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '301c7d5f-23f6-4fcf-ba76-1a3dbf845baf', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f9b58b04-6855-4ece-b021-cba7a3a62f4b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iMaKPdWb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fc0c1916-fd16-4379-9739-bcb03643b42e', 'attached_at': '', 'detached_at': '', 'volume_id': 'f9b58b04-6855-4ece-b021-cba7a3a62f4b', 'serial': 'f9b58b04-6855-4ece-b021-cba7a3a62f4b'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 14:11:23 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:11:23 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:11:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 14:11:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] CPU controller missing on host. {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 14:11:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 14:11:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] CPU controller found on host. {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 14:11:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72129) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 14:11:23 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T13:45:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 14:11:23 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Flavor limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 14:11:23 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Image limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 14:11:23 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Flavor pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 14:11:23 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Image pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 14:11:23 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 14:11:23 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 14:11:23 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 14:11:23 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Got 1 possible topologies {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 14:11:23 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 14:11:23 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 14:11:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Calling os-brick to attach iSCSI Volume {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 14:11:23 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f9b58b04-6855-4ece-b021-cba7a3a62f4b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iMaKPdWb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:11:23 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:11:23 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:11:23 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:11:23 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:11:23 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9b58b04-6855-4ece-b021-cba7a3a62f4b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:11:23 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9b58b04-6855-4ece-b021-cba7a3a62f4b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:11:23 user nova-compute[72129]: INFO os_brick.initiator.connectors.iscsi [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 14:11:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9b58b04-6855-4ece-b021-cba7a3a62f4b -p 172.16.0.220:3260 {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:11:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9b58b04-6855-4ece-b021-cba7a3a62f4b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:11:23 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ff790e-d138-45b6-8993-20d8e2d26e21]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:11:23 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 14:11:23 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:11:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9b58b04-6855-4ece-b021-cba7a3a62f4b -p 172.16.0.220:3260 --interface default --op new {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:11:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9b58b04-6855-4ece-b021-cba7a3a62f4b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:11:23 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a831b2db-e7ea-4b87-9202-8f2c635560c7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f9b58b04-6855-4ece-b021-cba7a3a62f4b] added\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:11:23 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f9b58b04-6855-4ece-b021-cba7a3a62f4b] added
Aug 01 14:11:23 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:11:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9b58b04-6855-4ece-b021-cba7a3a62f4b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:11:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9b58b04-6855-4ece-b021-cba7a3a62f4b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:11:23 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e5c763-b287-4411-88a7-42341c16a578]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:11:23 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:11:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9b58b04-6855-4ece-b021-cba7a3a62f4b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:11:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9b58b04-6855-4ece-b021-cba7a3a62f4b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:11:23 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[78aa3515-62c0-4e21-a2e0-41a938d01ae0]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:11:23 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:11:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9b58b04-6855-4ece-b021-cba7a3a62f4b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iMaKPdWb {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:11:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9b58b04-6855-4ece-b021-cba7a3a62f4b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iMaKPdWb" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:11:23 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[7383f051-649b-4970-b0ae-3c23943dcb79]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:11:23 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iMaKPdWb'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:11:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9b58b04-6855-4ece-b021-cba7a3a62f4b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:11:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9b58b04-6855-4ece-b021-cba7a3a62f4b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:11:23 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4071a8-5fc1-45af-8fb1-586dca474c2e]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:11:23 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:11:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:11:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:11:23 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[76077ade-3143-48d4-9572-116b69d9307d]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:11:23 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:11:23 user nova-compute[72129]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 (non-flash)
Aug 01 14:11:23 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:11:23 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:11:23 user nova-compute[72129]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 (non-flash)
Aug 01 14:11:23 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:11:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9b58b04-6855-4ece-b021-cba7a3a62f4b -p 172.16.0.220:3260 --login {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:11:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9b58b04-6855-4ece-b021-cba7a3a62f4b -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:11:24 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeff1f18-806c-4551-a725-cbc5303ce478]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f9b58b04-6855-4ece-b021-cba7a3a62f4b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f9b58b04-6855-4ece-b021-cba7a3a62f4b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:11:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f9b58b04-6855-4ece-b021-cba7a3a62f4b, portal: 172.16.0.220,3260]
Aug 01 14:11:24 user nova-compute[72129]: Login to [iface: default, target: iqn.2010-10.org.openstack:f9b58b04-6855-4ece-b021-cba7a3a62f4b, portal: 172.16.0.220,3260] successful.
Aug 01 14:11:24 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:11:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9b58b04-6855-4ece-b021-cba7a3a62f4b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:11:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9b58b04-6855-4ece-b021-cba7a3a62f4b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:11:24 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[8814ad9d-1b33-4a7d-b177-cc5796a2b15d]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:11:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:11:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:11:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:11:24 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[76112991-2724-4363-9d9f-b2f94282b212]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b58b04-6855-4ece-b021-cba7a3a62f4b (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:11:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:11:24 user nova-compute[72129]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 (non-flash)
Aug 01 14:11:24 user nova-compute[72129]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b58b04-6855-4ece-b021-cba7a3a62f4b (non-flash)
Aug 01 14:11:24 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:11:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:11:24 user nova-compute[72129]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 (non-flash)
Aug 01 14:11:24 user nova-compute[72129]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b58b04-6855-4ece-b021-cba7a3a62f4b (non-flash)
Aug 01 14:11:24 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:11:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9b58b04-6855-4ece-b021-cba7a3a62f4b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:11:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Connected to 172.16.0.220:3260 {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 14:11:24 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=72129) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 14:11:24 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72129) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 14:11:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:11:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:11:24 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67f1ab9-5bec-4d6c-9039-5d026f8e1b62]: (4, ('- - 0', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:11:24 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 14:11:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iMaKPdWb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 14:11:25 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:11:25 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23766386166316634', 'path': '/dev/sdb'} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:11:25 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23766386166316634', 'path': '/dev/sdb'} {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 14:11:25 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:11:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1474611541',display_name='tempest-TestVolumeBootPattern-server-1474611541',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1474611541',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNC/W23SfZUyUykD+/RvnPe5L4yiaqOIZwhr2x6wMubzv0aJUgMCBBDug36LSArw18K2rZhhyJmbPtRQrPLsQ9v32QcGWNTH4aynBroBlcsIvr6dB/z67zo0JXowDVQS+w==',key_name='tempest-TestVolumeBootPattern-1986080939',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='210837255c8148ec9b482ba3e2551362',ramdisk_id='',reservation_id='r-i10d9c73',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1876154436',owner_user_name='tempest-TestVolumeBootPattern-1876154436-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T14:11:16Z,user_data=None,user_id='7c341be2816c43cfa9adb58ee84e942b',uuid=fc0c1916-fd16-4379-9739-bcb03643b42e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "06b5806a-5009-4492-ab48-159cae6c002e", "address": "fa:16:3e:b6:04:68", "network": {"id": "a7f4226b-73fe-4265-ba2c-5d7dcdf154fd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1142462884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210837255c8148ec9b482ba3e2551362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06b5806a-50", "ovs_interfaceid": "06b5806a-5009-4492-ab48-159cae6c002e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 14:11:25 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Converting VIF {"id": "06b5806a-5009-4492-ab48-159cae6c002e", "address": "fa:16:3e:b6:04:68", "network": {"id": "a7f4226b-73fe-4265-ba2c-5d7dcdf154fd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1142462884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210837255c8148ec9b482ba3e2551362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06b5806a-50", "ovs_interfaceid": "06b5806a-5009-4492-ab48-159cae6c002e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:11:25 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:04:68,bridge_name='br-int',has_traffic_filtering=True,id=06b5806a-5009-4492-ab48-159cae6c002e,network=Network(a7f4226b-73fe-4265-ba2c-5d7dcdf154fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06b5806a-50') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:11:25 user nova-compute[72129]: DEBUG nova.objects.instance [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lazy-loading 'pci_devices' on Instance uuid fc0c1916-fd16-4379-9739-bcb03643b42e {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:11:25 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] End _get_guest_xml xml=<domain type="kvm">
Aug 01 14:11:25 user nova-compute[72129]:   <uuid>fc0c1916-fd16-4379-9739-bcb03643b42e</uuid>
Aug 01 14:11:25 user nova-compute[72129]:   <name>instance-00000025</name>
Aug 01 14:11:25 user nova-compute[72129]:   <memory>524288</memory>
Aug 01 14:11:25 user nova-compute[72129]:   <vcpu>1</vcpu>
Aug 01 14:11:25 user nova-compute[72129]:   <metadata>
Aug 01 14:11:25 user nova-compute[72129]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 14:11:25 user nova-compute[72129]:       <nova:package version="0.0.0"/>
Aug 01 14:11:25 user nova-compute[72129]:       <nova:name>tempest-TestVolumeBootPattern-server-1474611541</nova:name>
Aug 01 14:11:25 user nova-compute[72129]:       <nova:creationTime>2023-08-01 14:11:23</nova:creationTime>
Aug 01 14:11:25 user nova-compute[72129]:       <nova:flavor name="m1.tiny">
Aug 01 14:11:25 user nova-compute[72129]:         <nova:memory>512</nova:memory>
Aug 01 14:11:25 user nova-compute[72129]:         <nova:disk>1</nova:disk>
Aug 01 14:11:25 user nova-compute[72129]:         <nova:swap>0</nova:swap>
Aug 01 14:11:25 user nova-compute[72129]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 14:11:25 user nova-compute[72129]:         <nova:vcpus>1</nova:vcpus>
Aug 01 14:11:25 user nova-compute[72129]:       </nova:flavor>
Aug 01 14:11:25 user nova-compute[72129]:       <nova:owner>
Aug 01 14:11:25 user nova-compute[72129]:         <nova:user uuid="7c341be2816c43cfa9adb58ee84e942b">tempest-TestVolumeBootPattern-1876154436-project-member</nova:user>
Aug 01 14:11:25 user nova-compute[72129]:         <nova:project uuid="210837255c8148ec9b482ba3e2551362">tempest-TestVolumeBootPattern-1876154436</nova:project>
Aug 01 14:11:25 user nova-compute[72129]:       </nova:owner>
Aug 01 14:11:25 user nova-compute[72129]:       <nova:ports>
Aug 01 14:11:25 user nova-compute[72129]:         <nova:port uuid="06b5806a-5009-4492-ab48-159cae6c002e">
Aug 01 14:11:25 user nova-compute[72129]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 01 14:11:25 user nova-compute[72129]:         </nova:port>
Aug 01 14:11:25 user nova-compute[72129]:       </nova:ports>
Aug 01 14:11:25 user nova-compute[72129]:     </nova:instance>
Aug 01 14:11:25 user nova-compute[72129]:   </metadata>
Aug 01 14:11:25 user nova-compute[72129]:   <sysinfo type="smbios">
Aug 01 14:11:25 user nova-compute[72129]:     <system>
Aug 01 14:11:25 user nova-compute[72129]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 14:11:25 user nova-compute[72129]:       <entry name="product">OpenStack Nova</entry>
Aug 01 14:11:25 user nova-compute[72129]:       <entry name="version">0.0.0</entry>
Aug 01 14:11:25 user nova-compute[72129]:       <entry name="serial">fc0c1916-fd16-4379-9739-bcb03643b42e</entry>
Aug 01 14:11:25 user nova-compute[72129]:       <entry name="uuid">fc0c1916-fd16-4379-9739-bcb03643b42e</entry>
Aug 01 14:11:25 user nova-compute[72129]:       <entry name="family">Virtual Machine</entry>
Aug 01 14:11:25 user nova-compute[72129]:     </system>
Aug 01 14:11:25 user nova-compute[72129]:   </sysinfo>
Aug 01 14:11:25 user nova-compute[72129]:   <os>
Aug 01 14:11:25 user nova-compute[72129]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 14:11:25 user nova-compute[72129]:     <boot dev="hd"/>
Aug 01 14:11:25 user nova-compute[72129]:     <smbios mode="sysinfo"/>
Aug 01 14:11:25 user nova-compute[72129]:   </os>
Aug 01 14:11:25 user nova-compute[72129]:   <features>
Aug 01 14:11:25 user nova-compute[72129]:     <acpi/>
Aug 01 14:11:25 user nova-compute[72129]:     <apic/>
Aug 01 14:11:25 user nova-compute[72129]:     <vmcoreinfo/>
Aug 01 14:11:25 user nova-compute[72129]:   </features>
Aug 01 14:11:25 user nova-compute[72129]:   <clock offset="utc">
Aug 01 14:11:25 user nova-compute[72129]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 14:11:25 user nova-compute[72129]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 14:11:25 user nova-compute[72129]:     <timer name="hpet" present="no"/>
Aug 01 14:11:25 user nova-compute[72129]:   </clock>
Aug 01 14:11:25 user nova-compute[72129]:   <cpu mode="custom" match="exact">
Aug 01 14:11:25 user nova-compute[72129]:     <model>Nehalem</model>
Aug 01 14:11:25 user nova-compute[72129]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 14:11:25 user nova-compute[72129]:   </cpu>
Aug 01 14:11:25 user nova-compute[72129]:   <devices>
Aug 01 14:11:25 user nova-compute[72129]:     <disk type="block" device="disk">
Aug 01 14:11:25 user nova-compute[72129]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:11:25 user nova-compute[72129]:       <source dev="/dev/sdb"/>
Aug 01 14:11:25 user nova-compute[72129]:       <target dev="vda" bus="virtio"/>
Aug 01 14:11:25 user nova-compute[72129]:       <serial>f9b58b04-6855-4ece-b021-cba7a3a62f4b</serial>
Aug 01 14:11:25 user nova-compute[72129]:     </disk>
Aug 01 14:11:25 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 14:11:25 user nova-compute[72129]:       <mac address="fa:16:3e:b6:04:68"/>
Aug 01 14:11:25 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:11:25 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 14:11:25 user nova-compute[72129]:       <target dev="tap06b5806a-50"/>
Aug 01 14:11:25 user nova-compute[72129]:     </interface>
Aug 01 14:11:25 user nova-compute[72129]:     <serial type="pty">
Aug 01 14:11:25 user nova-compute[72129]:       <log file="/opt/stack/data/nova/instances/fc0c1916-fd16-4379-9739-bcb03643b42e/console.log" append="off"/>
Aug 01 14:11:25 user nova-compute[72129]:     </serial>
Aug 01 14:11:25 user nova-compute[72129]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 14:11:25 user nova-compute[72129]:     <video>
Aug 01 14:11:25 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:11:25 user nova-compute[72129]:     </video>
Aug 01 14:11:25 user nova-compute[72129]:     <rng model="virtio">
Aug 01 14:11:25 user nova-compute[72129]:       <backend model="random">/dev/urandom</backend>
Aug 01 14:11:25 user nova-compute[72129]:     </rng>
Aug 01 14:11:25 user nova-compute[72129]:     <controller type="usb" index="0" model="none"/>
Aug 01 14:11:25 user nova-compute[72129]:     <memballoon model="virtio">
Aug 01 14:11:25 user nova-compute[72129]:       <stats period="10"/>
Aug 01 14:11:25 user nova-compute[72129]:     </memballoon>
Aug 01 14:11:25 user nova-compute[72129]:   </devices>
Aug 01 14:11:25 user nova-compute[72129]: </domain>
Aug 01 14:11:25 user nova-compute[72129]:  {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 14:11:25 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:11:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1474611541',display_name='tempest-TestVolumeBootPattern-server-1474611541',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1474611541',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNC/W23SfZUyUykD+/RvnPe5L4yiaqOIZwhr2x6wMubzv0aJUgMCBBDug36LSArw18K2rZhhyJmbPtRQrPLsQ9v32QcGWNTH4aynBroBlcsIvr6dB/z67zo0JXowDVQS+w==',key_name='tempest-TestVolumeBootPattern-1986080939',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='210837255c8148ec9b482ba3e2551362',ramdisk_id='',reservation_id='r-i10d9c73',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1876154436',owner_user_name='tempest-TestVolumeBootPattern-1876154436-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T14:11:16Z,user_data=None,user_id='7c341be2816c43cfa9adb58ee84e942b',uuid=fc0c1916-fd16-4379-9739-bcb03643b42e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "06b5806a-5009-4492-ab48-159cae6c002e", "address": "fa:16:3e:b6:04:68", "network": {"id": "a7f4226b-73fe-4265-ba2c-5d7dcdf154fd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1142462884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210837255c8148ec9b482ba3e2551362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06b5806a-50", "ovs_interfaceid": "06b5806a-5009-4492-ab48-159cae6c002e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 14:11:25 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Converting VIF {"id": "06b5806a-5009-4492-ab48-159cae6c002e", "address": "fa:16:3e:b6:04:68", "network": {"id": "a7f4226b-73fe-4265-ba2c-5d7dcdf154fd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1142462884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210837255c8148ec9b482ba3e2551362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06b5806a-50", "ovs_interfaceid": "06b5806a-5009-4492-ab48-159cae6c002e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:11:25 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:04:68,bridge_name='br-int',has_traffic_filtering=True,id=06b5806a-5009-4492-ab48-159cae6c002e,network=Network(a7f4226b-73fe-4265-ba2c-5d7dcdf154fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06b5806a-50') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:11:25 user nova-compute[72129]: DEBUG os_vif [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:04:68,bridge_name='br-int',has_traffic_filtering=True,id=06b5806a-5009-4492-ab48-159cae6c002e,network=Network(a7f4226b-73fe-4265-ba2c-5d7dcdf154fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06b5806a-50') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 14:11:25 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:11:25 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:11:25 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 14:11:25 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:11:25 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap06b5806a-50, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:11:25 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap06b5806a-50, col_values=(('external_ids', {'iface-id': '06b5806a-5009-4492-ab48-159cae6c002e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:04:68', 'vm-uuid': 'fc0c1916-fd16-4379-9739-bcb03643b42e'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:11:25 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:11:25 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:11:25 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:11:25 user nova-compute[72129]: INFO os_vif [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:04:68,bridge_name='br-int',has_traffic_filtering=True,id=06b5806a-5009-4492-ab48-159cae6c002e,network=Network(a7f4226b-73fe-4265-ba2c-5d7dcdf154fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06b5806a-50')
Aug 01 14:11:25 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:11:25 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] No VIF found with MAC fa:16:3e:b6:04:68, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 14:11:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:11:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:11:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:11:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:11:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:11:26 user nova-compute[72129]: DEBUG nova.compute.manager [req-a884a135-61ca-480b-b452-edd9e98f9e30 req-e77330b6-dafe-4ad8-994c-aec467edf0f5 service nova] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Received event network-vif-plugged-06b5806a-5009-4492-ab48-159cae6c002e {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:11:26 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-a884a135-61ca-480b-b452-edd9e98f9e30 req-e77330b6-dafe-4ad8-994c-aec467edf0f5 service nova] Acquiring lock "fc0c1916-fd16-4379-9739-bcb03643b42e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:11:26 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-a884a135-61ca-480b-b452-edd9e98f9e30 req-e77330b6-dafe-4ad8-994c-aec467edf0f5 service nova] Lock "fc0c1916-fd16-4379-9739-bcb03643b42e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:11:26 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-a884a135-61ca-480b-b452-edd9e98f9e30 req-e77330b6-dafe-4ad8-994c-aec467edf0f5 service nova] Lock "fc0c1916-fd16-4379-9739-bcb03643b42e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:11:26 user nova-compute[72129]: DEBUG nova.compute.manager [req-a884a135-61ca-480b-b452-edd9e98f9e30 req-e77330b6-dafe-4ad8-994c-aec467edf0f5 service nova] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] No waiting events found dispatching network-vif-plugged-06b5806a-5009-4492-ab48-159cae6c002e {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:11:26 user nova-compute[72129]: WARNING nova.compute.manager [req-a884a135-61ca-480b-b452-edd9e98f9e30 req-e77330b6-dafe-4ad8-994c-aec467edf0f5 service nova] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Received unexpected event network-vif-plugged-06b5806a-5009-4492-ab48-159cae6c002e for instance with vm_state building and task_state spawning.
Aug 01 14:11:27 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:11:28 user nova-compute[72129]: DEBUG nova.compute.manager [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Instance event wait completed in 0 seconds for  {{(pid=72129) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 14:11:28 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Guest created on hypervisor {{(pid=72129) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 14:11:28 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690899088.742133, fc0c1916-fd16-4379-9739-bcb03643b42e => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:11:28 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] VM Resumed (Lifecycle Event)
Aug 01 14:11:28 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Instance spawned successfully.
Aug 01 14:11:28 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 14:11:28 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:11:28 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:11:28 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Found default for hw_cdrom_bus of ide {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:11:28 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Found default for hw_disk_bus of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:11:28 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Found default for hw_input_bus of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:11:28 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Found default for hw_pointer_model of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:11:28 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Found default for hw_video_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:11:28 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Found default for hw_vif_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:11:28 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 14:11:28 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690899088.743284, fc0c1916-fd16-4379-9739-bcb03643b42e => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:11:28 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] VM Started (Lifecycle Event)
Aug 01 14:11:28 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:11:28 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:11:28 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 14:11:28 user nova-compute[72129]: INFO nova.compute.manager [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Took 5.13 seconds to spawn the instance on the hypervisor.
Aug 01 14:11:28 user nova-compute[72129]: DEBUG nova.compute.manager [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:11:28 user nova-compute[72129]: INFO nova.compute.manager [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Took 13.99 seconds to build instance.
Aug 01 14:11:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a4d64759-5a44-4801-9ad7-34f860aac7d5 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "fc0c1916-fd16-4379-9739-bcb03643b42e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.107s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:11:29 user nova-compute[72129]: DEBUG nova.compute.manager [req-4e6ed0c7-3d2c-4e80-aa33-50e0cafefcfd req-3aa37f2d-06ae-4086-9350-134c2d90bf35 service nova] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Received event network-vif-plugged-06b5806a-5009-4492-ab48-159cae6c002e {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:11:29 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-4e6ed0c7-3d2c-4e80-aa33-50e0cafefcfd req-3aa37f2d-06ae-4086-9350-134c2d90bf35 service nova] Acquiring lock "fc0c1916-fd16-4379-9739-bcb03643b42e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:11:29 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-4e6ed0c7-3d2c-4e80-aa33-50e0cafefcfd req-3aa37f2d-06ae-4086-9350-134c2d90bf35 service nova] Lock "fc0c1916-fd16-4379-9739-bcb03643b42e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:11:29 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-4e6ed0c7-3d2c-4e80-aa33-50e0cafefcfd req-3aa37f2d-06ae-4086-9350-134c2d90bf35 service nova] Lock "fc0c1916-fd16-4379-9739-bcb03643b42e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:11:29 user nova-compute[72129]: DEBUG nova.compute.manager [req-4e6ed0c7-3d2c-4e80-aa33-50e0cafefcfd req-3aa37f2d-06ae-4086-9350-134c2d90bf35 service nova] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] No waiting events found dispatching network-vif-plugged-06b5806a-5009-4492-ab48-159cae6c002e {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:11:29 user nova-compute[72129]: WARNING nova.compute.manager [req-4e6ed0c7-3d2c-4e80-aa33-50e0cafefcfd req-3aa37f2d-06ae-4086-9350-134c2d90bf35 service nova] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Received unexpected event network-vif-plugged-06b5806a-5009-4492-ab48-159cae6c002e for instance with vm_state active and task_state None.
Aug 01 14:11:30 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:11:30 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:11:31 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:11:35 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:11:36 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:11:36 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:11:38 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:11:40 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:11:41 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:11:42 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:11:44 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:11:45 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:11:46 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:11:47 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:11:50 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:11:51 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:11:51 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:11:52 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:11:52 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72129) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 14:11:54 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:11:55 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:11:55 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Starting heal instance info cache {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 14:11:55 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "refresh_cache-0c43fda3-e098-4c3a-bcd5-14eac019db06" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:11:55 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquired lock "refresh_cache-0c43fda3-e098-4c3a-bcd5-14eac019db06" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:11:55 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Forcefully refreshing network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 14:11:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:11:55 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Updating instance_info_cache with network_info: [{"id": "42cfd021-0c3b-4c75-8758-1cf73c652fa4", "address": "fa:16:3e:d5:f1:da", "network": {"id": "59b1e538-8bfe-45ce-ab7b-c5838ab25582", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1129024349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0929886fa54d1c8023793806f10d31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42cfd021-0c", "ovs_interfaceid": "42cfd021-0c3b-4c75-8758-1cf73c652fa4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:11:55 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Releasing lock "refresh_cache-0c43fda3-e098-4c3a-bcd5-14eac019db06" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:11:55 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Updated the network info_cache for instance {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 14:11:56 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:11:56 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:11:57 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:11:57 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-8ee80c2f-e590-4e96-823c-cedbd99f2fbe tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Acquiring lock "0c43fda3-e098-4c3a-bcd5-14eac019db06" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:11:57 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-8ee80c2f-e590-4e96-823c-cedbd99f2fbe tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "0c43fda3-e098-4c3a-bcd5-14eac019db06" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:11:57 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-8ee80c2f-e590-4e96-823c-cedbd99f2fbe tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Acquiring lock "0c43fda3-e098-4c3a-bcd5-14eac019db06-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:11:57 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-8ee80c2f-e590-4e96-823c-cedbd99f2fbe tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "0c43fda3-e098-4c3a-bcd5-14eac019db06-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:11:57 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-8ee80c2f-e590-4e96-823c-cedbd99f2fbe tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "0c43fda3-e098-4c3a-bcd5-14eac019db06-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:11:57 user nova-compute[72129]: INFO nova.compute.manager [None req-8ee80c2f-e590-4e96-823c-cedbd99f2fbe tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Terminating instance
Aug 01 14:11:57 user nova-compute[72129]: DEBUG nova.compute.manager [None req-8ee80c2f-e590-4e96-823c-cedbd99f2fbe tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Start destroying the instance on the hypervisor. {{(pid=72129) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 14:11:57 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:11:57 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:11:57 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:11:57 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:11:57 user nova-compute[72129]: DEBUG nova.compute.manager [req-226f77dd-6ac8-48eb-b4c1-5becb4612f16 req-be7becc1-1a69-4988-af16-b63c46c5f2e5 service nova] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Received event network-vif-unplugged-42cfd021-0c3b-4c75-8758-1cf73c652fa4 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:11:57 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-226f77dd-6ac8-48eb-b4c1-5becb4612f16 req-be7becc1-1a69-4988-af16-b63c46c5f2e5 service nova] Acquiring lock "0c43fda3-e098-4c3a-bcd5-14eac019db06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:11:57 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-226f77dd-6ac8-48eb-b4c1-5becb4612f16 req-be7becc1-1a69-4988-af16-b63c46c5f2e5 service nova] Lock "0c43fda3-e098-4c3a-bcd5-14eac019db06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:11:57 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-226f77dd-6ac8-48eb-b4c1-5becb4612f16 req-be7becc1-1a69-4988-af16-b63c46c5f2e5 service nova] Lock "0c43fda3-e098-4c3a-bcd5-14eac019db06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:11:57 user nova-compute[72129]: DEBUG nova.compute.manager [req-226f77dd-6ac8-48eb-b4c1-5becb4612f16 req-be7becc1-1a69-4988-af16-b63c46c5f2e5 service nova] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] No waiting events found dispatching network-vif-unplugged-42cfd021-0c3b-4c75-8758-1cf73c652fa4 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:11:57 user nova-compute[72129]: DEBUG nova.compute.manager [req-226f77dd-6ac8-48eb-b4c1-5becb4612f16 req-be7becc1-1a69-4988-af16-b63c46c5f2e5 service nova] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Received event network-vif-unplugged-42cfd021-0c3b-4c75-8758-1cf73c652fa4 for instance with task_state deleting. {{(pid=72129) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 14:11:58 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:11:58 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:11:58 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Instance destroyed successfully.
Aug 01 14:11:58 user nova-compute[72129]: DEBUG nova.objects.instance [None req-8ee80c2f-e590-4e96-823c-cedbd99f2fbe tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lazy-loading 'resources' on Instance uuid 0c43fda3-e098-4c3a-bcd5-14eac019db06 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:11:58 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-8ee80c2f-e590-4e96-823c-cedbd99f2fbe tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:02:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-675723724',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-675723724',id=29,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T14:02:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1e0929886fa54d1c8023793806f10d31',ramdisk_id='',reservation_id='r-si6hyw7f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1414609013',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T14:04:31Z,user_data=None,user_id='cdb6f66592fe4cdebea02e5f5c1f4a60',uuid=0c43fda3-e098-4c3a-bcd5-14eac019db06,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "42cfd021-0c3b-4c75-8758-1cf73c652fa4", "address": "fa:16:3e:d5:f1:da", "network": {"id": "59b1e538-8bfe-45ce-ab7b-c5838ab25582", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1129024349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0929886fa54d1c8023793806f10d31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42cfd021-0c", "ovs_interfaceid": "42cfd021-0c3b-4c75-8758-1cf73c652fa4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 14:11:58 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-8ee80c2f-e590-4e96-823c-cedbd99f2fbe tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Converting VIF {"id": "42cfd021-0c3b-4c75-8758-1cf73c652fa4", "address": "fa:16:3e:d5:f1:da", "network": {"id": "59b1e538-8bfe-45ce-ab7b-c5838ab25582", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1129024349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0929886fa54d1c8023793806f10d31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42cfd021-0c", "ovs_interfaceid": "42cfd021-0c3b-4c75-8758-1cf73c652fa4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:11:58 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-8ee80c2f-e590-4e96-823c-cedbd99f2fbe tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d5:f1:da,bridge_name='br-int',has_traffic_filtering=True,id=42cfd021-0c3b-4c75-8758-1cf73c652fa4,network=Network(59b1e538-8bfe-45ce-ab7b-c5838ab25582),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42cfd021-0c') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:11:58 user nova-compute[72129]: DEBUG os_vif [None req-8ee80c2f-e590-4e96-823c-cedbd99f2fbe tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:f1:da,bridge_name='br-int',has_traffic_filtering=True,id=42cfd021-0c3b-4c75-8758-1cf73c652fa4,network=Network(59b1e538-8bfe-45ce-ab7b-c5838ab25582),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42cfd021-0c') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 14:11:58 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:11:58 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap42cfd021-0c, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:11:58 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:11:58 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:11:58 user nova-compute[72129]: INFO os_vif [None req-8ee80c2f-e590-4e96-823c-cedbd99f2fbe tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:f1:da,bridge_name='br-int',has_traffic_filtering=True,id=42cfd021-0c3b-4c75-8758-1cf73c652fa4,network=Network(59b1e538-8bfe-45ce-ab7b-c5838ab25582),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42cfd021-0c')
Aug 01 14:11:58 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-8ee80c2f-e590-4e96-823c-cedbd99f2fbe tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Deleting instance files /opt/stack/data/nova/instances/0c43fda3-e098-4c3a-bcd5-14eac019db06_del
Aug 01 14:11:58 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-8ee80c2f-e590-4e96-823c-cedbd99f2fbe tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Deletion of /opt/stack/data/nova/instances/0c43fda3-e098-4c3a-bcd5-14eac019db06_del complete
Aug 01 14:11:58 user nova-compute[72129]: INFO nova.compute.manager [None req-8ee80c2f-e590-4e96-823c-cedbd99f2fbe tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 01 14:11:58 user nova-compute[72129]: DEBUG oslo.service.loopingcall [None req-8ee80c2f-e590-4e96-823c-cedbd99f2fbe tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72129) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 14:11:58 user nova-compute[72129]: DEBUG nova.compute.manager [-] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Deallocating network for instance {{(pid=72129) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 14:11:58 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] deallocate_for_instance() {{(pid=72129) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 14:11:58 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:11:58 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Took 0.61 seconds to deallocate network for instance.
Aug 01 14:11:58 user nova-compute[72129]: DEBUG nova.compute.manager [req-d972871b-2a0c-47a6-b965-7375ba19e800 req-4cdc6375-f950-49a2-95b0-c4d2d683a6f4 service nova] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Received event network-vif-deleted-42cfd021-0c3b-4c75-8758-1cf73c652fa4 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:11:58 user nova-compute[72129]: INFO nova.compute.manager [req-d972871b-2a0c-47a6-b965-7375ba19e800 req-4cdc6375-f950-49a2-95b0-c4d2d683a6f4 service nova] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Neutron deleted interface 42cfd021-0c3b-4c75-8758-1cf73c652fa4; detaching it from the instance and deleting it from the info cache
Aug 01 14:11:58 user nova-compute[72129]: DEBUG nova.network.neutron [req-d972871b-2a0c-47a6-b965-7375ba19e800 req-4cdc6375-f950-49a2-95b0-c4d2d683a6f4 service nova] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:11:58 user nova-compute[72129]: DEBUG nova.compute.manager [req-d972871b-2a0c-47a6-b965-7375ba19e800 req-4cdc6375-f950-49a2-95b0-c4d2d683a6f4 service nova] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Detach interface failed, port_id=42cfd021-0c3b-4c75-8758-1cf73c652fa4, reason: Instance 0c43fda3-e098-4c3a-bcd5-14eac019db06 could not be found. {{(pid=72129) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 14:11:58 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-8ee80c2f-e590-4e96-823c-cedbd99f2fbe tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:11:58 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-8ee80c2f-e590-4e96-823c-cedbd99f2fbe tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:11:58 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-8ee80c2f-e590-4e96-823c-cedbd99f2fbe tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:11:58 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-8ee80c2f-e590-4e96-823c-cedbd99f2fbe tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:11:59 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:11:59 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-8ee80c2f-e590-4e96-823c-cedbd99f2fbe tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.235s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:11:59 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:11:59 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:11:59 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:11:59 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Auditing locally available compute resources for user (node: user) {{(pid=72129) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 14:11:59 user nova-compute[72129]: INFO nova.scheduler.client.report [None req-8ee80c2f-e590-4e96-823c-cedbd99f2fbe tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Deleted allocations for instance 0c43fda3-e098-4c3a-bcd5-14eac019db06
Aug 01 14:11:59 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-8ee80c2f-e590-4e96-823c-cedbd99f2fbe tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "0c43fda3-e098-4c3a-bcd5-14eac019db06" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.881s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:11:59 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 14:11:59 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:11:59 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:11:59 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:11:59 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:11:59 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 14:11:59 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 14:11:59 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e06fb45-d156-451b-9e4d-e3d2fed52c37/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:11:59 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e06fb45-d156-451b-9e4d-e3d2fed52c37/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:11:59 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e06fb45-d156-451b-9e4d-e3d2fed52c37/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:11:59 user nova-compute[72129]: DEBUG nova.compute.manager [req-971a998c-96c1-47ec-a47e-60191f9f0b87 req-23f18229-321f-4383-b888-85b484a4a443 service nova] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Received event network-vif-plugged-42cfd021-0c3b-4c75-8758-1cf73c652fa4 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:11:59 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-971a998c-96c1-47ec-a47e-60191f9f0b87 req-23f18229-321f-4383-b888-85b484a4a443 service nova] Acquiring lock "0c43fda3-e098-4c3a-bcd5-14eac019db06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:11:59 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-971a998c-96c1-47ec-a47e-60191f9f0b87 req-23f18229-321f-4383-b888-85b484a4a443 service nova] Lock "0c43fda3-e098-4c3a-bcd5-14eac019db06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:11:59 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-971a998c-96c1-47ec-a47e-60191f9f0b87 req-23f18229-321f-4383-b888-85b484a4a443 service nova] Lock "0c43fda3-e098-4c3a-bcd5-14eac019db06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:11:59 user nova-compute[72129]: DEBUG nova.compute.manager [req-971a998c-96c1-47ec-a47e-60191f9f0b87 req-23f18229-321f-4383-b888-85b484a4a443 service nova] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] No waiting events found dispatching network-vif-plugged-42cfd021-0c3b-4c75-8758-1cf73c652fa4 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:11:59 user nova-compute[72129]: WARNING nova.compute.manager [req-971a998c-96c1-47ec-a47e-60191f9f0b87 req-23f18229-321f-4383-b888-85b484a4a443 service nova] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Received unexpected event network-vif-plugged-42cfd021-0c3b-4c75-8758-1cf73c652fa4 for instance with vm_state deleted and task_state None.
Aug 01 14:11:59 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e06fb45-d156-451b-9e4d-e3d2fed52c37/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:11:59 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c31c5b8-5485-4603-853a-8b7ef7efa843/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:11:59 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c31c5b8-5485-4603-853a-8b7ef7efa843/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:11:59 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c31c5b8-5485-4603-853a-8b7ef7efa843/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:12:00 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c31c5b8-5485-4603-853a-8b7ef7efa843/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:12:00 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:12:00 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:12:00 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Hypervisor/Node resource view: name=user free_ram=8104MB free_disk=25.11703109741211GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72129) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 14:12:00 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:12:00 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:12:00 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:12:00 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance d031973f-8f48-43b3-a338-040950103e4c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:12:00 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:12:00 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 9c31c5b8-5485-4603-853a-8b7ef7efa843 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:12:00 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 1e06fb45-d156-451b-9e4d-e3d2fed52c37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:12:00 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance fc0c1916-fd16-4379-9739-bcb03643b42e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:12:00 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 14:12:00 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 14:12:00 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:12:00 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:12:00 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Compute_service record updated for user:user {{(pid=72129) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 14:12:00 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.453s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:12:01 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:12:01 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:12:01 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:12:03 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:12:08 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:12:11 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:12:13 user nova-compute[72129]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690899118.0146646, 0c43fda3-e098-4c3a-bcd5-14eac019db06 => Stopped> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:12:13 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] VM Stopped (Lifecycle Event)
Aug 01 14:12:13 user nova-compute[72129]: DEBUG nova.compute.manager [None req-daf4aba3-d86c-41a3-94e0-2aaaecdd3f8b None None] [instance: 0c43fda3-e098-4c3a-bcd5-14eac019db06] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:12:13 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:12:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:12:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:12:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72129) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 14:12:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:12:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:12:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:12:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:12:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:12:25 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:12:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:12:27 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:12:28 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:12:29 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:12:31 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:12:31 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:12:33 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:12:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Acquiring lock "89fdfdab-36a6-4481-bfa7-376c3a3a32ae" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:12:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Lock "89fdfdab-36a6-4481-bfa7-376c3a3a32ae" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:12:34 user nova-compute[72129]: DEBUG nova.compute.manager [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Starting instance... {{(pid=72129) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 14:12:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:12:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:12:34 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72129) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 14:12:34 user nova-compute[72129]: INFO nova.compute.claims [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Claim successful on node user
Aug 01 14:12:35 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:12:35 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:12:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.305s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:12:35 user nova-compute[72129]: DEBUG nova.compute.manager [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Start building networks asynchronously for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 14:12:35 user nova-compute[72129]: DEBUG nova.compute.manager [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Allocating IP information in the background. {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 14:12:35 user nova-compute[72129]: DEBUG nova.network.neutron [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] allocate_for_instance() {{(pid=72129) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 14:12:35 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 14:12:35 user nova-compute[72129]: DEBUG nova.compute.manager [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Start building block device mappings for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 14:12:35 user nova-compute[72129]: DEBUG nova.policy [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd1ce7ac7a65e441dbc8ac4873ee2156f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b34cc88cb64d6fbdc5e2688f6767d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72129) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 14:12:35 user nova-compute[72129]: DEBUG nova.compute.manager [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Start spawning the instance on the hypervisor. {{(pid=72129) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 14:12:35 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Creating instance directory {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 14:12:35 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Creating image(s)
Aug 01 14:12:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Acquiring lock "/opt/stack/data/nova/instances/89fdfdab-36a6-4481-bfa7-376c3a3a32ae/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:12:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Lock "/opt/stack/data/nova/instances/89fdfdab-36a6-4481-bfa7-376c3a3a32ae/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:12:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Lock "/opt/stack/data/nova/instances/89fdfdab-36a6-4481-bfa7-376c3a3a32ae/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:12:35 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:12:35 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.136s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:12:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Acquiring lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:12:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:12:35 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:12:35 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.140s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:12:35 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/89fdfdab-36a6-4481-bfa7-376c3a3a32ae/disk 1073741824 {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:12:35 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/89fdfdab-36a6-4481-bfa7-376c3a3a32ae/disk 1073741824" returned: 0 in 0.053s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:12:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.201s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:12:35 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:12:35 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.139s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:12:35 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Checking if we can resize image /opt/stack/data/nova/instances/89fdfdab-36a6-4481-bfa7-376c3a3a32ae/disk. size=1073741824 {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 14:12:35 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89fdfdab-36a6-4481-bfa7-376c3a3a32ae/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:12:35 user nova-compute[72129]: DEBUG nova.network.neutron [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Successfully created port: 778ce9fe-90f9-4d7f-98be-51407fc6520a {{(pid=72129) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 14:12:36 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89fdfdab-36a6-4481-bfa7-376c3a3a32ae/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:12:36 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Cannot resize image /opt/stack/data/nova/instances/89fdfdab-36a6-4481-bfa7-376c3a3a32ae/disk to a smaller size. {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 14:12:36 user nova-compute[72129]: DEBUG nova.objects.instance [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Lazy-loading 'migration_context' on Instance uuid 89fdfdab-36a6-4481-bfa7-376c3a3a32ae {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:12:36 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Created local disks {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 14:12:36 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Ensure instance console log exists: /opt/stack/data/nova/instances/89fdfdab-36a6-4481-bfa7-376c3a3a32ae/console.log {{(pid=72129) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 14:12:36 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:12:36 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:12:36 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:12:36 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:12:36 user nova-compute[72129]: DEBUG nova.network.neutron [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Successfully updated port: 778ce9fe-90f9-4d7f-98be-51407fc6520a {{(pid=72129) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 14:12:37 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Acquiring lock "refresh_cache-89fdfdab-36a6-4481-bfa7-376c3a3a32ae" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:12:37 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Acquired lock "refresh_cache-89fdfdab-36a6-4481-bfa7-376c3a3a32ae" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:12:37 user nova-compute[72129]: DEBUG nova.network.neutron [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 14:12:37 user nova-compute[72129]: DEBUG nova.network.neutron [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Instance cache missing network info. {{(pid=72129) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 14:12:37 user nova-compute[72129]: DEBUG nova.compute.manager [req-ad839d62-a7be-444b-9c1c-559957a3ee69 req-27efe1c9-6d8f-4e67-a3b4-115c83bc1703 service nova] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Received event network-changed-778ce9fe-90f9-4d7f-98be-51407fc6520a {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:12:37 user nova-compute[72129]: DEBUG nova.compute.manager [req-ad839d62-a7be-444b-9c1c-559957a3ee69 req-27efe1c9-6d8f-4e67-a3b4-115c83bc1703 service nova] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Refreshing instance network info cache due to event network-changed-778ce9fe-90f9-4d7f-98be-51407fc6520a. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 14:12:37 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ad839d62-a7be-444b-9c1c-559957a3ee69 req-27efe1c9-6d8f-4e67-a3b4-115c83bc1703 service nova] Acquiring lock "refresh_cache-89fdfdab-36a6-4481-bfa7-376c3a3a32ae" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:12:37 user nova-compute[72129]: DEBUG nova.network.neutron [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Updating instance_info_cache with network_info: [{"id": "778ce9fe-90f9-4d7f-98be-51407fc6520a", "address": "fa:16:3e:9f:0b:54", "network": {"id": "46796a3e-328f-4641-82aa-77c1d2c6c9cb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-446403350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b34cc88cb64d6fbdc5e2688f6767d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap778ce9fe-90", "ovs_interfaceid": "778ce9fe-90f9-4d7f-98be-51407fc6520a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:12:37 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Releasing lock "refresh_cache-89fdfdab-36a6-4481-bfa7-376c3a3a32ae" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:12:37 user nova-compute[72129]: DEBUG nova.compute.manager [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Instance network_info: |[{"id": "778ce9fe-90f9-4d7f-98be-51407fc6520a", "address": "fa:16:3e:9f:0b:54", "network": {"id": "46796a3e-328f-4641-82aa-77c1d2c6c9cb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-446403350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b34cc88cb64d6fbdc5e2688f6767d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap778ce9fe-90", "ovs_interfaceid": "778ce9fe-90f9-4d7f-98be-51407fc6520a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 14:12:37 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ad839d62-a7be-444b-9c1c-559957a3ee69 req-27efe1c9-6d8f-4e67-a3b4-115c83bc1703 service nova] Acquired lock "refresh_cache-89fdfdab-36a6-4481-bfa7-376c3a3a32ae" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:12:37 user nova-compute[72129]: DEBUG nova.network.neutron [req-ad839d62-a7be-444b-9c1c-559957a3ee69 req-27efe1c9-6d8f-4e67-a3b4-115c83bc1703 service nova] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Refreshing network info cache for port 778ce9fe-90f9-4d7f-98be-51407fc6520a {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 14:12:37 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Start _get_guest_xml network_info=[{"id": "778ce9fe-90f9-4d7f-98be-51407fc6520a", "address": "fa:16:3e:9f:0b:54", "network": {"id": "46796a3e-328f-4641-82aa-77c1d2c6c9cb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-446403350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b34cc88cb64d6fbdc5e2688f6767d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap778ce9fe-90", "ovs_interfaceid": "778ce9fe-90f9-4d7f-98be-51407fc6520a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'image_id': 'b6472c34-1b0f-4034-ba3a-7e8eb5103715'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 14:12:37 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:12:37 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:12:37 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 14:12:37 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] CPU controller missing on host. {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 14:12:37 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 14:12:37 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] CPU controller found on host. {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 14:12:37 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72129) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 14:12:37 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T13:45:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 14:12:37 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Flavor limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 14:12:37 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Image limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 14:12:37 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Flavor pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 14:12:37 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Image pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 14:12:37 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 14:12:37 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 14:12:37 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 14:12:37 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Got 1 possible topologies {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 14:12:37 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 14:12:37 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 14:12:37 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:12:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1109994487',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1109994487',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1109994',id=38,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLsXggziKjrecDfU+S/Y77siHxeHusA2I81DBx0zlXgVO1SCmj/5jjAQ1BXIAzgnz5Fftk4EfvhiMMztcwEds0kMmZ0il8IY46ZJJEIsM8Q9EkFM+clQ9gibE2PBc39p3Q==',key_name='tempest-keypair-244734479',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1b34cc88cb64d6fbdc5e2688f6767d4',ramdisk_id='',reservation_id='r-7uigjdmv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1146793536',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T14:12:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d1ce7ac7a65e441dbc8ac4873ee2156f',uuid=89fdfdab-36a6-4481-bfa7-376c3a3a32ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "778ce9fe-90f9-4d7f-98be-51407fc6520a", "address": "fa:16:3e:9f:0b:54", "network": {"id": "46796a3e-328f-4641-82aa-77c1d2c6c9cb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-446403350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b34cc88cb64d6fbdc5e2688f6767d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap778ce9fe-90", "ovs_interfaceid": "778ce9fe-90f9-4d7f-98be-51407fc6520a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 14:12:37 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Converting VIF {"id": "778ce9fe-90f9-4d7f-98be-51407fc6520a", "address": "fa:16:3e:9f:0b:54", "network": {"id": "46796a3e-328f-4641-82aa-77c1d2c6c9cb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-446403350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b34cc88cb64d6fbdc5e2688f6767d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap778ce9fe-90", "ovs_interfaceid": "778ce9fe-90f9-4d7f-98be-51407fc6520a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:12:37 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:0b:54,bridge_name='br-int',has_traffic_filtering=True,id=778ce9fe-90f9-4d7f-98be-51407fc6520a,network=Network(46796a3e-328f-4641-82aa-77c1d2c6c9cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap778ce9fe-90') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:12:37 user nova-compute[72129]: DEBUG nova.objects.instance [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Lazy-loading 'pci_devices' on Instance uuid 89fdfdab-36a6-4481-bfa7-376c3a3a32ae {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:12:37 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] End _get_guest_xml xml=<domain type="kvm">
Aug 01 14:12:37 user nova-compute[72129]:   <uuid>89fdfdab-36a6-4481-bfa7-376c3a3a32ae</uuid>
Aug 01 14:12:37 user nova-compute[72129]:   <name>instance-00000026</name>
Aug 01 14:12:37 user nova-compute[72129]:   <memory>524288</memory>
Aug 01 14:12:37 user nova-compute[72129]:   <vcpu>1</vcpu>
Aug 01 14:12:37 user nova-compute[72129]:   <metadata>
Aug 01 14:12:37 user nova-compute[72129]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 14:12:37 user nova-compute[72129]:       <nova:package version="0.0.0"/>
Aug 01 14:12:37 user nova-compute[72129]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1109994487</nova:name>
Aug 01 14:12:37 user nova-compute[72129]:       <nova:creationTime>2023-08-01 14:12:37</nova:creationTime>
Aug 01 14:12:37 user nova-compute[72129]:       <nova:flavor name="m1.tiny">
Aug 01 14:12:37 user nova-compute[72129]:         <nova:memory>512</nova:memory>
Aug 01 14:12:37 user nova-compute[72129]:         <nova:disk>1</nova:disk>
Aug 01 14:12:37 user nova-compute[72129]:         <nova:swap>0</nova:swap>
Aug 01 14:12:37 user nova-compute[72129]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 14:12:37 user nova-compute[72129]:         <nova:vcpus>1</nova:vcpus>
Aug 01 14:12:37 user nova-compute[72129]:       </nova:flavor>
Aug 01 14:12:37 user nova-compute[72129]:       <nova:owner>
Aug 01 14:12:37 user nova-compute[72129]:         <nova:user uuid="d1ce7ac7a65e441dbc8ac4873ee2156f">tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member</nova:user>
Aug 01 14:12:37 user nova-compute[72129]:         <nova:project uuid="b1b34cc88cb64d6fbdc5e2688f6767d4">tempest-TestServerVolumeAttachScenarioOldVersion-1146793536</nova:project>
Aug 01 14:12:37 user nova-compute[72129]:       </nova:owner>
Aug 01 14:12:37 user nova-compute[72129]:       <nova:root type="image" uuid="b6472c34-1b0f-4034-ba3a-7e8eb5103715"/>
Aug 01 14:12:37 user nova-compute[72129]:       <nova:ports>
Aug 01 14:12:37 user nova-compute[72129]:         <nova:port uuid="778ce9fe-90f9-4d7f-98be-51407fc6520a">
Aug 01 14:12:37 user nova-compute[72129]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 01 14:12:37 user nova-compute[72129]:         </nova:port>
Aug 01 14:12:37 user nova-compute[72129]:       </nova:ports>
Aug 01 14:12:37 user nova-compute[72129]:     </nova:instance>
Aug 01 14:12:37 user nova-compute[72129]:   </metadata>
Aug 01 14:12:37 user nova-compute[72129]:   <sysinfo type="smbios">
Aug 01 14:12:37 user nova-compute[72129]:     <system>
Aug 01 14:12:37 user nova-compute[72129]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 14:12:37 user nova-compute[72129]:       <entry name="product">OpenStack Nova</entry>
Aug 01 14:12:37 user nova-compute[72129]:       <entry name="version">0.0.0</entry>
Aug 01 14:12:37 user nova-compute[72129]:       <entry name="serial">89fdfdab-36a6-4481-bfa7-376c3a3a32ae</entry>
Aug 01 14:12:37 user nova-compute[72129]:       <entry name="uuid">89fdfdab-36a6-4481-bfa7-376c3a3a32ae</entry>
Aug 01 14:12:37 user nova-compute[72129]:       <entry name="family">Virtual Machine</entry>
Aug 01 14:12:37 user nova-compute[72129]:     </system>
Aug 01 14:12:37 user nova-compute[72129]:   </sysinfo>
Aug 01 14:12:37 user nova-compute[72129]:   <os>
Aug 01 14:12:37 user nova-compute[72129]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 14:12:37 user nova-compute[72129]:     <boot dev="hd"/>
Aug 01 14:12:37 user nova-compute[72129]:     <smbios mode="sysinfo"/>
Aug 01 14:12:37 user nova-compute[72129]:   </os>
Aug 01 14:12:37 user nova-compute[72129]:   <features>
Aug 01 14:12:37 user nova-compute[72129]:     <acpi/>
Aug 01 14:12:37 user nova-compute[72129]:     <apic/>
Aug 01 14:12:37 user nova-compute[72129]:     <vmcoreinfo/>
Aug 01 14:12:37 user nova-compute[72129]:   </features>
Aug 01 14:12:37 user nova-compute[72129]:   <clock offset="utc">
Aug 01 14:12:37 user nova-compute[72129]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 14:12:37 user nova-compute[72129]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 14:12:37 user nova-compute[72129]:     <timer name="hpet" present="no"/>
Aug 01 14:12:37 user nova-compute[72129]:   </clock>
Aug 01 14:12:37 user nova-compute[72129]:   <cpu mode="custom" match="exact">
Aug 01 14:12:37 user nova-compute[72129]:     <model>Nehalem</model>
Aug 01 14:12:37 user nova-compute[72129]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 14:12:37 user nova-compute[72129]:   </cpu>
Aug 01 14:12:37 user nova-compute[72129]:   <devices>
Aug 01 14:12:37 user nova-compute[72129]:     <disk type="file" device="disk">
Aug 01 14:12:37 user nova-compute[72129]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 14:12:37 user nova-compute[72129]:       <source file="/opt/stack/data/nova/instances/89fdfdab-36a6-4481-bfa7-376c3a3a32ae/disk"/>
Aug 01 14:12:37 user nova-compute[72129]:       <target dev="vda" bus="virtio"/>
Aug 01 14:12:37 user nova-compute[72129]:     </disk>
Aug 01 14:12:37 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 14:12:37 user nova-compute[72129]:       <mac address="fa:16:3e:9f:0b:54"/>
Aug 01 14:12:37 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:12:37 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 14:12:37 user nova-compute[72129]:       <target dev="tap778ce9fe-90"/>
Aug 01 14:12:37 user nova-compute[72129]:     </interface>
Aug 01 14:12:37 user nova-compute[72129]:     <serial type="pty">
Aug 01 14:12:37 user nova-compute[72129]:       <log file="/opt/stack/data/nova/instances/89fdfdab-36a6-4481-bfa7-376c3a3a32ae/console.log" append="off"/>
Aug 01 14:12:37 user nova-compute[72129]:     </serial>
Aug 01 14:12:37 user nova-compute[72129]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 14:12:37 user nova-compute[72129]:     <video>
Aug 01 14:12:37 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:12:37 user nova-compute[72129]:     </video>
Aug 01 14:12:37 user nova-compute[72129]:     <rng model="virtio">
Aug 01 14:12:37 user nova-compute[72129]:       <backend model="random">/dev/urandom</backend>
Aug 01 14:12:37 user nova-compute[72129]:     </rng>
Aug 01 14:12:37 user nova-compute[72129]:     <controller type="usb" index="0" model="none"/>
Aug 01 14:12:37 user nova-compute[72129]:     <memballoon model="virtio">
Aug 01 14:12:37 user nova-compute[72129]:       <stats period="10"/>
Aug 01 14:12:37 user nova-compute[72129]:     </memballoon>
Aug 01 14:12:37 user nova-compute[72129]:   </devices>
Aug 01 14:12:37 user nova-compute[72129]: </domain>
Aug 01 14:12:37 user nova-compute[72129]:  {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 14:12:37 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:12:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1109994487',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1109994487',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1109994',id=38,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLsXggziKjrecDfU+S/Y77siHxeHusA2I81DBx0zlXgVO1SCmj/5jjAQ1BXIAzgnz5Fftk4EfvhiMMztcwEds0kMmZ0il8IY46ZJJEIsM8Q9EkFM+clQ9gibE2PBc39p3Q==',key_name='tempest-keypair-244734479',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1b34cc88cb64d6fbdc5e2688f6767d4',ramdisk_id='',reservation_id='r-7uigjdmv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1146793536',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T14:12:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d1ce7ac7a65e441dbc8ac4873ee2156f',uuid=89fdfdab-36a6-4481-bfa7-376c3a3a32ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "778ce9fe-90f9-4d7f-98be-51407fc6520a", "address": "fa:16:3e:9f:0b:54", "network": {"id": "46796a3e-328f-4641-82aa-77c1d2c6c9cb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-446403350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b34cc88cb64d6fbdc5e2688f6767d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap778ce9fe-90", "ovs_interfaceid": "778ce9fe-90f9-4d7f-98be-51407fc6520a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 14:12:37 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Converting VIF {"id": "778ce9fe-90f9-4d7f-98be-51407fc6520a", "address": "fa:16:3e:9f:0b:54", "network": {"id": "46796a3e-328f-4641-82aa-77c1d2c6c9cb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-446403350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b34cc88cb64d6fbdc5e2688f6767d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap778ce9fe-90", "ovs_interfaceid": "778ce9fe-90f9-4d7f-98be-51407fc6520a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:12:37 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:0b:54,bridge_name='br-int',has_traffic_filtering=True,id=778ce9fe-90f9-4d7f-98be-51407fc6520a,network=Network(46796a3e-328f-4641-82aa-77c1d2c6c9cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap778ce9fe-90') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:12:37 user nova-compute[72129]: DEBUG os_vif [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:0b:54,bridge_name='br-int',has_traffic_filtering=True,id=778ce9fe-90f9-4d7f-98be-51407fc6520a,network=Network(46796a3e-328f-4641-82aa-77c1d2c6c9cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap778ce9fe-90') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 14:12:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:12:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:12:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 14:12:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:12:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap778ce9fe-90, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:12:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap778ce9fe-90, col_values=(('external_ids', {'iface-id': '778ce9fe-90f9-4d7f-98be-51407fc6520a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:0b:54', 'vm-uuid': '89fdfdab-36a6-4481-bfa7-376c3a3a32ae'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:12:37 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-fc7fb99d-575c-4bbc-bc2e-ce79ec3e6d18 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Acquiring lock "9c31c5b8-5485-4603-853a-8b7ef7efa843" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:12:37 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-fc7fb99d-575c-4bbc-bc2e-ce79ec3e6d18 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Lock "9c31c5b8-5485-4603-853a-8b7ef7efa843" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:12:37 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-fc7fb99d-575c-4bbc-bc2e-ce79ec3e6d18 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Acquiring lock "9c31c5b8-5485-4603-853a-8b7ef7efa843-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:12:37 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-fc7fb99d-575c-4bbc-bc2e-ce79ec3e6d18 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Lock "9c31c5b8-5485-4603-853a-8b7ef7efa843-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:12:37 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-fc7fb99d-575c-4bbc-bc2e-ce79ec3e6d18 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Lock "9c31c5b8-5485-4603-853a-8b7ef7efa843-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:12:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:12:37 user nova-compute[72129]: INFO os_vif [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:0b:54,bridge_name='br-int',has_traffic_filtering=True,id=778ce9fe-90f9-4d7f-98be-51407fc6520a,network=Network(46796a3e-328f-4641-82aa-77c1d2c6c9cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap778ce9fe-90')
Aug 01 14:12:37 user nova-compute[72129]: INFO nova.compute.manager [None req-fc7fb99d-575c-4bbc-bc2e-ce79ec3e6d18 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] [instance: 9c31c5b8-5485-4603-853a-8b7ef7efa843] Terminating instance
Aug 01 14:12:37 user nova-compute[72129]: DEBUG nova.compute.manager [None req-fc7fb99d-575c-4bbc-bc2e-ce79ec3e6d18 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] [instance: 9c31c5b8-5485-4603-853a-8b7ef7efa843] Start destroying the instance on the hypervisor. {{(pid=72129) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 14:12:37 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:12:37 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] No VIF found with MAC fa:16:3e:9f:0b:54, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 14:12:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:12:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:12:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:12:37 user nova-compute[72129]: DEBUG nova.compute.manager [req-7f1f417d-edc2-4194-b663-9747a62d2612 req-66e93ab4-4214-4777-ab78-925a2ba449ab service nova] [instance: 9c31c5b8-5485-4603-853a-8b7ef7efa843] Received event network-vif-unplugged-063c7c09-178e-47eb-92e2-76003c6356a3 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:12:37 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-7f1f417d-edc2-4194-b663-9747a62d2612 req-66e93ab4-4214-4777-ab78-925a2ba449ab service nova] Acquiring lock "9c31c5b8-5485-4603-853a-8b7ef7efa843-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:12:37 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-7f1f417d-edc2-4194-b663-9747a62d2612 req-66e93ab4-4214-4777-ab78-925a2ba449ab service nova] Lock "9c31c5b8-5485-4603-853a-8b7ef7efa843-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:12:37 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-7f1f417d-edc2-4194-b663-9747a62d2612 req-66e93ab4-4214-4777-ab78-925a2ba449ab service nova] Lock "9c31c5b8-5485-4603-853a-8b7ef7efa843-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:12:37 user nova-compute[72129]: DEBUG nova.compute.manager [req-7f1f417d-edc2-4194-b663-9747a62d2612 req-66e93ab4-4214-4777-ab78-925a2ba449ab service nova] [instance: 9c31c5b8-5485-4603-853a-8b7ef7efa843] No waiting events found dispatching network-vif-unplugged-063c7c09-178e-47eb-92e2-76003c6356a3 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:12:37 user nova-compute[72129]: DEBUG nova.compute.manager [req-7f1f417d-edc2-4194-b663-9747a62d2612 req-66e93ab4-4214-4777-ab78-925a2ba449ab service nova] [instance: 9c31c5b8-5485-4603-853a-8b7ef7efa843] Received event network-vif-unplugged-063c7c09-178e-47eb-92e2-76003c6356a3 for instance with task_state deleting. {{(pid=72129) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 14:12:37 user nova-compute[72129]: DEBUG nova.network.neutron [req-ad839d62-a7be-444b-9c1c-559957a3ee69 req-27efe1c9-6d8f-4e67-a3b4-115c83bc1703 service nova] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Updated VIF entry in instance network info cache for port 778ce9fe-90f9-4d7f-98be-51407fc6520a. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 14:12:37 user nova-compute[72129]: DEBUG nova.network.neutron [req-ad839d62-a7be-444b-9c1c-559957a3ee69 req-27efe1c9-6d8f-4e67-a3b4-115c83bc1703 service nova] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Updating instance_info_cache with network_info: [{"id": "778ce9fe-90f9-4d7f-98be-51407fc6520a", "address": "fa:16:3e:9f:0b:54", "network": {"id": "46796a3e-328f-4641-82aa-77c1d2c6c9cb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-446403350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b34cc88cb64d6fbdc5e2688f6767d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap778ce9fe-90", "ovs_interfaceid": "778ce9fe-90f9-4d7f-98be-51407fc6520a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:12:37 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ad839d62-a7be-444b-9c1c-559957a3ee69 req-27efe1c9-6d8f-4e67-a3b4-115c83bc1703 service nova] Releasing lock "refresh_cache-89fdfdab-36a6-4481-bfa7-376c3a3a32ae" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:12:38 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 9c31c5b8-5485-4603-853a-8b7ef7efa843] Instance destroyed successfully.
Aug 01 14:12:38 user nova-compute[72129]: DEBUG nova.objects.instance [None req-fc7fb99d-575c-4bbc-bc2e-ce79ec3e6d18 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Lazy-loading 'resources' on Instance uuid 9c31c5b8-5485-4603-853a-8b7ef7efa843 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:12:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-fc7fb99d-575c-4bbc-bc2e-ce79ec3e6d18 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:10:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-759872205',display_name='tempest-VolumesActionsTest-instance-759872205',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-759872205',id=36,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T14:10:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e0854d064104497b8b0413ff9ff74a9',ramdisk_id='',reservation_id='r-add0tbut',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-2013737032',owner_user_name='tempest-VolumesActionsTest-2013737032-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T14:10:53Z,user_data=None,user_id='aef0a4c176f4428d941f9d922b17ea93',uuid=9c31c5b8-5485-4603-853a-8b7ef7efa843,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "063c7c09-178e-47eb-92e2-76003c6356a3", "address": "fa:16:3e:35:5a:1a", "network": {"id": "1fc5fd20-6ca3-45f2-93ee-ac80e3311897", "bridge": "br-int", "label": "tempest-VolumesActionsTest-878643555-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e0854d064104497b8b0413ff9ff74a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap063c7c09-17", "ovs_interfaceid": "063c7c09-178e-47eb-92e2-76003c6356a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 14:12:38 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-fc7fb99d-575c-4bbc-bc2e-ce79ec3e6d18 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Converting VIF {"id": "063c7c09-178e-47eb-92e2-76003c6356a3", "address": "fa:16:3e:35:5a:1a", "network": {"id": "1fc5fd20-6ca3-45f2-93ee-ac80e3311897", "bridge": "br-int", "label": "tempest-VolumesActionsTest-878643555-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e0854d064104497b8b0413ff9ff74a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap063c7c09-17", "ovs_interfaceid": "063c7c09-178e-47eb-92e2-76003c6356a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:12:38 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-fc7fb99d-575c-4bbc-bc2e-ce79ec3e6d18 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:5a:1a,bridge_name='br-int',has_traffic_filtering=True,id=063c7c09-178e-47eb-92e2-76003c6356a3,network=Network(1fc5fd20-6ca3-45f2-93ee-ac80e3311897),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap063c7c09-17') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:12:38 user nova-compute[72129]: DEBUG os_vif [None req-fc7fb99d-575c-4bbc-bc2e-ce79ec3e6d18 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:5a:1a,bridge_name='br-int',has_traffic_filtering=True,id=063c7c09-178e-47eb-92e2-76003c6356a3,network=Network(1fc5fd20-6ca3-45f2-93ee-ac80e3311897),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap063c7c09-17') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 14:12:38 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:12:38 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap063c7c09-17, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:12:38 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:12:38 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:12:38 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:12:38 user nova-compute[72129]: INFO os_vif [None req-fc7fb99d-575c-4bbc-bc2e-ce79ec3e6d18 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:5a:1a,bridge_name='br-int',has_traffic_filtering=True,id=063c7c09-178e-47eb-92e2-76003c6356a3,network=Network(1fc5fd20-6ca3-45f2-93ee-ac80e3311897),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap063c7c09-17')
Aug 01 14:12:38 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-fc7fb99d-575c-4bbc-bc2e-ce79ec3e6d18 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] [instance: 9c31c5b8-5485-4603-853a-8b7ef7efa843] Deleting instance files /opt/stack/data/nova/instances/9c31c5b8-5485-4603-853a-8b7ef7efa843_del
Aug 01 14:12:38 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-fc7fb99d-575c-4bbc-bc2e-ce79ec3e6d18 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] [instance: 9c31c5b8-5485-4603-853a-8b7ef7efa843] Deletion of /opt/stack/data/nova/instances/9c31c5b8-5485-4603-853a-8b7ef7efa843_del complete
Aug 01 14:12:38 user nova-compute[72129]: INFO nova.compute.manager [None req-fc7fb99d-575c-4bbc-bc2e-ce79ec3e6d18 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] [instance: 9c31c5b8-5485-4603-853a-8b7ef7efa843] Took 1.12 seconds to destroy the instance on the hypervisor.
Aug 01 14:12:38 user nova-compute[72129]: DEBUG oslo.service.loopingcall [None req-fc7fb99d-575c-4bbc-bc2e-ce79ec3e6d18 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72129) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 14:12:38 user nova-compute[72129]: DEBUG nova.compute.manager [-] [instance: 9c31c5b8-5485-4603-853a-8b7ef7efa843] Deallocating network for instance {{(pid=72129) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 14:12:38 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 9c31c5b8-5485-4603-853a-8b7ef7efa843] deallocate_for_instance() {{(pid=72129) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 14:12:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:12:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:12:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:12:39 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 9c31c5b8-5485-4603-853a-8b7ef7efa843] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:12:39 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 9c31c5b8-5485-4603-853a-8b7ef7efa843] Took 0.73 seconds to deallocate network for instance.
Aug 01 14:12:39 user nova-compute[72129]: DEBUG nova.compute.manager [req-30234009-1b00-443c-9c82-717c99224f93 req-254e83de-84bd-47f1-b939-57e129524315 service nova] [instance: 9c31c5b8-5485-4603-853a-8b7ef7efa843] Received event network-vif-deleted-063c7c09-178e-47eb-92e2-76003c6356a3 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:12:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-fc7fb99d-575c-4bbc-bc2e-ce79ec3e6d18 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:12:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-fc7fb99d-575c-4bbc-bc2e-ce79ec3e6d18 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:12:39 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-fc7fb99d-575c-4bbc-bc2e-ce79ec3e6d18 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:12:39 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-fc7fb99d-575c-4bbc-bc2e-ce79ec3e6d18 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:12:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-fc7fb99d-575c-4bbc-bc2e-ce79ec3e6d18 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.312s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:12:39 user nova-compute[72129]: INFO nova.scheduler.client.report [None req-fc7fb99d-575c-4bbc-bc2e-ce79ec3e6d18 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Deleted allocations for instance 9c31c5b8-5485-4603-853a-8b7ef7efa843
Aug 01 14:12:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-fc7fb99d-575c-4bbc-bc2e-ce79ec3e6d18 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Lock "9c31c5b8-5485-4603-853a-8b7ef7efa843" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.365s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:12:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:12:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:12:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:12:39 user nova-compute[72129]: DEBUG nova.compute.manager [req-b4b20349-7302-4564-b05d-ed717bead1af req-c284daaa-485e-4d06-81b0-853ea03e85a7 service nova] [instance: 9c31c5b8-5485-4603-853a-8b7ef7efa843] Received event network-vif-plugged-063c7c09-178e-47eb-92e2-76003c6356a3 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:12:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-b4b20349-7302-4564-b05d-ed717bead1af req-c284daaa-485e-4d06-81b0-853ea03e85a7 service nova] Acquiring lock "9c31c5b8-5485-4603-853a-8b7ef7efa843-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:12:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-b4b20349-7302-4564-b05d-ed717bead1af req-c284daaa-485e-4d06-81b0-853ea03e85a7 service nova] Lock "9c31c5b8-5485-4603-853a-8b7ef7efa843-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:12:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-b4b20349-7302-4564-b05d-ed717bead1af req-c284daaa-485e-4d06-81b0-853ea03e85a7 service nova] Lock "9c31c5b8-5485-4603-853a-8b7ef7efa843-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:12:39 user nova-compute[72129]: DEBUG nova.compute.manager [req-b4b20349-7302-4564-b05d-ed717bead1af req-c284daaa-485e-4d06-81b0-853ea03e85a7 service nova] [instance: 9c31c5b8-5485-4603-853a-8b7ef7efa843] No waiting events found dispatching network-vif-plugged-063c7c09-178e-47eb-92e2-76003c6356a3 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:12:39 user nova-compute[72129]: WARNING nova.compute.manager [req-b4b20349-7302-4564-b05d-ed717bead1af req-c284daaa-485e-4d06-81b0-853ea03e85a7 service nova] [instance: 9c31c5b8-5485-4603-853a-8b7ef7efa843] Received unexpected event network-vif-plugged-063c7c09-178e-47eb-92e2-76003c6356a3 for instance with vm_state deleted and task_state None.
Aug 01 14:12:39 user nova-compute[72129]: DEBUG nova.compute.manager [req-b4b20349-7302-4564-b05d-ed717bead1af req-c284daaa-485e-4d06-81b0-853ea03e85a7 service nova] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Received event network-vif-plugged-778ce9fe-90f9-4d7f-98be-51407fc6520a {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:12:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-b4b20349-7302-4564-b05d-ed717bead1af req-c284daaa-485e-4d06-81b0-853ea03e85a7 service nova] Acquiring lock "89fdfdab-36a6-4481-bfa7-376c3a3a32ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:12:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-b4b20349-7302-4564-b05d-ed717bead1af req-c284daaa-485e-4d06-81b0-853ea03e85a7 service nova] Lock "89fdfdab-36a6-4481-bfa7-376c3a3a32ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:12:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-b4b20349-7302-4564-b05d-ed717bead1af req-c284daaa-485e-4d06-81b0-853ea03e85a7 service nova] Lock "89fdfdab-36a6-4481-bfa7-376c3a3a32ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:12:39 user nova-compute[72129]: DEBUG nova.compute.manager [req-b4b20349-7302-4564-b05d-ed717bead1af req-c284daaa-485e-4d06-81b0-853ea03e85a7 service nova] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] No waiting events found dispatching network-vif-plugged-778ce9fe-90f9-4d7f-98be-51407fc6520a {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:12:39 user nova-compute[72129]: WARNING nova.compute.manager [req-b4b20349-7302-4564-b05d-ed717bead1af req-c284daaa-485e-4d06-81b0-853ea03e85a7 service nova] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Received unexpected event network-vif-plugged-778ce9fe-90f9-4d7f-98be-51407fc6520a for instance with vm_state building and task_state spawning.
Aug 01 14:12:39 user nova-compute[72129]: DEBUG nova.compute.manager [req-b4b20349-7302-4564-b05d-ed717bead1af req-c284daaa-485e-4d06-81b0-853ea03e85a7 service nova] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Received event network-vif-plugged-778ce9fe-90f9-4d7f-98be-51407fc6520a {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:12:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-b4b20349-7302-4564-b05d-ed717bead1af req-c284daaa-485e-4d06-81b0-853ea03e85a7 service nova] Acquiring lock "89fdfdab-36a6-4481-bfa7-376c3a3a32ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:12:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-b4b20349-7302-4564-b05d-ed717bead1af req-c284daaa-485e-4d06-81b0-853ea03e85a7 service nova] Lock "89fdfdab-36a6-4481-bfa7-376c3a3a32ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:12:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-b4b20349-7302-4564-b05d-ed717bead1af req-c284daaa-485e-4d06-81b0-853ea03e85a7 service nova] Lock "89fdfdab-36a6-4481-bfa7-376c3a3a32ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:12:39 user nova-compute[72129]: DEBUG nova.compute.manager [req-b4b20349-7302-4564-b05d-ed717bead1af req-c284daaa-485e-4d06-81b0-853ea03e85a7 service nova] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] No waiting events found dispatching network-vif-plugged-778ce9fe-90f9-4d7f-98be-51407fc6520a {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:12:39 user nova-compute[72129]: WARNING nova.compute.manager [req-b4b20349-7302-4564-b05d-ed717bead1af req-c284daaa-485e-4d06-81b0-853ea03e85a7 service nova] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Received unexpected event network-vif-plugged-778ce9fe-90f9-4d7f-98be-51407fc6520a for instance with vm_state building and task_state spawning.
Aug 01 14:12:41 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:12:41 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690899161.4686923, 89fdfdab-36a6-4481-bfa7-376c3a3a32ae => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:12:41 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] VM Resumed (Lifecycle Event)
Aug 01 14:12:41 user nova-compute[72129]: DEBUG nova.compute.manager [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Instance event wait completed in 0 seconds for  {{(pid=72129) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 14:12:41 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Guest created on hypervisor {{(pid=72129) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 14:12:41 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Instance spawned successfully.
Aug 01 14:12:41 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 14:12:41 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:12:41 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:12:41 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Found default for hw_cdrom_bus of ide {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:12:41 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Found default for hw_disk_bus of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:12:41 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Found default for hw_input_bus of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:12:41 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Found default for hw_pointer_model of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:12:41 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Found default for hw_video_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:12:41 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Found default for hw_vif_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:12:41 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 14:12:41 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690899161.4703908, 89fdfdab-36a6-4481-bfa7-376c3a3a32ae => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:12:41 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] VM Started (Lifecycle Event)
Aug 01 14:12:41 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:12:41 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:12:41 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 14:12:41 user nova-compute[72129]: INFO nova.compute.manager [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Took 6.19 seconds to spawn the instance on the hypervisor.
Aug 01 14:12:41 user nova-compute[72129]: DEBUG nova.compute.manager [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:12:41 user nova-compute[72129]: INFO nova.compute.manager [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Took 6.81 seconds to build instance.
Aug 01 14:12:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-721141bd-dc7d-4c6e-b532-f2ff0a794f07 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Lock "89fdfdab-36a6-4481-bfa7-376c3a3a32ae" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.901s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:12:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:12:46 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:12:47 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-482bb57f-4aec-407d-bf44-32868328a953 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Acquiring lock "d031973f-8f48-43b3-a338-040950103e4c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:12:47 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-482bb57f-4aec-407d-bf44-32868328a953 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "d031973f-8f48-43b3-a338-040950103e4c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:12:47 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-482bb57f-4aec-407d-bf44-32868328a953 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Acquiring lock "d031973f-8f48-43b3-a338-040950103e4c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:12:47 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-482bb57f-4aec-407d-bf44-32868328a953 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "d031973f-8f48-43b3-a338-040950103e4c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:12:47 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-482bb57f-4aec-407d-bf44-32868328a953 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "d031973f-8f48-43b3-a338-040950103e4c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:12:47 user nova-compute[72129]: INFO nova.compute.manager [None req-482bb57f-4aec-407d-bf44-32868328a953 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: d031973f-8f48-43b3-a338-040950103e4c] Terminating instance
Aug 01 14:12:47 user nova-compute[72129]: DEBUG nova.compute.manager [None req-482bb57f-4aec-407d-bf44-32868328a953 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: d031973f-8f48-43b3-a338-040950103e4c] Start destroying the instance on the hypervisor. {{(pid=72129) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 14:12:47 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:12:47 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:12:48 user nova-compute[72129]: DEBUG nova.compute.manager [req-584aee8e-765b-4de8-bec7-d757774a5313 req-0c79da1e-7145-49e1-85e7-6f99d1f7dde5 service nova] [instance: d031973f-8f48-43b3-a338-040950103e4c] Received event network-vif-unplugged-a978f40a-6406-423f-81f7-1e8077b43fd5 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:12:48 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-584aee8e-765b-4de8-bec7-d757774a5313 req-0c79da1e-7145-49e1-85e7-6f99d1f7dde5 service nova] Acquiring lock "d031973f-8f48-43b3-a338-040950103e4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:12:48 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-584aee8e-765b-4de8-bec7-d757774a5313 req-0c79da1e-7145-49e1-85e7-6f99d1f7dde5 service nova] Lock "d031973f-8f48-43b3-a338-040950103e4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:12:48 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-584aee8e-765b-4de8-bec7-d757774a5313 req-0c79da1e-7145-49e1-85e7-6f99d1f7dde5 service nova] Lock "d031973f-8f48-43b3-a338-040950103e4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:12:48 user nova-compute[72129]: DEBUG nova.compute.manager [req-584aee8e-765b-4de8-bec7-d757774a5313 req-0c79da1e-7145-49e1-85e7-6f99d1f7dde5 service nova] [instance: d031973f-8f48-43b3-a338-040950103e4c] No waiting events found dispatching network-vif-unplugged-a978f40a-6406-423f-81f7-1e8077b43fd5 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:12:48 user nova-compute[72129]: DEBUG nova.compute.manager [req-584aee8e-765b-4de8-bec7-d757774a5313 req-0c79da1e-7145-49e1-85e7-6f99d1f7dde5 service nova] [instance: d031973f-8f48-43b3-a338-040950103e4c] Received event network-vif-unplugged-a978f40a-6406-423f-81f7-1e8077b43fd5 for instance with task_state deleting. {{(pid=72129) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 14:12:48 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:12:48 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:12:48 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: d031973f-8f48-43b3-a338-040950103e4c] Instance destroyed successfully.
Aug 01 14:12:48 user nova-compute[72129]: DEBUG nova.objects.instance [None req-482bb57f-4aec-407d-bf44-32868328a953 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lazy-loading 'resources' on Instance uuid d031973f-8f48-43b3-a338-040950103e4c {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:12:48 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-482bb57f-4aec-407d-bf44-32868328a953 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:56:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-750731877',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-750731877',id=19,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T13:58:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1e0929886fa54d1c8023793806f10d31',ramdisk_id='',reservation_id='r-n3dae9u5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1414609013',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T14:00:48Z,user_data=None,user_id='cdb6f66592fe4cdebea02e5f5c1f4a60',uuid=d031973f-8f48-43b3-a338-040950103e4c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a978f40a-6406-423f-81f7-1e8077b43fd5", "address": "fa:16:3e:09:fd:e5", "network": {"id": "59b1e538-8bfe-45ce-ab7b-c5838ab25582", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1129024349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0929886fa54d1c8023793806f10d31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa978f40a-64", "ovs_interfaceid": "a978f40a-6406-423f-81f7-1e8077b43fd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 14:12:48 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-482bb57f-4aec-407d-bf44-32868328a953 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Converting VIF {"id": "a978f40a-6406-423f-81f7-1e8077b43fd5", "address": "fa:16:3e:09:fd:e5", "network": {"id": "59b1e538-8bfe-45ce-ab7b-c5838ab25582", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1129024349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0929886fa54d1c8023793806f10d31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa978f40a-64", "ovs_interfaceid": "a978f40a-6406-423f-81f7-1e8077b43fd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:12:48 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-482bb57f-4aec-407d-bf44-32868328a953 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:09:fd:e5,bridge_name='br-int',has_traffic_filtering=True,id=a978f40a-6406-423f-81f7-1e8077b43fd5,network=Network(59b1e538-8bfe-45ce-ab7b-c5838ab25582),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa978f40a-64') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:12:48 user nova-compute[72129]: DEBUG os_vif [None req-482bb57f-4aec-407d-bf44-32868328a953 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:fd:e5,bridge_name='br-int',has_traffic_filtering=True,id=a978f40a-6406-423f-81f7-1e8077b43fd5,network=Network(59b1e538-8bfe-45ce-ab7b-c5838ab25582),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa978f40a-64') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 14:12:48 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:12:48 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa978f40a-64, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:12:48 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:12:48 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:12:48 user nova-compute[72129]: INFO os_vif [None req-482bb57f-4aec-407d-bf44-32868328a953 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:fd:e5,bridge_name='br-int',has_traffic_filtering=True,id=a978f40a-6406-423f-81f7-1e8077b43fd5,network=Network(59b1e538-8bfe-45ce-ab7b-c5838ab25582),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa978f40a-64')
Aug 01 14:12:48 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-482bb57f-4aec-407d-bf44-32868328a953 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: d031973f-8f48-43b3-a338-040950103e4c] calling os-brick to detach iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 14:12:48 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-482bb57f-4aec-407d-bf44-32868328a953 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, {'target_iqns': ['iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YbOIcMLV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:12:48 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-482bb57f-4aec-407d-bf44-32868328a953 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:12:48 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-482bb57f-4aec-407d-bf44-32868328a953 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:12:48 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-482bb57f-4aec-407d-bf44-32868328a953 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:12:48 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-482bb57f-4aec-407d-bf44-32868328a953 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6', 0)] {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 14:12:48 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:12:48 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:12:48 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[9232d99b-1ce5-4f03-9555-bc9b5628de74]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9b58b04-6855-4ece-b021-cba7a3a62f4b\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:12:48 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:12:48 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:12:48 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82c7734-311d-459f-96ac-8133ef673d44]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b58b04-6855-4ece-b021-cba7a3a62f4b (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:12:48 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-482bb57f-4aec-407d-bf44-32868328a953 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:12:48 user nova-compute[72129]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 (non-flash)
Aug 01 14:12:48 user nova-compute[72129]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b58b04-6855-4ece-b021-cba7a3a62f4b (non-flash)
Aug 01 14:12:48 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:12:48 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-482bb57f-4aec-407d-bf44-32868328a953 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 (non-flash)
Aug 01 14:12:48 user nova-compute[72129]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 (non-flash)
Aug 01 14:12:48 user nova-compute[72129]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b58b04-6855-4ece-b021-cba7a3a62f4b (non-flash)
Aug 01 14:12:48 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:12:48 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-482bb57f-4aec-407d-bf44-32868328a953 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f28105bacb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6'): ({'sdc'}, set())}) {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 14:12:48 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-482bb57f-4aec-407d-bf44-32868328a953 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Removing single pathed devices sdc {{(pid=72129) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 14:12:48 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:12:48 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:12:48 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[752d4076-5680-4840-9e04-e65cc926134c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:12:48 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:12:48 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:12:48 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f5a5c3d-c0e6-4ae6-9a28-71aa0518eb2a]: (4, ('ok\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:12:48 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-482bb57f-4aec-407d-bf44-32868328a953 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Flushing IO for device /dev/sdc {{(pid=72129) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 14:12:48 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:12:48 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:12:48 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6442be8-e29b-4c40-aa56-78bef2eedc16]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:12:48 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-482bb57f-4aec-407d-bf44-32868328a953 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72129) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 14:12:48 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:12:48 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:12:48 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77f8a55-207b-413b-aeda-075e523bc6a9]: (4, ('1', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:12:48 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-482bb57f-4aec-407d-bf44-32868328a953 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 14:12:48 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-482bb57f-4aec-407d-bf44-32868328a953 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] SCSI volumes sdc have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 14:12:48 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-482bb57f-4aec-407d-bf44-32868328a953 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6')] {{(pid=72129) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 14:12:48 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:12:48 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.176s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:12:48 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[0796f964-5f62-4615-b7fe-e077fcbdc88e]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:12:48 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-482bb57f-4aec-407d-bf44-32868328a953 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:12:48 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 -p 172.16.0.220:3260 --logout {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:12:48 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:12:48 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[f36b35b6-5d74-4092-acc7-c77d9ab863e1]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:12:48 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-482bb57f-4aec-407d-bf44-32868328a953 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6, portal: 172.16.0.220,3260]
Aug 01 14:12:48 user nova-compute[72129]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6, portal: 172.16.0.220,3260] successful.
Aug 01 14:12:48 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:12:48 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 -p 172.16.0.220:3260 --op delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:12:48 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11ec6e25-74a1-4f6b-a96c-634c55581fa6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:12:48 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b84cc8e-da2d-475a-944c-aa9a3f12b7b2]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:12:48 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-482bb57f-4aec-407d-bf44-32868328a953 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:12:48 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-482bb57f-4aec-407d-bf44-32868328a953 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.439s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:12:48 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-482bb57f-4aec-407d-bf44-32868328a953 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] <== disconnect_volume: return (440ms) None {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:12:48 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-482bb57f-4aec-407d-bf44-32868328a953 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: d031973f-8f48-43b3-a338-040950103e4c] Disconnected iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 14:12:48 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-482bb57f-4aec-407d-bf44-32868328a953 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: d031973f-8f48-43b3-a338-040950103e4c] Deleting instance files /opt/stack/data/nova/instances/d031973f-8f48-43b3-a338-040950103e4c_del
Aug 01 14:12:48 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-482bb57f-4aec-407d-bf44-32868328a953 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: d031973f-8f48-43b3-a338-040950103e4c] Deletion of /opt/stack/data/nova/instances/d031973f-8f48-43b3-a338-040950103e4c_del complete
Aug 01 14:12:49 user nova-compute[72129]: INFO nova.compute.manager [None req-482bb57f-4aec-407d-bf44-32868328a953 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: d031973f-8f48-43b3-a338-040950103e4c] Took 1.28 seconds to destroy the instance on the hypervisor.
Aug 01 14:12:49 user nova-compute[72129]: DEBUG oslo.service.loopingcall [None req-482bb57f-4aec-407d-bf44-32868328a953 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72129) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 14:12:49 user nova-compute[72129]: DEBUG nova.compute.manager [-] [instance: d031973f-8f48-43b3-a338-040950103e4c] Deallocating network for instance {{(pid=72129) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 14:12:49 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: d031973f-8f48-43b3-a338-040950103e4c] deallocate_for_instance() {{(pid=72129) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 14:12:49 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: d031973f-8f48-43b3-a338-040950103e4c] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:12:49 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: d031973f-8f48-43b3-a338-040950103e4c] Took 0.48 seconds to deallocate network for instance.
Aug 01 14:12:50 user nova-compute[72129]: DEBUG nova.compute.manager [req-1a593f69-91f6-4a2b-9760-8eb4fcdacc88 req-d4237319-6681-41e8-8898-12df10891269 service nova] [instance: d031973f-8f48-43b3-a338-040950103e4c] Received event network-vif-plugged-a978f40a-6406-423f-81f7-1e8077b43fd5 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:12:50 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-1a593f69-91f6-4a2b-9760-8eb4fcdacc88 req-d4237319-6681-41e8-8898-12df10891269 service nova] Acquiring lock "d031973f-8f48-43b3-a338-040950103e4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:12:50 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-1a593f69-91f6-4a2b-9760-8eb4fcdacc88 req-d4237319-6681-41e8-8898-12df10891269 service nova] Lock "d031973f-8f48-43b3-a338-040950103e4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:12:50 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-1a593f69-91f6-4a2b-9760-8eb4fcdacc88 req-d4237319-6681-41e8-8898-12df10891269 service nova] Lock "d031973f-8f48-43b3-a338-040950103e4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:12:50 user nova-compute[72129]: DEBUG nova.compute.manager [req-1a593f69-91f6-4a2b-9760-8eb4fcdacc88 req-d4237319-6681-41e8-8898-12df10891269 service nova] [instance: d031973f-8f48-43b3-a338-040950103e4c] No waiting events found dispatching network-vif-plugged-a978f40a-6406-423f-81f7-1e8077b43fd5 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:12:50 user nova-compute[72129]: WARNING nova.compute.manager [req-1a593f69-91f6-4a2b-9760-8eb4fcdacc88 req-d4237319-6681-41e8-8898-12df10891269 service nova] [instance: d031973f-8f48-43b3-a338-040950103e4c] Received unexpected event network-vif-plugged-a978f40a-6406-423f-81f7-1e8077b43fd5 for instance with vm_state active and task_state deleting.
Aug 01 14:12:50 user nova-compute[72129]: DEBUG nova.compute.manager [req-1a593f69-91f6-4a2b-9760-8eb4fcdacc88 req-d4237319-6681-41e8-8898-12df10891269 service nova] [instance: d031973f-8f48-43b3-a338-040950103e4c] Received event network-vif-deleted-a978f40a-6406-423f-81f7-1e8077b43fd5 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:12:50 user nova-compute[72129]: INFO nova.compute.manager [None req-482bb57f-4aec-407d-bf44-32868328a953 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: d031973f-8f48-43b3-a338-040950103e4c] Took 0.72 seconds to detach 1 volumes for instance.
Aug 01 14:12:50 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-482bb57f-4aec-407d-bf44-32868328a953 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:12:50 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-482bb57f-4aec-407d-bf44-32868328a953 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:12:50 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-482bb57f-4aec-407d-bf44-32868328a953 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:12:50 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-482bb57f-4aec-407d-bf44-32868328a953 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:12:50 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-482bb57f-4aec-407d-bf44-32868328a953 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.198s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:12:50 user nova-compute[72129]: INFO nova.scheduler.client.report [None req-482bb57f-4aec-407d-bf44-32868328a953 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Deleted allocations for instance d031973f-8f48-43b3-a338-040950103e4c
Aug 01 14:12:50 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-482bb57f-4aec-407d-bf44-32868328a953 tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "d031973f-8f48-43b3-a338-040950103e4c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.843s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:12:52 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:12:52 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72129) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 14:12:53 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:12:53 user nova-compute[72129]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690899158.5472264, 9c31c5b8-5485-4603-853a-8b7ef7efa843 => Stopped> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:12:53 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 9c31c5b8-5485-4603-853a-8b7ef7efa843] VM Stopped (Lifecycle Event)
Aug 01 14:12:53 user nova-compute[72129]: DEBUG nova.compute.manager [None req-48c271ef-67d3-4d94-b5b4-828aec352c7e None None] [instance: 9c31c5b8-5485-4603-853a-8b7ef7efa843] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:12:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a29f993c-969d-4b82-be36-c3621d1d8c6c tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Acquiring lock "1e06fb45-d156-451b-9e4d-e3d2fed52c37" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:12:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a29f993c-969d-4b82-be36-c3621d1d8c6c tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lock "1e06fb45-d156-451b-9e4d-e3d2fed52c37" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:12:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a29f993c-969d-4b82-be36-c3621d1d8c6c tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Acquiring lock "1e06fb45-d156-451b-9e4d-e3d2fed52c37-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:12:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a29f993c-969d-4b82-be36-c3621d1d8c6c tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lock "1e06fb45-d156-451b-9e4d-e3d2fed52c37-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:12:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a29f993c-969d-4b82-be36-c3621d1d8c6c tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lock "1e06fb45-d156-451b-9e4d-e3d2fed52c37-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:12:54 user nova-compute[72129]: INFO nova.compute.manager [None req-a29f993c-969d-4b82-be36-c3621d1d8c6c tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Terminating instance
Aug 01 14:12:54 user nova-compute[72129]: DEBUG nova.compute.manager [None req-a29f993c-969d-4b82-be36-c3621d1d8c6c tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Start destroying the instance on the hypervisor. {{(pid=72129) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 14:12:54 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:12:54 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:12:54 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:12:54 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:12:55 user nova-compute[72129]: DEBUG nova.compute.manager [req-a5555608-41ab-4fd2-9451-48bcb00ec1b9 req-0b10deeb-c609-437b-a233-f122cc8bced1 service nova] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Received event network-vif-unplugged-3811b72e-705a-4336-ac66-a0fed51437e4 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:12:55 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-a5555608-41ab-4fd2-9451-48bcb00ec1b9 req-0b10deeb-c609-437b-a233-f122cc8bced1 service nova] Acquiring lock "1e06fb45-d156-451b-9e4d-e3d2fed52c37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:12:55 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-a5555608-41ab-4fd2-9451-48bcb00ec1b9 req-0b10deeb-c609-437b-a233-f122cc8bced1 service nova] Lock "1e06fb45-d156-451b-9e4d-e3d2fed52c37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:12:55 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-a5555608-41ab-4fd2-9451-48bcb00ec1b9 req-0b10deeb-c609-437b-a233-f122cc8bced1 service nova] Lock "1e06fb45-d156-451b-9e4d-e3d2fed52c37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:12:55 user nova-compute[72129]: DEBUG nova.compute.manager [req-a5555608-41ab-4fd2-9451-48bcb00ec1b9 req-0b10deeb-c609-437b-a233-f122cc8bced1 service nova] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] No waiting events found dispatching network-vif-unplugged-3811b72e-705a-4336-ac66-a0fed51437e4 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:12:55 user nova-compute[72129]: DEBUG nova.compute.manager [req-a5555608-41ab-4fd2-9451-48bcb00ec1b9 req-0b10deeb-c609-437b-a233-f122cc8bced1 service nova] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Received event network-vif-unplugged-3811b72e-705a-4336-ac66-a0fed51437e4 for instance with task_state deleting. {{(pid=72129) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 14:12:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:12:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:12:55 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Instance destroyed successfully.
Aug 01 14:12:55 user nova-compute[72129]: DEBUG nova.objects.instance [None req-a29f993c-969d-4b82-be36-c3621d1d8c6c tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lazy-loading 'resources' on Instance uuid 1e06fb45-d156-451b-9e4d-e3d2fed52c37 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:12:55 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-a29f993c-969d-4b82-be36-c3621d1d8c6c tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T14:07:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1528036097',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1528036097',id=33,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIgNnezmd3WUtvMc91uqfFchcd5GoNgjDKdQnSLwhRBanZwsPizFNVNm3dzrcvRZ7hFRKmkWdxbqwDlwVGnI8tIUko9u2VFfHh/iPWhzSPvxCFMeliixeCIv/26AwtF9aQ==',key_name='tempest-keypair-12459561',keypairs=<?>,launch_index=0,launched_at=2023-08-01T14:11:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b724093fa43c4afb9130efa2cfc713d9',ramdisk_id='',reservation_id='r-29k01a26',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1864942034',owner_user_name='tempest-AttachVolumeShelveTestJSON-1864942034-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T14:11:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e5630ede467c4c99915b1b2f455ca0fb',uuid=1e06fb45-d156-451b-9e4d-e3d2fed52c37,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3811b72e-705a-4336-ac66-a0fed51437e4", "address": "fa:16:3e:a3:60:b1", "network": {"id": "ce10dac7-17d0-425a-bfee-70b8220d7871", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1288141476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b724093fa43c4afb9130efa2cfc713d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3811b72e-70", "ovs_interfaceid": "3811b72e-705a-4336-ac66-a0fed51437e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 14:12:55 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-a29f993c-969d-4b82-be36-c3621d1d8c6c tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Converting VIF {"id": "3811b72e-705a-4336-ac66-a0fed51437e4", "address": "fa:16:3e:a3:60:b1", "network": {"id": "ce10dac7-17d0-425a-bfee-70b8220d7871", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1288141476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b724093fa43c4afb9130efa2cfc713d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3811b72e-70", "ovs_interfaceid": "3811b72e-705a-4336-ac66-a0fed51437e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:12:55 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-a29f993c-969d-4b82-be36-c3621d1d8c6c tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:60:b1,bridge_name='br-int',has_traffic_filtering=True,id=3811b72e-705a-4336-ac66-a0fed51437e4,network=Network(ce10dac7-17d0-425a-bfee-70b8220d7871),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3811b72e-70') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:12:55 user nova-compute[72129]: DEBUG os_vif [None req-a29f993c-969d-4b82-be36-c3621d1d8c6c tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:60:b1,bridge_name='br-int',has_traffic_filtering=True,id=3811b72e-705a-4336-ac66-a0fed51437e4,network=Network(ce10dac7-17d0-425a-bfee-70b8220d7871),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3811b72e-70') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 14:12:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:12:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3811b72e-70, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:12:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:12:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:12:55 user nova-compute[72129]: INFO os_vif [None req-a29f993c-969d-4b82-be36-c3621d1d8c6c tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:60:b1,bridge_name='br-int',has_traffic_filtering=True,id=3811b72e-705a-4336-ac66-a0fed51437e4,network=Network(ce10dac7-17d0-425a-bfee-70b8220d7871),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3811b72e-70')
Aug 01 14:12:55 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-a29f993c-969d-4b82-be36-c3621d1d8c6c tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Deleting instance files /opt/stack/data/nova/instances/1e06fb45-d156-451b-9e4d-e3d2fed52c37_del
Aug 01 14:12:55 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-a29f993c-969d-4b82-be36-c3621d1d8c6c tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Deletion of /opt/stack/data/nova/instances/1e06fb45-d156-451b-9e4d-e3d2fed52c37_del complete
Aug 01 14:12:55 user nova-compute[72129]: INFO nova.compute.manager [None req-a29f993c-969d-4b82-be36-c3621d1d8c6c tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Took 0.66 seconds to destroy the instance on the hypervisor.
Aug 01 14:12:55 user nova-compute[72129]: DEBUG oslo.service.loopingcall [None req-a29f993c-969d-4b82-be36-c3621d1d8c6c tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72129) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 14:12:55 user nova-compute[72129]: DEBUG nova.compute.manager [-] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Deallocating network for instance {{(pid=72129) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 14:12:55 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] deallocate_for_instance() {{(pid=72129) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 14:12:56 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:12:56 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Starting heal instance info cache {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 14:12:56 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "refresh_cache-71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:12:56 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquired lock "refresh_cache-71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:12:56 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Forcefully refreshing network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 14:12:56 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:12:56 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Took 0.76 seconds to deallocate network for instance.
Aug 01 14:12:56 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:12:56 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a29f993c-969d-4b82-be36-c3621d1d8c6c tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:12:56 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a29f993c-969d-4b82-be36-c3621d1d8c6c tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:12:56 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-a29f993c-969d-4b82-be36-c3621d1d8c6c tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:12:56 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-a29f993c-969d-4b82-be36-c3621d1d8c6c tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:12:56 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a29f993c-969d-4b82-be36-c3621d1d8c6c tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.215s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:12:56 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Updating instance_info_cache with network_info: [{"id": "a5aad1a2-0499-4725-9837-ee171ff0b048", "address": "fa:16:3e:0d:87:39", "network": {"id": "a7f4226b-73fe-4265-ba2c-5d7dcdf154fd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1142462884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210837255c8148ec9b482ba3e2551362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5aad1a2-04", "ovs_interfaceid": "a5aad1a2-0499-4725-9837-ee171ff0b048", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:12:56 user nova-compute[72129]: INFO nova.scheduler.client.report [None req-a29f993c-969d-4b82-be36-c3621d1d8c6c tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Deleted allocations for instance 1e06fb45-d156-451b-9e4d-e3d2fed52c37
Aug 01 14:12:56 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Releasing lock "refresh_cache-71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:12:56 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Updated the network info_cache for instance {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 14:12:56 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:12:56 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:12:56 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a29f993c-969d-4b82-be36-c3621d1d8c6c tempest-AttachVolumeShelveTestJSON-1864942034 tempest-AttachVolumeShelveTestJSON-1864942034-project-member] Lock "1e06fb45-d156-451b-9e4d-e3d2fed52c37" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.803s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:12:57 user nova-compute[72129]: DEBUG nova.compute.manager [req-9e55d3b1-5587-4722-bdf5-540b501f930b req-4e67b4a7-dfe9-4bad-b2c1-5f0e3ed86b75 service nova] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Received event network-vif-plugged-3811b72e-705a-4336-ac66-a0fed51437e4 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:12:57 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-9e55d3b1-5587-4722-bdf5-540b501f930b req-4e67b4a7-dfe9-4bad-b2c1-5f0e3ed86b75 service nova] Acquiring lock "1e06fb45-d156-451b-9e4d-e3d2fed52c37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:12:57 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-9e55d3b1-5587-4722-bdf5-540b501f930b req-4e67b4a7-dfe9-4bad-b2c1-5f0e3ed86b75 service nova] Lock "1e06fb45-d156-451b-9e4d-e3d2fed52c37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:12:57 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-9e55d3b1-5587-4722-bdf5-540b501f930b req-4e67b4a7-dfe9-4bad-b2c1-5f0e3ed86b75 service nova] Lock "1e06fb45-d156-451b-9e4d-e3d2fed52c37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:12:57 user nova-compute[72129]: DEBUG nova.compute.manager [req-9e55d3b1-5587-4722-bdf5-540b501f930b req-4e67b4a7-dfe9-4bad-b2c1-5f0e3ed86b75 service nova] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] No waiting events found dispatching network-vif-plugged-3811b72e-705a-4336-ac66-a0fed51437e4 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:12:57 user nova-compute[72129]: WARNING nova.compute.manager [req-9e55d3b1-5587-4722-bdf5-540b501f930b req-4e67b4a7-dfe9-4bad-b2c1-5f0e3ed86b75 service nova] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Received unexpected event network-vif-plugged-3811b72e-705a-4336-ac66-a0fed51437e4 for instance with vm_state deleted and task_state None.
Aug 01 14:12:57 user nova-compute[72129]: DEBUG nova.compute.manager [req-9e55d3b1-5587-4722-bdf5-540b501f930b req-4e67b4a7-dfe9-4bad-b2c1-5f0e3ed86b75 service nova] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Received event network-vif-deleted-3811b72e-705a-4336-ac66-a0fed51437e4 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:12:58 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:12:59 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:12:59 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:12:59 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:12:59 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:12:59 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:12:59 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Auditing locally available compute resources for user (node: user) {{(pid=72129) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 14:12:59 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:12:59 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:12:59 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:12:59 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:12:59 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89fdfdab-36a6-4481-bfa7-376c3a3a32ae/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:12:59 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89fdfdab-36a6-4481-bfa7-376c3a3a32ae/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:12:59 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89fdfdab-36a6-4481-bfa7-376c3a3a32ae/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:12:59 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89fdfdab-36a6-4481-bfa7-376c3a3a32ae/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:12:59 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 14:12:59 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 14:13:00 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:13:00 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:13:00 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Hypervisor/Node resource view: name=user free_ram=8302MB free_disk=25.13477325439453GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72129) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 14:13:00 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:13:00 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:13:00 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:13:00 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:13:00 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance fc0c1916-fd16-4379-9739-bcb03643b42e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:13:00 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 89fdfdab-36a6-4481-bfa7-376c3a3a32ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:13:00 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 14:13:00 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 14:13:00 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:13:00 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:13:00 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:13:00 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Compute_service record updated for user:user {{(pid=72129) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 14:13:00 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.279s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:13:01 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:13:01 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:13:02 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:13:03 user nova-compute[72129]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690899168.4886894, d031973f-8f48-43b3-a338-040950103e4c => Stopped> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:13:03 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: d031973f-8f48-43b3-a338-040950103e4c] VM Stopped (Lifecycle Event)
Aug 01 14:13:03 user nova-compute[72129]: DEBUG nova.compute.manager [None req-43c017f7-872d-41fa-9c94-fca34b4d8c32 None None] [instance: d031973f-8f48-43b3-a338-040950103e4c] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:13:05 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:13:05 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:13:06 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:13:06 user nova-compute[72129]: DEBUG nova.compute.manager [req-9a0e94e6-1fdc-457d-90f0-38bc992321c7 req-c50e6a87-207f-42df-baaf-463268d4d63f service nova] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Received event network-changed-06b5806a-5009-4492-ab48-159cae6c002e {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:13:06 user nova-compute[72129]: DEBUG nova.compute.manager [req-9a0e94e6-1fdc-457d-90f0-38bc992321c7 req-c50e6a87-207f-42df-baaf-463268d4d63f service nova] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Refreshing instance network info cache due to event network-changed-06b5806a-5009-4492-ab48-159cae6c002e. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 14:13:06 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-9a0e94e6-1fdc-457d-90f0-38bc992321c7 req-c50e6a87-207f-42df-baaf-463268d4d63f service nova] Acquiring lock "refresh_cache-fc0c1916-fd16-4379-9739-bcb03643b42e" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:13:06 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-9a0e94e6-1fdc-457d-90f0-38bc992321c7 req-c50e6a87-207f-42df-baaf-463268d4d63f service nova] Acquired lock "refresh_cache-fc0c1916-fd16-4379-9739-bcb03643b42e" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:13:06 user nova-compute[72129]: DEBUG nova.network.neutron [req-9a0e94e6-1fdc-457d-90f0-38bc992321c7 req-c50e6a87-207f-42df-baaf-463268d4d63f service nova] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Refreshing network info cache for port 06b5806a-5009-4492-ab48-159cae6c002e {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 14:13:07 user nova-compute[72129]: DEBUG nova.network.neutron [req-9a0e94e6-1fdc-457d-90f0-38bc992321c7 req-c50e6a87-207f-42df-baaf-463268d4d63f service nova] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Updated VIF entry in instance network info cache for port 06b5806a-5009-4492-ab48-159cae6c002e. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 14:13:07 user nova-compute[72129]: DEBUG nova.network.neutron [req-9a0e94e6-1fdc-457d-90f0-38bc992321c7 req-c50e6a87-207f-42df-baaf-463268d4d63f service nova] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Updating instance_info_cache with network_info: [{"id": "06b5806a-5009-4492-ab48-159cae6c002e", "address": "fa:16:3e:b6:04:68", "network": {"id": "a7f4226b-73fe-4265-ba2c-5d7dcdf154fd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1142462884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210837255c8148ec9b482ba3e2551362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06b5806a-50", "ovs_interfaceid": "06b5806a-5009-4492-ab48-159cae6c002e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:13:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-9a0e94e6-1fdc-457d-90f0-38bc992321c7 req-c50e6a87-207f-42df-baaf-463268d4d63f service nova] Releasing lock "refresh_cache-fc0c1916-fd16-4379-9739-bcb03643b42e" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:13:07 user nova-compute[72129]: DEBUG nova.compute.manager [req-97165f27-a0c5-4b6c-876c-053867bf0372 req-f63efbfb-46c7-46f4-91f6-283d37207fbd service nova] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Received event network-changed-06b5806a-5009-4492-ab48-159cae6c002e {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:13:07 user nova-compute[72129]: DEBUG nova.compute.manager [req-97165f27-a0c5-4b6c-876c-053867bf0372 req-f63efbfb-46c7-46f4-91f6-283d37207fbd service nova] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Refreshing instance network info cache due to event network-changed-06b5806a-5009-4492-ab48-159cae6c002e. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 14:13:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-97165f27-a0c5-4b6c-876c-053867bf0372 req-f63efbfb-46c7-46f4-91f6-283d37207fbd service nova] Acquiring lock "refresh_cache-fc0c1916-fd16-4379-9739-bcb03643b42e" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:13:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-97165f27-a0c5-4b6c-876c-053867bf0372 req-f63efbfb-46c7-46f4-91f6-283d37207fbd service nova] Acquired lock "refresh_cache-fc0c1916-fd16-4379-9739-bcb03643b42e" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:13:07 user nova-compute[72129]: DEBUG nova.network.neutron [req-97165f27-a0c5-4b6c-876c-053867bf0372 req-f63efbfb-46c7-46f4-91f6-283d37207fbd service nova] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Refreshing network info cache for port 06b5806a-5009-4492-ab48-159cae6c002e {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 14:13:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-37e0997f-a273-4d5e-a79d-8ac04f06d3e7 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Acquiring lock "fc0c1916-fd16-4379-9739-bcb03643b42e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:13:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-37e0997f-a273-4d5e-a79d-8ac04f06d3e7 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "fc0c1916-fd16-4379-9739-bcb03643b42e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:13:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-37e0997f-a273-4d5e-a79d-8ac04f06d3e7 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Acquiring lock "fc0c1916-fd16-4379-9739-bcb03643b42e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:13:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-37e0997f-a273-4d5e-a79d-8ac04f06d3e7 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "fc0c1916-fd16-4379-9739-bcb03643b42e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:13:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-37e0997f-a273-4d5e-a79d-8ac04f06d3e7 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "fc0c1916-fd16-4379-9739-bcb03643b42e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:13:07 user nova-compute[72129]: INFO nova.compute.manager [None req-37e0997f-a273-4d5e-a79d-8ac04f06d3e7 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Terminating instance
Aug 01 14:13:07 user nova-compute[72129]: DEBUG nova.compute.manager [None req-37e0997f-a273-4d5e-a79d-8ac04f06d3e7 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Start destroying the instance on the hypervisor. {{(pid=72129) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 14:13:07 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:13:07 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:13:07 user nova-compute[72129]: DEBUG nova.compute.manager [req-77afc075-557d-4ae4-bff1-3d68b16efe3e req-23563805-4726-43a6-aa7f-fa134095142c service nova] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Received event network-vif-unplugged-06b5806a-5009-4492-ab48-159cae6c002e {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:13:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-77afc075-557d-4ae4-bff1-3d68b16efe3e req-23563805-4726-43a6-aa7f-fa134095142c service nova] Acquiring lock "fc0c1916-fd16-4379-9739-bcb03643b42e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:13:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-77afc075-557d-4ae4-bff1-3d68b16efe3e req-23563805-4726-43a6-aa7f-fa134095142c service nova] Lock "fc0c1916-fd16-4379-9739-bcb03643b42e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:13:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-77afc075-557d-4ae4-bff1-3d68b16efe3e req-23563805-4726-43a6-aa7f-fa134095142c service nova] Lock "fc0c1916-fd16-4379-9739-bcb03643b42e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:13:07 user nova-compute[72129]: DEBUG nova.compute.manager [req-77afc075-557d-4ae4-bff1-3d68b16efe3e req-23563805-4726-43a6-aa7f-fa134095142c service nova] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] No waiting events found dispatching network-vif-unplugged-06b5806a-5009-4492-ab48-159cae6c002e {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:13:07 user nova-compute[72129]: DEBUG nova.compute.manager [req-77afc075-557d-4ae4-bff1-3d68b16efe3e req-23563805-4726-43a6-aa7f-fa134095142c service nova] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Received event network-vif-unplugged-06b5806a-5009-4492-ab48-159cae6c002e for instance with task_state deleting. {{(pid=72129) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 14:13:08 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:13:08 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:13:08 user nova-compute[72129]: DEBUG nova.network.neutron [req-97165f27-a0c5-4b6c-876c-053867bf0372 req-f63efbfb-46c7-46f4-91f6-283d37207fbd service nova] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Updated VIF entry in instance network info cache for port 06b5806a-5009-4492-ab48-159cae6c002e. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 14:13:08 user nova-compute[72129]: DEBUG nova.network.neutron [req-97165f27-a0c5-4b6c-876c-053867bf0372 req-f63efbfb-46c7-46f4-91f6-283d37207fbd service nova] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Updating instance_info_cache with network_info: [{"id": "06b5806a-5009-4492-ab48-159cae6c002e", "address": "fa:16:3e:b6:04:68", "network": {"id": "a7f4226b-73fe-4265-ba2c-5d7dcdf154fd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1142462884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210837255c8148ec9b482ba3e2551362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06b5806a-50", "ovs_interfaceid": "06b5806a-5009-4492-ab48-159cae6c002e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:13:08 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-97165f27-a0c5-4b6c-876c-053867bf0372 req-f63efbfb-46c7-46f4-91f6-283d37207fbd service nova] Releasing lock "refresh_cache-fc0c1916-fd16-4379-9739-bcb03643b42e" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:13:08 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Instance destroyed successfully.
Aug 01 14:13:08 user nova-compute[72129]: DEBUG nova.objects.instance [None req-37e0997f-a273-4d5e-a79d-8ac04f06d3e7 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lazy-loading 'resources' on Instance uuid fc0c1916-fd16-4379-9739-bcb03643b42e {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:13:08 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-37e0997f-a273-4d5e-a79d-8ac04f06d3e7 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:11:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1474611541',display_name='tempest-TestVolumeBootPattern-server-1474611541',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1474611541',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNC/W23SfZUyUykD+/RvnPe5L4yiaqOIZwhr2x6wMubzv0aJUgMCBBDug36LSArw18K2rZhhyJmbPtRQrPLsQ9v32QcGWNTH4aynBroBlcsIvr6dB/z67zo0JXowDVQS+w==',key_name='tempest-TestVolumeBootPattern-1986080939',keypairs=<?>,launch_index=0,launched_at=2023-08-01T14:11:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='210837255c8148ec9b482ba3e2551362',ramdisk_id='',reservation_id='r-i10d9c73',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1876154436',owner_user_name='tempest-TestVolumeBootPattern-1876154436-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T14:11:29Z,user_data=None,user_id='7c341be2816c43cfa9adb58ee84e942b',uuid=fc0c1916-fd16-4379-9739-bcb03643b42e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "06b5806a-5009-4492-ab48-159cae6c002e", "address": "fa:16:3e:b6:04:68", "network": {"id": "a7f4226b-73fe-4265-ba2c-5d7dcdf154fd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1142462884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210837255c8148ec9b482ba3e2551362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06b5806a-50", "ovs_interfaceid": "06b5806a-5009-4492-ab48-159cae6c002e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 14:13:08 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-37e0997f-a273-4d5e-a79d-8ac04f06d3e7 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Converting VIF {"id": "06b5806a-5009-4492-ab48-159cae6c002e", "address": "fa:16:3e:b6:04:68", "network": {"id": "a7f4226b-73fe-4265-ba2c-5d7dcdf154fd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1142462884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210837255c8148ec9b482ba3e2551362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06b5806a-50", "ovs_interfaceid": "06b5806a-5009-4492-ab48-159cae6c002e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:13:08 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-37e0997f-a273-4d5e-a79d-8ac04f06d3e7 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b6:04:68,bridge_name='br-int',has_traffic_filtering=True,id=06b5806a-5009-4492-ab48-159cae6c002e,network=Network(a7f4226b-73fe-4265-ba2c-5d7dcdf154fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06b5806a-50') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:13:08 user nova-compute[72129]: DEBUG os_vif [None req-37e0997f-a273-4d5e-a79d-8ac04f06d3e7 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:04:68,bridge_name='br-int',has_traffic_filtering=True,id=06b5806a-5009-4492-ab48-159cae6c002e,network=Network(a7f4226b-73fe-4265-ba2c-5d7dcdf154fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06b5806a-50') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 14:13:08 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:13:08 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap06b5806a-50, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:13:08 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:13:08 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:13:08 user nova-compute[72129]: INFO os_vif [None req-37e0997f-a273-4d5e-a79d-8ac04f06d3e7 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:04:68,bridge_name='br-int',has_traffic_filtering=True,id=06b5806a-5009-4492-ab48-159cae6c002e,network=Network(a7f4226b-73fe-4265-ba2c-5d7dcdf154fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06b5806a-50')
Aug 01 14:13:08 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37e0997f-a273-4d5e-a79d-8ac04f06d3e7 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] calling os-brick to detach iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 14:13:08 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e0997f-a273-4d5e-a79d-8ac04f06d3e7 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, {'target_iqns': ['iqn.2010-10.org.openstack:f9b58b04-6855-4ece-b021-cba7a3a62f4b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iMaKPdWb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:13:08 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-37e0997f-a273-4d5e-a79d-8ac04f06d3e7 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:13:08 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-37e0997f-a273-4d5e-a79d-8ac04f06d3e7 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:13:08 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-37e0997f-a273-4d5e-a79d-8ac04f06d3e7 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:13:08 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e0997f-a273-4d5e-a79d-8ac04f06d3e7 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9b58b04-6855-4ece-b021-cba7a3a62f4b', 0)] {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 14:13:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:13:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:13:08 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[2059e472-70e6-4a62-a9b8-5f3587cd4697]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9b58b04-6855-4ece-b021-cba7a3a62f4b\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:13:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:13:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:13:08 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c7c728-75bc-4fb3-a8cd-1ca56e8c4de6]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b58b04-6855-4ece-b021-cba7a3a62f4b (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:13:08 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e0997f-a273-4d5e-a79d-8ac04f06d3e7 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 (non-flash)
Aug 01 14:13:08 user nova-compute[72129]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b58b04-6855-4ece-b021-cba7a3a62f4b (non-flash)
Aug 01 14:13:08 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:13:08 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e0997f-a273-4d5e-a79d-8ac04f06d3e7 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 (non-flash)
Aug 01 14:13:08 user nova-compute[72129]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9b58b04-6855-4ece-b021-cba7a3a62f4b (non-flash)
Aug 01 14:13:08 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:13:08 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e0997f-a273-4d5e-a79d-8ac04f06d3e7 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f281059a440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9b58b04-6855-4ece-b021-cba7a3a62f4b'): ({'sdb'}, set())}) {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 14:13:08 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-37e0997f-a273-4d5e-a79d-8ac04f06d3e7 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Removing single pathed devices sdb {{(pid=72129) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 14:13:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:13:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:13:08 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c38e79c0-f729-4d38-a52f-f8aa5b0c0332]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:13:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:13:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:13:08 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[96842297-d3ee-4d40-b881-356cb5a06f40]: (4, ('ok\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:13:08 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-37e0997f-a273-4d5e-a79d-8ac04f06d3e7 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Flushing IO for device /dev/sdb {{(pid=72129) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 14:13:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:13:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:13:08 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[0921de14-e4bb-404e-a28f-008a03b310f8]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:13:08 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-37e0997f-a273-4d5e-a79d-8ac04f06d3e7 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72129) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 14:13:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:13:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:13:08 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1867cb-f5d6-40fe-9acb-3fa7da8ddf64]: (4, ('1', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:13:08 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-37e0997f-a273-4d5e-a79d-8ac04f06d3e7 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 14:13:08 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-37e0997f-a273-4d5e-a79d-8ac04f06d3e7 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] SCSI volumes sdb have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 14:13:08 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e0997f-a273-4d5e-a79d-8ac04f06d3e7 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9b58b04-6855-4ece-b021-cba7a3a62f4b')] {{(pid=72129) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 14:13:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9b58b04-6855-4ece-b021-cba7a3a62f4b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:13:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9b58b04-6855-4ece-b021-cba7a3a62f4b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:13:08 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee313bf-ed8f-4039-9729-a6db5d58809d]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:13:08 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e0997f-a273-4d5e-a79d-8ac04f06d3e7 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:13:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9b58b04-6855-4ece-b021-cba7a3a62f4b -p 172.16.0.220:3260 --logout {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:13:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9b58b04-6855-4ece-b021-cba7a3a62f4b -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:13:08 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[189ca277-739f-42ad-82f1-24f4af9a28c1]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:f9b58b04-6855-4ece-b021-cba7a3a62f4b, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:f9b58b04-6855-4ece-b021-cba7a3a62f4b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:13:08 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e0997f-a273-4d5e-a79d-8ac04f06d3e7 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:f9b58b04-6855-4ece-b021-cba7a3a62f4b, portal: 172.16.0.220,3260]
Aug 01 14:13:08 user nova-compute[72129]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:f9b58b04-6855-4ece-b021-cba7a3a62f4b, portal: 172.16.0.220,3260] successful.
Aug 01 14:13:08 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:13:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9b58b04-6855-4ece-b021-cba7a3a62f4b -p 172.16.0.220:3260 --op delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:13:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9b58b04-6855-4ece-b021-cba7a3a62f4b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:13:08 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[9125dc40-3a54-49ea-9cab-677c31653bc4]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:13:08 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e0997f-a273-4d5e-a79d-8ac04f06d3e7 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:13:08 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-37e0997f-a273-4d5e-a79d-8ac04f06d3e7 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.273s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:13:08 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e0997f-a273-4d5e-a79d-8ac04f06d3e7 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] <== disconnect_volume: return (274ms) None {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:13:08 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37e0997f-a273-4d5e-a79d-8ac04f06d3e7 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Disconnected iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 14:13:08 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-37e0997f-a273-4d5e-a79d-8ac04f06d3e7 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Deleting instance files /opt/stack/data/nova/instances/fc0c1916-fd16-4379-9739-bcb03643b42e_del
Aug 01 14:13:08 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-37e0997f-a273-4d5e-a79d-8ac04f06d3e7 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Deletion of /opt/stack/data/nova/instances/fc0c1916-fd16-4379-9739-bcb03643b42e_del complete
Aug 01 14:13:08 user nova-compute[72129]: INFO nova.compute.manager [None req-37e0997f-a273-4d5e-a79d-8ac04f06d3e7 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Took 1.21 seconds to destroy the instance on the hypervisor.
Aug 01 14:13:08 user nova-compute[72129]: DEBUG oslo.service.loopingcall [None req-37e0997f-a273-4d5e-a79d-8ac04f06d3e7 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72129) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 14:13:08 user nova-compute[72129]: DEBUG nova.compute.manager [-] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Deallocating network for instance {{(pid=72129) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 14:13:08 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] deallocate_for_instance() {{(pid=72129) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 14:13:09 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:13:09 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Took 0.41 seconds to deallocate network for instance.
Aug 01 14:13:09 user nova-compute[72129]: DEBUG nova.compute.manager [req-feac3271-95e1-484e-b431-09b6094587c9 req-e825e6ca-bb8e-41db-99a3-e0d45ee3f1e9 service nova] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Received event network-vif-deleted-06b5806a-5009-4492-ab48-159cae6c002e {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:13:09 user nova-compute[72129]: INFO nova.compute.manager [req-feac3271-95e1-484e-b431-09b6094587c9 req-e825e6ca-bb8e-41db-99a3-e0d45ee3f1e9 service nova] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Neutron deleted interface 06b5806a-5009-4492-ab48-159cae6c002e; detaching it from the instance and deleting it from the info cache
Aug 01 14:13:09 user nova-compute[72129]: DEBUG nova.network.neutron [req-feac3271-95e1-484e-b431-09b6094587c9 req-e825e6ca-bb8e-41db-99a3-e0d45ee3f1e9 service nova] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:13:09 user nova-compute[72129]: DEBUG nova.compute.manager [req-feac3271-95e1-484e-b431-09b6094587c9 req-e825e6ca-bb8e-41db-99a3-e0d45ee3f1e9 service nova] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Detach interface failed, port_id=06b5806a-5009-4492-ab48-159cae6c002e, reason: Instance fc0c1916-fd16-4379-9739-bcb03643b42e could not be found. {{(pid=72129) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 14:13:10 user nova-compute[72129]: DEBUG nova.compute.manager [req-3e01e766-5877-44a2-8ea9-5f3e95ef2fa8 req-ff826030-dc56-4e11-9d3f-3964164d260d service nova] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Received event network-vif-plugged-06b5806a-5009-4492-ab48-159cae6c002e {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:13:10 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-3e01e766-5877-44a2-8ea9-5f3e95ef2fa8 req-ff826030-dc56-4e11-9d3f-3964164d260d service nova] Acquiring lock "fc0c1916-fd16-4379-9739-bcb03643b42e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:13:10 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-3e01e766-5877-44a2-8ea9-5f3e95ef2fa8 req-ff826030-dc56-4e11-9d3f-3964164d260d service nova] Lock "fc0c1916-fd16-4379-9739-bcb03643b42e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:13:10 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-3e01e766-5877-44a2-8ea9-5f3e95ef2fa8 req-ff826030-dc56-4e11-9d3f-3964164d260d service nova] Lock "fc0c1916-fd16-4379-9739-bcb03643b42e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:13:10 user nova-compute[72129]: DEBUG nova.compute.manager [req-3e01e766-5877-44a2-8ea9-5f3e95ef2fa8 req-ff826030-dc56-4e11-9d3f-3964164d260d service nova] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] No waiting events found dispatching network-vif-plugged-06b5806a-5009-4492-ab48-159cae6c002e {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:13:10 user nova-compute[72129]: WARNING nova.compute.manager [req-3e01e766-5877-44a2-8ea9-5f3e95ef2fa8 req-ff826030-dc56-4e11-9d3f-3964164d260d service nova] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Received unexpected event network-vif-plugged-06b5806a-5009-4492-ab48-159cae6c002e for instance with vm_state active and task_state deleting.
Aug 01 14:13:10 user nova-compute[72129]: INFO nova.compute.manager [None req-37e0997f-a273-4d5e-a79d-8ac04f06d3e7 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Took 0.72 seconds to detach 1 volumes for instance.
Aug 01 14:13:10 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-37e0997f-a273-4d5e-a79d-8ac04f06d3e7 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:13:10 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-37e0997f-a273-4d5e-a79d-8ac04f06d3e7 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:13:10 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-37e0997f-a273-4d5e-a79d-8ac04f06d3e7 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:13:10 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-37e0997f-a273-4d5e-a79d-8ac04f06d3e7 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:13:10 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-37e0997f-a273-4d5e-a79d-8ac04f06d3e7 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.191s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:13:10 user nova-compute[72129]: INFO nova.scheduler.client.report [None req-37e0997f-a273-4d5e-a79d-8ac04f06d3e7 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Deleted allocations for instance fc0c1916-fd16-4379-9739-bcb03643b42e
Aug 01 14:13:10 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-37e0997f-a273-4d5e-a79d-8ac04f06d3e7 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "fc0c1916-fd16-4379-9739-bcb03643b42e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.699s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:13:10 user nova-compute[72129]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690899175.4096026, 1e06fb45-d156-451b-9e4d-e3d2fed52c37 => Stopped> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:13:10 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] VM Stopped (Lifecycle Event)
Aug 01 14:13:10 user nova-compute[72129]: DEBUG nova.compute.manager [None req-a428739f-dbee-49bf-bf85-d2085e305394 None None] [instance: 1e06fb45-d156-451b-9e4d-e3d2fed52c37] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:13:11 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:13:13 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:13:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:13:23 user nova-compute[72129]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690899188.5044823, fc0c1916-fd16-4379-9739-bcb03643b42e => Stopped> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:13:23 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] VM Stopped (Lifecycle Event)
Aug 01 14:13:23 user nova-compute[72129]: DEBUG nova.compute.manager [None req-f973a5b1-fdd4-44b0-b1f2-5bf72f9796f9 None None] [instance: fc0c1916-fd16-4379-9739-bcb03643b42e] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:13:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:13:28 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:13:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Acquiring lock "0714c157-056f-4f64-94f4-da5c8e5f6eda" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:13:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Lock "0714c157-056f-4f64-94f4-da5c8e5f6eda" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:13:28 user nova-compute[72129]: DEBUG nova.compute.manager [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] Starting instance... {{(pid=72129) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 14:13:29 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:13:29 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:13:29 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72129) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 14:13:29 user nova-compute[72129]: INFO nova.compute.claims [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] Claim successful on node user
Aug 01 14:13:29 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:13:29 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:13:29 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.272s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:13:29 user nova-compute[72129]: DEBUG nova.compute.manager [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] Start building networks asynchronously for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 14:13:29 user nova-compute[72129]: DEBUG nova.compute.manager [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] Allocating IP information in the background. {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 14:13:29 user nova-compute[72129]: DEBUG nova.network.neutron [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] allocate_for_instance() {{(pid=72129) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 14:13:29 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 14:13:29 user nova-compute[72129]: DEBUG nova.compute.manager [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] Start building block device mappings for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 14:13:29 user nova-compute[72129]: DEBUG nova.policy [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aef0a4c176f4428d941f9d922b17ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e0854d064104497b8b0413ff9ff74a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72129) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 14:13:29 user nova-compute[72129]: DEBUG nova.compute.manager [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] Start spawning the instance on the hypervisor. {{(pid=72129) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 14:13:29 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] Creating instance directory {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 14:13:29 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] Creating image(s)
Aug 01 14:13:29 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Acquiring lock "/opt/stack/data/nova/instances/0714c157-056f-4f64-94f4-da5c8e5f6eda/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:13:29 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Lock "/opt/stack/data/nova/instances/0714c157-056f-4f64-94f4-da5c8e5f6eda/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:13:29 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Lock "/opt/stack/data/nova/instances/0714c157-056f-4f64-94f4-da5c8e5f6eda/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:13:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:13:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.165s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:13:29 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Acquiring lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:13:29 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:13:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:13:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.134s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:13:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/0714c157-056f-4f64-94f4-da5c8e5f6eda/disk 1073741824 {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:13:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/0714c157-056f-4f64-94f4-da5c8e5f6eda/disk 1073741824" returned: 0 in 0.053s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:13:29 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:13:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:13:30 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.153s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:13:30 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0714c157-056f-4f64-94f4-da5c8e5f6eda/disk. size=1073741824 {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 14:13:30 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0714c157-056f-4f64-94f4-da5c8e5f6eda/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:13:30 user nova-compute[72129]: DEBUG nova.network.neutron [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] Successfully created port: b1ecfcb5-5009-4b95-97ca-9949a6e42ddc {{(pid=72129) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 14:13:30 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0714c157-056f-4f64-94f4-da5c8e5f6eda/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:13:30 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Cannot resize image /opt/stack/data/nova/instances/0714c157-056f-4f64-94f4-da5c8e5f6eda/disk to a smaller size. {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 14:13:30 user nova-compute[72129]: DEBUG nova.objects.instance [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Lazy-loading 'migration_context' on Instance uuid 0714c157-056f-4f64-94f4-da5c8e5f6eda {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:13:30 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] Created local disks {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 14:13:30 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] Ensure instance console log exists: /opt/stack/data/nova/instances/0714c157-056f-4f64-94f4-da5c8e5f6eda/console.log {{(pid=72129) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 14:13:30 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:13:30 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:13:30 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:13:30 user nova-compute[72129]: DEBUG nova.network.neutron [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] Successfully updated port: b1ecfcb5-5009-4b95-97ca-9949a6e42ddc {{(pid=72129) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 14:13:30 user nova-compute[72129]: DEBUG nova.compute.manager [req-f4109235-711b-4576-a491-da54b0bdd036 req-77463db2-4bc6-42eb-bac5-f6ae2ce1f9be service nova] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] Received event network-changed-b1ecfcb5-5009-4b95-97ca-9949a6e42ddc {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:13:30 user nova-compute[72129]: DEBUG nova.compute.manager [req-f4109235-711b-4576-a491-da54b0bdd036 req-77463db2-4bc6-42eb-bac5-f6ae2ce1f9be service nova] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] Refreshing instance network info cache due to event network-changed-b1ecfcb5-5009-4b95-97ca-9949a6e42ddc. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 14:13:30 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f4109235-711b-4576-a491-da54b0bdd036 req-77463db2-4bc6-42eb-bac5-f6ae2ce1f9be service nova] Acquiring lock "refresh_cache-0714c157-056f-4f64-94f4-da5c8e5f6eda" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:13:30 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f4109235-711b-4576-a491-da54b0bdd036 req-77463db2-4bc6-42eb-bac5-f6ae2ce1f9be service nova] Acquired lock "refresh_cache-0714c157-056f-4f64-94f4-da5c8e5f6eda" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:13:30 user nova-compute[72129]: DEBUG nova.network.neutron [req-f4109235-711b-4576-a491-da54b0bdd036 req-77463db2-4bc6-42eb-bac5-f6ae2ce1f9be service nova] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] Refreshing network info cache for port b1ecfcb5-5009-4b95-97ca-9949a6e42ddc {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 14:13:30 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Acquiring lock "refresh_cache-0714c157-056f-4f64-94f4-da5c8e5f6eda" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:13:31 user nova-compute[72129]: DEBUG nova.network.neutron [req-f4109235-711b-4576-a491-da54b0bdd036 req-77463db2-4bc6-42eb-bac5-f6ae2ce1f9be service nova] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] Instance cache missing network info. {{(pid=72129) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 14:13:31 user nova-compute[72129]: DEBUG nova.network.neutron [req-f4109235-711b-4576-a491-da54b0bdd036 req-77463db2-4bc6-42eb-bac5-f6ae2ce1f9be service nova] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:13:31 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f4109235-711b-4576-a491-da54b0bdd036 req-77463db2-4bc6-42eb-bac5-f6ae2ce1f9be service nova] Releasing lock "refresh_cache-0714c157-056f-4f64-94f4-da5c8e5f6eda" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:13:31 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Acquired lock "refresh_cache-0714c157-056f-4f64-94f4-da5c8e5f6eda" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:13:31 user nova-compute[72129]: DEBUG nova.network.neutron [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 14:13:31 user nova-compute[72129]: DEBUG nova.network.neutron [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] Instance cache missing network info. {{(pid=72129) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 14:13:31 user nova-compute[72129]: DEBUG nova.network.neutron [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] Updating instance_info_cache with network_info: [{"id": "b1ecfcb5-5009-4b95-97ca-9949a6e42ddc", "address": "fa:16:3e:af:c6:c9", "network": {"id": "1fc5fd20-6ca3-45f2-93ee-ac80e3311897", "bridge": "br-int", "label": "tempest-VolumesActionsTest-878643555-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e0854d064104497b8b0413ff9ff74a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1ecfcb5-50", "ovs_interfaceid": "b1ecfcb5-5009-4b95-97ca-9949a6e42ddc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:13:31 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Releasing lock "refresh_cache-0714c157-056f-4f64-94f4-da5c8e5f6eda" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:13:31 user nova-compute[72129]: DEBUG nova.compute.manager [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] Instance network_info: |[{"id": "b1ecfcb5-5009-4b95-97ca-9949a6e42ddc", "address": "fa:16:3e:af:c6:c9", "network": {"id": "1fc5fd20-6ca3-45f2-93ee-ac80e3311897", "bridge": "br-int", "label": "tempest-VolumesActionsTest-878643555-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e0854d064104497b8b0413ff9ff74a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1ecfcb5-50", "ovs_interfaceid": "b1ecfcb5-5009-4b95-97ca-9949a6e42ddc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 14:13:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] Start _get_guest_xml network_info=[{"id": "b1ecfcb5-5009-4b95-97ca-9949a6e42ddc", "address": "fa:16:3e:af:c6:c9", "network": {"id": "1fc5fd20-6ca3-45f2-93ee-ac80e3311897", "bridge": "br-int", "label": "tempest-VolumesActionsTest-878643555-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e0854d064104497b8b0413ff9ff74a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1ecfcb5-50", "ovs_interfaceid": "b1ecfcb5-5009-4b95-97ca-9949a6e42ddc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'image_id': 'b6472c34-1b0f-4034-ba3a-7e8eb5103715'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 14:13:31 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:13:31 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:13:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 14:13:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] CPU controller missing on host. {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 14:13:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 14:13:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] CPU controller found on host. {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 14:13:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72129) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 14:13:31 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T13:45:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 14:13:31 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Flavor limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 14:13:31 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Image limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 14:13:31 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Flavor pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 14:13:31 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Image pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 14:13:31 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 14:13:31 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 14:13:31 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 14:13:31 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Got 1 possible topologies {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 14:13:31 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 14:13:31 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 14:13:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:13:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-979378732',display_name='tempest-VolumesActionsTest-instance-979378732',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-979378732',id=39,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e0854d064104497b8b0413ff9ff74a9',ramdisk_id='',reservation_id='r-lfdzvf5i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2013737032',owner_user_name='tempest-VolumesActionsTest-2013737032-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T14:13:29Z,user_data=None,user_id='aef0a4c176f4428d941f9d922b17ea93',uuid=0714c157-056f-4f64-94f4-da5c8e5f6eda,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1ecfcb5-5009-4b95-97ca-9949a6e42ddc", "address": "fa:16:3e:af:c6:c9", "network": {"id": "1fc5fd20-6ca3-45f2-93ee-ac80e3311897", "bridge": "br-int", "label": "tempest-VolumesActionsTest-878643555-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e0854d064104497b8b0413ff9ff74a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1ecfcb5-50", "ovs_interfaceid": "b1ecfcb5-5009-4b95-97ca-9949a6e42ddc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 14:13:31 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Converting VIF {"id": "b1ecfcb5-5009-4b95-97ca-9949a6e42ddc", "address": "fa:16:3e:af:c6:c9", "network": {"id": "1fc5fd20-6ca3-45f2-93ee-ac80e3311897", "bridge": "br-int", "label": "tempest-VolumesActionsTest-878643555-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e0854d064104497b8b0413ff9ff74a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1ecfcb5-50", "ovs_interfaceid": "b1ecfcb5-5009-4b95-97ca-9949a6e42ddc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:13:31 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:c6:c9,bridge_name='br-int',has_traffic_filtering=True,id=b1ecfcb5-5009-4b95-97ca-9949a6e42ddc,network=Network(1fc5fd20-6ca3-45f2-93ee-ac80e3311897),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1ecfcb5-50') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:13:31 user nova-compute[72129]: DEBUG nova.objects.instance [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Lazy-loading 'pci_devices' on Instance uuid 0714c157-056f-4f64-94f4-da5c8e5f6eda {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:13:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] End _get_guest_xml xml=<domain type="kvm">
Aug 01 14:13:31 user nova-compute[72129]:   <uuid>0714c157-056f-4f64-94f4-da5c8e5f6eda</uuid>
Aug 01 14:13:31 user nova-compute[72129]:   <name>instance-00000027</name>
Aug 01 14:13:31 user nova-compute[72129]:   <memory>524288</memory>
Aug 01 14:13:31 user nova-compute[72129]:   <vcpu>1</vcpu>
Aug 01 14:13:31 user nova-compute[72129]:   <metadata>
Aug 01 14:13:31 user nova-compute[72129]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 14:13:31 user nova-compute[72129]:       <nova:package version="0.0.0"/>
Aug 01 14:13:31 user nova-compute[72129]:       <nova:name>tempest-VolumesActionsTest-instance-979378732</nova:name>
Aug 01 14:13:31 user nova-compute[72129]:       <nova:creationTime>2023-08-01 14:13:31</nova:creationTime>
Aug 01 14:13:31 user nova-compute[72129]:       <nova:flavor name="m1.tiny">
Aug 01 14:13:31 user nova-compute[72129]:         <nova:memory>512</nova:memory>
Aug 01 14:13:31 user nova-compute[72129]:         <nova:disk>1</nova:disk>
Aug 01 14:13:31 user nova-compute[72129]:         <nova:swap>0</nova:swap>
Aug 01 14:13:31 user nova-compute[72129]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 14:13:31 user nova-compute[72129]:         <nova:vcpus>1</nova:vcpus>
Aug 01 14:13:31 user nova-compute[72129]:       </nova:flavor>
Aug 01 14:13:31 user nova-compute[72129]:       <nova:owner>
Aug 01 14:13:31 user nova-compute[72129]:         <nova:user uuid="aef0a4c176f4428d941f9d922b17ea93">tempest-VolumesActionsTest-2013737032-project-member</nova:user>
Aug 01 14:13:31 user nova-compute[72129]:         <nova:project uuid="2e0854d064104497b8b0413ff9ff74a9">tempest-VolumesActionsTest-2013737032</nova:project>
Aug 01 14:13:31 user nova-compute[72129]:       </nova:owner>
Aug 01 14:13:31 user nova-compute[72129]:       <nova:root type="image" uuid="b6472c34-1b0f-4034-ba3a-7e8eb5103715"/>
Aug 01 14:13:31 user nova-compute[72129]:       <nova:ports>
Aug 01 14:13:31 user nova-compute[72129]:         <nova:port uuid="b1ecfcb5-5009-4b95-97ca-9949a6e42ddc">
Aug 01 14:13:31 user nova-compute[72129]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 01 14:13:31 user nova-compute[72129]:         </nova:port>
Aug 01 14:13:31 user nova-compute[72129]:       </nova:ports>
Aug 01 14:13:31 user nova-compute[72129]:     </nova:instance>
Aug 01 14:13:31 user nova-compute[72129]:   </metadata>
Aug 01 14:13:31 user nova-compute[72129]:   <sysinfo type="smbios">
Aug 01 14:13:31 user nova-compute[72129]:     <system>
Aug 01 14:13:31 user nova-compute[72129]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 14:13:31 user nova-compute[72129]:       <entry name="product">OpenStack Nova</entry>
Aug 01 14:13:31 user nova-compute[72129]:       <entry name="version">0.0.0</entry>
Aug 01 14:13:31 user nova-compute[72129]:       <entry name="serial">0714c157-056f-4f64-94f4-da5c8e5f6eda</entry>
Aug 01 14:13:31 user nova-compute[72129]:       <entry name="uuid">0714c157-056f-4f64-94f4-da5c8e5f6eda</entry>
Aug 01 14:13:31 user nova-compute[72129]:       <entry name="family">Virtual Machine</entry>
Aug 01 14:13:31 user nova-compute[72129]:     </system>
Aug 01 14:13:31 user nova-compute[72129]:   </sysinfo>
Aug 01 14:13:31 user nova-compute[72129]:   <os>
Aug 01 14:13:31 user nova-compute[72129]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 14:13:31 user nova-compute[72129]:     <boot dev="hd"/>
Aug 01 14:13:31 user nova-compute[72129]:     <smbios mode="sysinfo"/>
Aug 01 14:13:31 user nova-compute[72129]:   </os>
Aug 01 14:13:31 user nova-compute[72129]:   <features>
Aug 01 14:13:31 user nova-compute[72129]:     <acpi/>
Aug 01 14:13:31 user nova-compute[72129]:     <apic/>
Aug 01 14:13:31 user nova-compute[72129]:     <vmcoreinfo/>
Aug 01 14:13:31 user nova-compute[72129]:   </features>
Aug 01 14:13:31 user nova-compute[72129]:   <clock offset="utc">
Aug 01 14:13:31 user nova-compute[72129]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 14:13:31 user nova-compute[72129]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 14:13:31 user nova-compute[72129]:     <timer name="hpet" present="no"/>
Aug 01 14:13:31 user nova-compute[72129]:   </clock>
Aug 01 14:13:31 user nova-compute[72129]:   <cpu mode="custom" match="exact">
Aug 01 14:13:31 user nova-compute[72129]:     <model>Nehalem</model>
Aug 01 14:13:31 user nova-compute[72129]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 14:13:31 user nova-compute[72129]:   </cpu>
Aug 01 14:13:31 user nova-compute[72129]:   <devices>
Aug 01 14:13:31 user nova-compute[72129]:     <disk type="file" device="disk">
Aug 01 14:13:31 user nova-compute[72129]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 14:13:31 user nova-compute[72129]:       <source file="/opt/stack/data/nova/instances/0714c157-056f-4f64-94f4-da5c8e5f6eda/disk"/>
Aug 01 14:13:31 user nova-compute[72129]:       <target dev="vda" bus="virtio"/>
Aug 01 14:13:31 user nova-compute[72129]:     </disk>
Aug 01 14:13:31 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 14:13:31 user nova-compute[72129]:       <mac address="fa:16:3e:af:c6:c9"/>
Aug 01 14:13:31 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:13:31 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 14:13:31 user nova-compute[72129]:       <target dev="tapb1ecfcb5-50"/>
Aug 01 14:13:31 user nova-compute[72129]:     </interface>
Aug 01 14:13:31 user nova-compute[72129]:     <serial type="pty">
Aug 01 14:13:31 user nova-compute[72129]:       <log file="/opt/stack/data/nova/instances/0714c157-056f-4f64-94f4-da5c8e5f6eda/console.log" append="off"/>
Aug 01 14:13:31 user nova-compute[72129]:     </serial>
Aug 01 14:13:31 user nova-compute[72129]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 14:13:31 user nova-compute[72129]:     <video>
Aug 01 14:13:31 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:13:31 user nova-compute[72129]:     </video>
Aug 01 14:13:31 user nova-compute[72129]:     <rng model="virtio">
Aug 01 14:13:31 user nova-compute[72129]:       <backend model="random">/dev/urandom</backend>
Aug 01 14:13:31 user nova-compute[72129]:     </rng>
Aug 01 14:13:31 user nova-compute[72129]:     <controller type="usb" index="0" model="none"/>
Aug 01 14:13:31 user nova-compute[72129]:     <memballoon model="virtio">
Aug 01 14:13:31 user nova-compute[72129]:       <stats period="10"/>
Aug 01 14:13:31 user nova-compute[72129]:     </memballoon>
Aug 01 14:13:31 user nova-compute[72129]:   </devices>
Aug 01 14:13:31 user nova-compute[72129]: </domain>
Aug 01 14:13:31 user nova-compute[72129]:  {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 14:13:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:13:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-979378732',display_name='tempest-VolumesActionsTest-instance-979378732',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-979378732',id=39,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e0854d064104497b8b0413ff9ff74a9',ramdisk_id='',reservation_id='r-lfdzvf5i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2013737032',owner_user_name='tempest-VolumesActionsTest-2013737032-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T14:13:29Z,user_data=None,user_id='aef0a4c176f4428d941f9d922b17ea93',uuid=0714c157-056f-4f64-94f4-da5c8e5f6eda,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1ecfcb5-5009-4b95-97ca-9949a6e42ddc", "address": "fa:16:3e:af:c6:c9", "network": {"id": "1fc5fd20-6ca3-45f2-93ee-ac80e3311897", "bridge": "br-int", "label": "tempest-VolumesActionsTest-878643555-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e0854d064104497b8b0413ff9ff74a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1ecfcb5-50", "ovs_interfaceid": "b1ecfcb5-5009-4b95-97ca-9949a6e42ddc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 14:13:31 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Converting VIF {"id": "b1ecfcb5-5009-4b95-97ca-9949a6e42ddc", "address": "fa:16:3e:af:c6:c9", "network": {"id": "1fc5fd20-6ca3-45f2-93ee-ac80e3311897", "bridge": "br-int", "label": "tempest-VolumesActionsTest-878643555-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e0854d064104497b8b0413ff9ff74a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1ecfcb5-50", "ovs_interfaceid": "b1ecfcb5-5009-4b95-97ca-9949a6e42ddc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:13:31 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:c6:c9,bridge_name='br-int',has_traffic_filtering=True,id=b1ecfcb5-5009-4b95-97ca-9949a6e42ddc,network=Network(1fc5fd20-6ca3-45f2-93ee-ac80e3311897),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1ecfcb5-50') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:13:31 user nova-compute[72129]: DEBUG os_vif [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:c6:c9,bridge_name='br-int',has_traffic_filtering=True,id=b1ecfcb5-5009-4b95-97ca-9949a6e42ddc,network=Network(1fc5fd20-6ca3-45f2-93ee-ac80e3311897),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1ecfcb5-50') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 14:13:31 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:13:31 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:13:31 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 14:13:31 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:13:31 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb1ecfcb5-50, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:13:31 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb1ecfcb5-50, col_values=(('external_ids', {'iface-id': 'b1ecfcb5-5009-4b95-97ca-9949a6e42ddc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:c6:c9', 'vm-uuid': '0714c157-056f-4f64-94f4-da5c8e5f6eda'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:13:31 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:13:31 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:13:31 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:13:31 user nova-compute[72129]: INFO os_vif [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:c6:c9,bridge_name='br-int',has_traffic_filtering=True,id=b1ecfcb5-5009-4b95-97ca-9949a6e42ddc,network=Network(1fc5fd20-6ca3-45f2-93ee-ac80e3311897),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1ecfcb5-50')
Aug 01 14:13:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:13:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] No VIF found with MAC fa:16:3e:af:c6:c9, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 14:13:32 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:13:32 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:13:32 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:13:33 user nova-compute[72129]: DEBUG nova.compute.manager [req-d254e29a-a6ec-472d-9e9d-2e132be4efb5 req-e4342408-fbdb-41ef-89bb-d0e2429850c6 service nova] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] Received event network-vif-plugged-b1ecfcb5-5009-4b95-97ca-9949a6e42ddc {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:13:33 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-d254e29a-a6ec-472d-9e9d-2e132be4efb5 req-e4342408-fbdb-41ef-89bb-d0e2429850c6 service nova] Acquiring lock "0714c157-056f-4f64-94f4-da5c8e5f6eda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:13:33 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-d254e29a-a6ec-472d-9e9d-2e132be4efb5 req-e4342408-fbdb-41ef-89bb-d0e2429850c6 service nova] Lock "0714c157-056f-4f64-94f4-da5c8e5f6eda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:13:33 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-d254e29a-a6ec-472d-9e9d-2e132be4efb5 req-e4342408-fbdb-41ef-89bb-d0e2429850c6 service nova] Lock "0714c157-056f-4f64-94f4-da5c8e5f6eda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:13:33 user nova-compute[72129]: DEBUG nova.compute.manager [req-d254e29a-a6ec-472d-9e9d-2e132be4efb5 req-e4342408-fbdb-41ef-89bb-d0e2429850c6 service nova] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] No waiting events found dispatching network-vif-plugged-b1ecfcb5-5009-4b95-97ca-9949a6e42ddc {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:13:33 user nova-compute[72129]: WARNING nova.compute.manager [req-d254e29a-a6ec-472d-9e9d-2e132be4efb5 req-e4342408-fbdb-41ef-89bb-d0e2429850c6 service nova] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] Received unexpected event network-vif-plugged-b1ecfcb5-5009-4b95-97ca-9949a6e42ddc for instance with vm_state building and task_state spawning.
Aug 01 14:13:33 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:13:33 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:13:33 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:13:35 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690899215.021209, 0714c157-056f-4f64-94f4-da5c8e5f6eda => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:13:35 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] VM Resumed (Lifecycle Event)
Aug 01 14:13:35 user nova-compute[72129]: DEBUG nova.compute.manager [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] Instance event wait completed in 0 seconds for  {{(pid=72129) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 14:13:35 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] Guest created on hypervisor {{(pid=72129) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 14:13:35 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] Instance spawned successfully.
Aug 01 14:13:35 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 14:13:35 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:13:35 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:13:35 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] Found default for hw_cdrom_bus of ide {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:13:35 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] Found default for hw_disk_bus of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:13:35 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] Found default for hw_input_bus of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:13:35 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] Found default for hw_pointer_model of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:13:35 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] Found default for hw_video_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:13:35 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] Found default for hw_vif_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:13:35 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 14:13:35 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690899215.0254228, 0714c157-056f-4f64-94f4-da5c8e5f6eda => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:13:35 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] VM Started (Lifecycle Event)
Aug 01 14:13:35 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:13:35 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:13:35 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 14:13:35 user nova-compute[72129]: INFO nova.compute.manager [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] Took 5.62 seconds to spawn the instance on the hypervisor.
Aug 01 14:13:35 user nova-compute[72129]: DEBUG nova.compute.manager [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:13:35 user nova-compute[72129]: DEBUG nova.compute.manager [req-e11973f1-b754-4903-bc2e-245f43c7a09d req-77781bdb-3c8c-4439-a723-f7e7b9799503 service nova] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] Received event network-vif-plugged-b1ecfcb5-5009-4b95-97ca-9949a6e42ddc {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:13:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-e11973f1-b754-4903-bc2e-245f43c7a09d req-77781bdb-3c8c-4439-a723-f7e7b9799503 service nova] Acquiring lock "0714c157-056f-4f64-94f4-da5c8e5f6eda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:13:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-e11973f1-b754-4903-bc2e-245f43c7a09d req-77781bdb-3c8c-4439-a723-f7e7b9799503 service nova] Lock "0714c157-056f-4f64-94f4-da5c8e5f6eda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:13:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-e11973f1-b754-4903-bc2e-245f43c7a09d req-77781bdb-3c8c-4439-a723-f7e7b9799503 service nova] Lock "0714c157-056f-4f64-94f4-da5c8e5f6eda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:13:35 user nova-compute[72129]: DEBUG nova.compute.manager [req-e11973f1-b754-4903-bc2e-245f43c7a09d req-77781bdb-3c8c-4439-a723-f7e7b9799503 service nova] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] No waiting events found dispatching network-vif-plugged-b1ecfcb5-5009-4b95-97ca-9949a6e42ddc {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:13:35 user nova-compute[72129]: WARNING nova.compute.manager [req-e11973f1-b754-4903-bc2e-245f43c7a09d req-77781bdb-3c8c-4439-a723-f7e7b9799503 service nova] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] Received unexpected event network-vif-plugged-b1ecfcb5-5009-4b95-97ca-9949a6e42ddc for instance with vm_state building and task_state spawning.
Aug 01 14:13:35 user nova-compute[72129]: INFO nova.compute.manager [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] Took 6.18 seconds to build instance.
Aug 01 14:13:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-ffba15b3-664e-4572-bbd6-720d3a028e77 tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Lock "0714c157-056f-4f64-94f4-da5c8e5f6eda" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.275s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:13:36 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:13:36 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:13:38 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-89feaccb-e05e-4f95-8723-3b7b20895f7b tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Acquiring lock "0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:13:38 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-89feaccb-e05e-4f95-8723-3b7b20895f7b tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:13:38 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-89feaccb-e05e-4f95-8723-3b7b20895f7b tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Acquiring lock "0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:13:38 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-89feaccb-e05e-4f95-8723-3b7b20895f7b tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:13:38 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-89feaccb-e05e-4f95-8723-3b7b20895f7b tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:13:38 user nova-compute[72129]: INFO nova.compute.manager [None req-89feaccb-e05e-4f95-8723-3b7b20895f7b tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Terminating instance
Aug 01 14:13:38 user nova-compute[72129]: DEBUG nova.compute.manager [None req-89feaccb-e05e-4f95-8723-3b7b20895f7b tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Start destroying the instance on the hypervisor. {{(pid=72129) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 14:13:38 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:13:38 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:13:38 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:13:38 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:13:38 user nova-compute[72129]: DEBUG nova.compute.manager [req-8f328bc2-d34a-4f88-8201-bfac8ea560dc req-4d09777f-c3ad-46dd-8e7b-7576f1f78aed service nova] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Received event network-vif-unplugged-d4f68f78-6df9-41b7-8d32-27f55f224683 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:13:38 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-8f328bc2-d34a-4f88-8201-bfac8ea560dc req-4d09777f-c3ad-46dd-8e7b-7576f1f78aed service nova] Acquiring lock "0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:13:38 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-8f328bc2-d34a-4f88-8201-bfac8ea560dc req-4d09777f-c3ad-46dd-8e7b-7576f1f78aed service nova] Lock "0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:13:38 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-8f328bc2-d34a-4f88-8201-bfac8ea560dc req-4d09777f-c3ad-46dd-8e7b-7576f1f78aed service nova] Lock "0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:13:38 user nova-compute[72129]: DEBUG nova.compute.manager [req-8f328bc2-d34a-4f88-8201-bfac8ea560dc req-4d09777f-c3ad-46dd-8e7b-7576f1f78aed service nova] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] No waiting events found dispatching network-vif-unplugged-d4f68f78-6df9-41b7-8d32-27f55f224683 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:13:38 user nova-compute[72129]: DEBUG nova.compute.manager [req-8f328bc2-d34a-4f88-8201-bfac8ea560dc req-4d09777f-c3ad-46dd-8e7b-7576f1f78aed service nova] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Received event network-vif-unplugged-d4f68f78-6df9-41b7-8d32-27f55f224683 for instance with task_state deleting. {{(pid=72129) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 14:13:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:13:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:13:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:13:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:13:39 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Instance destroyed successfully.
Aug 01 14:13:39 user nova-compute[72129]: DEBUG nova.objects.instance [None req-89feaccb-e05e-4f95-8723-3b7b20895f7b tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lazy-loading 'resources' on Instance uuid 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:13:39 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-89feaccb-e05e-4f95-8723-3b7b20895f7b tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T13:53:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1536283622',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1536283622',id=16,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T13:54:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1e0929886fa54d1c8023793806f10d31',ramdisk_id='',reservation_id='r-qtibntd8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1414609013',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T13:55:57Z,user_data=None,user_id='cdb6f66592fe4cdebea02e5f5c1f4a60',uuid=0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d4f68f78-6df9-41b7-8d32-27f55f224683", "address": "fa:16:3e:23:49:b3", "network": {"id": "59b1e538-8bfe-45ce-ab7b-c5838ab25582", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1129024349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0929886fa54d1c8023793806f10d31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f68f78-6d", "ovs_interfaceid": "d4f68f78-6df9-41b7-8d32-27f55f224683", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 14:13:39 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-89feaccb-e05e-4f95-8723-3b7b20895f7b tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Converting VIF {"id": "d4f68f78-6df9-41b7-8d32-27f55f224683", "address": "fa:16:3e:23:49:b3", "network": {"id": "59b1e538-8bfe-45ce-ab7b-c5838ab25582", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1129024349-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0929886fa54d1c8023793806f10d31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f68f78-6d", "ovs_interfaceid": "d4f68f78-6df9-41b7-8d32-27f55f224683", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:13:39 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-89feaccb-e05e-4f95-8723-3b7b20895f7b tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:49:b3,bridge_name='br-int',has_traffic_filtering=True,id=d4f68f78-6df9-41b7-8d32-27f55f224683,network=Network(59b1e538-8bfe-45ce-ab7b-c5838ab25582),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4f68f78-6d') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:13:39 user nova-compute[72129]: DEBUG os_vif [None req-89feaccb-e05e-4f95-8723-3b7b20895f7b tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:49:b3,bridge_name='br-int',has_traffic_filtering=True,id=d4f68f78-6df9-41b7-8d32-27f55f224683,network=Network(59b1e538-8bfe-45ce-ab7b-c5838ab25582),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4f68f78-6d') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 14:13:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:13:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd4f68f78-6d, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:13:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:13:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:13:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:13:39 user nova-compute[72129]: INFO os_vif [None req-89feaccb-e05e-4f95-8723-3b7b20895f7b tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:49:b3,bridge_name='br-int',has_traffic_filtering=True,id=d4f68f78-6df9-41b7-8d32-27f55f224683,network=Network(59b1e538-8bfe-45ce-ab7b-c5838ab25582),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4f68f78-6d')
Aug 01 14:13:39 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-89feaccb-e05e-4f95-8723-3b7b20895f7b tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Deleting instance files /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d_del
Aug 01 14:13:39 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-89feaccb-e05e-4f95-8723-3b7b20895f7b tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Deletion of /opt/stack/data/nova/instances/0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d_del complete
Aug 01 14:13:39 user nova-compute[72129]: INFO nova.compute.manager [None req-89feaccb-e05e-4f95-8723-3b7b20895f7b tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Took 0.99 seconds to destroy the instance on the hypervisor.
Aug 01 14:13:39 user nova-compute[72129]: DEBUG oslo.service.loopingcall [None req-89feaccb-e05e-4f95-8723-3b7b20895f7b tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72129) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 14:13:39 user nova-compute[72129]: DEBUG nova.compute.manager [-] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Deallocating network for instance {{(pid=72129) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 14:13:39 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] deallocate_for_instance() {{(pid=72129) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 14:13:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:13:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:13:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:13:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:13:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:13:40 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:13:40 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Took 0.58 seconds to deallocate network for instance.
Aug 01 14:13:40 user nova-compute[72129]: DEBUG nova.compute.manager [req-820bf51d-0e16-4ecd-8971-8e1c1a81ede1 req-5844acdd-8299-4fa1-97ed-f2145a762287 service nova] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Received event network-vif-deleted-d4f68f78-6df9-41b7-8d32-27f55f224683 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:13:40 user nova-compute[72129]: INFO nova.compute.manager [req-820bf51d-0e16-4ecd-8971-8e1c1a81ede1 req-5844acdd-8299-4fa1-97ed-f2145a762287 service nova] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Neutron deleted interface d4f68f78-6df9-41b7-8d32-27f55f224683; detaching it from the instance and deleting it from the info cache
Aug 01 14:13:40 user nova-compute[72129]: DEBUG nova.network.neutron [req-820bf51d-0e16-4ecd-8971-8e1c1a81ede1 req-5844acdd-8299-4fa1-97ed-f2145a762287 service nova] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:13:40 user nova-compute[72129]: DEBUG nova.compute.manager [req-820bf51d-0e16-4ecd-8971-8e1c1a81ede1 req-5844acdd-8299-4fa1-97ed-f2145a762287 service nova] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Detach interface failed, port_id=d4f68f78-6df9-41b7-8d32-27f55f224683, reason: Instance 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d could not be found. {{(pid=72129) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 14:13:40 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-89feaccb-e05e-4f95-8723-3b7b20895f7b tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:13:40 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-89feaccb-e05e-4f95-8723-3b7b20895f7b tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:13:40 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-89feaccb-e05e-4f95-8723-3b7b20895f7b tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:13:40 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-89feaccb-e05e-4f95-8723-3b7b20895f7b tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:13:40 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-89feaccb-e05e-4f95-8723-3b7b20895f7b tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.180s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:13:40 user nova-compute[72129]: INFO nova.scheduler.client.report [None req-89feaccb-e05e-4f95-8723-3b7b20895f7b tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Deleted allocations for instance 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d
Aug 01 14:13:40 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-89feaccb-e05e-4f95-8723-3b7b20895f7b tempest-ServerBootFromVolumeStableRescueTest-1414609013 tempest-ServerBootFromVolumeStableRescueTest-1414609013-project-member] Lock "0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.937s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:13:40 user nova-compute[72129]: DEBUG nova.compute.manager [req-4b0b0b69-c412-41b3-9f7c-875f5c6af8b5 req-7096a910-0d25-43af-b10a-0534f9716af7 service nova] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Received event network-vif-plugged-d4f68f78-6df9-41b7-8d32-27f55f224683 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:13:40 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-4b0b0b69-c412-41b3-9f7c-875f5c6af8b5 req-7096a910-0d25-43af-b10a-0534f9716af7 service nova] Acquiring lock "0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:13:40 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-4b0b0b69-c412-41b3-9f7c-875f5c6af8b5 req-7096a910-0d25-43af-b10a-0534f9716af7 service nova] Lock "0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:13:40 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-4b0b0b69-c412-41b3-9f7c-875f5c6af8b5 req-7096a910-0d25-43af-b10a-0534f9716af7 service nova] Lock "0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:13:40 user nova-compute[72129]: DEBUG nova.compute.manager [req-4b0b0b69-c412-41b3-9f7c-875f5c6af8b5 req-7096a910-0d25-43af-b10a-0534f9716af7 service nova] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] No waiting events found dispatching network-vif-plugged-d4f68f78-6df9-41b7-8d32-27f55f224683 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:13:40 user nova-compute[72129]: WARNING nova.compute.manager [req-4b0b0b69-c412-41b3-9f7c-875f5c6af8b5 req-7096a910-0d25-43af-b10a-0534f9716af7 service nova] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Received unexpected event network-vif-plugged-d4f68f78-6df9-41b7-8d32-27f55f224683 for instance with vm_state deleted and task_state None.
Aug 01 14:13:40 user nova-compute[72129]: DEBUG nova.compute.manager [req-4b0b0b69-c412-41b3-9f7c-875f5c6af8b5 req-7096a910-0d25-43af-b10a-0534f9716af7 service nova] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Received event network-vif-plugged-d4f68f78-6df9-41b7-8d32-27f55f224683 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:13:40 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-4b0b0b69-c412-41b3-9f7c-875f5c6af8b5 req-7096a910-0d25-43af-b10a-0534f9716af7 service nova] Acquiring lock "0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:13:40 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-4b0b0b69-c412-41b3-9f7c-875f5c6af8b5 req-7096a910-0d25-43af-b10a-0534f9716af7 service nova] Lock "0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:13:40 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-4b0b0b69-c412-41b3-9f7c-875f5c6af8b5 req-7096a910-0d25-43af-b10a-0534f9716af7 service nova] Lock "0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:13:40 user nova-compute[72129]: DEBUG nova.compute.manager [req-4b0b0b69-c412-41b3-9f7c-875f5c6af8b5 req-7096a910-0d25-43af-b10a-0534f9716af7 service nova] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] No waiting events found dispatching network-vif-plugged-d4f68f78-6df9-41b7-8d32-27f55f224683 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:13:40 user nova-compute[72129]: WARNING nova.compute.manager [req-4b0b0b69-c412-41b3-9f7c-875f5c6af8b5 req-7096a910-0d25-43af-b10a-0534f9716af7 service nova] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Received unexpected event network-vif-plugged-d4f68f78-6df9-41b7-8d32-27f55f224683 for instance with vm_state deleted and task_state None.
Aug 01 14:13:40 user nova-compute[72129]: DEBUG nova.compute.manager [req-4b0b0b69-c412-41b3-9f7c-875f5c6af8b5 req-7096a910-0d25-43af-b10a-0534f9716af7 service nova] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Received event network-vif-plugged-d4f68f78-6df9-41b7-8d32-27f55f224683 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:13:40 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-4b0b0b69-c412-41b3-9f7c-875f5c6af8b5 req-7096a910-0d25-43af-b10a-0534f9716af7 service nova] Acquiring lock "0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:13:40 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-4b0b0b69-c412-41b3-9f7c-875f5c6af8b5 req-7096a910-0d25-43af-b10a-0534f9716af7 service nova] Lock "0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:13:40 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-4b0b0b69-c412-41b3-9f7c-875f5c6af8b5 req-7096a910-0d25-43af-b10a-0534f9716af7 service nova] Lock "0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:13:40 user nova-compute[72129]: DEBUG nova.compute.manager [req-4b0b0b69-c412-41b3-9f7c-875f5c6af8b5 req-7096a910-0d25-43af-b10a-0534f9716af7 service nova] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] No waiting events found dispatching network-vif-plugged-d4f68f78-6df9-41b7-8d32-27f55f224683 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:13:40 user nova-compute[72129]: WARNING nova.compute.manager [req-4b0b0b69-c412-41b3-9f7c-875f5c6af8b5 req-7096a910-0d25-43af-b10a-0534f9716af7 service nova] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Received unexpected event network-vif-plugged-d4f68f78-6df9-41b7-8d32-27f55f224683 for instance with vm_state deleted and task_state None.
Aug 01 14:13:40 user nova-compute[72129]: DEBUG nova.compute.manager [req-4b0b0b69-c412-41b3-9f7c-875f5c6af8b5 req-7096a910-0d25-43af-b10a-0534f9716af7 service nova] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Received event network-vif-unplugged-d4f68f78-6df9-41b7-8d32-27f55f224683 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:13:40 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-4b0b0b69-c412-41b3-9f7c-875f5c6af8b5 req-7096a910-0d25-43af-b10a-0534f9716af7 service nova] Acquiring lock "0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:13:40 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-4b0b0b69-c412-41b3-9f7c-875f5c6af8b5 req-7096a910-0d25-43af-b10a-0534f9716af7 service nova] Lock "0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:13:40 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-4b0b0b69-c412-41b3-9f7c-875f5c6af8b5 req-7096a910-0d25-43af-b10a-0534f9716af7 service nova] Lock "0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:13:40 user nova-compute[72129]: DEBUG nova.compute.manager [req-4b0b0b69-c412-41b3-9f7c-875f5c6af8b5 req-7096a910-0d25-43af-b10a-0534f9716af7 service nova] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] No waiting events found dispatching network-vif-unplugged-d4f68f78-6df9-41b7-8d32-27f55f224683 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:13:40 user nova-compute[72129]: WARNING nova.compute.manager [req-4b0b0b69-c412-41b3-9f7c-875f5c6af8b5 req-7096a910-0d25-43af-b10a-0534f9716af7 service nova] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Received unexpected event network-vif-unplugged-d4f68f78-6df9-41b7-8d32-27f55f224683 for instance with vm_state deleted and task_state None.
Aug 01 14:13:40 user nova-compute[72129]: DEBUG nova.compute.manager [req-4b0b0b69-c412-41b3-9f7c-875f5c6af8b5 req-7096a910-0d25-43af-b10a-0534f9716af7 service nova] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Received event network-vif-plugged-d4f68f78-6df9-41b7-8d32-27f55f224683 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:13:40 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-4b0b0b69-c412-41b3-9f7c-875f5c6af8b5 req-7096a910-0d25-43af-b10a-0534f9716af7 service nova] Acquiring lock "0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:13:40 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-4b0b0b69-c412-41b3-9f7c-875f5c6af8b5 req-7096a910-0d25-43af-b10a-0534f9716af7 service nova] Lock "0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:13:40 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-4b0b0b69-c412-41b3-9f7c-875f5c6af8b5 req-7096a910-0d25-43af-b10a-0534f9716af7 service nova] Lock "0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:13:40 user nova-compute[72129]: DEBUG nova.compute.manager [req-4b0b0b69-c412-41b3-9f7c-875f5c6af8b5 req-7096a910-0d25-43af-b10a-0534f9716af7 service nova] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] No waiting events found dispatching network-vif-plugged-d4f68f78-6df9-41b7-8d32-27f55f224683 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:13:40 user nova-compute[72129]: WARNING nova.compute.manager [req-4b0b0b69-c412-41b3-9f7c-875f5c6af8b5 req-7096a910-0d25-43af-b10a-0534f9716af7 service nova] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Received unexpected event network-vif-plugged-d4f68f78-6df9-41b7-8d32-27f55f224683 for instance with vm_state deleted and task_state None.
Aug 01 14:13:44 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:13:45 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:13:49 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:13:51 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:13:52 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:13:52 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72129) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 14:13:54 user nova-compute[72129]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690899219.2263079, 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d => Stopped> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:13:54 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] VM Stopped (Lifecycle Event)
Aug 01 14:13:54 user nova-compute[72129]: DEBUG nova.compute.manager [None req-df6b3126-9939-4de6-addb-9dc805c24d47 None None] [instance: 0fa69ad4-448c-4080-b8ca-8bc61bf9ed6d] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:13:54 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:13:56 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:13:56 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Starting heal instance info cache {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 14:13:56 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Rebuilding the list of instances to heal {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 14:13:56 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "refresh_cache-71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:13:56 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquired lock "refresh_cache-71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:13:56 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Forcefully refreshing network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 14:13:56 user nova-compute[72129]: DEBUG nova.objects.instance [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lazy-loading 'info_cache' on Instance uuid 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:13:56 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:13:56 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Updating instance_info_cache with network_info: [{"id": "a5aad1a2-0499-4725-9837-ee171ff0b048", "address": "fa:16:3e:0d:87:39", "network": {"id": "a7f4226b-73fe-4265-ba2c-5d7dcdf154fd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1142462884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210837255c8148ec9b482ba3e2551362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5aad1a2-04", "ovs_interfaceid": "a5aad1a2-0499-4725-9837-ee171ff0b048", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:13:56 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Releasing lock "refresh_cache-71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:13:56 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Updated the network info_cache for instance {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 14:13:56 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:13:58 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:13:58 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:13:59 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:13:59 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:13:59 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:13:59 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:13:59 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:13:59 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Auditing locally available compute resources for user (node: user) {{(pid=72129) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 14:13:59 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89fdfdab-36a6-4481-bfa7-376c3a3a32ae/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:13:59 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:13:59 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89fdfdab-36a6-4481-bfa7-376c3a3a32ae/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:13:59 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89fdfdab-36a6-4481-bfa7-376c3a3a32ae/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:13:59 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:13:59 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89fdfdab-36a6-4481-bfa7-376c3a3a32ae/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:13:59 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 14:13:59 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0714c157-056f-4f64-94f4-da5c8e5f6eda/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:13:59 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0714c157-056f-4f64-94f4-da5c8e5f6eda/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:13:59 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0714c157-056f-4f64-94f4-da5c8e5f6eda/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:13:59 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0714c157-056f-4f64-94f4-da5c8e5f6eda/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:14:00 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:14:00 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:14:00 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Hypervisor/Node resource view: name=user free_ram=8359MB free_disk=25.227954864501953GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72129) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 14:14:00 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:14:00 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:14:00 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:14:00 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 89fdfdab-36a6-4481-bfa7-376c3a3a32ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:14:00 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 0714c157-056f-4f64-94f4-da5c8e5f6eda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:14:00 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 14:14:00 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 14:14:00 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:14:00 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:14:00 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Compute_service record updated for user:user {{(pid=72129) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 14:14:00 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.302s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:14:01 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:14:02 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:14:03 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:14:04 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:14:04 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:14:05 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:14:06 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:14:07 user nova-compute[72129]: DEBUG nova.compute.manager [req-8346a474-165d-4eb8-b00f-871518dddf7e req-597780b4-d755-4dd5-ba67-19f9bdb6e867 service nova] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Received event network-changed-a5aad1a2-0499-4725-9837-ee171ff0b048 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:14:07 user nova-compute[72129]: DEBUG nova.compute.manager [req-8346a474-165d-4eb8-b00f-871518dddf7e req-597780b4-d755-4dd5-ba67-19f9bdb6e867 service nova] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Refreshing instance network info cache due to event network-changed-a5aad1a2-0499-4725-9837-ee171ff0b048. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 14:14:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-8346a474-165d-4eb8-b00f-871518dddf7e req-597780b4-d755-4dd5-ba67-19f9bdb6e867 service nova] Acquiring lock "refresh_cache-71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:14:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-8346a474-165d-4eb8-b00f-871518dddf7e req-597780b4-d755-4dd5-ba67-19f9bdb6e867 service nova] Acquired lock "refresh_cache-71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:14:07 user nova-compute[72129]: DEBUG nova.network.neutron [req-8346a474-165d-4eb8-b00f-871518dddf7e req-597780b4-d755-4dd5-ba67-19f9bdb6e867 service nova] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Refreshing network info cache for port a5aad1a2-0499-4725-9837-ee171ff0b048 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 14:14:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-477acaf9-c2c1-4179-9f40-a2880d7d3533 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Acquiring lock "71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:14:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-477acaf9-c2c1-4179-9f40-a2880d7d3533 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:14:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-477acaf9-c2c1-4179-9f40-a2880d7d3533 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Acquiring lock "71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:14:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-477acaf9-c2c1-4179-9f40-a2880d7d3533 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:14:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-477acaf9-c2c1-4179-9f40-a2880d7d3533 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:14:07 user nova-compute[72129]: INFO nova.compute.manager [None req-477acaf9-c2c1-4179-9f40-a2880d7d3533 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Terminating instance
Aug 01 14:14:07 user nova-compute[72129]: DEBUG nova.compute.manager [None req-477acaf9-c2c1-4179-9f40-a2880d7d3533 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Start destroying the instance on the hypervisor. {{(pid=72129) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 14:14:07 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:14:07 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:14:07 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:14:07 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:14:07 user nova-compute[72129]: DEBUG nova.compute.manager [req-19ef696a-d8d7-4fa0-8e8d-f7f49c72fcb9 req-cb874aad-f257-4d4b-a4b9-1e9453b77dbd service nova] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Received event network-vif-unplugged-a5aad1a2-0499-4725-9837-ee171ff0b048 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:14:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-19ef696a-d8d7-4fa0-8e8d-f7f49c72fcb9 req-cb874aad-f257-4d4b-a4b9-1e9453b77dbd service nova] Acquiring lock "71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:14:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-19ef696a-d8d7-4fa0-8e8d-f7f49c72fcb9 req-cb874aad-f257-4d4b-a4b9-1e9453b77dbd service nova] Lock "71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:14:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-19ef696a-d8d7-4fa0-8e8d-f7f49c72fcb9 req-cb874aad-f257-4d4b-a4b9-1e9453b77dbd service nova] Lock "71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:14:07 user nova-compute[72129]: DEBUG nova.compute.manager [req-19ef696a-d8d7-4fa0-8e8d-f7f49c72fcb9 req-cb874aad-f257-4d4b-a4b9-1e9453b77dbd service nova] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] No waiting events found dispatching network-vif-unplugged-a5aad1a2-0499-4725-9837-ee171ff0b048 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:14:07 user nova-compute[72129]: DEBUG nova.compute.manager [req-19ef696a-d8d7-4fa0-8e8d-f7f49c72fcb9 req-cb874aad-f257-4d4b-a4b9-1e9453b77dbd service nova] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Received event network-vif-unplugged-a5aad1a2-0499-4725-9837-ee171ff0b048 for instance with task_state deleting. {{(pid=72129) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 14:14:08 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Instance destroyed successfully.
Aug 01 14:14:08 user nova-compute[72129]: DEBUG nova.objects.instance [None req-477acaf9-c2c1-4179-9f40-a2880d7d3533 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lazy-loading 'resources' on Instance uuid 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:14:08 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-477acaf9-c2c1-4179-9f40-a2880d7d3533 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:09:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-23799228',display_name='tempest-TestVolumeBootPattern-server-23799228',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-23799228',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNC/W23SfZUyUykD+/RvnPe5L4yiaqOIZwhr2x6wMubzv0aJUgMCBBDug36LSArw18K2rZhhyJmbPtRQrPLsQ9v32QcGWNTH4aynBroBlcsIvr6dB/z67zo0JXowDVQS+w==',key_name='tempest-TestVolumeBootPattern-1986080939',keypairs=<?>,launch_index=0,launched_at=2023-08-01T14:09:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='210837255c8148ec9b482ba3e2551362',ramdisk_id='',reservation_id='r-8mdi9x81',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1876154436',owner_user_name='tempest-TestVolumeBootPattern-1876154436-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T14:09:29Z,user_data=None,user_id='7c341be2816c43cfa9adb58ee84e942b',uuid=71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a5aad1a2-0499-4725-9837-ee171ff0b048", "address": "fa:16:3e:0d:87:39", "network": {"id": "a7f4226b-73fe-4265-ba2c-5d7dcdf154fd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1142462884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210837255c8148ec9b482ba3e2551362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5aad1a2-04", "ovs_interfaceid": "a5aad1a2-0499-4725-9837-ee171ff0b048", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 14:14:08 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-477acaf9-c2c1-4179-9f40-a2880d7d3533 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Converting VIF {"id": "a5aad1a2-0499-4725-9837-ee171ff0b048", "address": "fa:16:3e:0d:87:39", "network": {"id": "a7f4226b-73fe-4265-ba2c-5d7dcdf154fd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1142462884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210837255c8148ec9b482ba3e2551362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5aad1a2-04", "ovs_interfaceid": "a5aad1a2-0499-4725-9837-ee171ff0b048", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:14:08 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-477acaf9-c2c1-4179-9f40-a2880d7d3533 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0d:87:39,bridge_name='br-int',has_traffic_filtering=True,id=a5aad1a2-0499-4725-9837-ee171ff0b048,network=Network(a7f4226b-73fe-4265-ba2c-5d7dcdf154fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5aad1a2-04') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:14:08 user nova-compute[72129]: DEBUG os_vif [None req-477acaf9-c2c1-4179-9f40-a2880d7d3533 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:87:39,bridge_name='br-int',has_traffic_filtering=True,id=a5aad1a2-0499-4725-9837-ee171ff0b048,network=Network(a7f4226b-73fe-4265-ba2c-5d7dcdf154fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5aad1a2-04') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 14:14:08 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:14:08 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa5aad1a2-04, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:14:08 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:14:08 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:14:08 user nova-compute[72129]: INFO os_vif [None req-477acaf9-c2c1-4179-9f40-a2880d7d3533 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:87:39,bridge_name='br-int',has_traffic_filtering=True,id=a5aad1a2-0499-4725-9837-ee171ff0b048,network=Network(a7f4226b-73fe-4265-ba2c-5d7dcdf154fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5aad1a2-04')
Aug 01 14:14:08 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-477acaf9-c2c1-4179-9f40-a2880d7d3533 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] calling os-brick to detach iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 14:14:08 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-477acaf9-c2c1-4179-9f40-a2880d7d3533 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, {'target_iqns': ['iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pedDTuLS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:14:08 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-477acaf9-c2c1-4179-9f40-a2880d7d3533 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:14:08 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-477acaf9-c2c1-4179-9f40-a2880d7d3533 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:14:08 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-477acaf9-c2c1-4179-9f40-a2880d7d3533 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:14:08 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-477acaf9-c2c1-4179-9f40-a2880d7d3533 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883', 0)] {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 14:14:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:14:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:14:08 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[65950811-b786-4028-a405-c399cda2d902]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:14:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:14:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:14:08 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[7598e7c0-df7a-43fc-a0b2-9f64a758d5c3]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:14:08 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-477acaf9-c2c1-4179-9f40-a2880d7d3533 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 (non-flash)
Aug 01 14:14:08 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:14:08 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-477acaf9-c2c1-4179-9f40-a2880d7d3533 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 (non-flash)
Aug 01 14:14:08 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:14:08 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-477acaf9-c2c1-4179-9f40-a2880d7d3533 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2820174790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883'): ({'sdd'}, set())}) {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 14:14:08 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-477acaf9-c2c1-4179-9f40-a2880d7d3533 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Removing single pathed devices sdd {{(pid=72129) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 14:14:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:14:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:14:08 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd878e4-9d04-4480-be7d-282a0b7fec57]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:14:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:14:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:14:08 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20fbeee-99a9-4b16-a861-0b580e34c646]: (4, ('ok\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:14:08 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-477acaf9-c2c1-4179-9f40-a2880d7d3533 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Flushing IO for device /dev/sdd {{(pid=72129) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 14:14:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:14:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:14:08 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[7495ba70-11a3-4ce4-98b3-74557edb3adb]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:14:08 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-477acaf9-c2c1-4179-9f40-a2880d7d3533 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72129) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 14:14:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:14:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:14:08 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a26ba6-0161-4ea5-8673-0612d49f8ddd]: (4, ('1', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:14:08 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-477acaf9-c2c1-4179-9f40-a2880d7d3533 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 14:14:08 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-477acaf9-c2c1-4179-9f40-a2880d7d3533 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] SCSI volumes sdd have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 14:14:08 user nova-compute[72129]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_5aa03bbf', '/dev/disk/by-id/scsi-1SCST_BIO5aa03bbf-7dc814f1398f5070', '/dev/disk/by-id/scsi-23764633831346631') {{(pid=82887) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 01 14:14:08 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c2f47c-395d-4a6a-9721-86d29c24b051]: (4, None) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:14:08 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-477acaf9-c2c1-4179-9f40-a2880d7d3533 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883')] {{(pid=72129) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 14:14:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:14:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:14:08 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56b6916-201d-4526-be1d-c2d79f11c7b5]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:14:08 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-477acaf9-c2c1-4179-9f40-a2880d7d3533 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:14:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 -p 172.16.0.220:3260 --logout {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:14:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:14:08 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b1cdea-c05b-4c1a-845b-b68371d06c70]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:14:08 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-477acaf9-c2c1-4179-9f40-a2880d7d3533 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883, portal: 172.16.0.220,3260]
Aug 01 14:14:08 user nova-compute[72129]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883, portal: 172.16.0.220,3260] successful.
Aug 01 14:14:08 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:14:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 -p 172.16.0.220:3260 --op delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:14:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:becf1ccd-4c86-418e-a9eb-be3cb1fff883 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:14:08 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b9d084-9eb9-4845-9882-df6f6f5c651a]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:14:08 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-477acaf9-c2c1-4179-9f40-a2880d7d3533 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:14:08 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-477acaf9-c2c1-4179-9f40-a2880d7d3533 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:14:08 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-477acaf9-c2c1-4179-9f40-a2880d7d3533 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] <== disconnect_volume: return (272ms) None {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:14:08 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-477acaf9-c2c1-4179-9f40-a2880d7d3533 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Disconnected iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 14:14:08 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-477acaf9-c2c1-4179-9f40-a2880d7d3533 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Deleting instance files /opt/stack/data/nova/instances/71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d_del
Aug 01 14:14:08 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-477acaf9-c2c1-4179-9f40-a2880d7d3533 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Deletion of /opt/stack/data/nova/instances/71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d_del complete
Aug 01 14:14:08 user nova-compute[72129]: INFO nova.compute.manager [None req-477acaf9-c2c1-4179-9f40-a2880d7d3533 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Took 1.13 seconds to destroy the instance on the hypervisor.
Aug 01 14:14:08 user nova-compute[72129]: DEBUG oslo.service.loopingcall [None req-477acaf9-c2c1-4179-9f40-a2880d7d3533 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72129) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 14:14:08 user nova-compute[72129]: DEBUG nova.compute.manager [-] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Deallocating network for instance {{(pid=72129) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 14:14:08 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] deallocate_for_instance() {{(pid=72129) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 14:14:08 user nova-compute[72129]: DEBUG nova.network.neutron [req-8346a474-165d-4eb8-b00f-871518dddf7e req-597780b4-d755-4dd5-ba67-19f9bdb6e867 service nova] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Updated VIF entry in instance network info cache for port a5aad1a2-0499-4725-9837-ee171ff0b048. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 14:14:08 user nova-compute[72129]: DEBUG nova.network.neutron [req-8346a474-165d-4eb8-b00f-871518dddf7e req-597780b4-d755-4dd5-ba67-19f9bdb6e867 service nova] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Updating instance_info_cache with network_info: [{"id": "a5aad1a2-0499-4725-9837-ee171ff0b048", "address": "fa:16:3e:0d:87:39", "network": {"id": "a7f4226b-73fe-4265-ba2c-5d7dcdf154fd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1142462884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "210837255c8148ec9b482ba3e2551362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5aad1a2-04", "ovs_interfaceid": "a5aad1a2-0499-4725-9837-ee171ff0b048", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:14:08 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-8346a474-165d-4eb8-b00f-871518dddf7e req-597780b4-d755-4dd5-ba67-19f9bdb6e867 service nova] Releasing lock "refresh_cache-71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:14:08 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:14:08 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Took 0.54 seconds to deallocate network for instance.
Aug 01 14:14:09 user nova-compute[72129]: DEBUG nova.compute.manager [req-b74d9799-b8d4-472b-b0c4-2a555e89b1b8 req-8cca44d7-257e-47a4-be6d-ad218de17114 service nova] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Received event network-vif-deleted-a5aad1a2-0499-4725-9837-ee171ff0b048 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:14:09 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:14:09 user nova-compute[72129]: DEBUG nova.compute.manager [req-33d3aa31-e922-41b7-915e-1a2eb70cc9a8 req-54837585-d84d-4115-8f8b-e84ccc413e2b service nova] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Received event network-vif-plugged-a5aad1a2-0499-4725-9837-ee171ff0b048 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:14:09 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-33d3aa31-e922-41b7-915e-1a2eb70cc9a8 req-54837585-d84d-4115-8f8b-e84ccc413e2b service nova] Acquiring lock "71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:14:09 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-33d3aa31-e922-41b7-915e-1a2eb70cc9a8 req-54837585-d84d-4115-8f8b-e84ccc413e2b service nova] Lock "71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:14:09 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-33d3aa31-e922-41b7-915e-1a2eb70cc9a8 req-54837585-d84d-4115-8f8b-e84ccc413e2b service nova] Lock "71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:14:09 user nova-compute[72129]: DEBUG nova.compute.manager [req-33d3aa31-e922-41b7-915e-1a2eb70cc9a8 req-54837585-d84d-4115-8f8b-e84ccc413e2b service nova] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] No waiting events found dispatching network-vif-plugged-a5aad1a2-0499-4725-9837-ee171ff0b048 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:14:09 user nova-compute[72129]: WARNING nova.compute.manager [req-33d3aa31-e922-41b7-915e-1a2eb70cc9a8 req-54837585-d84d-4115-8f8b-e84ccc413e2b service nova] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Received unexpected event network-vif-plugged-a5aad1a2-0499-4725-9837-ee171ff0b048 for instance with vm_state active and task_state deleting.
Aug 01 14:14:09 user nova-compute[72129]: INFO nova.compute.manager [None req-477acaf9-c2c1-4179-9f40-a2880d7d3533 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Took 0.73 seconds to detach 1 volumes for instance.
Aug 01 14:14:09 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-477acaf9-c2c1-4179-9f40-a2880d7d3533 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:14:09 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-477acaf9-c2c1-4179-9f40-a2880d7d3533 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:14:09 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-477acaf9-c2c1-4179-9f40-a2880d7d3533 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:14:09 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-477acaf9-c2c1-4179-9f40-a2880d7d3533 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:14:09 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-477acaf9-c2c1-4179-9f40-a2880d7d3533 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.165s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:14:09 user nova-compute[72129]: INFO nova.scheduler.client.report [None req-477acaf9-c2c1-4179-9f40-a2880d7d3533 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Deleted allocations for instance 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d
Aug 01 14:14:10 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-477acaf9-c2c1-4179-9f40-a2880d7d3533 tempest-TestVolumeBootPattern-1876154436 tempest-TestVolumeBootPattern-1876154436-project-member] Lock "71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.760s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:14:11 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:14:12 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Acquiring lock "5c3a4469-30fd-4f27-a3b7-957422dd2746" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:14:12 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "5c3a4469-30fd-4f27-a3b7-957422dd2746" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:14:12 user nova-compute[72129]: DEBUG nova.compute.manager [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Starting instance... {{(pid=72129) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 14:14:12 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:14:12 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:14:12 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72129) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 14:14:12 user nova-compute[72129]: INFO nova.compute.claims [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Claim successful on node user
Aug 01 14:14:12 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:14:12 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:14:12 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.339s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:14:12 user nova-compute[72129]: DEBUG nova.compute.manager [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Start building networks asynchronously for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 14:14:12 user nova-compute[72129]: DEBUG nova.compute.manager [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Allocating IP information in the background. {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 14:14:12 user nova-compute[72129]: DEBUG nova.network.neutron [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] allocate_for_instance() {{(pid=72129) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 14:14:12 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 14:14:12 user nova-compute[72129]: DEBUG nova.compute.manager [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Start building block device mappings for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 14:14:12 user nova-compute[72129]: DEBUG nova.policy [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '85308332b4084e9f8c1bf605f540434b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d5ede0f2e44eaab914ffc17aef8aa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72129) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 14:14:12 user nova-compute[72129]: DEBUG nova.compute.manager [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Start spawning the instance on the hypervisor. {{(pid=72129) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 14:14:12 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Creating instance directory {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 14:14:12 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Creating image(s)
Aug 01 14:14:12 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Acquiring lock "/opt/stack/data/nova/instances/5c3a4469-30fd-4f27-a3b7-957422dd2746/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:14:12 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "/opt/stack/data/nova/instances/5c3a4469-30fd-4f27-a3b7-957422dd2746/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:14:12 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "/opt/stack/data/nova/instances/5c3a4469-30fd-4f27-a3b7-957422dd2746/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:14:12 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:14:12 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.136s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:14:12 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Acquiring lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:14:12 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:14:12 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:14:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.133s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:14:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/5c3a4469-30fd-4f27-a3b7-957422dd2746/disk 1073741824 {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:14:13 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:14:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/5c3a4469-30fd-4f27-a3b7-957422dd2746/disk 1073741824" returned: 0 in 0.050s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:14:13 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.188s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:14:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:14:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.147s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:14:13 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5c3a4469-30fd-4f27-a3b7-957422dd2746/disk. size=1073741824 {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 14:14:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3a4469-30fd-4f27-a3b7-957422dd2746/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:14:13 user nova-compute[72129]: DEBUG nova.network.neutron [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Successfully created port: 7f4ef5f0-b138-43aa-ad82-ced2ff871e3d {{(pid=72129) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 14:14:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3a4469-30fd-4f27-a3b7-957422dd2746/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:14:13 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Cannot resize image /opt/stack/data/nova/instances/5c3a4469-30fd-4f27-a3b7-957422dd2746/disk to a smaller size. {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 14:14:13 user nova-compute[72129]: DEBUG nova.objects.instance [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lazy-loading 'migration_context' on Instance uuid 5c3a4469-30fd-4f27-a3b7-957422dd2746 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:14:13 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Created local disks {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 14:14:13 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Ensure instance console log exists: /opt/stack/data/nova/instances/5c3a4469-30fd-4f27-a3b7-957422dd2746/console.log {{(pid=72129) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 14:14:13 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:14:13 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:14:13 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:14:14 user nova-compute[72129]: DEBUG nova.network.neutron [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Successfully updated port: 7f4ef5f0-b138-43aa-ad82-ced2ff871e3d {{(pid=72129) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 14:14:14 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Acquiring lock "refresh_cache-5c3a4469-30fd-4f27-a3b7-957422dd2746" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:14:14 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Acquired lock "refresh_cache-5c3a4469-30fd-4f27-a3b7-957422dd2746" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:14:14 user nova-compute[72129]: DEBUG nova.network.neutron [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 14:14:14 user nova-compute[72129]: DEBUG nova.compute.manager [req-9335889f-b3bf-4f27-bdca-937088b08b72 req-701c4d53-d12f-4ab8-9e90-fe3171c5867f service nova] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Received event network-changed-7f4ef5f0-b138-43aa-ad82-ced2ff871e3d {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:14:14 user nova-compute[72129]: DEBUG nova.compute.manager [req-9335889f-b3bf-4f27-bdca-937088b08b72 req-701c4d53-d12f-4ab8-9e90-fe3171c5867f service nova] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Refreshing instance network info cache due to event network-changed-7f4ef5f0-b138-43aa-ad82-ced2ff871e3d. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 14:14:14 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-9335889f-b3bf-4f27-bdca-937088b08b72 req-701c4d53-d12f-4ab8-9e90-fe3171c5867f service nova] Acquiring lock "refresh_cache-5c3a4469-30fd-4f27-a3b7-957422dd2746" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:14:14 user nova-compute[72129]: DEBUG nova.network.neutron [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Instance cache missing network info. {{(pid=72129) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 14:14:14 user nova-compute[72129]: DEBUG nova.network.neutron [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Updating instance_info_cache with network_info: [{"id": "7f4ef5f0-b138-43aa-ad82-ced2ff871e3d", "address": "fa:16:3e:5d:46:e3", "network": {"id": "9d4effd9-bf5c-41a7-a8e2-18d2177ace34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333645199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5d5ede0f2e44eaab914ffc17aef8aa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f4ef5f0-b1", "ovs_interfaceid": "7f4ef5f0-b138-43aa-ad82-ced2ff871e3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:14:14 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Releasing lock "refresh_cache-5c3a4469-30fd-4f27-a3b7-957422dd2746" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:14:14 user nova-compute[72129]: DEBUG nova.compute.manager [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Instance network_info: |[{"id": "7f4ef5f0-b138-43aa-ad82-ced2ff871e3d", "address": "fa:16:3e:5d:46:e3", "network": {"id": "9d4effd9-bf5c-41a7-a8e2-18d2177ace34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333645199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5d5ede0f2e44eaab914ffc17aef8aa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f4ef5f0-b1", "ovs_interfaceid": "7f4ef5f0-b138-43aa-ad82-ced2ff871e3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 14:14:14 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-9335889f-b3bf-4f27-bdca-937088b08b72 req-701c4d53-d12f-4ab8-9e90-fe3171c5867f service nova] Acquired lock "refresh_cache-5c3a4469-30fd-4f27-a3b7-957422dd2746" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:14:14 user nova-compute[72129]: DEBUG nova.network.neutron [req-9335889f-b3bf-4f27-bdca-937088b08b72 req-701c4d53-d12f-4ab8-9e90-fe3171c5867f service nova] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Refreshing network info cache for port 7f4ef5f0-b138-43aa-ad82-ced2ff871e3d {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 14:14:14 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Start _get_guest_xml network_info=[{"id": "7f4ef5f0-b138-43aa-ad82-ced2ff871e3d", "address": "fa:16:3e:5d:46:e3", "network": {"id": "9d4effd9-bf5c-41a7-a8e2-18d2177ace34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333645199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5d5ede0f2e44eaab914ffc17aef8aa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f4ef5f0-b1", "ovs_interfaceid": "7f4ef5f0-b138-43aa-ad82-ced2ff871e3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'image_id': 'b6472c34-1b0f-4034-ba3a-7e8eb5103715'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 14:14:14 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:14:14 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:14:14 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 14:14:14 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] CPU controller missing on host. {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 14:14:14 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 14:14:14 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] CPU controller found on host. {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 14:14:14 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72129) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 14:14:14 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T13:45:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 14:14:14 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Flavor limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 14:14:14 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Image limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 14:14:14 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Flavor pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 14:14:14 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Image pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 14:14:14 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 14:14:14 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 14:14:14 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 14:14:14 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Got 1 possible topologies {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 14:14:14 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 14:14:14 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 14:14:14 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:14:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1764116350',display_name='tempest-AttachVolumeNegativeTest-server-1764116350',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1764116350',id=40,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5AOOX6iS6ZoVlJVsbEDFw2v2ug9zPmHb6G55Oi/9APMMv0fvM3QGtRVL9M6EpF0I7uoWOIwS+cq4kenUzLa77uuwaPtKA+zqMr3v6GGfADyF3FLrwb7wLyBQqdzFkv+w==',key_name='tempest-keypair-1609805560',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f5d5ede0f2e44eaab914ffc17aef8aa8',ramdisk_id='',reservation_id='r-28ey4k9b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2079788087',owner_user_name='tempest-AttachVolumeNegativeTest-2079788087-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T14:14:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85308332b4084e9f8c1bf605f540434b',uuid=5c3a4469-30fd-4f27-a3b7-957422dd2746,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f4ef5f0-b138-43aa-ad82-ced2ff871e3d", "address": "fa:16:3e:5d:46:e3", "network": {"id": "9d4effd9-bf5c-41a7-a8e2-18d2177ace34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333645199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5d5ede0f2e44eaab914ffc17aef8aa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f4ef5f0-b1", "ovs_interfaceid": "7f4ef5f0-b138-43aa-ad82-ced2ff871e3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 14:14:14 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Converting VIF {"id": "7f4ef5f0-b138-43aa-ad82-ced2ff871e3d", "address": "fa:16:3e:5d:46:e3", "network": {"id": "9d4effd9-bf5c-41a7-a8e2-18d2177ace34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333645199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5d5ede0f2e44eaab914ffc17aef8aa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f4ef5f0-b1", "ovs_interfaceid": "7f4ef5f0-b138-43aa-ad82-ced2ff871e3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:14:14 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:46:e3,bridge_name='br-int',has_traffic_filtering=True,id=7f4ef5f0-b138-43aa-ad82-ced2ff871e3d,network=Network(9d4effd9-bf5c-41a7-a8e2-18d2177ace34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f4ef5f0-b1') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:14:14 user nova-compute[72129]: DEBUG nova.objects.instance [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lazy-loading 'pci_devices' on Instance uuid 5c3a4469-30fd-4f27-a3b7-957422dd2746 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:14:14 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] End _get_guest_xml xml=<domain type="kvm">
Aug 01 14:14:14 user nova-compute[72129]:   <uuid>5c3a4469-30fd-4f27-a3b7-957422dd2746</uuid>
Aug 01 14:14:14 user nova-compute[72129]:   <name>instance-00000028</name>
Aug 01 14:14:14 user nova-compute[72129]:   <memory>524288</memory>
Aug 01 14:14:14 user nova-compute[72129]:   <vcpu>1</vcpu>
Aug 01 14:14:14 user nova-compute[72129]:   <metadata>
Aug 01 14:14:14 user nova-compute[72129]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 14:14:14 user nova-compute[72129]:       <nova:package version="0.0.0"/>
Aug 01 14:14:14 user nova-compute[72129]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1764116350</nova:name>
Aug 01 14:14:14 user nova-compute[72129]:       <nova:creationTime>2023-08-01 14:14:14</nova:creationTime>
Aug 01 14:14:14 user nova-compute[72129]:       <nova:flavor name="m1.tiny">
Aug 01 14:14:14 user nova-compute[72129]:         <nova:memory>512</nova:memory>
Aug 01 14:14:14 user nova-compute[72129]:         <nova:disk>1</nova:disk>
Aug 01 14:14:14 user nova-compute[72129]:         <nova:swap>0</nova:swap>
Aug 01 14:14:14 user nova-compute[72129]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 14:14:14 user nova-compute[72129]:         <nova:vcpus>1</nova:vcpus>
Aug 01 14:14:14 user nova-compute[72129]:       </nova:flavor>
Aug 01 14:14:14 user nova-compute[72129]:       <nova:owner>
Aug 01 14:14:14 user nova-compute[72129]:         <nova:user uuid="85308332b4084e9f8c1bf605f540434b">tempest-AttachVolumeNegativeTest-2079788087-project-member</nova:user>
Aug 01 14:14:14 user nova-compute[72129]:         <nova:project uuid="f5d5ede0f2e44eaab914ffc17aef8aa8">tempest-AttachVolumeNegativeTest-2079788087</nova:project>
Aug 01 14:14:14 user nova-compute[72129]:       </nova:owner>
Aug 01 14:14:14 user nova-compute[72129]:       <nova:root type="image" uuid="b6472c34-1b0f-4034-ba3a-7e8eb5103715"/>
Aug 01 14:14:14 user nova-compute[72129]:       <nova:ports>
Aug 01 14:14:14 user nova-compute[72129]:         <nova:port uuid="7f4ef5f0-b138-43aa-ad82-ced2ff871e3d">
Aug 01 14:14:14 user nova-compute[72129]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 01 14:14:14 user nova-compute[72129]:         </nova:port>
Aug 01 14:14:14 user nova-compute[72129]:       </nova:ports>
Aug 01 14:14:14 user nova-compute[72129]:     </nova:instance>
Aug 01 14:14:14 user nova-compute[72129]:   </metadata>
Aug 01 14:14:14 user nova-compute[72129]:   <sysinfo type="smbios">
Aug 01 14:14:14 user nova-compute[72129]:     <system>
Aug 01 14:14:14 user nova-compute[72129]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 14:14:14 user nova-compute[72129]:       <entry name="product">OpenStack Nova</entry>
Aug 01 14:14:14 user nova-compute[72129]:       <entry name="version">0.0.0</entry>
Aug 01 14:14:14 user nova-compute[72129]:       <entry name="serial">5c3a4469-30fd-4f27-a3b7-957422dd2746</entry>
Aug 01 14:14:14 user nova-compute[72129]:       <entry name="uuid">5c3a4469-30fd-4f27-a3b7-957422dd2746</entry>
Aug 01 14:14:14 user nova-compute[72129]:       <entry name="family">Virtual Machine</entry>
Aug 01 14:14:14 user nova-compute[72129]:     </system>
Aug 01 14:14:14 user nova-compute[72129]:   </sysinfo>
Aug 01 14:14:14 user nova-compute[72129]:   <os>
Aug 01 14:14:14 user nova-compute[72129]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 14:14:14 user nova-compute[72129]:     <boot dev="hd"/>
Aug 01 14:14:14 user nova-compute[72129]:     <smbios mode="sysinfo"/>
Aug 01 14:14:14 user nova-compute[72129]:   </os>
Aug 01 14:14:14 user nova-compute[72129]:   <features>
Aug 01 14:14:14 user nova-compute[72129]:     <acpi/>
Aug 01 14:14:14 user nova-compute[72129]:     <apic/>
Aug 01 14:14:14 user nova-compute[72129]:     <vmcoreinfo/>
Aug 01 14:14:14 user nova-compute[72129]:   </features>
Aug 01 14:14:14 user nova-compute[72129]:   <clock offset="utc">
Aug 01 14:14:14 user nova-compute[72129]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 14:14:14 user nova-compute[72129]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 14:14:14 user nova-compute[72129]:     <timer name="hpet" present="no"/>
Aug 01 14:14:14 user nova-compute[72129]:   </clock>
Aug 01 14:14:14 user nova-compute[72129]:   <cpu mode="custom" match="exact">
Aug 01 14:14:14 user nova-compute[72129]:     <model>Nehalem</model>
Aug 01 14:14:14 user nova-compute[72129]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 14:14:14 user nova-compute[72129]:   </cpu>
Aug 01 14:14:14 user nova-compute[72129]:   <devices>
Aug 01 14:14:14 user nova-compute[72129]:     <disk type="file" device="disk">
Aug 01 14:14:14 user nova-compute[72129]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 14:14:14 user nova-compute[72129]:       <source file="/opt/stack/data/nova/instances/5c3a4469-30fd-4f27-a3b7-957422dd2746/disk"/>
Aug 01 14:14:14 user nova-compute[72129]:       <target dev="vda" bus="virtio"/>
Aug 01 14:14:14 user nova-compute[72129]:     </disk>
Aug 01 14:14:14 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 14:14:14 user nova-compute[72129]:       <mac address="fa:16:3e:5d:46:e3"/>
Aug 01 14:14:14 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:14:14 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 14:14:14 user nova-compute[72129]:       <target dev="tap7f4ef5f0-b1"/>
Aug 01 14:14:14 user nova-compute[72129]:     </interface>
Aug 01 14:14:14 user nova-compute[72129]:     <serial type="pty">
Aug 01 14:14:14 user nova-compute[72129]:       <log file="/opt/stack/data/nova/instances/5c3a4469-30fd-4f27-a3b7-957422dd2746/console.log" append="off"/>
Aug 01 14:14:14 user nova-compute[72129]:     </serial>
Aug 01 14:14:14 user nova-compute[72129]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 14:14:14 user nova-compute[72129]:     <video>
Aug 01 14:14:14 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:14:14 user nova-compute[72129]:     </video>
Aug 01 14:14:14 user nova-compute[72129]:     <rng model="virtio">
Aug 01 14:14:14 user nova-compute[72129]:       <backend model="random">/dev/urandom</backend>
Aug 01 14:14:14 user nova-compute[72129]:     </rng>
Aug 01 14:14:14 user nova-compute[72129]:     <controller type="usb" index="0" model="none"/>
Aug 01 14:14:14 user nova-compute[72129]:     <memballoon model="virtio">
Aug 01 14:14:14 user nova-compute[72129]:       <stats period="10"/>
Aug 01 14:14:14 user nova-compute[72129]:     </memballoon>
Aug 01 14:14:14 user nova-compute[72129]:   </devices>
Aug 01 14:14:14 user nova-compute[72129]: </domain>
Aug 01 14:14:14 user nova-compute[72129]:  {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 14:14:14 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:14:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1764116350',display_name='tempest-AttachVolumeNegativeTest-server-1764116350',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1764116350',id=40,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5AOOX6iS6ZoVlJVsbEDFw2v2ug9zPmHb6G55Oi/9APMMv0fvM3QGtRVL9M6EpF0I7uoWOIwS+cq4kenUzLa77uuwaPtKA+zqMr3v6GGfADyF3FLrwb7wLyBQqdzFkv+w==',key_name='tempest-keypair-1609805560',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f5d5ede0f2e44eaab914ffc17aef8aa8',ramdisk_id='',reservation_id='r-28ey4k9b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2079788087',owner_user_name='tempest-AttachVolumeNegativeTest-2079788087-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T14:14:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85308332b4084e9f8c1bf605f540434b',uuid=5c3a4469-30fd-4f27-a3b7-957422dd2746,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f4ef5f0-b138-43aa-ad82-ced2ff871e3d", "address": "fa:16:3e:5d:46:e3", "network": {"id": "9d4effd9-bf5c-41a7-a8e2-18d2177ace34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333645199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5d5ede0f2e44eaab914ffc17aef8aa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f4ef5f0-b1", "ovs_interfaceid": "7f4ef5f0-b138-43aa-ad82-ced2ff871e3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 14:14:14 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Converting VIF {"id": "7f4ef5f0-b138-43aa-ad82-ced2ff871e3d", "address": "fa:16:3e:5d:46:e3", "network": {"id": "9d4effd9-bf5c-41a7-a8e2-18d2177ace34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333645199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5d5ede0f2e44eaab914ffc17aef8aa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f4ef5f0-b1", "ovs_interfaceid": "7f4ef5f0-b138-43aa-ad82-ced2ff871e3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:14:14 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:46:e3,bridge_name='br-int',has_traffic_filtering=True,id=7f4ef5f0-b138-43aa-ad82-ced2ff871e3d,network=Network(9d4effd9-bf5c-41a7-a8e2-18d2177ace34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f4ef5f0-b1') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:14:14 user nova-compute[72129]: DEBUG os_vif [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:46:e3,bridge_name='br-int',has_traffic_filtering=True,id=7f4ef5f0-b138-43aa-ad82-ced2ff871e3d,network=Network(9d4effd9-bf5c-41a7-a8e2-18d2177ace34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f4ef5f0-b1') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 14:14:14 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:14:14 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:14:14 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 14:14:14 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:14:14 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7f4ef5f0-b1, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:14:14 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7f4ef5f0-b1, col_values=(('external_ids', {'iface-id': '7f4ef5f0-b138-43aa-ad82-ced2ff871e3d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:46:e3', 'vm-uuid': '5c3a4469-30fd-4f27-a3b7-957422dd2746'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:14:14 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:14:14 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:14:14 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:14:14 user nova-compute[72129]: INFO os_vif [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:46:e3,bridge_name='br-int',has_traffic_filtering=True,id=7f4ef5f0-b138-43aa-ad82-ced2ff871e3d,network=Network(9d4effd9-bf5c-41a7-a8e2-18d2177ace34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f4ef5f0-b1')
Aug 01 14:14:14 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:14:14 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] No VIF found with MAC fa:16:3e:5d:46:e3, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 14:14:14 user nova-compute[72129]: DEBUG nova.network.neutron [req-9335889f-b3bf-4f27-bdca-937088b08b72 req-701c4d53-d12f-4ab8-9e90-fe3171c5867f service nova] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Updated VIF entry in instance network info cache for port 7f4ef5f0-b138-43aa-ad82-ced2ff871e3d. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 14:14:14 user nova-compute[72129]: DEBUG nova.network.neutron [req-9335889f-b3bf-4f27-bdca-937088b08b72 req-701c4d53-d12f-4ab8-9e90-fe3171c5867f service nova] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Updating instance_info_cache with network_info: [{"id": "7f4ef5f0-b138-43aa-ad82-ced2ff871e3d", "address": "fa:16:3e:5d:46:e3", "network": {"id": "9d4effd9-bf5c-41a7-a8e2-18d2177ace34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333645199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5d5ede0f2e44eaab914ffc17aef8aa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f4ef5f0-b1", "ovs_interfaceid": "7f4ef5f0-b138-43aa-ad82-ced2ff871e3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:14:14 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-9335889f-b3bf-4f27-bdca-937088b08b72 req-701c4d53-d12f-4ab8-9e90-fe3171c5867f service nova] Releasing lock "refresh_cache-5c3a4469-30fd-4f27-a3b7-957422dd2746" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:14:15 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:14:15 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:14:15 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:14:16 user nova-compute[72129]: DEBUG nova.compute.manager [req-29505b50-7b5b-418b-885f-027111a9e79f req-8eb257ad-7e2a-482f-8bbb-73890124eea4 service nova] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Received event network-vif-plugged-7f4ef5f0-b138-43aa-ad82-ced2ff871e3d {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:14:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-29505b50-7b5b-418b-885f-027111a9e79f req-8eb257ad-7e2a-482f-8bbb-73890124eea4 service nova] Acquiring lock "5c3a4469-30fd-4f27-a3b7-957422dd2746-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:14:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-29505b50-7b5b-418b-885f-027111a9e79f req-8eb257ad-7e2a-482f-8bbb-73890124eea4 service nova] Lock "5c3a4469-30fd-4f27-a3b7-957422dd2746-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:14:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-29505b50-7b5b-418b-885f-027111a9e79f req-8eb257ad-7e2a-482f-8bbb-73890124eea4 service nova] Lock "5c3a4469-30fd-4f27-a3b7-957422dd2746-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:14:16 user nova-compute[72129]: DEBUG nova.compute.manager [req-29505b50-7b5b-418b-885f-027111a9e79f req-8eb257ad-7e2a-482f-8bbb-73890124eea4 service nova] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] No waiting events found dispatching network-vif-plugged-7f4ef5f0-b138-43aa-ad82-ced2ff871e3d {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:14:16 user nova-compute[72129]: WARNING nova.compute.manager [req-29505b50-7b5b-418b-885f-027111a9e79f req-8eb257ad-7e2a-482f-8bbb-73890124eea4 service nova] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Received unexpected event network-vif-plugged-7f4ef5f0-b138-43aa-ad82-ced2ff871e3d for instance with vm_state building and task_state spawning.
Aug 01 14:14:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:14:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:14:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:14:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:14:18 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690899258.0347867, 5c3a4469-30fd-4f27-a3b7-957422dd2746 => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:14:18 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] VM Resumed (Lifecycle Event)
Aug 01 14:14:18 user nova-compute[72129]: DEBUG nova.compute.manager [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Instance event wait completed in 0 seconds for  {{(pid=72129) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 14:14:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Guest created on hypervisor {{(pid=72129) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 14:14:18 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Instance spawned successfully.
Aug 01 14:14:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 14:14:18 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:14:18 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:14:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Found default for hw_cdrom_bus of ide {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:14:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Found default for hw_disk_bus of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:14:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Found default for hw_input_bus of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:14:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Found default for hw_pointer_model of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:14:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Found default for hw_video_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:14:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Found default for hw_vif_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:14:18 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 14:14:18 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690899258.036497, 5c3a4469-30fd-4f27-a3b7-957422dd2746 => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:14:18 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] VM Started (Lifecycle Event)
Aug 01 14:14:18 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:14:18 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:14:18 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 14:14:18 user nova-compute[72129]: INFO nova.compute.manager [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Took 5.37 seconds to spawn the instance on the hypervisor.
Aug 01 14:14:18 user nova-compute[72129]: DEBUG nova.compute.manager [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:14:18 user nova-compute[72129]: DEBUG nova.compute.manager [req-9672bf16-6b41-4ad5-83b7-d84256d42dd5 req-84906b75-5873-44b4-83e0-11a01f9d30eb service nova] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Received event network-vif-plugged-7f4ef5f0-b138-43aa-ad82-ced2ff871e3d {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:14:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-9672bf16-6b41-4ad5-83b7-d84256d42dd5 req-84906b75-5873-44b4-83e0-11a01f9d30eb service nova] Acquiring lock "5c3a4469-30fd-4f27-a3b7-957422dd2746-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:14:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-9672bf16-6b41-4ad5-83b7-d84256d42dd5 req-84906b75-5873-44b4-83e0-11a01f9d30eb service nova] Lock "5c3a4469-30fd-4f27-a3b7-957422dd2746-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:14:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-9672bf16-6b41-4ad5-83b7-d84256d42dd5 req-84906b75-5873-44b4-83e0-11a01f9d30eb service nova] Lock "5c3a4469-30fd-4f27-a3b7-957422dd2746-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:14:18 user nova-compute[72129]: DEBUG nova.compute.manager [req-9672bf16-6b41-4ad5-83b7-d84256d42dd5 req-84906b75-5873-44b4-83e0-11a01f9d30eb service nova] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] No waiting events found dispatching network-vif-plugged-7f4ef5f0-b138-43aa-ad82-ced2ff871e3d {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:14:18 user nova-compute[72129]: WARNING nova.compute.manager [req-9672bf16-6b41-4ad5-83b7-d84256d42dd5 req-84906b75-5873-44b4-83e0-11a01f9d30eb service nova] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Received unexpected event network-vif-plugged-7f4ef5f0-b138-43aa-ad82-ced2ff871e3d for instance with vm_state building and task_state spawning.
Aug 01 14:14:18 user nova-compute[72129]: INFO nova.compute.manager [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Took 6.04 seconds to build instance.
Aug 01 14:14:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-865dec59-c9f3-4c84-aa3a-eb54e4890eae tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "5c3a4469-30fd-4f27-a3b7-957422dd2746" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.134s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:14:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:14:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:14:23 user nova-compute[72129]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690899248.0611362, 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d => Stopped> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:14:23 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] VM Stopped (Lifecycle Event)
Aug 01 14:14:23 user nova-compute[72129]: DEBUG nova.compute.manager [None req-4fe27587-fd5f-4206-aed2-1b7c19bea223 None None] [instance: 71ec7ac0-37ed-4d2c-83e6-9f3418c5dc5d] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:14:24 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:14:25 user nova-compute[72129]: DEBUG nova.compute.manager [req-6e44dbe9-623e-471c-89cc-8bf07908b1d1 req-44ce7631-ae9e-4394-83bd-7589fb631714 service nova] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Received event network-changed-778ce9fe-90f9-4d7f-98be-51407fc6520a {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:14:25 user nova-compute[72129]: DEBUG nova.compute.manager [req-6e44dbe9-623e-471c-89cc-8bf07908b1d1 req-44ce7631-ae9e-4394-83bd-7589fb631714 service nova] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Refreshing instance network info cache due to event network-changed-778ce9fe-90f9-4d7f-98be-51407fc6520a. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 14:14:25 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-6e44dbe9-623e-471c-89cc-8bf07908b1d1 req-44ce7631-ae9e-4394-83bd-7589fb631714 service nova] Acquiring lock "refresh_cache-89fdfdab-36a6-4481-bfa7-376c3a3a32ae" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:14:25 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-6e44dbe9-623e-471c-89cc-8bf07908b1d1 req-44ce7631-ae9e-4394-83bd-7589fb631714 service nova] Acquired lock "refresh_cache-89fdfdab-36a6-4481-bfa7-376c3a3a32ae" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:14:25 user nova-compute[72129]: DEBUG nova.network.neutron [req-6e44dbe9-623e-471c-89cc-8bf07908b1d1 req-44ce7631-ae9e-4394-83bd-7589fb631714 service nova] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Refreshing network info cache for port 778ce9fe-90f9-4d7f-98be-51407fc6520a {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 14:14:26 user nova-compute[72129]: DEBUG nova.network.neutron [req-6e44dbe9-623e-471c-89cc-8bf07908b1d1 req-44ce7631-ae9e-4394-83bd-7589fb631714 service nova] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Updated VIF entry in instance network info cache for port 778ce9fe-90f9-4d7f-98be-51407fc6520a. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 14:14:26 user nova-compute[72129]: DEBUG nova.network.neutron [req-6e44dbe9-623e-471c-89cc-8bf07908b1d1 req-44ce7631-ae9e-4394-83bd-7589fb631714 service nova] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Updating instance_info_cache with network_info: [{"id": "778ce9fe-90f9-4d7f-98be-51407fc6520a", "address": "fa:16:3e:9f:0b:54", "network": {"id": "46796a3e-328f-4641-82aa-77c1d2c6c9cb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-446403350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b34cc88cb64d6fbdc5e2688f6767d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap778ce9fe-90", "ovs_interfaceid": "778ce9fe-90f9-4d7f-98be-51407fc6520a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:14:26 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-6e44dbe9-623e-471c-89cc-8bf07908b1d1 req-44ce7631-ae9e-4394-83bd-7589fb631714 service nova] Releasing lock "refresh_cache-89fdfdab-36a6-4481-bfa7-376c3a3a32ae" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:14:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:14:29 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:14:29 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9361b565-b633-4670-ad41-23e48abd4faf tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Acquiring lock "89fdfdab-36a6-4481-bfa7-376c3a3a32ae" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:14:29 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9361b565-b633-4670-ad41-23e48abd4faf tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Lock "89fdfdab-36a6-4481-bfa7-376c3a3a32ae" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:14:29 user nova-compute[72129]: DEBUG nova.objects.instance [None req-9361b565-b633-4670-ad41-23e48abd4faf tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Lazy-loading 'flavor' on Instance uuid 89fdfdab-36a6-4481-bfa7-376c3a3a32ae {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:14:29 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9361b565-b633-4670-ad41-23e48abd4faf tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Lock "89fdfdab-36a6-4481-bfa7-376c3a3a32ae" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:14:30 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9361b565-b633-4670-ad41-23e48abd4faf tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Acquiring lock "89fdfdab-36a6-4481-bfa7-376c3a3a32ae" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:14:30 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9361b565-b633-4670-ad41-23e48abd4faf tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Lock "89fdfdab-36a6-4481-bfa7-376c3a3a32ae" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:14:30 user nova-compute[72129]: INFO nova.compute.manager [None req-9361b565-b633-4670-ad41-23e48abd4faf tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Attaching volume ee7a6c1d-97a9-4700-8593-c3099fcf43cb to /dev/vdb
Aug 01 14:14:30 user nova-compute[72129]: DEBUG os_brick.utils [None req-9361b565-b633-4670-ad41-23e48abd4faf tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:14:30 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:14:30 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:14:30 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2fe757-d988-422a-b37c-12fabb131aa7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f9b449c2cd3d\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:14:30 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:14:30 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:14:30 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27fd1fc-ae88-4691-b892-3925ad0b4a38]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:14:30 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:14:30 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:14:30 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba21318-a580-4020-9b6a-c30ac2f28111]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:14:30 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d0e5a2-d39c-4d7b-ab0d-d5193fb5b8ad]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:14:30 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-9361b565-b633-4670-ad41-23e48abd4faf tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Running cmd (subprocess): nvme version {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:14:30 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-9361b565-b633-4670-ad41-23e48abd4faf tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] 'nvme version' failed. Not Retrying. {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 14:14:30 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9361b565-b633-4670-ad41-23e48abd4faf tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] nvme not present on system {{(pid=72129) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 14:14:30 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:14:30 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 14:14:30 user nova-compute[72129]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 14:14:30 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[060297d6-2c92-4804-91fc-9f993872577f]: (4, '') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:14:30 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-9361b565-b633-4670-ad41-23e48abd4faf tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72129) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 14:14:30 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-9361b565-b633-4670-ad41-23e48abd4faf tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 14:14:30 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-9361b565-b633-4670-ad41-23e48abd4faf tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] LIGHTOS: no hostnqn found. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 14:14:30 user nova-compute[72129]: DEBUG os_brick.utils [None req-9361b565-b633-4670-ad41-23e48abd4faf tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f9b449c2cd3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:14:30 user nova-compute[72129]: DEBUG nova.virt.block_device [None req-9361b565-b633-4670-ad41-23e48abd4faf tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Updating existing volume attachment record: a5b97561-9fa9-4d99-a9e9-4667d47ec79d {{(pid=72129) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 14:14:31 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:14:31 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:14:34 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:14:36 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:14:37 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9361b565-b633-4670-ad41-23e48abd4faf tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Calling os-brick to attach iSCSI Volume {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 14:14:37 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9361b565-b633-4670-ad41-23e48abd4faf tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ee7a6c1d-97a9-4700-8593-c3099fcf43cb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MYkwPvQA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:14:37 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-9361b565-b633-4670-ad41-23e48abd4faf tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:14:37 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-9361b565-b633-4670-ad41-23e48abd4faf tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:14:37 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-9361b565-b633-4670-ad41-23e48abd4faf tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:14:37 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-9361b565-b633-4670-ad41-23e48abd4faf tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:14:37 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-9361b565-b633-4670-ad41-23e48abd4faf tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee7a6c1d-97a9-4700-8593-c3099fcf43cb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:14:37 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-9361b565-b633-4670-ad41-23e48abd4faf tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee7a6c1d-97a9-4700-8593-c3099fcf43cb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:14:37 user nova-compute[72129]: INFO os_brick.initiator.connectors.iscsi [None req-9361b565-b633-4670-ad41-23e48abd4faf tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 14:14:37 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee7a6c1d-97a9-4700-8593-c3099fcf43cb -p 172.16.0.220:3260 {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:14:37 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee7a6c1d-97a9-4700-8593-c3099fcf43cb -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:14:37 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5f764c-cb7d-4bdf-a82f-fc8de1a06520]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:14:37 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9361b565-b633-4670-ad41-23e48abd4faf tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 14:14:37 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:14:37 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee7a6c1d-97a9-4700-8593-c3099fcf43cb -p 172.16.0.220:3260 --interface default --op new {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:14:37 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee7a6c1d-97a9-4700-8593-c3099fcf43cb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:14:37 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[90fd6548-cf41-4c0c-98cc-33a89f2753e4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ee7a6c1d-97a9-4700-8593-c3099fcf43cb] added\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:14:37 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9361b565-b633-4670-ad41-23e48abd4faf tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ee7a6c1d-97a9-4700-8593-c3099fcf43cb] added
Aug 01 14:14:37 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:14:37 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee7a6c1d-97a9-4700-8593-c3099fcf43cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:14:37 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee7a6c1d-97a9-4700-8593-c3099fcf43cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.040s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:14:37 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a5297d-0981-492f-95bf-2923479bb0c6]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:14:37 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9361b565-b633-4670-ad41-23e48abd4faf tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:14:37 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee7a6c1d-97a9-4700-8593-c3099fcf43cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:14:37 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee7a6c1d-97a9-4700-8593-c3099fcf43cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:14:37 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd54936-bf04-46e7-9e62-50671cfb55bd]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:14:37 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9361b565-b633-4670-ad41-23e48abd4faf tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:14:37 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee7a6c1d-97a9-4700-8593-c3099fcf43cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MYkwPvQA {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:14:37 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee7a6c1d-97a9-4700-8593-c3099fcf43cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MYkwPvQA" returned: 0 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:14:37 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[1044cd6d-ab5d-486d-9a2b-3933622a9e76]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:14:37 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9361b565-b633-4670-ad41-23e48abd4faf tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MYkwPvQA'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:14:37 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee7a6c1d-97a9-4700-8593-c3099fcf43cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:14:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:14:37 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee7a6c1d-97a9-4700-8593-c3099fcf43cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:14:37 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d8c2d9-d665-46fe-8a4e-1b89680a1c84]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:14:37 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9361b565-b633-4670-ad41-23e48abd4faf tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:14:37 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:14:37 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:14:37 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a108fe65-60ea-40c5-bec6-c03bfec73f8f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:14:37 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9361b565-b633-4670-ad41-23e48abd4faf tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 14:14:37 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:14:37 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9361b565-b633-4670-ad41-23e48abd4faf tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 14:14:37 user nova-compute[72129]:  {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:14:37 user nova-compute[72129]: WARNING os_brick.initiator.connectors.iscsi [None req-9361b565-b633-4670-ad41-23e48abd4faf tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 14:14:37 user nova-compute[72129]: 
Aug 01 14:14:37 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee7a6c1d-97a9-4700-8593-c3099fcf43cb -p 172.16.0.220:3260 --login {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:14:37 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee7a6c1d-97a9-4700-8593-c3099fcf43cb -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:14:37 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[758f37db-bd05-48c3-b49a-db4de1ce7a91]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ee7a6c1d-97a9-4700-8593-c3099fcf43cb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ee7a6c1d-97a9-4700-8593-c3099fcf43cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:14:37 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9361b565-b633-4670-ad41-23e48abd4faf tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ee7a6c1d-97a9-4700-8593-c3099fcf43cb, portal: 172.16.0.220,3260]
Aug 01 14:14:37 user nova-compute[72129]: Login to [iface: default, target: iqn.2010-10.org.openstack:ee7a6c1d-97a9-4700-8593-c3099fcf43cb, portal: 172.16.0.220,3260] successful.
Aug 01 14:14:37 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:14:37 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee7a6c1d-97a9-4700-8593-c3099fcf43cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:14:37 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee7a6c1d-97a9-4700-8593-c3099fcf43cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:14:37 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf2e3549-e7ac-4ccd-9428-6a43f195efdc]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:14:37 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9361b565-b633-4670-ad41-23e48abd4faf tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:14:37 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:14:37 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:14:37 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[0004126f-a052-4e0b-bb22-b3c3745b1e4d]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7a6c1d-97a9-4700-8593-c3099fcf43cb (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:14:37 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9361b565-b633-4670-ad41-23e48abd4faf tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7a6c1d-97a9-4700-8593-c3099fcf43cb (non-flash)
Aug 01 14:14:37 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:14:37 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9361b565-b633-4670-ad41-23e48abd4faf tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7a6c1d-97a9-4700-8593-c3099fcf43cb (non-flash)
Aug 01 14:14:37 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:14:37 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-9361b565-b633-4670-ad41-23e48abd4faf tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee7a6c1d-97a9-4700-8593-c3099fcf43cb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:14:37 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9361b565-b633-4670-ad41-23e48abd4faf tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Connected to 172.16.0.220:3260 {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 14:14:37 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-9361b565-b633-4670-ad41-23e48abd4faf tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=72129) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 14:14:37 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-9361b565-b633-4670-ad41-23e48abd4faf tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72129) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 14:14:37 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:14:37 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:14:37 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f1240c-4068-45d8-82dc-4f4637fdb17e]: (4, ('- - 0', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:14:37 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-9361b565-b633-4670-ad41-23e48abd4faf tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 14:14:37 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9361b565-b633-4670-ad41-23e48abd4faf tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MYkwPvQA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 14:14:38 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:14:38 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-9361b565-b633-4670-ad41-23e48abd4faf tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:14:38 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-9361b565-b633-4670-ad41-23e48abd4faf tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '23666633961313232', 'path': '/dev/sdb'} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:14:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9361b565-b633-4670-ad41-23e48abd4faf tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23666633961313232', 'path': '/dev/sdb'} {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 14:14:38 user nova-compute[72129]: DEBUG nova.objects.instance [None req-9361b565-b633-4670-ad41-23e48abd4faf tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Lazy-loading 'flavor' on Instance uuid 89fdfdab-36a6-4481-bfa7-376c3a3a32ae {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:14:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-9361b565-b633-4670-ad41-23e48abd4faf tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 14:14:38 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:14:38 user nova-compute[72129]:   <source dev="/dev/sdb"/>
Aug 01 14:14:38 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 14:14:38 user nova-compute[72129]:   <serial>ee7a6c1d-97a9-4700-8593-c3099fcf43cb</serial>
Aug 01 14:14:38 user nova-compute[72129]: </disk>
Aug 01 14:14:38 user nova-compute[72129]:  {{(pid=72129) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 14:14:39 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9361b565-b633-4670-ad41-23e48abd4faf tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:14:39 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9361b565-b633-4670-ad41-23e48abd4faf tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:14:39 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9361b565-b633-4670-ad41-23e48abd4faf tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] No VIF found with MAC fa:16:3e:9f:0b:54, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 14:14:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9361b565-b633-4670-ad41-23e48abd4faf tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Lock "89fdfdab-36a6-4481-bfa7-376c3a3a32ae" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.179s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:14:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:14:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:14:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Acquiring lock "b3f54430-8d5d-478b-8dc7-d7592ee3db36" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:14:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lock "b3f54430-8d5d-478b-8dc7-d7592ee3db36" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:14:41 user nova-compute[72129]: DEBUG nova.compute.manager [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Starting instance... {{(pid=72129) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 14:14:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:14:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:14:41 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72129) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 14:14:41 user nova-compute[72129]: INFO nova.compute.claims [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Claim successful on node user
Aug 01 14:14:41 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:14:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-df079fcf-5df9-4455-aee5-73ac1519c754 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Acquiring lock "89fdfdab-36a6-4481-bfa7-376c3a3a32ae" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:14:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-df079fcf-5df9-4455-aee5-73ac1519c754 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Lock "89fdfdab-36a6-4481-bfa7-376c3a3a32ae" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:14:41 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:14:41 user nova-compute[72129]: INFO nova.compute.manager [None req-df079fcf-5df9-4455-aee5-73ac1519c754 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Detaching volume ee7a6c1d-97a9-4700-8593-c3099fcf43cb
Aug 01 14:14:41 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:14:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.371s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:14:41 user nova-compute[72129]: DEBUG nova.compute.manager [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Start building networks asynchronously for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 14:14:41 user nova-compute[72129]: INFO nova.virt.block_device [None req-df079fcf-5df9-4455-aee5-73ac1519c754 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Attempting to driver detach volume ee7a6c1d-97a9-4700-8593-c3099fcf43cb from mountpoint /dev/vdb
Aug 01 14:14:41 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-df079fcf-5df9-4455-aee5-73ac1519c754 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Attempting to detach device vdb from instance 89fdfdab-36a6-4481-bfa7-376c3a3a32ae from the persistent domain config. {{(pid=72129) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 14:14:41 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-df079fcf-5df9-4455-aee5-73ac1519c754 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 14:14:41 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:14:41 user nova-compute[72129]:   <source dev="/dev/sdb"/>
Aug 01 14:14:41 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 14:14:41 user nova-compute[72129]:   <serial>ee7a6c1d-97a9-4700-8593-c3099fcf43cb</serial>
Aug 01 14:14:41 user nova-compute[72129]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 14:14:41 user nova-compute[72129]: </disk>
Aug 01 14:14:41 user nova-compute[72129]:  {{(pid=72129) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 14:14:41 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-df079fcf-5df9-4455-aee5-73ac1519c754 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Successfully detached device vdb from instance 89fdfdab-36a6-4481-bfa7-376c3a3a32ae from the persistent domain config.
Aug 01 14:14:41 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-df079fcf-5df9-4455-aee5-73ac1519c754 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 89fdfdab-36a6-4481-bfa7-376c3a3a32ae from the live domain config. {{(pid=72129) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 14:14:41 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-df079fcf-5df9-4455-aee5-73ac1519c754 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 14:14:41 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:14:41 user nova-compute[72129]:   <source dev="/dev/sdb"/>
Aug 01 14:14:41 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 14:14:41 user nova-compute[72129]:   <serial>ee7a6c1d-97a9-4700-8593-c3099fcf43cb</serial>
Aug 01 14:14:41 user nova-compute[72129]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 14:14:41 user nova-compute[72129]: </disk>
Aug 01 14:14:41 user nova-compute[72129]:  {{(pid=72129) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 14:14:41 user nova-compute[72129]: DEBUG nova.compute.manager [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Allocating IP information in the background. {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 14:14:41 user nova-compute[72129]: DEBUG nova.network.neutron [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] allocate_for_instance() {{(pid=72129) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 14:14:41 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 14:14:41 user nova-compute[72129]: DEBUG nova.compute.manager [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Start building block device mappings for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG nova.policy [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'deb1597afdc647598ee893dd51880173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42cca3e17d4e4df79c94c4b94fb3fcec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72129) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG nova.compute.manager [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Start spawning the instance on the hypervisor. {{(pid=72129) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Creating instance directory {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 14:14:42 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Creating image(s)
Aug 01 14:14:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Acquiring lock "/opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lock "/opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lock "/opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.140s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Acquiring lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Received event <DeviceRemovedEvent: 1690899282.3150563, 89fdfdab-36a6-4481-bfa7-376c3a3a32ae => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72129) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-df079fcf-5df9-4455-aee5-73ac1519c754 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 89fdfdab-36a6-4481-bfa7-376c3a3a32ae {{(pid=72129) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 14:14:42 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-df079fcf-5df9-4455-aee5-73ac1519c754 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Successfully detached device vdb from instance 89fdfdab-36a6-4481-bfa7-376c3a3a32ae from the live domain config.
Aug 01 14:14:42 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df079fcf-5df9-4455-aee5-73ac1519c754 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] calling os-brick to detach iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-df079fcf-5df9-4455-aee5-73ac1519c754 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, {'target_iqns': ['iqn.2010-10.org.openstack:ee7a6c1d-97a9-4700-8593-c3099fcf43cb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MYkwPvQA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:14:42 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-df079fcf-5df9-4455-aee5-73ac1519c754 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:14:42 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-df079fcf-5df9-4455-aee5-73ac1519c754 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-df079fcf-5df9-4455-aee5-73ac1519c754 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-df079fcf-5df9-4455-aee5-73ac1519c754 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee7a6c1d-97a9-4700-8593-c3099fcf43cb', 0)] {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.153s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk 1073741824 {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32c6e95-b975-403a-af55-5c9cc4e20fdf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee7a6c1d-97a9-4700-8593-c3099fcf43cb\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk 1073741824" returned: 0 in 0.061s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.217s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89d95ac-1e9f-43f2-a16f-7b1832216b57]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7a6c1d-97a9-4700-8593-c3099fcf43cb (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-df079fcf-5df9-4455-aee5-73ac1519c754 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7a6c1d-97a9-4700-8593-c3099fcf43cb (non-flash)
Aug 01 14:14:42 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-df079fcf-5df9-4455-aee5-73ac1519c754 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee7a6c1d-97a9-4700-8593-c3099fcf43cb (non-flash)
Aug 01 14:14:42 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-df079fcf-5df9-4455-aee5-73ac1519c754 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f28104f7880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee7a6c1d-97a9-4700-8593-c3099fcf43cb'): ({'sdb'}, set())}) {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-df079fcf-5df9-4455-aee5-73ac1519c754 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Removing single pathed devices sdb {{(pid=72129) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Acquiring lock "3bdb8e41-8cd5-4c33-9624-d262cacd0f5d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lock "3bdb8e41-8cd5-4c33-9624-d262cacd0f5d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[76fccd5d-4215-47ac-9e7a-9300942de648]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG nova.compute.manager [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Starting instance... {{(pid=72129) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.030s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[e651d46b-ff54-4021-82ae-3cb37a22d1bb]: (4, ('ok\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-df079fcf-5df9-4455-aee5-73ac1519c754 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Flushing IO for device /dev/sdb {{(pid=72129) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[0406209d-6189-440e-b6c5-d50e7b7c341d]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-df079fcf-5df9-4455-aee5-73ac1519c754 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72129) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.154s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk. size=1073741824 {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a126c5-5a92-494e-a86e-4572974c8fca]: (4, ('1', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-df079fcf-5df9-4455-aee5-73ac1519c754 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-df079fcf-5df9-4455-aee5-73ac1519c754 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] SCSI volumes sdb have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-df079fcf-5df9-4455-aee5-73ac1519c754 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee7a6c1d-97a9-4700-8593-c3099fcf43cb')] {{(pid=72129) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee7a6c1d-97a9-4700-8593-c3099fcf43cb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee7a6c1d-97a9-4700-8593-c3099fcf43cb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d52f68-3f88-4cf0-9bab-f30390eda0e9]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-df079fcf-5df9-4455-aee5-73ac1519c754 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee7a6c1d-97a9-4700-8593-c3099fcf43cb -p 172.16.0.220:3260 --logout {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG nova.network.neutron [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Successfully created port: 77cb18a9-2c41-4aa6-8784-ffcbafeb1341 {{(pid=72129) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72129) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 14:14:42 user nova-compute[72129]: INFO nova.compute.claims [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Claim successful on node user
Aug 01 14:14:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee7a6c1d-97a9-4700-8593-c3099fcf43cb -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b356243-1b5d-4b86-a4d1-46f77628c777]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:ee7a6c1d-97a9-4700-8593-c3099fcf43cb, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:ee7a6c1d-97a9-4700-8593-c3099fcf43cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-df079fcf-5df9-4455-aee5-73ac1519c754 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:ee7a6c1d-97a9-4700-8593-c3099fcf43cb, portal: 172.16.0.220,3260]
Aug 01 14:14:42 user nova-compute[72129]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:ee7a6c1d-97a9-4700-8593-c3099fcf43cb, portal: 172.16.0.220,3260] successful.
Aug 01 14:14:42 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee7a6c1d-97a9-4700-8593-c3099fcf43cb -p 172.16.0.220:3260 --op delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Cannot resize image /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk to a smaller size. {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG nova.objects.instance [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lazy-loading 'migration_context' on Instance uuid b3f54430-8d5d-478b-8dc7-d7592ee3db36 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee7a6c1d-97a9-4700-8593-c3099fcf43cb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[7998a437-1b4c-4bdd-aab1-09903e9686dc]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-df079fcf-5df9-4455-aee5-73ac1519c754 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-df079fcf-5df9-4455-aee5-73ac1519c754 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.406s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-df079fcf-5df9-4455-aee5-73ac1519c754 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] <== disconnect_volume: return (408ms) None {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df079fcf-5df9-4455-aee5-73ac1519c754 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Disconnected iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Created local disks {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Ensure instance console log exists: /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/console.log {{(pid=72129) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.276s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:14:42 user nova-compute[72129]: DEBUG nova.compute.manager [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Start building networks asynchronously for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 14:14:43 user nova-compute[72129]: DEBUG nova.compute.manager [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Allocating IP information in the background. {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 14:14:43 user nova-compute[72129]: DEBUG nova.network.neutron [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] allocate_for_instance() {{(pid=72129) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 14:14:43 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 14:14:43 user nova-compute[72129]: DEBUG nova.compute.manager [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Start building block device mappings for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 14:14:43 user nova-compute[72129]: DEBUG nova.policy [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'deb1597afdc647598ee893dd51880173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42cca3e17d4e4df79c94c4b94fb3fcec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72129) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 14:14:43 user nova-compute[72129]: DEBUG nova.compute.manager [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Start spawning the instance on the hypervisor. {{(pid=72129) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 14:14:43 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Creating instance directory {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 14:14:43 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Creating image(s)
Aug 01 14:14:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Acquiring lock "/opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:14:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lock "/opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:14:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lock "/opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:14:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:14:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.146s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:14:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Acquiring lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:14:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:14:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:14:43 user nova-compute[72129]: DEBUG nova.network.neutron [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Successfully updated port: 77cb18a9-2c41-4aa6-8784-ffcbafeb1341 {{(pid=72129) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 14:14:43 user nova-compute[72129]: DEBUG nova.objects.instance [None req-df079fcf-5df9-4455-aee5-73ac1519c754 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Lazy-loading 'flavor' on Instance uuid 89fdfdab-36a6-4481-bfa7-376c3a3a32ae {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:14:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Acquiring lock "refresh_cache-b3f54430-8d5d-478b-8dc7-d7592ee3db36" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:14:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Acquired lock "refresh_cache-b3f54430-8d5d-478b-8dc7-d7592ee3db36" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:14:43 user nova-compute[72129]: DEBUG nova.network.neutron [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 14:14:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.152s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:14:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk 1073741824 {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:14:43 user nova-compute[72129]: DEBUG nova.compute.manager [req-993e1641-d322-4b3a-848b-b24fc6333aa5 req-073ef941-e2f8-4603-807b-ada84460f252 service nova] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Received event network-changed-77cb18a9-2c41-4aa6-8784-ffcbafeb1341 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:14:43 user nova-compute[72129]: DEBUG nova.compute.manager [req-993e1641-d322-4b3a-848b-b24fc6333aa5 req-073ef941-e2f8-4603-807b-ada84460f252 service nova] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Refreshing instance network info cache due to event network-changed-77cb18a9-2c41-4aa6-8784-ffcbafeb1341. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 14:14:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-993e1641-d322-4b3a-848b-b24fc6333aa5 req-073ef941-e2f8-4603-807b-ada84460f252 service nova] Acquiring lock "refresh_cache-b3f54430-8d5d-478b-8dc7-d7592ee3db36" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:14:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk 1073741824" returned: 0 in 0.064s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:14:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.219s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:14:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:14:43 user nova-compute[72129]: DEBUG nova.network.neutron [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Instance cache missing network info. {{(pid=72129) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 14:14:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-df079fcf-5df9-4455-aee5-73ac1519c754 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Lock "89fdfdab-36a6-4481-bfa7-376c3a3a32ae" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.012s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:14:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.147s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:14:43 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk. size=1073741824 {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 14:14:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:14:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:14:43 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Cannot resize image /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk to a smaller size. {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 14:14:43 user nova-compute[72129]: DEBUG nova.objects.instance [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lazy-loading 'migration_context' on Instance uuid 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:14:43 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Created local disks {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 14:14:43 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Ensure instance console log exists: /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/console.log {{(pid=72129) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 14:14:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:14:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:14:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:14:43 user nova-compute[72129]: DEBUG nova.network.neutron [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Updating instance_info_cache with network_info: [{"id": "77cb18a9-2c41-4aa6-8784-ffcbafeb1341", "address": "fa:16:3e:d2:d6:8b", "network": {"id": "6ffcec16-7b44-472a-b7cd-af16ebd4a653", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-901464581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cca3e17d4e4df79c94c4b94fb3fcec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77cb18a9-2c", "ovs_interfaceid": "77cb18a9-2c41-4aa6-8784-ffcbafeb1341", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:14:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Releasing lock "refresh_cache-b3f54430-8d5d-478b-8dc7-d7592ee3db36" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:14:43 user nova-compute[72129]: DEBUG nova.compute.manager [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Instance network_info: |[{"id": "77cb18a9-2c41-4aa6-8784-ffcbafeb1341", "address": "fa:16:3e:d2:d6:8b", "network": {"id": "6ffcec16-7b44-472a-b7cd-af16ebd4a653", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-901464581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cca3e17d4e4df79c94c4b94fb3fcec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77cb18a9-2c", "ovs_interfaceid": "77cb18a9-2c41-4aa6-8784-ffcbafeb1341", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 14:14:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-993e1641-d322-4b3a-848b-b24fc6333aa5 req-073ef941-e2f8-4603-807b-ada84460f252 service nova] Acquired lock "refresh_cache-b3f54430-8d5d-478b-8dc7-d7592ee3db36" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:14:43 user nova-compute[72129]: DEBUG nova.network.neutron [req-993e1641-d322-4b3a-848b-b24fc6333aa5 req-073ef941-e2f8-4603-807b-ada84460f252 service nova] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Refreshing network info cache for port 77cb18a9-2c41-4aa6-8784-ffcbafeb1341 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 14:14:43 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Start _get_guest_xml network_info=[{"id": "77cb18a9-2c41-4aa6-8784-ffcbafeb1341", "address": "fa:16:3e:d2:d6:8b", "network": {"id": "6ffcec16-7b44-472a-b7cd-af16ebd4a653", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-901464581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cca3e17d4e4df79c94c4b94fb3fcec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77cb18a9-2c", "ovs_interfaceid": "77cb18a9-2c41-4aa6-8784-ffcbafeb1341", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'image_id': 'b6472c34-1b0f-4034-ba3a-7e8eb5103715'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 14:14:43 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:14:43 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:14:43 user nova-compute[72129]: DEBUG nova.network.neutron [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Successfully created port: 10889d2c-ec62-4b92-b325-0f5d7d67851f {{(pid=72129) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 14:14:43 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 14:14:43 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] CPU controller missing on host. {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 14:14:43 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 14:14:43 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] CPU controller found on host. {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 14:14:43 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72129) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 14:14:43 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T13:45:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 14:14:43 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Flavor limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 14:14:43 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Image limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 14:14:43 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Flavor pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 14:14:43 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Image pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 14:14:43 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 14:14:43 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 14:14:43 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 14:14:43 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Got 1 possible topologies {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 14:14:43 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 14:14:43 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 14:14:43 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:14:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-998646471',display_name='tempest-ServerRescueNegativeTestJSON-server-998646471',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-998646471',id=41,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42cca3e17d4e4df79c94c4b94fb3fcec',ramdisk_id='',reservation_id='r-3w5r0zro',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-481576424',owner_user_name='tempest-ServerRescueNegativeTestJSON-481576424-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T14:14:42Z,user_data=None,user_id='deb1597afdc647598ee893dd51880173',uuid=b3f54430-8d5d-478b-8dc7-d7592ee3db36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77cb18a9-2c41-4aa6-8784-ffcbafeb1341", "address": "fa:16:3e:d2:d6:8b", "network": {"id": "6ffcec16-7b44-472a-b7cd-af16ebd4a653", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-901464581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cca3e17d4e4df79c94c4b94fb3fcec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77cb18a9-2c", "ovs_interfaceid": "77cb18a9-2c41-4aa6-8784-ffcbafeb1341", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 14:14:43 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Converting VIF {"id": "77cb18a9-2c41-4aa6-8784-ffcbafeb1341", "address": "fa:16:3e:d2:d6:8b", "network": {"id": "6ffcec16-7b44-472a-b7cd-af16ebd4a653", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-901464581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cca3e17d4e4df79c94c4b94fb3fcec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77cb18a9-2c", "ovs_interfaceid": "77cb18a9-2c41-4aa6-8784-ffcbafeb1341", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:14:43 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:d6:8b,bridge_name='br-int',has_traffic_filtering=True,id=77cb18a9-2c41-4aa6-8784-ffcbafeb1341,network=Network(6ffcec16-7b44-472a-b7cd-af16ebd4a653),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77cb18a9-2c') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:14:43 user nova-compute[72129]: DEBUG nova.objects.instance [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lazy-loading 'pci_devices' on Instance uuid b3f54430-8d5d-478b-8dc7-d7592ee3db36 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:14:44 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] End _get_guest_xml xml=<domain type="kvm">
Aug 01 14:14:44 user nova-compute[72129]:   <uuid>b3f54430-8d5d-478b-8dc7-d7592ee3db36</uuid>
Aug 01 14:14:44 user nova-compute[72129]:   <name>instance-00000029</name>
Aug 01 14:14:44 user nova-compute[72129]:   <memory>524288</memory>
Aug 01 14:14:44 user nova-compute[72129]:   <vcpu>1</vcpu>
Aug 01 14:14:44 user nova-compute[72129]:   <metadata>
Aug 01 14:14:44 user nova-compute[72129]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 14:14:44 user nova-compute[72129]:       <nova:package version="0.0.0"/>
Aug 01 14:14:44 user nova-compute[72129]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-998646471</nova:name>
Aug 01 14:14:44 user nova-compute[72129]:       <nova:creationTime>2023-08-01 14:14:43</nova:creationTime>
Aug 01 14:14:44 user nova-compute[72129]:       <nova:flavor name="m1.tiny">
Aug 01 14:14:44 user nova-compute[72129]:         <nova:memory>512</nova:memory>
Aug 01 14:14:44 user nova-compute[72129]:         <nova:disk>1</nova:disk>
Aug 01 14:14:44 user nova-compute[72129]:         <nova:swap>0</nova:swap>
Aug 01 14:14:44 user nova-compute[72129]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 14:14:44 user nova-compute[72129]:         <nova:vcpus>1</nova:vcpus>
Aug 01 14:14:44 user nova-compute[72129]:       </nova:flavor>
Aug 01 14:14:44 user nova-compute[72129]:       <nova:owner>
Aug 01 14:14:44 user nova-compute[72129]:         <nova:user uuid="deb1597afdc647598ee893dd51880173">tempest-ServerRescueNegativeTestJSON-481576424-project-member</nova:user>
Aug 01 14:14:44 user nova-compute[72129]:         <nova:project uuid="42cca3e17d4e4df79c94c4b94fb3fcec">tempest-ServerRescueNegativeTestJSON-481576424</nova:project>
Aug 01 14:14:44 user nova-compute[72129]:       </nova:owner>
Aug 01 14:14:44 user nova-compute[72129]:       <nova:root type="image" uuid="b6472c34-1b0f-4034-ba3a-7e8eb5103715"/>
Aug 01 14:14:44 user nova-compute[72129]:       <nova:ports>
Aug 01 14:14:44 user nova-compute[72129]:         <nova:port uuid="77cb18a9-2c41-4aa6-8784-ffcbafeb1341">
Aug 01 14:14:44 user nova-compute[72129]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 01 14:14:44 user nova-compute[72129]:         </nova:port>
Aug 01 14:14:44 user nova-compute[72129]:       </nova:ports>
Aug 01 14:14:44 user nova-compute[72129]:     </nova:instance>
Aug 01 14:14:44 user nova-compute[72129]:   </metadata>
Aug 01 14:14:44 user nova-compute[72129]:   <sysinfo type="smbios">
Aug 01 14:14:44 user nova-compute[72129]:     <system>
Aug 01 14:14:44 user nova-compute[72129]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 14:14:44 user nova-compute[72129]:       <entry name="product">OpenStack Nova</entry>
Aug 01 14:14:44 user nova-compute[72129]:       <entry name="version">0.0.0</entry>
Aug 01 14:14:44 user nova-compute[72129]:       <entry name="serial">b3f54430-8d5d-478b-8dc7-d7592ee3db36</entry>
Aug 01 14:14:44 user nova-compute[72129]:       <entry name="uuid">b3f54430-8d5d-478b-8dc7-d7592ee3db36</entry>
Aug 01 14:14:44 user nova-compute[72129]:       <entry name="family">Virtual Machine</entry>
Aug 01 14:14:44 user nova-compute[72129]:     </system>
Aug 01 14:14:44 user nova-compute[72129]:   </sysinfo>
Aug 01 14:14:44 user nova-compute[72129]:   <os>
Aug 01 14:14:44 user nova-compute[72129]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 14:14:44 user nova-compute[72129]:     <boot dev="hd"/>
Aug 01 14:14:44 user nova-compute[72129]:     <smbios mode="sysinfo"/>
Aug 01 14:14:44 user nova-compute[72129]:   </os>
Aug 01 14:14:44 user nova-compute[72129]:   <features>
Aug 01 14:14:44 user nova-compute[72129]:     <acpi/>
Aug 01 14:14:44 user nova-compute[72129]:     <apic/>
Aug 01 14:14:44 user nova-compute[72129]:     <vmcoreinfo/>
Aug 01 14:14:44 user nova-compute[72129]:   </features>
Aug 01 14:14:44 user nova-compute[72129]:   <clock offset="utc">
Aug 01 14:14:44 user nova-compute[72129]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 14:14:44 user nova-compute[72129]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 14:14:44 user nova-compute[72129]:     <timer name="hpet" present="no"/>
Aug 01 14:14:44 user nova-compute[72129]:   </clock>
Aug 01 14:14:44 user nova-compute[72129]:   <cpu mode="custom" match="exact">
Aug 01 14:14:44 user nova-compute[72129]:     <model>Nehalem</model>
Aug 01 14:14:44 user nova-compute[72129]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 14:14:44 user nova-compute[72129]:   </cpu>
Aug 01 14:14:44 user nova-compute[72129]:   <devices>
Aug 01 14:14:44 user nova-compute[72129]:     <disk type="file" device="disk">
Aug 01 14:14:44 user nova-compute[72129]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 14:14:44 user nova-compute[72129]:       <source file="/opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk"/>
Aug 01 14:14:44 user nova-compute[72129]:       <target dev="vda" bus="virtio"/>
Aug 01 14:14:44 user nova-compute[72129]:     </disk>
Aug 01 14:14:44 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 14:14:44 user nova-compute[72129]:       <mac address="fa:16:3e:d2:d6:8b"/>
Aug 01 14:14:44 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:14:44 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 14:14:44 user nova-compute[72129]:       <target dev="tap77cb18a9-2c"/>
Aug 01 14:14:44 user nova-compute[72129]:     </interface>
Aug 01 14:14:44 user nova-compute[72129]:     <serial type="pty">
Aug 01 14:14:44 user nova-compute[72129]:       <log file="/opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/console.log" append="off"/>
Aug 01 14:14:44 user nova-compute[72129]:     </serial>
Aug 01 14:14:44 user nova-compute[72129]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 14:14:44 user nova-compute[72129]:     <video>
Aug 01 14:14:44 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:14:44 user nova-compute[72129]:     </video>
Aug 01 14:14:44 user nova-compute[72129]:     <rng model="virtio">
Aug 01 14:14:44 user nova-compute[72129]:       <backend model="random">/dev/urandom</backend>
Aug 01 14:14:44 user nova-compute[72129]:     </rng>
Aug 01 14:14:44 user nova-compute[72129]:     <controller type="usb" index="0" model="none"/>
Aug 01 14:14:44 user nova-compute[72129]:     <memballoon model="virtio">
Aug 01 14:14:44 user nova-compute[72129]:       <stats period="10"/>
Aug 01 14:14:44 user nova-compute[72129]:     </memballoon>
Aug 01 14:14:44 user nova-compute[72129]:   </devices>
Aug 01 14:14:44 user nova-compute[72129]: </domain>
Aug 01 14:14:44 user nova-compute[72129]:  {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 14:14:44 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:14:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-998646471',display_name='tempest-ServerRescueNegativeTestJSON-server-998646471',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-998646471',id=41,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42cca3e17d4e4df79c94c4b94fb3fcec',ramdisk_id='',reservation_id='r-3w5r0zro',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-481576424',owner_user_name='tempest-ServerRescueNegativeTestJSON-481576424-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T14:14:42Z,user_data=None,user_id='deb1597afdc647598ee893dd51880173',uuid=b3f54430-8d5d-478b-8dc7-d7592ee3db36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77cb18a9-2c41-4aa6-8784-ffcbafeb1341", "address": "fa:16:3e:d2:d6:8b", "network": {"id": "6ffcec16-7b44-472a-b7cd-af16ebd4a653", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-901464581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cca3e17d4e4df79c94c4b94fb3fcec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77cb18a9-2c", "ovs_interfaceid": "77cb18a9-2c41-4aa6-8784-ffcbafeb1341", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 14:14:44 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Converting VIF {"id": "77cb18a9-2c41-4aa6-8784-ffcbafeb1341", "address": "fa:16:3e:d2:d6:8b", "network": {"id": "6ffcec16-7b44-472a-b7cd-af16ebd4a653", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-901464581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cca3e17d4e4df79c94c4b94fb3fcec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77cb18a9-2c", "ovs_interfaceid": "77cb18a9-2c41-4aa6-8784-ffcbafeb1341", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:14:44 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:d6:8b,bridge_name='br-int',has_traffic_filtering=True,id=77cb18a9-2c41-4aa6-8784-ffcbafeb1341,network=Network(6ffcec16-7b44-472a-b7cd-af16ebd4a653),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77cb18a9-2c') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:14:44 user nova-compute[72129]: DEBUG os_vif [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:d6:8b,bridge_name='br-int',has_traffic_filtering=True,id=77cb18a9-2c41-4aa6-8784-ffcbafeb1341,network=Network(6ffcec16-7b44-472a-b7cd-af16ebd4a653),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77cb18a9-2c') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 14:14:44 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:14:44 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:14:44 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 14:14:44 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:14:44 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap77cb18a9-2c, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:14:44 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap77cb18a9-2c, col_values=(('external_ids', {'iface-id': '77cb18a9-2c41-4aa6-8784-ffcbafeb1341', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:d6:8b', 'vm-uuid': 'b3f54430-8d5d-478b-8dc7-d7592ee3db36'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:14:44 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:14:44 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:14:44 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:14:44 user nova-compute[72129]: INFO os_vif [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:d6:8b,bridge_name='br-int',has_traffic_filtering=True,id=77cb18a9-2c41-4aa6-8784-ffcbafeb1341,network=Network(6ffcec16-7b44-472a-b7cd-af16ebd4a653),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77cb18a9-2c')
Aug 01 14:14:44 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:14:44 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] No VIF found with MAC fa:16:3e:d2:d6:8b, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 14:14:44 user nova-compute[72129]: DEBUG nova.network.neutron [req-993e1641-d322-4b3a-848b-b24fc6333aa5 req-073ef941-e2f8-4603-807b-ada84460f252 service nova] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Updated VIF entry in instance network info cache for port 77cb18a9-2c41-4aa6-8784-ffcbafeb1341. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 14:14:44 user nova-compute[72129]: DEBUG nova.network.neutron [req-993e1641-d322-4b3a-848b-b24fc6333aa5 req-073ef941-e2f8-4603-807b-ada84460f252 service nova] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Updating instance_info_cache with network_info: [{"id": "77cb18a9-2c41-4aa6-8784-ffcbafeb1341", "address": "fa:16:3e:d2:d6:8b", "network": {"id": "6ffcec16-7b44-472a-b7cd-af16ebd4a653", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-901464581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cca3e17d4e4df79c94c4b94fb3fcec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77cb18a9-2c", "ovs_interfaceid": "77cb18a9-2c41-4aa6-8784-ffcbafeb1341", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:14:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-993e1641-d322-4b3a-848b-b24fc6333aa5 req-073ef941-e2f8-4603-807b-ada84460f252 service nova] Releasing lock "refresh_cache-b3f54430-8d5d-478b-8dc7-d7592ee3db36" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:14:44 user nova-compute[72129]: DEBUG nova.network.neutron [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Successfully updated port: 10889d2c-ec62-4b92-b325-0f5d7d67851f {{(pid=72129) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 14:14:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Acquiring lock "refresh_cache-3bdb8e41-8cd5-4c33-9624-d262cacd0f5d" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:14:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Acquired lock "refresh_cache-3bdb8e41-8cd5-4c33-9624-d262cacd0f5d" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:14:44 user nova-compute[72129]: DEBUG nova.network.neutron [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 14:14:44 user nova-compute[72129]: DEBUG nova.compute.manager [req-1f359e53-c098-406e-986b-ea51cf8c54d3 req-d748e71c-bb40-412f-a861-f27b8e7e1d56 service nova] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Received event network-changed-10889d2c-ec62-4b92-b325-0f5d7d67851f {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:14:44 user nova-compute[72129]: DEBUG nova.compute.manager [req-1f359e53-c098-406e-986b-ea51cf8c54d3 req-d748e71c-bb40-412f-a861-f27b8e7e1d56 service nova] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Refreshing instance network info cache due to event network-changed-10889d2c-ec62-4b92-b325-0f5d7d67851f. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 14:14:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-1f359e53-c098-406e-986b-ea51cf8c54d3 req-d748e71c-bb40-412f-a861-f27b8e7e1d56 service nova] Acquiring lock "refresh_cache-3bdb8e41-8cd5-4c33-9624-d262cacd0f5d" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:14:44 user nova-compute[72129]: DEBUG nova.network.neutron [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Instance cache missing network info. {{(pid=72129) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 14:14:45 user nova-compute[72129]: DEBUG nova.network.neutron [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Updating instance_info_cache with network_info: [{"id": "10889d2c-ec62-4b92-b325-0f5d7d67851f", "address": "fa:16:3e:52:40:4c", "network": {"id": "6ffcec16-7b44-472a-b7cd-af16ebd4a653", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-901464581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cca3e17d4e4df79c94c4b94fb3fcec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10889d2c-ec", "ovs_interfaceid": "10889d2c-ec62-4b92-b325-0f5d7d67851f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:14:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Releasing lock "refresh_cache-3bdb8e41-8cd5-4c33-9624-d262cacd0f5d" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:14:45 user nova-compute[72129]: DEBUG nova.compute.manager [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Instance network_info: |[{"id": "10889d2c-ec62-4b92-b325-0f5d7d67851f", "address": "fa:16:3e:52:40:4c", "network": {"id": "6ffcec16-7b44-472a-b7cd-af16ebd4a653", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-901464581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cca3e17d4e4df79c94c4b94fb3fcec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10889d2c-ec", "ovs_interfaceid": "10889d2c-ec62-4b92-b325-0f5d7d67851f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 14:14:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-1f359e53-c098-406e-986b-ea51cf8c54d3 req-d748e71c-bb40-412f-a861-f27b8e7e1d56 service nova] Acquired lock "refresh_cache-3bdb8e41-8cd5-4c33-9624-d262cacd0f5d" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:14:45 user nova-compute[72129]: DEBUG nova.network.neutron [req-1f359e53-c098-406e-986b-ea51cf8c54d3 req-d748e71c-bb40-412f-a861-f27b8e7e1d56 service nova] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Refreshing network info cache for port 10889d2c-ec62-4b92-b325-0f5d7d67851f {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 14:14:45 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Start _get_guest_xml network_info=[{"id": "10889d2c-ec62-4b92-b325-0f5d7d67851f", "address": "fa:16:3e:52:40:4c", "network": {"id": "6ffcec16-7b44-472a-b7cd-af16ebd4a653", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-901464581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cca3e17d4e4df79c94c4b94fb3fcec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10889d2c-ec", "ovs_interfaceid": "10889d2c-ec62-4b92-b325-0f5d7d67851f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'image_id': 'b6472c34-1b0f-4034-ba3a-7e8eb5103715'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 14:14:45 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:14:45 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:14:45 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 14:14:45 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] CPU controller missing on host. {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 14:14:45 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 14:14:45 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] CPU controller found on host. {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 14:14:45 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72129) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 14:14:45 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T13:45:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 14:14:45 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Flavor limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 14:14:45 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Image limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 14:14:45 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Flavor pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 14:14:45 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Image pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 14:14:45 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 14:14:45 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 14:14:45 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 14:14:45 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Got 1 possible topologies {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 14:14:45 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 14:14:45 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 14:14:45 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:14:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1844594790',display_name='tempest-ServerRescueNegativeTestJSON-server-1844594790',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1844594790',id=42,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42cca3e17d4e4df79c94c4b94fb3fcec',ramdisk_id='',reservation_id='r-qb9lk1yt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-481576424',owner_user_name='tempest-ServerRescueNegativeTestJSON-481576424-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T14:14:43Z,user_data=None,user_id='deb1597afdc647598ee893dd51880173',uuid=3bdb8e41-8cd5-4c33-9624-d262cacd0f5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10889d2c-ec62-4b92-b325-0f5d7d67851f", "address": "fa:16:3e:52:40:4c", "network": {"id": "6ffcec16-7b44-472a-b7cd-af16ebd4a653", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-901464581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cca3e17d4e4df79c94c4b94fb3fcec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10889d2c-ec", "ovs_interfaceid": "10889d2c-ec62-4b92-b325-0f5d7d67851f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 14:14:45 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Converting VIF {"id": "10889d2c-ec62-4b92-b325-0f5d7d67851f", "address": "fa:16:3e:52:40:4c", "network": {"id": "6ffcec16-7b44-472a-b7cd-af16ebd4a653", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-901464581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cca3e17d4e4df79c94c4b94fb3fcec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10889d2c-ec", "ovs_interfaceid": "10889d2c-ec62-4b92-b325-0f5d7d67851f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:14:45 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:40:4c,bridge_name='br-int',has_traffic_filtering=True,id=10889d2c-ec62-4b92-b325-0f5d7d67851f,network=Network(6ffcec16-7b44-472a-b7cd-af16ebd4a653),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10889d2c-ec') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:14:45 user nova-compute[72129]: DEBUG nova.objects.instance [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lazy-loading 'pci_devices' on Instance uuid 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:14:45 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] End _get_guest_xml xml=<domain type="kvm">
Aug 01 14:14:45 user nova-compute[72129]:   <uuid>3bdb8e41-8cd5-4c33-9624-d262cacd0f5d</uuid>
Aug 01 14:14:45 user nova-compute[72129]:   <name>instance-0000002a</name>
Aug 01 14:14:45 user nova-compute[72129]:   <memory>524288</memory>
Aug 01 14:14:45 user nova-compute[72129]:   <vcpu>1</vcpu>
Aug 01 14:14:45 user nova-compute[72129]:   <metadata>
Aug 01 14:14:45 user nova-compute[72129]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 14:14:45 user nova-compute[72129]:       <nova:package version="0.0.0"/>
Aug 01 14:14:45 user nova-compute[72129]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1844594790</nova:name>
Aug 01 14:14:45 user nova-compute[72129]:       <nova:creationTime>2023-08-01 14:14:45</nova:creationTime>
Aug 01 14:14:45 user nova-compute[72129]:       <nova:flavor name="m1.tiny">
Aug 01 14:14:45 user nova-compute[72129]:         <nova:memory>512</nova:memory>
Aug 01 14:14:45 user nova-compute[72129]:         <nova:disk>1</nova:disk>
Aug 01 14:14:45 user nova-compute[72129]:         <nova:swap>0</nova:swap>
Aug 01 14:14:45 user nova-compute[72129]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 14:14:45 user nova-compute[72129]:         <nova:vcpus>1</nova:vcpus>
Aug 01 14:14:45 user nova-compute[72129]:       </nova:flavor>
Aug 01 14:14:45 user nova-compute[72129]:       <nova:owner>
Aug 01 14:14:45 user nova-compute[72129]:         <nova:user uuid="deb1597afdc647598ee893dd51880173">tempest-ServerRescueNegativeTestJSON-481576424-project-member</nova:user>
Aug 01 14:14:45 user nova-compute[72129]:         <nova:project uuid="42cca3e17d4e4df79c94c4b94fb3fcec">tempest-ServerRescueNegativeTestJSON-481576424</nova:project>
Aug 01 14:14:45 user nova-compute[72129]:       </nova:owner>
Aug 01 14:14:45 user nova-compute[72129]:       <nova:root type="image" uuid="b6472c34-1b0f-4034-ba3a-7e8eb5103715"/>
Aug 01 14:14:45 user nova-compute[72129]:       <nova:ports>
Aug 01 14:14:45 user nova-compute[72129]:         <nova:port uuid="10889d2c-ec62-4b92-b325-0f5d7d67851f">
Aug 01 14:14:45 user nova-compute[72129]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 01 14:14:45 user nova-compute[72129]:         </nova:port>
Aug 01 14:14:45 user nova-compute[72129]:       </nova:ports>
Aug 01 14:14:45 user nova-compute[72129]:     </nova:instance>
Aug 01 14:14:45 user nova-compute[72129]:   </metadata>
Aug 01 14:14:45 user nova-compute[72129]:   <sysinfo type="smbios">
Aug 01 14:14:45 user nova-compute[72129]:     <system>
Aug 01 14:14:45 user nova-compute[72129]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 14:14:45 user nova-compute[72129]:       <entry name="product">OpenStack Nova</entry>
Aug 01 14:14:45 user nova-compute[72129]:       <entry name="version">0.0.0</entry>
Aug 01 14:14:45 user nova-compute[72129]:       <entry name="serial">3bdb8e41-8cd5-4c33-9624-d262cacd0f5d</entry>
Aug 01 14:14:45 user nova-compute[72129]:       <entry name="uuid">3bdb8e41-8cd5-4c33-9624-d262cacd0f5d</entry>
Aug 01 14:14:45 user nova-compute[72129]:       <entry name="family">Virtual Machine</entry>
Aug 01 14:14:45 user nova-compute[72129]:     </system>
Aug 01 14:14:45 user nova-compute[72129]:   </sysinfo>
Aug 01 14:14:45 user nova-compute[72129]:   <os>
Aug 01 14:14:45 user nova-compute[72129]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 14:14:45 user nova-compute[72129]:     <boot dev="hd"/>
Aug 01 14:14:45 user nova-compute[72129]:     <smbios mode="sysinfo"/>
Aug 01 14:14:45 user nova-compute[72129]:   </os>
Aug 01 14:14:45 user nova-compute[72129]:   <features>
Aug 01 14:14:45 user nova-compute[72129]:     <acpi/>
Aug 01 14:14:45 user nova-compute[72129]:     <apic/>
Aug 01 14:14:45 user nova-compute[72129]:     <vmcoreinfo/>
Aug 01 14:14:45 user nova-compute[72129]:   </features>
Aug 01 14:14:45 user nova-compute[72129]:   <clock offset="utc">
Aug 01 14:14:45 user nova-compute[72129]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 14:14:45 user nova-compute[72129]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 14:14:45 user nova-compute[72129]:     <timer name="hpet" present="no"/>
Aug 01 14:14:45 user nova-compute[72129]:   </clock>
Aug 01 14:14:45 user nova-compute[72129]:   <cpu mode="custom" match="exact">
Aug 01 14:14:45 user nova-compute[72129]:     <model>Nehalem</model>
Aug 01 14:14:45 user nova-compute[72129]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 14:14:45 user nova-compute[72129]:   </cpu>
Aug 01 14:14:45 user nova-compute[72129]:   <devices>
Aug 01 14:14:45 user nova-compute[72129]:     <disk type="file" device="disk">
Aug 01 14:14:45 user nova-compute[72129]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 14:14:45 user nova-compute[72129]:       <source file="/opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk"/>
Aug 01 14:14:45 user nova-compute[72129]:       <target dev="vda" bus="virtio"/>
Aug 01 14:14:45 user nova-compute[72129]:     </disk>
Aug 01 14:14:45 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 14:14:45 user nova-compute[72129]:       <mac address="fa:16:3e:52:40:4c"/>
Aug 01 14:14:45 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:14:45 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 14:14:45 user nova-compute[72129]:       <target dev="tap10889d2c-ec"/>
Aug 01 14:14:45 user nova-compute[72129]:     </interface>
Aug 01 14:14:45 user nova-compute[72129]:     <serial type="pty">
Aug 01 14:14:45 user nova-compute[72129]:       <log file="/opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/console.log" append="off"/>
Aug 01 14:14:45 user nova-compute[72129]:     </serial>
Aug 01 14:14:45 user nova-compute[72129]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 14:14:45 user nova-compute[72129]:     <video>
Aug 01 14:14:45 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:14:45 user nova-compute[72129]:     </video>
Aug 01 14:14:45 user nova-compute[72129]:     <rng model="virtio">
Aug 01 14:14:45 user nova-compute[72129]:       <backend model="random">/dev/urandom</backend>
Aug 01 14:14:45 user nova-compute[72129]:     </rng>
Aug 01 14:14:45 user nova-compute[72129]:     <controller type="usb" index="0" model="none"/>
Aug 01 14:14:45 user nova-compute[72129]:     <memballoon model="virtio">
Aug 01 14:14:45 user nova-compute[72129]:       <stats period="10"/>
Aug 01 14:14:45 user nova-compute[72129]:     </memballoon>
Aug 01 14:14:45 user nova-compute[72129]:   </devices>
Aug 01 14:14:45 user nova-compute[72129]: </domain>
Aug 01 14:14:45 user nova-compute[72129]:  {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 14:14:45 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:14:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1844594790',display_name='tempest-ServerRescueNegativeTestJSON-server-1844594790',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1844594790',id=42,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42cca3e17d4e4df79c94c4b94fb3fcec',ramdisk_id='',reservation_id='r-qb9lk1yt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-481576424',owner_user_name='tempest-ServerRescueNegativeTestJSON-481576424-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T14:14:43Z,user_data=None,user_id='deb1597afdc647598ee893dd51880173',uuid=3bdb8e41-8cd5-4c33-9624-d262cacd0f5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10889d2c-ec62-4b92-b325-0f5d7d67851f", "address": "fa:16:3e:52:40:4c", "network": {"id": "6ffcec16-7b44-472a-b7cd-af16ebd4a653", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-901464581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cca3e17d4e4df79c94c4b94fb3fcec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10889d2c-ec", "ovs_interfaceid": "10889d2c-ec62-4b92-b325-0f5d7d67851f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 14:14:45 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Converting VIF {"id": "10889d2c-ec62-4b92-b325-0f5d7d67851f", "address": "fa:16:3e:52:40:4c", "network": {"id": "6ffcec16-7b44-472a-b7cd-af16ebd4a653", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-901464581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cca3e17d4e4df79c94c4b94fb3fcec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10889d2c-ec", "ovs_interfaceid": "10889d2c-ec62-4b92-b325-0f5d7d67851f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:14:45 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:40:4c,bridge_name='br-int',has_traffic_filtering=True,id=10889d2c-ec62-4b92-b325-0f5d7d67851f,network=Network(6ffcec16-7b44-472a-b7cd-af16ebd4a653),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10889d2c-ec') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:14:45 user nova-compute[72129]: DEBUG os_vif [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:40:4c,bridge_name='br-int',has_traffic_filtering=True,id=10889d2c-ec62-4b92-b325-0f5d7d67851f,network=Network(6ffcec16-7b44-472a-b7cd-af16ebd4a653),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10889d2c-ec') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 14:14:45 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:14:45 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:14:45 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 14:14:45 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:14:45 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap10889d2c-ec, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:14:45 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap10889d2c-ec, col_values=(('external_ids', {'iface-id': '10889d2c-ec62-4b92-b325-0f5d7d67851f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:40:4c', 'vm-uuid': '3bdb8e41-8cd5-4c33-9624-d262cacd0f5d'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:14:45 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:14:45 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:14:45 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:14:45 user nova-compute[72129]: INFO os_vif [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:40:4c,bridge_name='br-int',has_traffic_filtering=True,id=10889d2c-ec62-4b92-b325-0f5d7d67851f,network=Network(6ffcec16-7b44-472a-b7cd-af16ebd4a653),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10889d2c-ec')
Aug 01 14:14:45 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:14:45 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] No VIF found with MAC fa:16:3e:52:40:4c, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 14:14:45 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:14:45 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:14:45 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:14:45 user nova-compute[72129]: DEBUG nova.compute.manager [req-c2f04fd6-26e7-46cd-bad4-c65b063dff9d req-79ad1097-df4d-4615-a515-72087d4ac432 service nova] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Received event network-vif-plugged-77cb18a9-2c41-4aa6-8784-ffcbafeb1341 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:14:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-c2f04fd6-26e7-46cd-bad4-c65b063dff9d req-79ad1097-df4d-4615-a515-72087d4ac432 service nova] Acquiring lock "b3f54430-8d5d-478b-8dc7-d7592ee3db36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:14:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-c2f04fd6-26e7-46cd-bad4-c65b063dff9d req-79ad1097-df4d-4615-a515-72087d4ac432 service nova] Lock "b3f54430-8d5d-478b-8dc7-d7592ee3db36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:14:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-c2f04fd6-26e7-46cd-bad4-c65b063dff9d req-79ad1097-df4d-4615-a515-72087d4ac432 service nova] Lock "b3f54430-8d5d-478b-8dc7-d7592ee3db36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:14:45 user nova-compute[72129]: DEBUG nova.compute.manager [req-c2f04fd6-26e7-46cd-bad4-c65b063dff9d req-79ad1097-df4d-4615-a515-72087d4ac432 service nova] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] No waiting events found dispatching network-vif-plugged-77cb18a9-2c41-4aa6-8784-ffcbafeb1341 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:14:45 user nova-compute[72129]: WARNING nova.compute.manager [req-c2f04fd6-26e7-46cd-bad4-c65b063dff9d req-79ad1097-df4d-4615-a515-72087d4ac432 service nova] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Received unexpected event network-vif-plugged-77cb18a9-2c41-4aa6-8784-ffcbafeb1341 for instance with vm_state building and task_state spawning.
Aug 01 14:14:45 user nova-compute[72129]: DEBUG nova.network.neutron [req-1f359e53-c098-406e-986b-ea51cf8c54d3 req-d748e71c-bb40-412f-a861-f27b8e7e1d56 service nova] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Updated VIF entry in instance network info cache for port 10889d2c-ec62-4b92-b325-0f5d7d67851f. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 14:14:45 user nova-compute[72129]: DEBUG nova.network.neutron [req-1f359e53-c098-406e-986b-ea51cf8c54d3 req-d748e71c-bb40-412f-a861-f27b8e7e1d56 service nova] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Updating instance_info_cache with network_info: [{"id": "10889d2c-ec62-4b92-b325-0f5d7d67851f", "address": "fa:16:3e:52:40:4c", "network": {"id": "6ffcec16-7b44-472a-b7cd-af16ebd4a653", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-901464581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cca3e17d4e4df79c94c4b94fb3fcec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10889d2c-ec", "ovs_interfaceid": "10889d2c-ec62-4b92-b325-0f5d7d67851f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:14:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-1f359e53-c098-406e-986b-ea51cf8c54d3 req-d748e71c-bb40-412f-a861-f27b8e7e1d56 service nova] Releasing lock "refresh_cache-3bdb8e41-8cd5-4c33-9624-d262cacd0f5d" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:14:45 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:14:45 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:14:45 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:14:45 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:14:46 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:14:46 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:14:46 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:14:46 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:14:47 user nova-compute[72129]: DEBUG nova.compute.manager [req-81590c95-793d-422b-8841-a1568b34bfb7 req-65a124f2-81a3-4abc-81da-35984b8e7ca4 service nova] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Received event network-vif-plugged-10889d2c-ec62-4b92-b325-0f5d7d67851f {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:14:47 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-81590c95-793d-422b-8841-a1568b34bfb7 req-65a124f2-81a3-4abc-81da-35984b8e7ca4 service nova] Acquiring lock "3bdb8e41-8cd5-4c33-9624-d262cacd0f5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:14:47 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-81590c95-793d-422b-8841-a1568b34bfb7 req-65a124f2-81a3-4abc-81da-35984b8e7ca4 service nova] Lock "3bdb8e41-8cd5-4c33-9624-d262cacd0f5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:14:47 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-81590c95-793d-422b-8841-a1568b34bfb7 req-65a124f2-81a3-4abc-81da-35984b8e7ca4 service nova] Lock "3bdb8e41-8cd5-4c33-9624-d262cacd0f5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:14:47 user nova-compute[72129]: DEBUG nova.compute.manager [req-81590c95-793d-422b-8841-a1568b34bfb7 req-65a124f2-81a3-4abc-81da-35984b8e7ca4 service nova] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] No waiting events found dispatching network-vif-plugged-10889d2c-ec62-4b92-b325-0f5d7d67851f {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:14:47 user nova-compute[72129]: WARNING nova.compute.manager [req-81590c95-793d-422b-8841-a1568b34bfb7 req-65a124f2-81a3-4abc-81da-35984b8e7ca4 service nova] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Received unexpected event network-vif-plugged-10889d2c-ec62-4b92-b325-0f5d7d67851f for instance with vm_state building and task_state spawning.
Aug 01 14:14:47 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:14:47 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:14:47 user nova-compute[72129]: DEBUG nova.compute.manager [req-5d50015d-766e-4ce0-a2b5-a7e6275859d6 req-db467c95-d7df-49fe-857a-f90545a9a564 service nova] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Received event network-vif-plugged-77cb18a9-2c41-4aa6-8784-ffcbafeb1341 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:14:47 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-5d50015d-766e-4ce0-a2b5-a7e6275859d6 req-db467c95-d7df-49fe-857a-f90545a9a564 service nova] Acquiring lock "b3f54430-8d5d-478b-8dc7-d7592ee3db36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:14:47 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-5d50015d-766e-4ce0-a2b5-a7e6275859d6 req-db467c95-d7df-49fe-857a-f90545a9a564 service nova] Lock "b3f54430-8d5d-478b-8dc7-d7592ee3db36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:14:47 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-5d50015d-766e-4ce0-a2b5-a7e6275859d6 req-db467c95-d7df-49fe-857a-f90545a9a564 service nova] Lock "b3f54430-8d5d-478b-8dc7-d7592ee3db36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:14:47 user nova-compute[72129]: DEBUG nova.compute.manager [req-5d50015d-766e-4ce0-a2b5-a7e6275859d6 req-db467c95-d7df-49fe-857a-f90545a9a564 service nova] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] No waiting events found dispatching network-vif-plugged-77cb18a9-2c41-4aa6-8784-ffcbafeb1341 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:14:47 user nova-compute[72129]: WARNING nova.compute.manager [req-5d50015d-766e-4ce0-a2b5-a7e6275859d6 req-db467c95-d7df-49fe-857a-f90545a9a564 service nova] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Received unexpected event network-vif-plugged-77cb18a9-2c41-4aa6-8784-ffcbafeb1341 for instance with vm_state building and task_state spawning.
Aug 01 14:14:48 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690899288.553357, b3f54430-8d5d-478b-8dc7-d7592ee3db36 => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:14:48 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] VM Resumed (Lifecycle Event)
Aug 01 14:14:48 user nova-compute[72129]: DEBUG nova.compute.manager [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Instance event wait completed in 0 seconds for  {{(pid=72129) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 14:14:48 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Guest created on hypervisor {{(pid=72129) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 14:14:48 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Instance spawned successfully.
Aug 01 14:14:48 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 14:14:48 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:14:48 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:14:48 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Found default for hw_cdrom_bus of ide {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:14:48 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Found default for hw_disk_bus of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:14:48 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Found default for hw_input_bus of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:14:48 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Found default for hw_pointer_model of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:14:48 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Found default for hw_video_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:14:48 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Found default for hw_vif_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:14:48 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 14:14:48 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690899288.5549505, b3f54430-8d5d-478b-8dc7-d7592ee3db36 => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:14:48 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] VM Started (Lifecycle Event)
Aug 01 14:14:48 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:14:48 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:14:48 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 14:14:48 user nova-compute[72129]: INFO nova.compute.manager [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Took 6.65 seconds to spawn the instance on the hypervisor.
Aug 01 14:14:48 user nova-compute[72129]: DEBUG nova.compute.manager [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:14:48 user nova-compute[72129]: INFO nova.compute.manager [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Took 7.52 seconds to build instance.
Aug 01 14:14:48 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c3617266-544f-4bd2-9fd3-9fbc110eb2e0 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lock "b3f54430-8d5d-478b-8dc7-d7592ee3db36" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.623s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:14:49 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690899289.054011, 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:14:49 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] VM Resumed (Lifecycle Event)
Aug 01 14:14:49 user nova-compute[72129]: DEBUG nova.compute.manager [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Instance event wait completed in 0 seconds for  {{(pid=72129) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 14:14:49 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Guest created on hypervisor {{(pid=72129) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 14:14:49 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Instance spawned successfully.
Aug 01 14:14:49 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 14:14:49 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:14:49 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:14:49 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Found default for hw_cdrom_bus of ide {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:14:49 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Found default for hw_disk_bus of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:14:49 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Found default for hw_input_bus of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:14:49 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Found default for hw_pointer_model of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:14:49 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Found default for hw_video_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:14:49 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Found default for hw_vif_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:14:49 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 14:14:49 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690899289.0568807, 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:14:49 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] VM Started (Lifecycle Event)
Aug 01 14:14:49 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:14:49 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:14:49 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 14:14:49 user nova-compute[72129]: DEBUG nova.compute.manager [req-c23f0c36-34ec-4286-93c6-6bdb5880cb92 req-87b8777d-610b-4ef1-a026-1a948e90ed03 service nova] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Received event network-vif-plugged-10889d2c-ec62-4b92-b325-0f5d7d67851f {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:14:49 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-c23f0c36-34ec-4286-93c6-6bdb5880cb92 req-87b8777d-610b-4ef1-a026-1a948e90ed03 service nova] Acquiring lock "3bdb8e41-8cd5-4c33-9624-d262cacd0f5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:14:49 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-c23f0c36-34ec-4286-93c6-6bdb5880cb92 req-87b8777d-610b-4ef1-a026-1a948e90ed03 service nova] Lock "3bdb8e41-8cd5-4c33-9624-d262cacd0f5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:14:49 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-c23f0c36-34ec-4286-93c6-6bdb5880cb92 req-87b8777d-610b-4ef1-a026-1a948e90ed03 service nova] Lock "3bdb8e41-8cd5-4c33-9624-d262cacd0f5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:14:49 user nova-compute[72129]: DEBUG nova.compute.manager [req-c23f0c36-34ec-4286-93c6-6bdb5880cb92 req-87b8777d-610b-4ef1-a026-1a948e90ed03 service nova] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] No waiting events found dispatching network-vif-plugged-10889d2c-ec62-4b92-b325-0f5d7d67851f {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:14:49 user nova-compute[72129]: WARNING nova.compute.manager [req-c23f0c36-34ec-4286-93c6-6bdb5880cb92 req-87b8777d-610b-4ef1-a026-1a948e90ed03 service nova] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Received unexpected event network-vif-plugged-10889d2c-ec62-4b92-b325-0f5d7d67851f for instance with vm_state building and task_state spawning.
Aug 01 14:14:49 user nova-compute[72129]: INFO nova.compute.manager [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Took 6.01 seconds to spawn the instance on the hypervisor.
Aug 01 14:14:49 user nova-compute[72129]: DEBUG nova.compute.manager [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:14:49 user nova-compute[72129]: INFO nova.compute.manager [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Took 6.62 seconds to build instance.
Aug 01 14:14:49 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a3b0982f-6f8a-41ad-813d-214a92deba83 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lock "3bdb8e41-8cd5-4c33-9624-d262cacd0f5d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.797s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:14:50 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:14:51 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:14:52 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:14:52 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72129) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 14:14:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:14:56 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:14:56 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Starting heal instance info cache {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 14:14:56 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "refresh_cache-89fdfdab-36a6-4481-bfa7-376c3a3a32ae" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:14:56 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquired lock "refresh_cache-89fdfdab-36a6-4481-bfa7-376c3a3a32ae" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:14:56 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Forcefully refreshing network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 14:14:56 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:14:56 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Updating instance_info_cache with network_info: [{"id": "778ce9fe-90f9-4d7f-98be-51407fc6520a", "address": "fa:16:3e:9f:0b:54", "network": {"id": "46796a3e-328f-4641-82aa-77c1d2c6c9cb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-446403350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b34cc88cb64d6fbdc5e2688f6767d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap778ce9fe-90", "ovs_interfaceid": "778ce9fe-90f9-4d7f-98be-51407fc6520a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:14:56 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Releasing lock "refresh_cache-89fdfdab-36a6-4481-bfa7-376c3a3a32ae" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:14:56 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Updated the network info_cache for instance {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 14:14:57 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:14:58 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:15:00 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:15:00 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:15:00 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:15:00 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:15:00 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:15:00 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Auditing locally available compute resources for user (node: user) {{(pid=72129) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 14:15:00 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89fdfdab-36a6-4481-bfa7-376c3a3a32ae/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:15:00 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:15:00 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89fdfdab-36a6-4481-bfa7-376c3a3a32ae/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:15:00 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89fdfdab-36a6-4481-bfa7-376c3a3a32ae/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:15:00 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89fdfdab-36a6-4481-bfa7-376c3a3a32ae/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:15:00 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3a4469-30fd-4f27-a3b7-957422dd2746/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:15:00 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3a4469-30fd-4f27-a3b7-957422dd2746/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:15:00 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3a4469-30fd-4f27-a3b7-957422dd2746/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:15:00 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3a4469-30fd-4f27-a3b7-957422dd2746/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:15:00 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:15:00 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:15:00 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:15:01 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:15:01 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0714c157-056f-4f64-94f4-da5c8e5f6eda/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:15:01 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0714c157-056f-4f64-94f4-da5c8e5f6eda/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:15:01 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0714c157-056f-4f64-94f4-da5c8e5f6eda/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:15:01 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:15:01 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0714c157-056f-4f64-94f4-da5c8e5f6eda/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:15:01 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:15:01 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:15:01 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:15:01 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:15:02 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:15:02 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:15:02 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Hypervisor/Node resource view: name=user free_ram=8171MB free_disk=25.177959442138672GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72129) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 14:15:02 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:15:02 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:15:02 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 89fdfdab-36a6-4481-bfa7-376c3a3a32ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:15:02 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 0714c157-056f-4f64-94f4-da5c8e5f6eda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:15:02 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 5c3a4469-30fd-4f27-a3b7-957422dd2746 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:15:02 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance b3f54430-8d5d-478b-8dc7-d7592ee3db36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:15:02 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:15:02 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 14:15:02 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 14:15:02 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:15:02 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:15:02 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Compute_service record updated for user:user {{(pid=72129) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 14:15:02 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.378s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:15:03 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:15:03 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:15:03 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:15:05 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:15:06 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:15:06 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:15:10 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:15:10 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:15:11 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:15:15 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:15:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:15:19 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e52c6872-e42d-4458-8e9f-b634c59222ef tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Acquiring lock "0714c157-056f-4f64-94f4-da5c8e5f6eda" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:15:19 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e52c6872-e42d-4458-8e9f-b634c59222ef tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Lock "0714c157-056f-4f64-94f4-da5c8e5f6eda" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:15:19 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e52c6872-e42d-4458-8e9f-b634c59222ef tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Acquiring lock "0714c157-056f-4f64-94f4-da5c8e5f6eda-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:15:19 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e52c6872-e42d-4458-8e9f-b634c59222ef tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Lock "0714c157-056f-4f64-94f4-da5c8e5f6eda-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:15:19 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e52c6872-e42d-4458-8e9f-b634c59222ef tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Lock "0714c157-056f-4f64-94f4-da5c8e5f6eda-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:15:19 user nova-compute[72129]: INFO nova.compute.manager [None req-e52c6872-e42d-4458-8e9f-b634c59222ef tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] Terminating instance
Aug 01 14:15:19 user nova-compute[72129]: DEBUG nova.compute.manager [None req-e52c6872-e42d-4458-8e9f-b634c59222ef tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] Start destroying the instance on the hypervisor. {{(pid=72129) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 14:15:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:15:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:15:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:15:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:15:19 user nova-compute[72129]: DEBUG nova.compute.manager [req-340fa15a-3553-422a-9985-41d1a31823c5 req-3dc80cd3-3373-4c8d-8fa0-c1111726606a service nova] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] Received event network-vif-unplugged-b1ecfcb5-5009-4b95-97ca-9949a6e42ddc {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:15:19 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-340fa15a-3553-422a-9985-41d1a31823c5 req-3dc80cd3-3373-4c8d-8fa0-c1111726606a service nova] Acquiring lock "0714c157-056f-4f64-94f4-da5c8e5f6eda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:15:19 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-340fa15a-3553-422a-9985-41d1a31823c5 req-3dc80cd3-3373-4c8d-8fa0-c1111726606a service nova] Lock "0714c157-056f-4f64-94f4-da5c8e5f6eda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:15:19 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-340fa15a-3553-422a-9985-41d1a31823c5 req-3dc80cd3-3373-4c8d-8fa0-c1111726606a service nova] Lock "0714c157-056f-4f64-94f4-da5c8e5f6eda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:15:19 user nova-compute[72129]: DEBUG nova.compute.manager [req-340fa15a-3553-422a-9985-41d1a31823c5 req-3dc80cd3-3373-4c8d-8fa0-c1111726606a service nova] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] No waiting events found dispatching network-vif-unplugged-b1ecfcb5-5009-4b95-97ca-9949a6e42ddc {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:15:19 user nova-compute[72129]: DEBUG nova.compute.manager [req-340fa15a-3553-422a-9985-41d1a31823c5 req-3dc80cd3-3373-4c8d-8fa0-c1111726606a service nova] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] Received event network-vif-unplugged-b1ecfcb5-5009-4b95-97ca-9949a6e42ddc for instance with task_state deleting. {{(pid=72129) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 14:15:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:15:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:15:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:15:20 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] Instance destroyed successfully.
Aug 01 14:15:20 user nova-compute[72129]: DEBUG nova.objects.instance [None req-e52c6872-e42d-4458-8e9f-b634c59222ef tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Lazy-loading 'resources' on Instance uuid 0714c157-056f-4f64-94f4-da5c8e5f6eda {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:15:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:15:20 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-e52c6872-e42d-4458-8e9f-b634c59222ef tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:13:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-979378732',display_name='tempest-VolumesActionsTest-instance-979378732',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-979378732',id=39,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T14:13:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e0854d064104497b8b0413ff9ff74a9',ramdisk_id='',reservation_id='r-lfdzvf5i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-2013737032',owner_user_name='tempest-VolumesActionsTest-2013737032-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T14:13:35Z,user_data=None,user_id='aef0a4c176f4428d941f9d922b17ea93',uuid=0714c157-056f-4f64-94f4-da5c8e5f6eda,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b1ecfcb5-5009-4b95-97ca-9949a6e42ddc", "address": "fa:16:3e:af:c6:c9", "network": {"id": "1fc5fd20-6ca3-45f2-93ee-ac80e3311897", "bridge": "br-int", "label": "tempest-VolumesActionsTest-878643555-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e0854d064104497b8b0413ff9ff74a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1ecfcb5-50", "ovs_interfaceid": "b1ecfcb5-5009-4b95-97ca-9949a6e42ddc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 14:15:20 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-e52c6872-e42d-4458-8e9f-b634c59222ef tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Converting VIF {"id": "b1ecfcb5-5009-4b95-97ca-9949a6e42ddc", "address": "fa:16:3e:af:c6:c9", "network": {"id": "1fc5fd20-6ca3-45f2-93ee-ac80e3311897", "bridge": "br-int", "label": "tempest-VolumesActionsTest-878643555-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e0854d064104497b8b0413ff9ff74a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1ecfcb5-50", "ovs_interfaceid": "b1ecfcb5-5009-4b95-97ca-9949a6e42ddc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:15:20 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-e52c6872-e42d-4458-8e9f-b634c59222ef tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:c6:c9,bridge_name='br-int',has_traffic_filtering=True,id=b1ecfcb5-5009-4b95-97ca-9949a6e42ddc,network=Network(1fc5fd20-6ca3-45f2-93ee-ac80e3311897),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1ecfcb5-50') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:15:20 user nova-compute[72129]: DEBUG os_vif [None req-e52c6872-e42d-4458-8e9f-b634c59222ef tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:c6:c9,bridge_name='br-int',has_traffic_filtering=True,id=b1ecfcb5-5009-4b95-97ca-9949a6e42ddc,network=Network(1fc5fd20-6ca3-45f2-93ee-ac80e3311897),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1ecfcb5-50') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 14:15:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:15:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb1ecfcb5-50, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:15:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:15:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:15:20 user nova-compute[72129]: INFO os_vif [None req-e52c6872-e42d-4458-8e9f-b634c59222ef tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:c6:c9,bridge_name='br-int',has_traffic_filtering=True,id=b1ecfcb5-5009-4b95-97ca-9949a6e42ddc,network=Network(1fc5fd20-6ca3-45f2-93ee-ac80e3311897),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1ecfcb5-50')
Aug 01 14:15:20 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-e52c6872-e42d-4458-8e9f-b634c59222ef tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] Deleting instance files /opt/stack/data/nova/instances/0714c157-056f-4f64-94f4-da5c8e5f6eda_del
Aug 01 14:15:20 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-e52c6872-e42d-4458-8e9f-b634c59222ef tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] Deletion of /opt/stack/data/nova/instances/0714c157-056f-4f64-94f4-da5c8e5f6eda_del complete
Aug 01 14:15:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:15:20 user nova-compute[72129]: INFO nova.compute.manager [None req-e52c6872-e42d-4458-8e9f-b634c59222ef tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] Took 0.67 seconds to destroy the instance on the hypervisor.
Aug 01 14:15:20 user nova-compute[72129]: DEBUG oslo.service.loopingcall [None req-e52c6872-e42d-4458-8e9f-b634c59222ef tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72129) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 14:15:20 user nova-compute[72129]: DEBUG nova.compute.manager [-] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] Deallocating network for instance {{(pid=72129) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 14:15:20 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] deallocate_for_instance() {{(pid=72129) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 14:15:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:15:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:15:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:15:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:15:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:15:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:15:21 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:15:21 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] Took 0.95 seconds to deallocate network for instance.
Aug 01 14:15:21 user nova-compute[72129]: DEBUG nova.compute.manager [req-e079deda-7c95-4919-907c-5ce15d00ee6f req-435b7995-39eb-40fb-8b66-e1b6d1d17cc5 service nova] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] Received event network-vif-deleted-b1ecfcb5-5009-4b95-97ca-9949a6e42ddc {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:15:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e52c6872-e42d-4458-8e9f-b634c59222ef tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:15:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e52c6872-e42d-4458-8e9f-b634c59222ef tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:15:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:15:21 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-e52c6872-e42d-4458-8e9f-b634c59222ef tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:15:21 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-e52c6872-e42d-4458-8e9f-b634c59222ef tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:15:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e52c6872-e42d-4458-8e9f-b634c59222ef tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.199s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:15:21 user nova-compute[72129]: INFO nova.scheduler.client.report [None req-e52c6872-e42d-4458-8e9f-b634c59222ef tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Deleted allocations for instance 0714c157-056f-4f64-94f4-da5c8e5f6eda
Aug 01 14:15:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e52c6872-e42d-4458-8e9f-b634c59222ef tempest-VolumesActionsTest-2013737032 tempest-VolumesActionsTest-2013737032-project-member] Lock "0714c157-056f-4f64-94f4-da5c8e5f6eda" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.999s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:15:21 user nova-compute[72129]: DEBUG nova.compute.manager [req-5082f7f7-d6fb-488b-a2bb-3e4b93894439 req-86c59a1e-6e86-4e03-8af6-8435a98e78c2 service nova] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] Received event network-vif-plugged-b1ecfcb5-5009-4b95-97ca-9949a6e42ddc {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:15:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-5082f7f7-d6fb-488b-a2bb-3e4b93894439 req-86c59a1e-6e86-4e03-8af6-8435a98e78c2 service nova] Acquiring lock "0714c157-056f-4f64-94f4-da5c8e5f6eda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:15:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-5082f7f7-d6fb-488b-a2bb-3e4b93894439 req-86c59a1e-6e86-4e03-8af6-8435a98e78c2 service nova] Lock "0714c157-056f-4f64-94f4-da5c8e5f6eda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:15:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-5082f7f7-d6fb-488b-a2bb-3e4b93894439 req-86c59a1e-6e86-4e03-8af6-8435a98e78c2 service nova] Lock "0714c157-056f-4f64-94f4-da5c8e5f6eda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:15:21 user nova-compute[72129]: DEBUG nova.compute.manager [req-5082f7f7-d6fb-488b-a2bb-3e4b93894439 req-86c59a1e-6e86-4e03-8af6-8435a98e78c2 service nova] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] No waiting events found dispatching network-vif-plugged-b1ecfcb5-5009-4b95-97ca-9949a6e42ddc {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:15:21 user nova-compute[72129]: WARNING nova.compute.manager [req-5082f7f7-d6fb-488b-a2bb-3e4b93894439 req-86c59a1e-6e86-4e03-8af6-8435a98e78c2 service nova] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] Received unexpected event network-vif-plugged-b1ecfcb5-5009-4b95-97ca-9949a6e42ddc for instance with vm_state deleted and task_state None.
Aug 01 14:15:21 user nova-compute[72129]: DEBUG nova.compute.manager [req-5082f7f7-d6fb-488b-a2bb-3e4b93894439 req-86c59a1e-6e86-4e03-8af6-8435a98e78c2 service nova] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] Received event network-vif-plugged-b1ecfcb5-5009-4b95-97ca-9949a6e42ddc {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:15:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-5082f7f7-d6fb-488b-a2bb-3e4b93894439 req-86c59a1e-6e86-4e03-8af6-8435a98e78c2 service nova] Acquiring lock "0714c157-056f-4f64-94f4-da5c8e5f6eda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:15:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-5082f7f7-d6fb-488b-a2bb-3e4b93894439 req-86c59a1e-6e86-4e03-8af6-8435a98e78c2 service nova] Lock "0714c157-056f-4f64-94f4-da5c8e5f6eda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:15:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-5082f7f7-d6fb-488b-a2bb-3e4b93894439 req-86c59a1e-6e86-4e03-8af6-8435a98e78c2 service nova] Lock "0714c157-056f-4f64-94f4-da5c8e5f6eda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:15:21 user nova-compute[72129]: DEBUG nova.compute.manager [req-5082f7f7-d6fb-488b-a2bb-3e4b93894439 req-86c59a1e-6e86-4e03-8af6-8435a98e78c2 service nova] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] No waiting events found dispatching network-vif-plugged-b1ecfcb5-5009-4b95-97ca-9949a6e42ddc {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:15:21 user nova-compute[72129]: WARNING nova.compute.manager [req-5082f7f7-d6fb-488b-a2bb-3e4b93894439 req-86c59a1e-6e86-4e03-8af6-8435a98e78c2 service nova] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] Received unexpected event network-vif-plugged-b1ecfcb5-5009-4b95-97ca-9949a6e42ddc for instance with vm_state deleted and task_state None.
Aug 01 14:15:21 user nova-compute[72129]: DEBUG nova.compute.manager [req-5082f7f7-d6fb-488b-a2bb-3e4b93894439 req-86c59a1e-6e86-4e03-8af6-8435a98e78c2 service nova] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] Received event network-vif-plugged-b1ecfcb5-5009-4b95-97ca-9949a6e42ddc {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:15:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-5082f7f7-d6fb-488b-a2bb-3e4b93894439 req-86c59a1e-6e86-4e03-8af6-8435a98e78c2 service nova] Acquiring lock "0714c157-056f-4f64-94f4-da5c8e5f6eda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:15:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-5082f7f7-d6fb-488b-a2bb-3e4b93894439 req-86c59a1e-6e86-4e03-8af6-8435a98e78c2 service nova] Lock "0714c157-056f-4f64-94f4-da5c8e5f6eda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:15:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-5082f7f7-d6fb-488b-a2bb-3e4b93894439 req-86c59a1e-6e86-4e03-8af6-8435a98e78c2 service nova] Lock "0714c157-056f-4f64-94f4-da5c8e5f6eda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:15:21 user nova-compute[72129]: DEBUG nova.compute.manager [req-5082f7f7-d6fb-488b-a2bb-3e4b93894439 req-86c59a1e-6e86-4e03-8af6-8435a98e78c2 service nova] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] No waiting events found dispatching network-vif-plugged-b1ecfcb5-5009-4b95-97ca-9949a6e42ddc {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:15:21 user nova-compute[72129]: WARNING nova.compute.manager [req-5082f7f7-d6fb-488b-a2bb-3e4b93894439 req-86c59a1e-6e86-4e03-8af6-8435a98e78c2 service nova] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] Received unexpected event network-vif-plugged-b1ecfcb5-5009-4b95-97ca-9949a6e42ddc for instance with vm_state deleted and task_state None.
Aug 01 14:15:21 user nova-compute[72129]: DEBUG nova.compute.manager [req-5082f7f7-d6fb-488b-a2bb-3e4b93894439 req-86c59a1e-6e86-4e03-8af6-8435a98e78c2 service nova] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] Received event network-vif-unplugged-b1ecfcb5-5009-4b95-97ca-9949a6e42ddc {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:15:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-5082f7f7-d6fb-488b-a2bb-3e4b93894439 req-86c59a1e-6e86-4e03-8af6-8435a98e78c2 service nova] Acquiring lock "0714c157-056f-4f64-94f4-da5c8e5f6eda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:15:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-5082f7f7-d6fb-488b-a2bb-3e4b93894439 req-86c59a1e-6e86-4e03-8af6-8435a98e78c2 service nova] Lock "0714c157-056f-4f64-94f4-da5c8e5f6eda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:15:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-5082f7f7-d6fb-488b-a2bb-3e4b93894439 req-86c59a1e-6e86-4e03-8af6-8435a98e78c2 service nova] Lock "0714c157-056f-4f64-94f4-da5c8e5f6eda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:15:21 user nova-compute[72129]: DEBUG nova.compute.manager [req-5082f7f7-d6fb-488b-a2bb-3e4b93894439 req-86c59a1e-6e86-4e03-8af6-8435a98e78c2 service nova] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] No waiting events found dispatching network-vif-unplugged-b1ecfcb5-5009-4b95-97ca-9949a6e42ddc {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:15:21 user nova-compute[72129]: WARNING nova.compute.manager [req-5082f7f7-d6fb-488b-a2bb-3e4b93894439 req-86c59a1e-6e86-4e03-8af6-8435a98e78c2 service nova] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] Received unexpected event network-vif-unplugged-b1ecfcb5-5009-4b95-97ca-9949a6e42ddc for instance with vm_state deleted and task_state None.
Aug 01 14:15:21 user nova-compute[72129]: DEBUG nova.compute.manager [req-5082f7f7-d6fb-488b-a2bb-3e4b93894439 req-86c59a1e-6e86-4e03-8af6-8435a98e78c2 service nova] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] Received event network-vif-plugged-b1ecfcb5-5009-4b95-97ca-9949a6e42ddc {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:15:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-5082f7f7-d6fb-488b-a2bb-3e4b93894439 req-86c59a1e-6e86-4e03-8af6-8435a98e78c2 service nova] Acquiring lock "0714c157-056f-4f64-94f4-da5c8e5f6eda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:15:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-5082f7f7-d6fb-488b-a2bb-3e4b93894439 req-86c59a1e-6e86-4e03-8af6-8435a98e78c2 service nova] Lock "0714c157-056f-4f64-94f4-da5c8e5f6eda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:15:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-5082f7f7-d6fb-488b-a2bb-3e4b93894439 req-86c59a1e-6e86-4e03-8af6-8435a98e78c2 service nova] Lock "0714c157-056f-4f64-94f4-da5c8e5f6eda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:15:21 user nova-compute[72129]: DEBUG nova.compute.manager [req-5082f7f7-d6fb-488b-a2bb-3e4b93894439 req-86c59a1e-6e86-4e03-8af6-8435a98e78c2 service nova] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] No waiting events found dispatching network-vif-plugged-b1ecfcb5-5009-4b95-97ca-9949a6e42ddc {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:15:21 user nova-compute[72129]: WARNING nova.compute.manager [req-5082f7f7-d6fb-488b-a2bb-3e4b93894439 req-86c59a1e-6e86-4e03-8af6-8435a98e78c2 service nova] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] Received unexpected event network-vif-plugged-b1ecfcb5-5009-4b95-97ca-9949a6e42ddc for instance with vm_state deleted and task_state None.
Aug 01 14:15:25 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:15:30 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:15:35 user nova-compute[72129]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690899320.1897905, 0714c157-056f-4f64-94f4-da5c8e5f6eda => Stopped> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:15:35 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] VM Stopped (Lifecycle Event)
Aug 01 14:15:35 user nova-compute[72129]: DEBUG nova.compute.manager [None req-a81a15b6-a61f-417f-9fcc-660183c4b000 None None] [instance: 0714c157-056f-4f64-94f4-da5c8e5f6eda] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:15:35 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:15:36 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-09d604de-ecfd-4b6d-88b5-f90e49bc5182 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Acquiring lock "89fdfdab-36a6-4481-bfa7-376c3a3a32ae" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:15:36 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-09d604de-ecfd-4b6d-88b5-f90e49bc5182 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Lock "89fdfdab-36a6-4481-bfa7-376c3a3a32ae" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:15:36 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-09d604de-ecfd-4b6d-88b5-f90e49bc5182 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Acquiring lock "89fdfdab-36a6-4481-bfa7-376c3a3a32ae-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:15:36 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-09d604de-ecfd-4b6d-88b5-f90e49bc5182 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Lock "89fdfdab-36a6-4481-bfa7-376c3a3a32ae-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:15:36 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-09d604de-ecfd-4b6d-88b5-f90e49bc5182 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Lock "89fdfdab-36a6-4481-bfa7-376c3a3a32ae-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:15:36 user nova-compute[72129]: INFO nova.compute.manager [None req-09d604de-ecfd-4b6d-88b5-f90e49bc5182 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Terminating instance
Aug 01 14:15:36 user nova-compute[72129]: DEBUG nova.compute.manager [None req-09d604de-ecfd-4b6d-88b5-f90e49bc5182 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Start destroying the instance on the hypervisor. {{(pid=72129) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 14:15:36 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:15:36 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:15:36 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:15:36 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:15:36 user nova-compute[72129]: DEBUG nova.compute.manager [req-553a328e-78c4-4693-8f01-a07c60a7a881 req-3c9e8cf7-91c7-436b-be1e-144279a50393 service nova] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Received event network-vif-unplugged-778ce9fe-90f9-4d7f-98be-51407fc6520a {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:15:36 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-553a328e-78c4-4693-8f01-a07c60a7a881 req-3c9e8cf7-91c7-436b-be1e-144279a50393 service nova] Acquiring lock "89fdfdab-36a6-4481-bfa7-376c3a3a32ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:15:36 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-553a328e-78c4-4693-8f01-a07c60a7a881 req-3c9e8cf7-91c7-436b-be1e-144279a50393 service nova] Lock "89fdfdab-36a6-4481-bfa7-376c3a3a32ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:15:36 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-553a328e-78c4-4693-8f01-a07c60a7a881 req-3c9e8cf7-91c7-436b-be1e-144279a50393 service nova] Lock "89fdfdab-36a6-4481-bfa7-376c3a3a32ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:15:36 user nova-compute[72129]: DEBUG nova.compute.manager [req-553a328e-78c4-4693-8f01-a07c60a7a881 req-3c9e8cf7-91c7-436b-be1e-144279a50393 service nova] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] No waiting events found dispatching network-vif-unplugged-778ce9fe-90f9-4d7f-98be-51407fc6520a {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:15:36 user nova-compute[72129]: DEBUG nova.compute.manager [req-553a328e-78c4-4693-8f01-a07c60a7a881 req-3c9e8cf7-91c7-436b-be1e-144279a50393 service nova] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Received event network-vif-unplugged-778ce9fe-90f9-4d7f-98be-51407fc6520a for instance with task_state deleting. {{(pid=72129) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 14:15:36 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:15:36 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:15:36 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:15:36 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Instance destroyed successfully.
Aug 01 14:15:36 user nova-compute[72129]: DEBUG nova.objects.instance [None req-09d604de-ecfd-4b6d-88b5-f90e49bc5182 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Lazy-loading 'resources' on Instance uuid 89fdfdab-36a6-4481-bfa7-376c3a3a32ae {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:15:36 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-09d604de-ecfd-4b6d-88b5-f90e49bc5182 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:12:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1109994487',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1109994487',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1109994',id=38,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLsXggziKjrecDfU+S/Y77siHxeHusA2I81DBx0zlXgVO1SCmj/5jjAQ1BXIAzgnz5Fftk4EfvhiMMztcwEds0kMmZ0il8IY46ZJJEIsM8Q9EkFM+clQ9gibE2PBc39p3Q==',key_name='tempest-keypair-244734479',keypairs=<?>,launch_index=0,launched_at=2023-08-01T14:12:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b1b34cc88cb64d6fbdc5e2688f6767d4',ramdisk_id='',reservation_id='r-7uigjdmv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1146793536',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T14:12:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d1ce7ac7a65e441dbc8ac4873ee2156f',uuid=89fdfdab-36a6-4481-bfa7-376c3a3a32ae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "778ce9fe-90f9-4d7f-98be-51407fc6520a", "address": "fa:16:3e:9f:0b:54", "network": {"id": "46796a3e-328f-4641-82aa-77c1d2c6c9cb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-446403350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b34cc88cb64d6fbdc5e2688f6767d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap778ce9fe-90", "ovs_interfaceid": "778ce9fe-90f9-4d7f-98be-51407fc6520a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 14:15:36 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-09d604de-ecfd-4b6d-88b5-f90e49bc5182 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Converting VIF {"id": "778ce9fe-90f9-4d7f-98be-51407fc6520a", "address": "fa:16:3e:9f:0b:54", "network": {"id": "46796a3e-328f-4641-82aa-77c1d2c6c9cb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-446403350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b34cc88cb64d6fbdc5e2688f6767d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap778ce9fe-90", "ovs_interfaceid": "778ce9fe-90f9-4d7f-98be-51407fc6520a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:15:36 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-09d604de-ecfd-4b6d-88b5-f90e49bc5182 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9f:0b:54,bridge_name='br-int',has_traffic_filtering=True,id=778ce9fe-90f9-4d7f-98be-51407fc6520a,network=Network(46796a3e-328f-4641-82aa-77c1d2c6c9cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap778ce9fe-90') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:15:36 user nova-compute[72129]: DEBUG os_vif [None req-09d604de-ecfd-4b6d-88b5-f90e49bc5182 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:0b:54,bridge_name='br-int',has_traffic_filtering=True,id=778ce9fe-90f9-4d7f-98be-51407fc6520a,network=Network(46796a3e-328f-4641-82aa-77c1d2c6c9cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap778ce9fe-90') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 14:15:36 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:15:36 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap778ce9fe-90, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:15:36 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:15:36 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:15:36 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:15:36 user nova-compute[72129]: INFO os_vif [None req-09d604de-ecfd-4b6d-88b5-f90e49bc5182 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:0b:54,bridge_name='br-int',has_traffic_filtering=True,id=778ce9fe-90f9-4d7f-98be-51407fc6520a,network=Network(46796a3e-328f-4641-82aa-77c1d2c6c9cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap778ce9fe-90')
Aug 01 14:15:37 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-09d604de-ecfd-4b6d-88b5-f90e49bc5182 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Deleting instance files /opt/stack/data/nova/instances/89fdfdab-36a6-4481-bfa7-376c3a3a32ae_del
Aug 01 14:15:37 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-09d604de-ecfd-4b6d-88b5-f90e49bc5182 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Deletion of /opt/stack/data/nova/instances/89fdfdab-36a6-4481-bfa7-376c3a3a32ae_del complete
Aug 01 14:15:37 user nova-compute[72129]: INFO nova.compute.manager [None req-09d604de-ecfd-4b6d-88b5-f90e49bc5182 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 01 14:15:37 user nova-compute[72129]: DEBUG oslo.service.loopingcall [None req-09d604de-ecfd-4b6d-88b5-f90e49bc5182 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72129) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 14:15:37 user nova-compute[72129]: DEBUG nova.compute.manager [-] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Deallocating network for instance {{(pid=72129) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 14:15:37 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] deallocate_for_instance() {{(pid=72129) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 14:15:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:15:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:15:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:15:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:15:38 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:15:38 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Took 0.95 seconds to deallocate network for instance.
Aug 01 14:15:38 user nova-compute[72129]: DEBUG nova.compute.manager [req-c56d03e9-a81f-48bd-9be0-ecf083385f34 req-0d5cd45f-4687-4307-97d2-1a7cdcebf83e service nova] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Received event network-vif-deleted-778ce9fe-90f9-4d7f-98be-51407fc6520a {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:15:38 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-09d604de-ecfd-4b6d-88b5-f90e49bc5182 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:15:38 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-09d604de-ecfd-4b6d-88b5-f90e49bc5182 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:15:38 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-09d604de-ecfd-4b6d-88b5-f90e49bc5182 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:15:38 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-09d604de-ecfd-4b6d-88b5-f90e49bc5182 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:15:38 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-09d604de-ecfd-4b6d-88b5-f90e49bc5182 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.187s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:15:38 user nova-compute[72129]: INFO nova.scheduler.client.report [None req-09d604de-ecfd-4b6d-88b5-f90e49bc5182 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Deleted allocations for instance 89fdfdab-36a6-4481-bfa7-376c3a3a32ae
Aug 01 14:15:38 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-09d604de-ecfd-4b6d-88b5-f90e49bc5182 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536 tempest-TestServerVolumeAttachScenarioOldVersion-1146793536-project-member] Lock "89fdfdab-36a6-4481-bfa7-376c3a3a32ae" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.197s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:15:38 user nova-compute[72129]: DEBUG nova.compute.manager [req-d04c1513-d791-486a-b53e-07ed0ac9a4ea req-ca4271a9-ff19-4ba6-a9f8-2cb40b024344 service nova] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Received event network-vif-plugged-778ce9fe-90f9-4d7f-98be-51407fc6520a {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:15:38 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-d04c1513-d791-486a-b53e-07ed0ac9a4ea req-ca4271a9-ff19-4ba6-a9f8-2cb40b024344 service nova] Acquiring lock "89fdfdab-36a6-4481-bfa7-376c3a3a32ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:15:38 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-d04c1513-d791-486a-b53e-07ed0ac9a4ea req-ca4271a9-ff19-4ba6-a9f8-2cb40b024344 service nova] Lock "89fdfdab-36a6-4481-bfa7-376c3a3a32ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:15:38 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-d04c1513-d791-486a-b53e-07ed0ac9a4ea req-ca4271a9-ff19-4ba6-a9f8-2cb40b024344 service nova] Lock "89fdfdab-36a6-4481-bfa7-376c3a3a32ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:15:38 user nova-compute[72129]: DEBUG nova.compute.manager [req-d04c1513-d791-486a-b53e-07ed0ac9a4ea req-ca4271a9-ff19-4ba6-a9f8-2cb40b024344 service nova] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] No waiting events found dispatching network-vif-plugged-778ce9fe-90f9-4d7f-98be-51407fc6520a {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:15:38 user nova-compute[72129]: WARNING nova.compute.manager [req-d04c1513-d791-486a-b53e-07ed0ac9a4ea req-ca4271a9-ff19-4ba6-a9f8-2cb40b024344 service nova] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Received unexpected event network-vif-plugged-778ce9fe-90f9-4d7f-98be-51407fc6520a for instance with vm_state deleted and task_state None.
Aug 01 14:15:38 user nova-compute[72129]: DEBUG nova.compute.manager [req-d04c1513-d791-486a-b53e-07ed0ac9a4ea req-ca4271a9-ff19-4ba6-a9f8-2cb40b024344 service nova] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Received event network-vif-plugged-778ce9fe-90f9-4d7f-98be-51407fc6520a {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:15:38 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-d04c1513-d791-486a-b53e-07ed0ac9a4ea req-ca4271a9-ff19-4ba6-a9f8-2cb40b024344 service nova] Acquiring lock "89fdfdab-36a6-4481-bfa7-376c3a3a32ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:15:38 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-d04c1513-d791-486a-b53e-07ed0ac9a4ea req-ca4271a9-ff19-4ba6-a9f8-2cb40b024344 service nova] Lock "89fdfdab-36a6-4481-bfa7-376c3a3a32ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:15:38 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-d04c1513-d791-486a-b53e-07ed0ac9a4ea req-ca4271a9-ff19-4ba6-a9f8-2cb40b024344 service nova] Lock "89fdfdab-36a6-4481-bfa7-376c3a3a32ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:15:38 user nova-compute[72129]: DEBUG nova.compute.manager [req-d04c1513-d791-486a-b53e-07ed0ac9a4ea req-ca4271a9-ff19-4ba6-a9f8-2cb40b024344 service nova] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] No waiting events found dispatching network-vif-plugged-778ce9fe-90f9-4d7f-98be-51407fc6520a {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:15:38 user nova-compute[72129]: WARNING nova.compute.manager [req-d04c1513-d791-486a-b53e-07ed0ac9a4ea req-ca4271a9-ff19-4ba6-a9f8-2cb40b024344 service nova] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Received unexpected event network-vif-plugged-778ce9fe-90f9-4d7f-98be-51407fc6520a for instance with vm_state deleted and task_state None.
Aug 01 14:15:38 user nova-compute[72129]: DEBUG nova.compute.manager [req-d04c1513-d791-486a-b53e-07ed0ac9a4ea req-ca4271a9-ff19-4ba6-a9f8-2cb40b024344 service nova] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Received event network-vif-plugged-778ce9fe-90f9-4d7f-98be-51407fc6520a {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:15:38 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-d04c1513-d791-486a-b53e-07ed0ac9a4ea req-ca4271a9-ff19-4ba6-a9f8-2cb40b024344 service nova] Acquiring lock "89fdfdab-36a6-4481-bfa7-376c3a3a32ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:15:38 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-d04c1513-d791-486a-b53e-07ed0ac9a4ea req-ca4271a9-ff19-4ba6-a9f8-2cb40b024344 service nova] Lock "89fdfdab-36a6-4481-bfa7-376c3a3a32ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:15:38 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-d04c1513-d791-486a-b53e-07ed0ac9a4ea req-ca4271a9-ff19-4ba6-a9f8-2cb40b024344 service nova] Lock "89fdfdab-36a6-4481-bfa7-376c3a3a32ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:15:38 user nova-compute[72129]: DEBUG nova.compute.manager [req-d04c1513-d791-486a-b53e-07ed0ac9a4ea req-ca4271a9-ff19-4ba6-a9f8-2cb40b024344 service nova] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] No waiting events found dispatching network-vif-plugged-778ce9fe-90f9-4d7f-98be-51407fc6520a {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:15:38 user nova-compute[72129]: WARNING nova.compute.manager [req-d04c1513-d791-486a-b53e-07ed0ac9a4ea req-ca4271a9-ff19-4ba6-a9f8-2cb40b024344 service nova] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Received unexpected event network-vif-plugged-778ce9fe-90f9-4d7f-98be-51407fc6520a for instance with vm_state deleted and task_state None.
Aug 01 14:15:38 user nova-compute[72129]: DEBUG nova.compute.manager [req-d04c1513-d791-486a-b53e-07ed0ac9a4ea req-ca4271a9-ff19-4ba6-a9f8-2cb40b024344 service nova] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Received event network-vif-unplugged-778ce9fe-90f9-4d7f-98be-51407fc6520a {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:15:38 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-d04c1513-d791-486a-b53e-07ed0ac9a4ea req-ca4271a9-ff19-4ba6-a9f8-2cb40b024344 service nova] Acquiring lock "89fdfdab-36a6-4481-bfa7-376c3a3a32ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:15:38 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-d04c1513-d791-486a-b53e-07ed0ac9a4ea req-ca4271a9-ff19-4ba6-a9f8-2cb40b024344 service nova] Lock "89fdfdab-36a6-4481-bfa7-376c3a3a32ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:15:38 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-d04c1513-d791-486a-b53e-07ed0ac9a4ea req-ca4271a9-ff19-4ba6-a9f8-2cb40b024344 service nova] Lock "89fdfdab-36a6-4481-bfa7-376c3a3a32ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:15:38 user nova-compute[72129]: DEBUG nova.compute.manager [req-d04c1513-d791-486a-b53e-07ed0ac9a4ea req-ca4271a9-ff19-4ba6-a9f8-2cb40b024344 service nova] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] No waiting events found dispatching network-vif-unplugged-778ce9fe-90f9-4d7f-98be-51407fc6520a {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:15:38 user nova-compute[72129]: WARNING nova.compute.manager [req-d04c1513-d791-486a-b53e-07ed0ac9a4ea req-ca4271a9-ff19-4ba6-a9f8-2cb40b024344 service nova] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Received unexpected event network-vif-unplugged-778ce9fe-90f9-4d7f-98be-51407fc6520a for instance with vm_state deleted and task_state None.
Aug 01 14:15:38 user nova-compute[72129]: DEBUG nova.compute.manager [req-d04c1513-d791-486a-b53e-07ed0ac9a4ea req-ca4271a9-ff19-4ba6-a9f8-2cb40b024344 service nova] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Received event network-vif-plugged-778ce9fe-90f9-4d7f-98be-51407fc6520a {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:15:38 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-d04c1513-d791-486a-b53e-07ed0ac9a4ea req-ca4271a9-ff19-4ba6-a9f8-2cb40b024344 service nova] Acquiring lock "89fdfdab-36a6-4481-bfa7-376c3a3a32ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:15:38 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-d04c1513-d791-486a-b53e-07ed0ac9a4ea req-ca4271a9-ff19-4ba6-a9f8-2cb40b024344 service nova] Lock "89fdfdab-36a6-4481-bfa7-376c3a3a32ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:15:38 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-d04c1513-d791-486a-b53e-07ed0ac9a4ea req-ca4271a9-ff19-4ba6-a9f8-2cb40b024344 service nova] Lock "89fdfdab-36a6-4481-bfa7-376c3a3a32ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:15:38 user nova-compute[72129]: DEBUG nova.compute.manager [req-d04c1513-d791-486a-b53e-07ed0ac9a4ea req-ca4271a9-ff19-4ba6-a9f8-2cb40b024344 service nova] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] No waiting events found dispatching network-vif-plugged-778ce9fe-90f9-4d7f-98be-51407fc6520a {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:15:38 user nova-compute[72129]: WARNING nova.compute.manager [req-d04c1513-d791-486a-b53e-07ed0ac9a4ea req-ca4271a9-ff19-4ba6-a9f8-2cb40b024344 service nova] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Received unexpected event network-vif-plugged-778ce9fe-90f9-4d7f-98be-51407fc6520a for instance with vm_state deleted and task_state None.
Aug 01 14:15:41 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:15:46 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:15:46 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:15:46 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72129) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 14:15:46 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:15:46 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:15:46 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:15:51 user nova-compute[72129]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690899336.9536366, 89fdfdab-36a6-4481-bfa7-376c3a3a32ae => Stopped> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:15:51 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] VM Stopped (Lifecycle Event)
Aug 01 14:15:51 user nova-compute[72129]: DEBUG nova.compute.manager [None req-ac6f87e8-93f4-4778-9ca0-727c7b0f4102 None None] [instance: 89fdfdab-36a6-4481-bfa7-376c3a3a32ae] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:15:51 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:15:54 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:15:54 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72129) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 14:15:56 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:15:56 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:15:56 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72129) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 14:15:56 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:15:56 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:15:56 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:15:57 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:15:57 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Starting heal instance info cache {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 14:15:57 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Didn't find any instances for network info cache update. {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 14:15:59 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:16:00 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:16:01 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:16:01 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:16:01 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:16:01 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:16:01 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Auditing locally available compute resources for user (node: user) {{(pid=72129) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 14:16:01 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3a4469-30fd-4f27-a3b7-957422dd2746/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:16:01 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3a4469-30fd-4f27-a3b7-957422dd2746/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:16:01 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3a4469-30fd-4f27-a3b7-957422dd2746/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:16:01 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3a4469-30fd-4f27-a3b7-957422dd2746/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:16:01 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:16:01 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:16:01 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:16:01 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:16:01 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:16:01 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:16:01 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:16:02 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:16:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:16:02 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:16:02 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:16:02 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Hypervisor/Node resource view: name=user free_ram=8469MB free_disk=25.17630386352539GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72129) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 14:16:02 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:16:02 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:16:02 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 5c3a4469-30fd-4f27-a3b7-957422dd2746 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:16:02 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance b3f54430-8d5d-478b-8dc7-d7592ee3db36 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:16:02 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:16:02 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 14:16:02 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 14:16:02 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Refreshing inventories for resource provider c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 14:16:02 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Updating ProviderTree inventory for provider c2f345c3-9b82-4164-b21d-1eef8e661842 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 14:16:02 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Updating inventory in ProviderTree for provider c2f345c3-9b82-4164-b21d-1eef8e661842 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 14:16:02 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Refreshing aggregate associations for resource provider c2f345c3-9b82-4164-b21d-1eef8e661842, aggregates: None {{(pid=72129) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 14:16:02 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Refreshing trait associations for resource provider c2f345c3-9b82-4164-b21d-1eef8e661842, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE {{(pid=72129) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 14:16:03 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:16:03 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:16:03 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Compute_service record updated for user:user {{(pid=72129) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 14:16:03 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.561s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:16:03 user nova-compute[72129]: DEBUG nova.compute.manager [req-de594e5a-6347-45cc-a6c2-8eb90961c602 req-21216b0e-a2b0-4657-8b47-abf6c8b0fe72 service nova] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Received event network-changed-7f4ef5f0-b138-43aa-ad82-ced2ff871e3d {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:16:03 user nova-compute[72129]: DEBUG nova.compute.manager [req-de594e5a-6347-45cc-a6c2-8eb90961c602 req-21216b0e-a2b0-4657-8b47-abf6c8b0fe72 service nova] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Refreshing instance network info cache due to event network-changed-7f4ef5f0-b138-43aa-ad82-ced2ff871e3d. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 14:16:03 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-de594e5a-6347-45cc-a6c2-8eb90961c602 req-21216b0e-a2b0-4657-8b47-abf6c8b0fe72 service nova] Acquiring lock "refresh_cache-5c3a4469-30fd-4f27-a3b7-957422dd2746" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:16:03 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-de594e5a-6347-45cc-a6c2-8eb90961c602 req-21216b0e-a2b0-4657-8b47-abf6c8b0fe72 service nova] Acquired lock "refresh_cache-5c3a4469-30fd-4f27-a3b7-957422dd2746" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:16:03 user nova-compute[72129]: DEBUG nova.network.neutron [req-de594e5a-6347-45cc-a6c2-8eb90961c602 req-21216b0e-a2b0-4657-8b47-abf6c8b0fe72 service nova] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Refreshing network info cache for port 7f4ef5f0-b138-43aa-ad82-ced2ff871e3d {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 14:16:04 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:16:04 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:16:04 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:16:04 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:16:04 user nova-compute[72129]: DEBUG nova.network.neutron [req-de594e5a-6347-45cc-a6c2-8eb90961c602 req-21216b0e-a2b0-4657-8b47-abf6c8b0fe72 service nova] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Updated VIF entry in instance network info cache for port 7f4ef5f0-b138-43aa-ad82-ced2ff871e3d. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 14:16:04 user nova-compute[72129]: DEBUG nova.network.neutron [req-de594e5a-6347-45cc-a6c2-8eb90961c602 req-21216b0e-a2b0-4657-8b47-abf6c8b0fe72 service nova] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Updating instance_info_cache with network_info: [{"id": "7f4ef5f0-b138-43aa-ad82-ced2ff871e3d", "address": "fa:16:3e:5d:46:e3", "network": {"id": "9d4effd9-bf5c-41a7-a8e2-18d2177ace34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333645199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5d5ede0f2e44eaab914ffc17aef8aa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f4ef5f0-b1", "ovs_interfaceid": "7f4ef5f0-b138-43aa-ad82-ced2ff871e3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:16:04 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-de594e5a-6347-45cc-a6c2-8eb90961c602 req-21216b0e-a2b0-4657-8b47-abf6c8b0fe72 service nova] Releasing lock "refresh_cache-5c3a4469-30fd-4f27-a3b7-957422dd2746" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:16:06 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:16:06 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:16:07 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:16:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5b8a0ce0-22ce-4d40-80a2-bc24b1a76f8a tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Acquiring lock "5c3a4469-30fd-4f27-a3b7-957422dd2746" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:16:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5b8a0ce0-22ce-4d40-80a2-bc24b1a76f8a tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "5c3a4469-30fd-4f27-a3b7-957422dd2746" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:16:07 user nova-compute[72129]: DEBUG nova.objects.instance [None req-5b8a0ce0-22ce-4d40-80a2-bc24b1a76f8a tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lazy-loading 'flavor' on Instance uuid 5c3a4469-30fd-4f27-a3b7-957422dd2746 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:16:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5b8a0ce0-22ce-4d40-80a2-bc24b1a76f8a tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "5c3a4469-30fd-4f27-a3b7-957422dd2746" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:16:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5b8a0ce0-22ce-4d40-80a2-bc24b1a76f8a tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Acquiring lock "5c3a4469-30fd-4f27-a3b7-957422dd2746" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:16:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5b8a0ce0-22ce-4d40-80a2-bc24b1a76f8a tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "5c3a4469-30fd-4f27-a3b7-957422dd2746" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:16:07 user nova-compute[72129]: INFO nova.compute.manager [None req-5b8a0ce0-22ce-4d40-80a2-bc24b1a76f8a tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Attaching volume 7fd044df-fc7f-4e7e-972b-e7e430dbb010 to /dev/vdb
Aug 01 14:16:07 user nova-compute[72129]: DEBUG os_brick.utils [None req-5b8a0ce0-22ce-4d40-80a2-bc24b1a76f8a tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:16:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:16:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:16:07 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[661c6c4a-03ce-43d5-a365-ad8b64b42f6d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f9b449c2cd3d\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:16:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:16:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:16:07 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[85eb184e-6dde-41fb-a6f0-08a147f741c9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:16:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:16:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:16:07 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[55871792-c20a-4a75-aaa9-0c1010f64539]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:16:07 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[21fe798a-0fb2-4f34-a434-87bcf9f7e6e9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:16:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-5b8a0ce0-22ce-4d40-80a2-bc24b1a76f8a tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Running cmd (subprocess): nvme version {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:16:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-5b8a0ce0-22ce-4d40-80a2-bc24b1a76f8a tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] 'nvme version' failed. Not Retrying. {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 14:16:07 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5b8a0ce0-22ce-4d40-80a2-bc24b1a76f8a tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] nvme not present on system {{(pid=72129) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 14:16:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:16:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 14:16:07 user nova-compute[72129]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 14:16:07 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[962e4553-dd0e-47b0-a4e2-0f0425a5865b]: (4, '') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:16:07 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-5b8a0ce0-22ce-4d40-80a2-bc24b1a76f8a tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72129) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 14:16:07 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-5b8a0ce0-22ce-4d40-80a2-bc24b1a76f8a tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 14:16:07 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-5b8a0ce0-22ce-4d40-80a2-bc24b1a76f8a tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] LIGHTOS: no hostnqn found. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 14:16:07 user nova-compute[72129]: DEBUG os_brick.utils [None req-5b8a0ce0-22ce-4d40-80a2-bc24b1a76f8a tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f9b449c2cd3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:16:07 user nova-compute[72129]: DEBUG nova.virt.block_device [None req-5b8a0ce0-22ce-4d40-80a2-bc24b1a76f8a tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Updating existing volume attachment record: 15bfcb0a-eb9f-484a-95b6-9fb1d2758b49 {{(pid=72129) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 14:16:11 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:16:12 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:16:12 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:16:14 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b8a0ce0-22ce-4d40-80a2-bc24b1a76f8a tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Calling os-brick to attach iSCSI Volume {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 14:16:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8a0ce0-22ce-4d40-80a2-bc24b1a76f8a tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7fd044df-fc7f-4e7e-972b-e7e430dbb010'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QdvTGJAi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:16:14 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-5b8a0ce0-22ce-4d40-80a2-bc24b1a76f8a tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:16:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-5b8a0ce0-22ce-4d40-80a2-bc24b1a76f8a tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:16:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-5b8a0ce0-22ce-4d40-80a2-bc24b1a76f8a tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:16:14 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-5b8a0ce0-22ce-4d40-80a2-bc24b1a76f8a tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:16:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-5b8a0ce0-22ce-4d40-80a2-bc24b1a76f8a tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7fd044df-fc7f-4e7e-972b-e7e430dbb010" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:16:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-5b8a0ce0-22ce-4d40-80a2-bc24b1a76f8a tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7fd044df-fc7f-4e7e-972b-e7e430dbb010" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:16:14 user nova-compute[72129]: INFO os_brick.initiator.connectors.iscsi [None req-5b8a0ce0-22ce-4d40-80a2-bc24b1a76f8a tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 14:16:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fd044df-fc7f-4e7e-972b-e7e430dbb010 -p 172.16.0.220:3260 {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:16:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fd044df-fc7f-4e7e-972b-e7e430dbb010 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:16:14 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[493f2f0a-bf61-481b-a110-23afb9b400f7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:16:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8a0ce0-22ce-4d40-80a2-bc24b1a76f8a tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 14:16:14 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:16:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fd044df-fc7f-4e7e-972b-e7e430dbb010 -p 172.16.0.220:3260 --interface default --op new {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:16:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fd044df-fc7f-4e7e-972b-e7e430dbb010 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:16:14 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[6935b25f-6d83-40ff-8cd9-d770ab60f217]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7fd044df-fc7f-4e7e-972b-e7e430dbb010] added\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:16:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8a0ce0-22ce-4d40-80a2-bc24b1a76f8a tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7fd044df-fc7f-4e7e-972b-e7e430dbb010] added
Aug 01 14:16:14 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:16:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fd044df-fc7f-4e7e-972b-e7e430dbb010 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:16:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fd044df-fc7f-4e7e-972b-e7e430dbb010 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:16:14 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a58e60-87f9-4094-acfc-de8c2bb89a88]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:16:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8a0ce0-22ce-4d40-80a2-bc24b1a76f8a tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:16:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fd044df-fc7f-4e7e-972b-e7e430dbb010 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:16:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fd044df-fc7f-4e7e-972b-e7e430dbb010 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:16:14 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[54010e3b-a82d-4355-b789-cd9e18f3c263]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:16:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8a0ce0-22ce-4d40-80a2-bc24b1a76f8a tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:16:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fd044df-fc7f-4e7e-972b-e7e430dbb010 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QdvTGJAi {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:16:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fd044df-fc7f-4e7e-972b-e7e430dbb010 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QdvTGJAi" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:16:14 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0675e9-1e6a-46cd-81e9-8762b6ae38d3]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:16:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8a0ce0-22ce-4d40-80a2-bc24b1a76f8a tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QdvTGJAi'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:16:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fd044df-fc7f-4e7e-972b-e7e430dbb010 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:16:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fd044df-fc7f-4e7e-972b-e7e430dbb010 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:16:14 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad61e4fb-7cf2-42ff-b7da-e84bfa9d534b]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:16:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8a0ce0-22ce-4d40-80a2-bc24b1a76f8a tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:16:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:16:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:16:14 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[148310db-c62c-46a2-867f-276fd217adb5]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:16:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8a0ce0-22ce-4d40-80a2-bc24b1a76f8a tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 14:16:14 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:16:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8a0ce0-22ce-4d40-80a2-bc24b1a76f8a tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 14:16:14 user nova-compute[72129]:  {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:16:14 user nova-compute[72129]: WARNING os_brick.initiator.connectors.iscsi [None req-5b8a0ce0-22ce-4d40-80a2-bc24b1a76f8a tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 14:16:14 user nova-compute[72129]: 
Aug 01 14:16:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fd044df-fc7f-4e7e-972b-e7e430dbb010 -p 172.16.0.220:3260 --login {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:16:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fd044df-fc7f-4e7e-972b-e7e430dbb010 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:16:14 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7b3353-699b-48b6-a3eb-f6a85b3040e3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7fd044df-fc7f-4e7e-972b-e7e430dbb010, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7fd044df-fc7f-4e7e-972b-e7e430dbb010, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:16:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8a0ce0-22ce-4d40-80a2-bc24b1a76f8a tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7fd044df-fc7f-4e7e-972b-e7e430dbb010, portal: 172.16.0.220,3260]
Aug 01 14:16:14 user nova-compute[72129]: Login to [iface: default, target: iqn.2010-10.org.openstack:7fd044df-fc7f-4e7e-972b-e7e430dbb010, portal: 172.16.0.220,3260] successful.
Aug 01 14:16:14 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:16:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fd044df-fc7f-4e7e-972b-e7e430dbb010 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:16:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fd044df-fc7f-4e7e-972b-e7e430dbb010 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:16:14 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[737f373d-ac5b-4d5e-8956-9a6cb88a29a9]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:16:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8a0ce0-22ce-4d40-80a2-bc24b1a76f8a tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:16:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:16:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:16:14 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae36a86-16d9-4874-9aa2-fc7d8d5ae80a]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fd044df-fc7f-4e7e-972b-e7e430dbb010 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:16:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8a0ce0-22ce-4d40-80a2-bc24b1a76f8a tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fd044df-fc7f-4e7e-972b-e7e430dbb010 (non-flash)
Aug 01 14:16:14 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:16:15 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8a0ce0-22ce-4d40-80a2-bc24b1a76f8a tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fd044df-fc7f-4e7e-972b-e7e430dbb010 (non-flash)
Aug 01 14:16:15 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:16:15 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-5b8a0ce0-22ce-4d40-80a2-bc24b1a76f8a tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7fd044df-fc7f-4e7e-972b-e7e430dbb010" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:16:15 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8a0ce0-22ce-4d40-80a2-bc24b1a76f8a tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Connected to 172.16.0.220:3260 {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 14:16:15 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-5b8a0ce0-22ce-4d40-80a2-bc24b1a76f8a tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=72129) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 14:16:15 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-5b8a0ce0-22ce-4d40-80a2-bc24b1a76f8a tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72129) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 14:16:15 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:16:15 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:16:15 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72129) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 14:16:15 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:16:15 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5aeefb-ddf9-45fa-a071-708b347b12f2]: (4, ('- - 0', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:16:15 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-5b8a0ce0-22ce-4d40-80a2-bc24b1a76f8a tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: None {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 14:16:16 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-5b8a0ce0-22ce-4d40-80a2-bc24b1a76f8a tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 14:16:16 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8a0ce0-22ce-4d40-80a2-bc24b1a76f8a tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QdvTGJAi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 14:16:16 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-5b8a0ce0-22ce-4d40-80a2-bc24b1a76f8a tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:16:16 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8a0ce0-22ce-4d40-80a2-bc24b1a76f8a tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '26533313933663066', 'path': '/dev/sdb'} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:16:16 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b8a0ce0-22ce-4d40-80a2-bc24b1a76f8a tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26533313933663066', 'path': '/dev/sdb'} {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 14:16:16 user nova-compute[72129]: DEBUG nova.objects.instance [None req-5b8a0ce0-22ce-4d40-80a2-bc24b1a76f8a tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lazy-loading 'flavor' on Instance uuid 5c3a4469-30fd-4f27-a3b7-957422dd2746 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:16:16 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-5b8a0ce0-22ce-4d40-80a2-bc24b1a76f8a tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 14:16:16 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:16:16 user nova-compute[72129]:   <source dev="/dev/sdb"/>
Aug 01 14:16:16 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 14:16:16 user nova-compute[72129]:   <serial>7fd044df-fc7f-4e7e-972b-e7e430dbb010</serial>
Aug 01 14:16:16 user nova-compute[72129]: </disk>
Aug 01 14:16:16 user nova-compute[72129]:  {{(pid=72129) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 14:16:16 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-5b8a0ce0-22ce-4d40-80a2-bc24b1a76f8a tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:16:16 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-5b8a0ce0-22ce-4d40-80a2-bc24b1a76f8a tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:16:16 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-5b8a0ce0-22ce-4d40-80a2-bc24b1a76f8a tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] No VIF found with MAC fa:16:3e:5d:46:e3, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 14:16:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5b8a0ce0-22ce-4d40-80a2-bc24b1a76f8a tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "5c3a4469-30fd-4f27-a3b7-957422dd2746" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.878s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:16:17 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:16:17 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:16:17 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72129) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 14:16:17 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:16:17 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:16:17 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:16:17 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:16:19 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:16:19 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Cleaning up deleted instances {{(pid=72129) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 14:16:19 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] There are 0 instances to clean {{(pid=72129) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 14:16:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Acquiring lock "8043d318-06fd-4fb3-bd9f-533bff05d91a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:16:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "8043d318-06fd-4fb3-bd9f-533bff05d91a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:16:20 user nova-compute[72129]: DEBUG nova.compute.manager [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] Starting instance... {{(pid=72129) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 14:16:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:16:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:16:20 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72129) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 14:16:20 user nova-compute[72129]: INFO nova.compute.claims [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] Claim successful on node user
Aug 01 14:16:20 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:16:20 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:16:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.268s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:16:20 user nova-compute[72129]: DEBUG nova.compute.manager [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] Start building networks asynchronously for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 14:16:20 user nova-compute[72129]: DEBUG nova.compute.manager [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] Allocating IP information in the background. {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 14:16:20 user nova-compute[72129]: DEBUG nova.network.neutron [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] allocate_for_instance() {{(pid=72129) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 14:16:20 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 14:16:20 user nova-compute[72129]: DEBUG nova.compute.manager [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] Start building block device mappings for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 14:16:20 user nova-compute[72129]: DEBUG nova.policy [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '85308332b4084e9f8c1bf605f540434b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d5ede0f2e44eaab914ffc17aef8aa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72129) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 14:16:20 user nova-compute[72129]: DEBUG nova.compute.manager [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] Start spawning the instance on the hypervisor. {{(pid=72129) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 14:16:20 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] Creating instance directory {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 14:16:20 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] Creating image(s)
Aug 01 14:16:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Acquiring lock "/opt/stack/data/nova/instances/8043d318-06fd-4fb3-bd9f-533bff05d91a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:16:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "/opt/stack/data/nova/instances/8043d318-06fd-4fb3-bd9f-533bff05d91a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:16:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "/opt/stack/data/nova/instances/8043d318-06fd-4fb3-bd9f-533bff05d91a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:16:20 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:16:20 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.139s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:16:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Acquiring lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:16:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:16:20 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:16:21 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.131s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:16:21 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/8043d318-06fd-4fb3-bd9f-533bff05d91a/disk 1073741824 {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:16:21 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/8043d318-06fd-4fb3-bd9f-533bff05d91a/disk 1073741824" returned: 0 in 0.055s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:16:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.192s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:16:21 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:16:21 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.138s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:16:21 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8043d318-06fd-4fb3-bd9f-533bff05d91a/disk. size=1073741824 {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 14:16:21 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8043d318-06fd-4fb3-bd9f-533bff05d91a/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:16:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:16:21 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8043d318-06fd-4fb3-bd9f-533bff05d91a/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:16:21 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Cannot resize image /opt/stack/data/nova/instances/8043d318-06fd-4fb3-bd9f-533bff05d91a/disk to a smaller size. {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 14:16:21 user nova-compute[72129]: DEBUG nova.objects.instance [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lazy-loading 'migration_context' on Instance uuid 8043d318-06fd-4fb3-bd9f-533bff05d91a {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:16:21 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] Created local disks {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 14:16:21 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] Ensure instance console log exists: /opt/stack/data/nova/instances/8043d318-06fd-4fb3-bd9f-533bff05d91a/console.log {{(pid=72129) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 14:16:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:16:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:16:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:16:21 user nova-compute[72129]: DEBUG nova.network.neutron [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] Successfully created port: 4be76ebe-2106-4cff-9aba-a9c1acef3c57 {{(pid=72129) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 14:16:22 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:16:22 user nova-compute[72129]: DEBUG nova.network.neutron [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] Successfully updated port: 4be76ebe-2106-4cff-9aba-a9c1acef3c57 {{(pid=72129) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 14:16:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Acquiring lock "refresh_cache-8043d318-06fd-4fb3-bd9f-533bff05d91a" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:16:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Acquired lock "refresh_cache-8043d318-06fd-4fb3-bd9f-533bff05d91a" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:16:22 user nova-compute[72129]: DEBUG nova.network.neutron [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 14:16:22 user nova-compute[72129]: DEBUG nova.compute.manager [req-f0c469e3-e5eb-4719-adda-0046af8d4ac0 req-f4bce4ba-f745-476e-8352-37c4e66bab45 service nova] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] Received event network-changed-4be76ebe-2106-4cff-9aba-a9c1acef3c57 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:16:22 user nova-compute[72129]: DEBUG nova.compute.manager [req-f0c469e3-e5eb-4719-adda-0046af8d4ac0 req-f4bce4ba-f745-476e-8352-37c4e66bab45 service nova] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] Refreshing instance network info cache due to event network-changed-4be76ebe-2106-4cff-9aba-a9c1acef3c57. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 14:16:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f0c469e3-e5eb-4719-adda-0046af8d4ac0 req-f4bce4ba-f745-476e-8352-37c4e66bab45 service nova] Acquiring lock "refresh_cache-8043d318-06fd-4fb3-bd9f-533bff05d91a" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:16:22 user nova-compute[72129]: DEBUG nova.network.neutron [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] Instance cache missing network info. {{(pid=72129) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 14:16:22 user nova-compute[72129]: DEBUG nova.network.neutron [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] Updating instance_info_cache with network_info: [{"id": "4be76ebe-2106-4cff-9aba-a9c1acef3c57", "address": "fa:16:3e:b9:b0:19", "network": {"id": "9d4effd9-bf5c-41a7-a8e2-18d2177ace34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333645199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5d5ede0f2e44eaab914ffc17aef8aa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4be76ebe-21", "ovs_interfaceid": "4be76ebe-2106-4cff-9aba-a9c1acef3c57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:16:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Releasing lock "refresh_cache-8043d318-06fd-4fb3-bd9f-533bff05d91a" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:16:22 user nova-compute[72129]: DEBUG nova.compute.manager [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] Instance network_info: |[{"id": "4be76ebe-2106-4cff-9aba-a9c1acef3c57", "address": "fa:16:3e:b9:b0:19", "network": {"id": "9d4effd9-bf5c-41a7-a8e2-18d2177ace34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333645199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5d5ede0f2e44eaab914ffc17aef8aa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4be76ebe-21", "ovs_interfaceid": "4be76ebe-2106-4cff-9aba-a9c1acef3c57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 14:16:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f0c469e3-e5eb-4719-adda-0046af8d4ac0 req-f4bce4ba-f745-476e-8352-37c4e66bab45 service nova] Acquired lock "refresh_cache-8043d318-06fd-4fb3-bd9f-533bff05d91a" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:16:22 user nova-compute[72129]: DEBUG nova.network.neutron [req-f0c469e3-e5eb-4719-adda-0046af8d4ac0 req-f4bce4ba-f745-476e-8352-37c4e66bab45 service nova] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] Refreshing network info cache for port 4be76ebe-2106-4cff-9aba-a9c1acef3c57 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 14:16:22 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] Start _get_guest_xml network_info=[{"id": "4be76ebe-2106-4cff-9aba-a9c1acef3c57", "address": "fa:16:3e:b9:b0:19", "network": {"id": "9d4effd9-bf5c-41a7-a8e2-18d2177ace34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333645199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5d5ede0f2e44eaab914ffc17aef8aa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4be76ebe-21", "ovs_interfaceid": "4be76ebe-2106-4cff-9aba-a9c1acef3c57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'image_id': 'b6472c34-1b0f-4034-ba3a-7e8eb5103715'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 14:16:22 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:16:22 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:16:22 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 14:16:22 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] CPU controller missing on host. {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 14:16:22 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 14:16:22 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] CPU controller found on host. {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 14:16:22 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72129) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 14:16:22 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T13:45:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 14:16:22 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Flavor limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 14:16:22 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Image limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 14:16:22 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Flavor pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 14:16:22 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Image pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 14:16:22 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 14:16:22 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 14:16:22 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 14:16:22 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Got 1 possible topologies {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 14:16:22 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 14:16:22 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 14:16:22 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:16:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1911490303',display_name='tempest-AttachVolumeNegativeTest-server-1911490303',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1911490303',id=43,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNlLEDDO8UZAAe7st+wafBwmBvjvlQL+99FkpCUaq7Wv7eLrrzSHXawb76osq3LmniuaoMtsCmQb+p7rkMHTabIahPh5C37PkmdPayYp6Y9uaRR6hJwMt7yoZf1zUQS0JA==',key_name='tempest-keypair-429919159',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f5d5ede0f2e44eaab914ffc17aef8aa8',ramdisk_id='',reservation_id='r-i630gard',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2079788087',owner_user_name='tempest-AttachVolumeNegativeTest-2079788087-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T14:16:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85308332b4084e9f8c1bf605f540434b',uuid=8043d318-06fd-4fb3-bd9f-533bff05d91a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4be76ebe-2106-4cff-9aba-a9c1acef3c57", "address": "fa:16:3e:b9:b0:19", "network": {"id": "9d4effd9-bf5c-41a7-a8e2-18d2177ace34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333645199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5d5ede0f2e44eaab914ffc17aef8aa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4be76ebe-21", "ovs_interfaceid": "4be76ebe-2106-4cff-9aba-a9c1acef3c57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 14:16:22 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Converting VIF {"id": "4be76ebe-2106-4cff-9aba-a9c1acef3c57", "address": "fa:16:3e:b9:b0:19", "network": {"id": "9d4effd9-bf5c-41a7-a8e2-18d2177ace34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333645199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5d5ede0f2e44eaab914ffc17aef8aa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4be76ebe-21", "ovs_interfaceid": "4be76ebe-2106-4cff-9aba-a9c1acef3c57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:16:22 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:b0:19,bridge_name='br-int',has_traffic_filtering=True,id=4be76ebe-2106-4cff-9aba-a9c1acef3c57,network=Network(9d4effd9-bf5c-41a7-a8e2-18d2177ace34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4be76ebe-21') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:16:22 user nova-compute[72129]: DEBUG nova.objects.instance [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lazy-loading 'pci_devices' on Instance uuid 8043d318-06fd-4fb3-bd9f-533bff05d91a {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:16:22 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] End _get_guest_xml xml=<domain type="kvm">
Aug 01 14:16:22 user nova-compute[72129]:   <uuid>8043d318-06fd-4fb3-bd9f-533bff05d91a</uuid>
Aug 01 14:16:22 user nova-compute[72129]:   <name>instance-0000002b</name>
Aug 01 14:16:22 user nova-compute[72129]:   <memory>524288</memory>
Aug 01 14:16:22 user nova-compute[72129]:   <vcpu>1</vcpu>
Aug 01 14:16:22 user nova-compute[72129]:   <metadata>
Aug 01 14:16:22 user nova-compute[72129]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 14:16:22 user nova-compute[72129]:       <nova:package version="0.0.0"/>
Aug 01 14:16:22 user nova-compute[72129]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1911490303</nova:name>
Aug 01 14:16:22 user nova-compute[72129]:       <nova:creationTime>2023-08-01 14:16:22</nova:creationTime>
Aug 01 14:16:22 user nova-compute[72129]:       <nova:flavor name="m1.tiny">
Aug 01 14:16:22 user nova-compute[72129]:         <nova:memory>512</nova:memory>
Aug 01 14:16:22 user nova-compute[72129]:         <nova:disk>1</nova:disk>
Aug 01 14:16:22 user nova-compute[72129]:         <nova:swap>0</nova:swap>
Aug 01 14:16:22 user nova-compute[72129]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 14:16:22 user nova-compute[72129]:         <nova:vcpus>1</nova:vcpus>
Aug 01 14:16:22 user nova-compute[72129]:       </nova:flavor>
Aug 01 14:16:22 user nova-compute[72129]:       <nova:owner>
Aug 01 14:16:22 user nova-compute[72129]:         <nova:user uuid="85308332b4084e9f8c1bf605f540434b">tempest-AttachVolumeNegativeTest-2079788087-project-member</nova:user>
Aug 01 14:16:22 user nova-compute[72129]:         <nova:project uuid="f5d5ede0f2e44eaab914ffc17aef8aa8">tempest-AttachVolumeNegativeTest-2079788087</nova:project>
Aug 01 14:16:22 user nova-compute[72129]:       </nova:owner>
Aug 01 14:16:22 user nova-compute[72129]:       <nova:root type="image" uuid="b6472c34-1b0f-4034-ba3a-7e8eb5103715"/>
Aug 01 14:16:22 user nova-compute[72129]:       <nova:ports>
Aug 01 14:16:22 user nova-compute[72129]:         <nova:port uuid="4be76ebe-2106-4cff-9aba-a9c1acef3c57">
Aug 01 14:16:22 user nova-compute[72129]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 01 14:16:22 user nova-compute[72129]:         </nova:port>
Aug 01 14:16:22 user nova-compute[72129]:       </nova:ports>
Aug 01 14:16:22 user nova-compute[72129]:     </nova:instance>
Aug 01 14:16:22 user nova-compute[72129]:   </metadata>
Aug 01 14:16:22 user nova-compute[72129]:   <sysinfo type="smbios">
Aug 01 14:16:22 user nova-compute[72129]:     <system>
Aug 01 14:16:22 user nova-compute[72129]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 14:16:22 user nova-compute[72129]:       <entry name="product">OpenStack Nova</entry>
Aug 01 14:16:22 user nova-compute[72129]:       <entry name="version">0.0.0</entry>
Aug 01 14:16:22 user nova-compute[72129]:       <entry name="serial">8043d318-06fd-4fb3-bd9f-533bff05d91a</entry>
Aug 01 14:16:22 user nova-compute[72129]:       <entry name="uuid">8043d318-06fd-4fb3-bd9f-533bff05d91a</entry>
Aug 01 14:16:22 user nova-compute[72129]:       <entry name="family">Virtual Machine</entry>
Aug 01 14:16:22 user nova-compute[72129]:     </system>
Aug 01 14:16:22 user nova-compute[72129]:   </sysinfo>
Aug 01 14:16:22 user nova-compute[72129]:   <os>
Aug 01 14:16:22 user nova-compute[72129]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 14:16:22 user nova-compute[72129]:     <boot dev="hd"/>
Aug 01 14:16:22 user nova-compute[72129]:     <smbios mode="sysinfo"/>
Aug 01 14:16:22 user nova-compute[72129]:   </os>
Aug 01 14:16:22 user nova-compute[72129]:   <features>
Aug 01 14:16:22 user nova-compute[72129]:     <acpi/>
Aug 01 14:16:22 user nova-compute[72129]:     <apic/>
Aug 01 14:16:22 user nova-compute[72129]:     <vmcoreinfo/>
Aug 01 14:16:22 user nova-compute[72129]:   </features>
Aug 01 14:16:22 user nova-compute[72129]:   <clock offset="utc">
Aug 01 14:16:22 user nova-compute[72129]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 14:16:22 user nova-compute[72129]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 14:16:22 user nova-compute[72129]:     <timer name="hpet" present="no"/>
Aug 01 14:16:22 user nova-compute[72129]:   </clock>
Aug 01 14:16:22 user nova-compute[72129]:   <cpu mode="custom" match="exact">
Aug 01 14:16:22 user nova-compute[72129]:     <model>Nehalem</model>
Aug 01 14:16:22 user nova-compute[72129]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 14:16:22 user nova-compute[72129]:   </cpu>
Aug 01 14:16:22 user nova-compute[72129]:   <devices>
Aug 01 14:16:22 user nova-compute[72129]:     <disk type="file" device="disk">
Aug 01 14:16:22 user nova-compute[72129]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 14:16:22 user nova-compute[72129]:       <source file="/opt/stack/data/nova/instances/8043d318-06fd-4fb3-bd9f-533bff05d91a/disk"/>
Aug 01 14:16:22 user nova-compute[72129]:       <target dev="vda" bus="virtio"/>
Aug 01 14:16:22 user nova-compute[72129]:     </disk>
Aug 01 14:16:22 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 14:16:22 user nova-compute[72129]:       <mac address="fa:16:3e:b9:b0:19"/>
Aug 01 14:16:22 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:16:22 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 14:16:22 user nova-compute[72129]:       <target dev="tap4be76ebe-21"/>
Aug 01 14:16:22 user nova-compute[72129]:     </interface>
Aug 01 14:16:22 user nova-compute[72129]:     <serial type="pty">
Aug 01 14:16:22 user nova-compute[72129]:       <log file="/opt/stack/data/nova/instances/8043d318-06fd-4fb3-bd9f-533bff05d91a/console.log" append="off"/>
Aug 01 14:16:22 user nova-compute[72129]:     </serial>
Aug 01 14:16:22 user nova-compute[72129]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 14:16:22 user nova-compute[72129]:     <video>
Aug 01 14:16:22 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:16:22 user nova-compute[72129]:     </video>
Aug 01 14:16:22 user nova-compute[72129]:     <rng model="virtio">
Aug 01 14:16:22 user nova-compute[72129]:       <backend model="random">/dev/urandom</backend>
Aug 01 14:16:22 user nova-compute[72129]:     </rng>
Aug 01 14:16:22 user nova-compute[72129]:     <controller type="usb" index="0" model="none"/>
Aug 01 14:16:22 user nova-compute[72129]:     <memballoon model="virtio">
Aug 01 14:16:22 user nova-compute[72129]:       <stats period="10"/>
Aug 01 14:16:22 user nova-compute[72129]:     </memballoon>
Aug 01 14:16:22 user nova-compute[72129]:   </devices>
Aug 01 14:16:22 user nova-compute[72129]: </domain>
Aug 01 14:16:22 user nova-compute[72129]:  {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 14:16:22 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:16:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1911490303',display_name='tempest-AttachVolumeNegativeTest-server-1911490303',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1911490303',id=43,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNlLEDDO8UZAAe7st+wafBwmBvjvlQL+99FkpCUaq7Wv7eLrrzSHXawb76osq3LmniuaoMtsCmQb+p7rkMHTabIahPh5C37PkmdPayYp6Y9uaRR6hJwMt7yoZf1zUQS0JA==',key_name='tempest-keypair-429919159',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f5d5ede0f2e44eaab914ffc17aef8aa8',ramdisk_id='',reservation_id='r-i630gard',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2079788087',owner_user_name='tempest-AttachVolumeNegativeTest-2079788087-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T14:16:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85308332b4084e9f8c1bf605f540434b',uuid=8043d318-06fd-4fb3-bd9f-533bff05d91a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4be76ebe-2106-4cff-9aba-a9c1acef3c57", "address": "fa:16:3e:b9:b0:19", "network": {"id": "9d4effd9-bf5c-41a7-a8e2-18d2177ace34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333645199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5d5ede0f2e44eaab914ffc17aef8aa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4be76ebe-21", "ovs_interfaceid": "4be76ebe-2106-4cff-9aba-a9c1acef3c57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 14:16:22 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Converting VIF {"id": "4be76ebe-2106-4cff-9aba-a9c1acef3c57", "address": "fa:16:3e:b9:b0:19", "network": {"id": "9d4effd9-bf5c-41a7-a8e2-18d2177ace34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333645199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5d5ede0f2e44eaab914ffc17aef8aa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4be76ebe-21", "ovs_interfaceid": "4be76ebe-2106-4cff-9aba-a9c1acef3c57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:16:22 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:b0:19,bridge_name='br-int',has_traffic_filtering=True,id=4be76ebe-2106-4cff-9aba-a9c1acef3c57,network=Network(9d4effd9-bf5c-41a7-a8e2-18d2177ace34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4be76ebe-21') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:16:22 user nova-compute[72129]: DEBUG os_vif [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:b0:19,bridge_name='br-int',has_traffic_filtering=True,id=4be76ebe-2106-4cff-9aba-a9c1acef3c57,network=Network(9d4effd9-bf5c-41a7-a8e2-18d2177ace34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4be76ebe-21') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 14:16:22 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:16:22 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:16:22 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 14:16:22 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:16:22 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4be76ebe-21, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:16:22 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4be76ebe-21, col_values=(('external_ids', {'iface-id': '4be76ebe-2106-4cff-9aba-a9c1acef3c57', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:b0:19', 'vm-uuid': '8043d318-06fd-4fb3-bd9f-533bff05d91a'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:16:22 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:16:22 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:16:22 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:16:22 user nova-compute[72129]: INFO os_vif [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:b0:19,bridge_name='br-int',has_traffic_filtering=True,id=4be76ebe-2106-4cff-9aba-a9c1acef3c57,network=Network(9d4effd9-bf5c-41a7-a8e2-18d2177ace34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4be76ebe-21')
Aug 01 14:16:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:16:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] No VIF found with MAC fa:16:3e:b9:b0:19, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 14:16:23 user nova-compute[72129]: DEBUG nova.network.neutron [req-f0c469e3-e5eb-4719-adda-0046af8d4ac0 req-f4bce4ba-f745-476e-8352-37c4e66bab45 service nova] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] Updated VIF entry in instance network info cache for port 4be76ebe-2106-4cff-9aba-a9c1acef3c57. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 14:16:23 user nova-compute[72129]: DEBUG nova.network.neutron [req-f0c469e3-e5eb-4719-adda-0046af8d4ac0 req-f4bce4ba-f745-476e-8352-37c4e66bab45 service nova] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] Updating instance_info_cache with network_info: [{"id": "4be76ebe-2106-4cff-9aba-a9c1acef3c57", "address": "fa:16:3e:b9:b0:19", "network": {"id": "9d4effd9-bf5c-41a7-a8e2-18d2177ace34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333645199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5d5ede0f2e44eaab914ffc17aef8aa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4be76ebe-21", "ovs_interfaceid": "4be76ebe-2106-4cff-9aba-a9c1acef3c57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:16:23 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f0c469e3-e5eb-4719-adda-0046af8d4ac0 req-f4bce4ba-f745-476e-8352-37c4e66bab45 service nova] Releasing lock "refresh_cache-8043d318-06fd-4fb3-bd9f-533bff05d91a" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:16:24 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:16:24 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:16:24 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:16:24 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:16:24 user nova-compute[72129]: DEBUG nova.compute.manager [req-a3839bac-765c-417c-96fa-63eb52fca8aa req-9abc76ba-c9cc-4920-b569-a3bfecb40c76 service nova] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] Received event network-vif-plugged-4be76ebe-2106-4cff-9aba-a9c1acef3c57 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:16:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-a3839bac-765c-417c-96fa-63eb52fca8aa req-9abc76ba-c9cc-4920-b569-a3bfecb40c76 service nova] Acquiring lock "8043d318-06fd-4fb3-bd9f-533bff05d91a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:16:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-a3839bac-765c-417c-96fa-63eb52fca8aa req-9abc76ba-c9cc-4920-b569-a3bfecb40c76 service nova] Lock "8043d318-06fd-4fb3-bd9f-533bff05d91a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:16:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-a3839bac-765c-417c-96fa-63eb52fca8aa req-9abc76ba-c9cc-4920-b569-a3bfecb40c76 service nova] Lock "8043d318-06fd-4fb3-bd9f-533bff05d91a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:16:24 user nova-compute[72129]: DEBUG nova.compute.manager [req-a3839bac-765c-417c-96fa-63eb52fca8aa req-9abc76ba-c9cc-4920-b569-a3bfecb40c76 service nova] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] No waiting events found dispatching network-vif-plugged-4be76ebe-2106-4cff-9aba-a9c1acef3c57 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:16:24 user nova-compute[72129]: WARNING nova.compute.manager [req-a3839bac-765c-417c-96fa-63eb52fca8aa req-9abc76ba-c9cc-4920-b569-a3bfecb40c76 service nova] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] Received unexpected event network-vif-plugged-4be76ebe-2106-4cff-9aba-a9c1acef3c57 for instance with vm_state building and task_state spawning.
Aug 01 14:16:25 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:16:27 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:16:27 user nova-compute[72129]: DEBUG nova.compute.manager [req-b139d4bf-a543-451b-953f-0489d479eb4b req-169e89a8-6c6b-4373-b26f-811be537a6a7 service nova] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] Received event network-vif-plugged-4be76ebe-2106-4cff-9aba-a9c1acef3c57 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:16:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-b139d4bf-a543-451b-953f-0489d479eb4b req-169e89a8-6c6b-4373-b26f-811be537a6a7 service nova] Acquiring lock "8043d318-06fd-4fb3-bd9f-533bff05d91a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:16:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-b139d4bf-a543-451b-953f-0489d479eb4b req-169e89a8-6c6b-4373-b26f-811be537a6a7 service nova] Lock "8043d318-06fd-4fb3-bd9f-533bff05d91a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:16:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-b139d4bf-a543-451b-953f-0489d479eb4b req-169e89a8-6c6b-4373-b26f-811be537a6a7 service nova] Lock "8043d318-06fd-4fb3-bd9f-533bff05d91a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:16:27 user nova-compute[72129]: DEBUG nova.compute.manager [req-b139d4bf-a543-451b-953f-0489d479eb4b req-169e89a8-6c6b-4373-b26f-811be537a6a7 service nova] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] No waiting events found dispatching network-vif-plugged-4be76ebe-2106-4cff-9aba-a9c1acef3c57 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:16:27 user nova-compute[72129]: WARNING nova.compute.manager [req-b139d4bf-a543-451b-953f-0489d479eb4b req-169e89a8-6c6b-4373-b26f-811be537a6a7 service nova] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] Received unexpected event network-vif-plugged-4be76ebe-2106-4cff-9aba-a9c1acef3c57 for instance with vm_state building and task_state spawning.
Aug 01 14:16:27 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:16:28 user nova-compute[72129]: DEBUG nova.compute.manager [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] Instance event wait completed in 0 seconds for  {{(pid=72129) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 14:16:28 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] Guest created on hypervisor {{(pid=72129) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 14:16:28 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] Instance spawned successfully.
Aug 01 14:16:28 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 14:16:28 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690899388.1481717, 8043d318-06fd-4fb3-bd9f-533bff05d91a => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:16:28 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] VM Resumed (Lifecycle Event)
Aug 01 14:16:28 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:16:28 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:16:28 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] Found default for hw_cdrom_bus of ide {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:16:28 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] Found default for hw_disk_bus of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:16:28 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] Found default for hw_input_bus of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:16:28 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] Found default for hw_pointer_model of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:16:28 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] Found default for hw_video_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:16:28 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] Found default for hw_vif_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:16:28 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 14:16:28 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690899388.1524181, 8043d318-06fd-4fb3-bd9f-533bff05d91a => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:16:28 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] VM Started (Lifecycle Event)
Aug 01 14:16:28 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:16:28 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:16:28 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 14:16:28 user nova-compute[72129]: INFO nova.compute.manager [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] Took 7.54 seconds to spawn the instance on the hypervisor.
Aug 01 14:16:28 user nova-compute[72129]: DEBUG nova.compute.manager [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:16:28 user nova-compute[72129]: INFO nova.compute.manager [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] Took 8.18 seconds to build instance.
Aug 01 14:16:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-7e684d75-15f5-452a-955f-c400f62e5d93 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "8043d318-06fd-4fb3-bd9f-533bff05d91a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.284s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:16:32 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:16:32 user nova-compute[72129]: INFO nova.compute.manager [None req-58119811-fc0e-4b27-be41-fbd4bf1b2be1 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Rescuing
Aug 01 14:16:32 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-58119811-fc0e-4b27-be41-fbd4bf1b2be1 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Acquiring lock "refresh_cache-3bdb8e41-8cd5-4c33-9624-d262cacd0f5d" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:16:32 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-58119811-fc0e-4b27-be41-fbd4bf1b2be1 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Acquired lock "refresh_cache-3bdb8e41-8cd5-4c33-9624-d262cacd0f5d" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:16:32 user nova-compute[72129]: DEBUG nova.network.neutron [None req-58119811-fc0e-4b27-be41-fbd4bf1b2be1 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 14:16:32 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:16:33 user nova-compute[72129]: DEBUG nova.network.neutron [None req-58119811-fc0e-4b27-be41-fbd4bf1b2be1 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Updating instance_info_cache with network_info: [{"id": "10889d2c-ec62-4b92-b325-0f5d7d67851f", "address": "fa:16:3e:52:40:4c", "network": {"id": "6ffcec16-7b44-472a-b7cd-af16ebd4a653", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-901464581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cca3e17d4e4df79c94c4b94fb3fcec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10889d2c-ec", "ovs_interfaceid": "10889d2c-ec62-4b92-b325-0f5d7d67851f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:16:33 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-58119811-fc0e-4b27-be41-fbd4bf1b2be1 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Releasing lock "refresh_cache-3bdb8e41-8cd5-4c33-9624-d262cacd0f5d" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:16:33 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:16:33 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:16:33 user nova-compute[72129]: DEBUG nova.compute.manager [req-261c92b5-f996-4c78-b5f9-563fb746fc64 req-a26cbc44-4115-4631-af08-ddab547a09b8 service nova] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Received event network-vif-unplugged-10889d2c-ec62-4b92-b325-0f5d7d67851f {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:16:33 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-261c92b5-f996-4c78-b5f9-563fb746fc64 req-a26cbc44-4115-4631-af08-ddab547a09b8 service nova] Acquiring lock "3bdb8e41-8cd5-4c33-9624-d262cacd0f5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:16:33 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-261c92b5-f996-4c78-b5f9-563fb746fc64 req-a26cbc44-4115-4631-af08-ddab547a09b8 service nova] Lock "3bdb8e41-8cd5-4c33-9624-d262cacd0f5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:16:33 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-261c92b5-f996-4c78-b5f9-563fb746fc64 req-a26cbc44-4115-4631-af08-ddab547a09b8 service nova] Lock "3bdb8e41-8cd5-4c33-9624-d262cacd0f5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:16:34 user nova-compute[72129]: DEBUG nova.compute.manager [req-261c92b5-f996-4c78-b5f9-563fb746fc64 req-a26cbc44-4115-4631-af08-ddab547a09b8 service nova] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] No waiting events found dispatching network-vif-unplugged-10889d2c-ec62-4b92-b325-0f5d7d67851f {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:16:34 user nova-compute[72129]: WARNING nova.compute.manager [req-261c92b5-f996-4c78-b5f9-563fb746fc64 req-a26cbc44-4115-4631-af08-ddab547a09b8 service nova] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Received unexpected event network-vif-unplugged-10889d2c-ec62-4b92-b325-0f5d7d67851f for instance with vm_state active and task_state rescuing.
Aug 01 14:16:34 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:16:34 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:16:34 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:16:34 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:16:34 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Instance destroyed successfully.
Aug 01 14:16:34 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-58119811-fc0e-4b27-be41-fbd4bf1b2be1 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Attempting rescue
Aug 01 14:16:34 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-58119811-fc0e-4b27-be41-fbd4bf1b2be1 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72129) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 01 14:16:34 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-58119811-fc0e-4b27-be41-fbd4bf1b2be1 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Instance directory exists: not creating {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 01 14:16:34 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-58119811-fc0e-4b27-be41-fbd4bf1b2be1 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Creating image(s)
Aug 01 14:16:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-58119811-fc0e-4b27-be41-fbd4bf1b2be1 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Acquiring lock "/opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:16:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-58119811-fc0e-4b27-be41-fbd4bf1b2be1 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lock "/opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:16:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-58119811-fc0e-4b27-be41-fbd4bf1b2be1 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lock "/opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:16:34 user nova-compute[72129]: DEBUG nova.objects.instance [None req-58119811-fc0e-4b27-be41-fbd4bf1b2be1 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:16:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-58119811-fc0e-4b27-be41-fbd4bf1b2be1 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Acquiring lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:16:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-58119811-fc0e-4b27-be41-fbd4bf1b2be1 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:16:34 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-58119811-fc0e-4b27-be41-fbd4bf1b2be1 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:16:34 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:16:34 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-58119811-fc0e-4b27-be41-fbd4bf1b2be1 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.187s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:16:34 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-58119811-fc0e-4b27-be41-fbd4bf1b2be1 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk.rescue {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:16:34 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:16:34 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-58119811-fc0e-4b27-be41-fbd4bf1b2be1 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk.rescue" returned: 0 in 0.076s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:16:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-58119811-fc0e-4b27-be41-fbd4bf1b2be1 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:16:34 user nova-compute[72129]: DEBUG nova.objects.instance [None req-58119811-fc0e-4b27-be41-fbd4bf1b2be1 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lazy-loading 'migration_context' on Instance uuid 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:16:34 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-58119811-fc0e-4b27-be41-fbd4bf1b2be1 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Created local disks {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 14:16:34 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-58119811-fc0e-4b27-be41-fbd4bf1b2be1 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Start _get_guest_xml network_info=[{"id": "10889d2c-ec62-4b92-b325-0f5d7d67851f", "address": "fa:16:3e:52:40:4c", "network": {"id": "6ffcec16-7b44-472a-b7cd-af16ebd4a653", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-901464581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-901464581-network", "vif_mac": "fa:16:3e:52:40:4c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cca3e17d4e4df79c94c4b94fb3fcec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10889d2c-ec", "ovs_interfaceid": "10889d2c-ec62-4b92-b325-0f5d7d67851f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'b6472c34-1b0f-4034-ba3a-7e8eb5103715', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 14:16:34 user nova-compute[72129]: DEBUG nova.objects.instance [None req-58119811-fc0e-4b27-be41-fbd4bf1b2be1 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lazy-loading 'resources' on Instance uuid 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:16:34 user nova-compute[72129]: DEBUG nova.objects.instance [None req-58119811-fc0e-4b27-be41-fbd4bf1b2be1 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lazy-loading 'numa_topology' on Instance uuid 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:16:34 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-58119811-fc0e-4b27-be41-fbd4bf1b2be1 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:16:34 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-58119811-fc0e-4b27-be41-fbd4bf1b2be1 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:16:34 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-58119811-fc0e-4b27-be41-fbd4bf1b2be1 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 14:16:34 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-58119811-fc0e-4b27-be41-fbd4bf1b2be1 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] CPU controller missing on host. {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 14:16:34 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-58119811-fc0e-4b27-be41-fbd4bf1b2be1 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 14:16:34 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-58119811-fc0e-4b27-be41-fbd4bf1b2be1 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] CPU controller found on host. {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 14:16:34 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-58119811-fc0e-4b27-be41-fbd4bf1b2be1 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72129) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 14:16:34 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-58119811-fc0e-4b27-be41-fbd4bf1b2be1 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T13:45:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 14:16:34 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-58119811-fc0e-4b27-be41-fbd4bf1b2be1 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Flavor limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 14:16:34 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-58119811-fc0e-4b27-be41-fbd4bf1b2be1 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Image limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 14:16:34 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-58119811-fc0e-4b27-be41-fbd4bf1b2be1 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Flavor pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 14:16:34 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-58119811-fc0e-4b27-be41-fbd4bf1b2be1 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Image pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 14:16:34 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-58119811-fc0e-4b27-be41-fbd4bf1b2be1 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 14:16:34 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-58119811-fc0e-4b27-be41-fbd4bf1b2be1 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 14:16:34 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-58119811-fc0e-4b27-be41-fbd4bf1b2be1 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 14:16:34 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-58119811-fc0e-4b27-be41-fbd4bf1b2be1 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Got 1 possible topologies {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 14:16:34 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-58119811-fc0e-4b27-be41-fbd4bf1b2be1 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 14:16:34 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-58119811-fc0e-4b27-be41-fbd4bf1b2be1 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 14:16:34 user nova-compute[72129]: DEBUG nova.objects.instance [None req-58119811-fc0e-4b27-be41-fbd4bf1b2be1 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:16:34 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-58119811-fc0e-4b27-be41-fbd4bf1b2be1 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:14:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1844594790',display_name='tempest-ServerRescueNegativeTestJSON-server-1844594790',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1844594790',id=42,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T14:14:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='42cca3e17d4e4df79c94c4b94fb3fcec',ramdisk_id='',reservation_id='r-qb9lk1yt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-481576424',owner_user_name='tempest-ServerRescueNegativeTestJSON-481576424-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T14:14:49Z,user_data=None,user_id='deb1597afdc647598ee893dd51880173',uuid=3bdb8e41-8cd5-4c33-9624-d262cacd0f5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "10889d2c-ec62-4b92-b325-0f5d7d67851f", "address": "fa:16:3e:52:40:4c", "network": {"id": "6ffcec16-7b44-472a-b7cd-af16ebd4a653", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-901464581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-901464581-network", "vif_mac": "fa:16:3e:52:40:4c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cca3e17d4e4df79c94c4b94fb3fcec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10889d2c-ec", "ovs_interfaceid": "10889d2c-ec62-4b92-b325-0f5d7d67851f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 14:16:34 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-58119811-fc0e-4b27-be41-fbd4bf1b2be1 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Converting VIF {"id": "10889d2c-ec62-4b92-b325-0f5d7d67851f", "address": "fa:16:3e:52:40:4c", "network": {"id": "6ffcec16-7b44-472a-b7cd-af16ebd4a653", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-901464581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-901464581-network", "vif_mac": "fa:16:3e:52:40:4c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cca3e17d4e4df79c94c4b94fb3fcec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10889d2c-ec", "ovs_interfaceid": "10889d2c-ec62-4b92-b325-0f5d7d67851f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:16:34 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-58119811-fc0e-4b27-be41-fbd4bf1b2be1 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:52:40:4c,bridge_name='br-int',has_traffic_filtering=True,id=10889d2c-ec62-4b92-b325-0f5d7d67851f,network=Network(6ffcec16-7b44-472a-b7cd-af16ebd4a653),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10889d2c-ec') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:16:34 user nova-compute[72129]: DEBUG nova.objects.instance [None req-58119811-fc0e-4b27-be41-fbd4bf1b2be1 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lazy-loading 'pci_devices' on Instance uuid 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:16:34 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-58119811-fc0e-4b27-be41-fbd4bf1b2be1 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] End _get_guest_xml xml=<domain type="kvm">
Aug 01 14:16:34 user nova-compute[72129]:   <uuid>3bdb8e41-8cd5-4c33-9624-d262cacd0f5d</uuid>
Aug 01 14:16:34 user nova-compute[72129]:   <name>instance-0000002a</name>
Aug 01 14:16:34 user nova-compute[72129]:   <memory>524288</memory>
Aug 01 14:16:34 user nova-compute[72129]:   <vcpu>1</vcpu>
Aug 01 14:16:34 user nova-compute[72129]:   <metadata>
Aug 01 14:16:34 user nova-compute[72129]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 14:16:34 user nova-compute[72129]:       <nova:package version="0.0.0"/>
Aug 01 14:16:34 user nova-compute[72129]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1844594790</nova:name>
Aug 01 14:16:34 user nova-compute[72129]:       <nova:creationTime>2023-08-01 14:16:34</nova:creationTime>
Aug 01 14:16:34 user nova-compute[72129]:       <nova:flavor name="m1.tiny">
Aug 01 14:16:34 user nova-compute[72129]:         <nova:memory>512</nova:memory>
Aug 01 14:16:34 user nova-compute[72129]:         <nova:disk>1</nova:disk>
Aug 01 14:16:34 user nova-compute[72129]:         <nova:swap>0</nova:swap>
Aug 01 14:16:34 user nova-compute[72129]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 14:16:34 user nova-compute[72129]:         <nova:vcpus>1</nova:vcpus>
Aug 01 14:16:34 user nova-compute[72129]:       </nova:flavor>
Aug 01 14:16:34 user nova-compute[72129]:       <nova:owner>
Aug 01 14:16:34 user nova-compute[72129]:         <nova:user uuid="deb1597afdc647598ee893dd51880173">tempest-ServerRescueNegativeTestJSON-481576424-project-member</nova:user>
Aug 01 14:16:34 user nova-compute[72129]:         <nova:project uuid="42cca3e17d4e4df79c94c4b94fb3fcec">tempest-ServerRescueNegativeTestJSON-481576424</nova:project>
Aug 01 14:16:34 user nova-compute[72129]:       </nova:owner>
Aug 01 14:16:34 user nova-compute[72129]:       <nova:root type="image" uuid="b6472c34-1b0f-4034-ba3a-7e8eb5103715"/>
Aug 01 14:16:34 user nova-compute[72129]:       <nova:ports>
Aug 01 14:16:34 user nova-compute[72129]:         <nova:port uuid="10889d2c-ec62-4b92-b325-0f5d7d67851f">
Aug 01 14:16:34 user nova-compute[72129]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 01 14:16:34 user nova-compute[72129]:         </nova:port>
Aug 01 14:16:34 user nova-compute[72129]:       </nova:ports>
Aug 01 14:16:34 user nova-compute[72129]:     </nova:instance>
Aug 01 14:16:34 user nova-compute[72129]:   </metadata>
Aug 01 14:16:34 user nova-compute[72129]:   <sysinfo type="smbios">
Aug 01 14:16:34 user nova-compute[72129]:     <system>
Aug 01 14:16:34 user nova-compute[72129]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 14:16:34 user nova-compute[72129]:       <entry name="product">OpenStack Nova</entry>
Aug 01 14:16:34 user nova-compute[72129]:       <entry name="version">0.0.0</entry>
Aug 01 14:16:34 user nova-compute[72129]:       <entry name="serial">3bdb8e41-8cd5-4c33-9624-d262cacd0f5d</entry>
Aug 01 14:16:34 user nova-compute[72129]:       <entry name="uuid">3bdb8e41-8cd5-4c33-9624-d262cacd0f5d</entry>
Aug 01 14:16:34 user nova-compute[72129]:       <entry name="family">Virtual Machine</entry>
Aug 01 14:16:34 user nova-compute[72129]:     </system>
Aug 01 14:16:34 user nova-compute[72129]:   </sysinfo>
Aug 01 14:16:34 user nova-compute[72129]:   <os>
Aug 01 14:16:34 user nova-compute[72129]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 14:16:34 user nova-compute[72129]:     <smbios mode="sysinfo"/>
Aug 01 14:16:34 user nova-compute[72129]:   </os>
Aug 01 14:16:34 user nova-compute[72129]:   <features>
Aug 01 14:16:34 user nova-compute[72129]:     <acpi/>
Aug 01 14:16:34 user nova-compute[72129]:     <apic/>
Aug 01 14:16:34 user nova-compute[72129]:     <vmcoreinfo/>
Aug 01 14:16:34 user nova-compute[72129]:   </features>
Aug 01 14:16:34 user nova-compute[72129]:   <clock offset="utc">
Aug 01 14:16:34 user nova-compute[72129]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 14:16:34 user nova-compute[72129]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 14:16:34 user nova-compute[72129]:     <timer name="hpet" present="no"/>
Aug 01 14:16:34 user nova-compute[72129]:   </clock>
Aug 01 14:16:34 user nova-compute[72129]:   <cpu mode="custom" match="exact">
Aug 01 14:16:34 user nova-compute[72129]:     <model>Nehalem</model>
Aug 01 14:16:34 user nova-compute[72129]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 14:16:34 user nova-compute[72129]:   </cpu>
Aug 01 14:16:34 user nova-compute[72129]:   <devices>
Aug 01 14:16:34 user nova-compute[72129]:     <disk type="file" device="disk">
Aug 01 14:16:34 user nova-compute[72129]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 14:16:34 user nova-compute[72129]:       <source file="/opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk.rescue"/>
Aug 01 14:16:34 user nova-compute[72129]:       <target dev="vda" bus="virtio"/>
Aug 01 14:16:34 user nova-compute[72129]:     </disk>
Aug 01 14:16:34 user nova-compute[72129]:     <disk type="file" device="disk">
Aug 01 14:16:34 user nova-compute[72129]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 14:16:34 user nova-compute[72129]:       <source file="/opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk"/>
Aug 01 14:16:34 user nova-compute[72129]:       <target dev="vdb" bus="virtio"/>
Aug 01 14:16:34 user nova-compute[72129]:     </disk>
Aug 01 14:16:34 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 14:16:34 user nova-compute[72129]:       <mac address="fa:16:3e:52:40:4c"/>
Aug 01 14:16:34 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:16:34 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 14:16:34 user nova-compute[72129]:       <target dev="tap10889d2c-ec"/>
Aug 01 14:16:34 user nova-compute[72129]:     </interface>
Aug 01 14:16:34 user nova-compute[72129]:     <serial type="pty">
Aug 01 14:16:34 user nova-compute[72129]:       <log file="/opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/console.log" append="off"/>
Aug 01 14:16:34 user nova-compute[72129]:     </serial>
Aug 01 14:16:34 user nova-compute[72129]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 14:16:34 user nova-compute[72129]:     <video>
Aug 01 14:16:34 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:16:34 user nova-compute[72129]:     </video>
Aug 01 14:16:34 user nova-compute[72129]:     <rng model="virtio">
Aug 01 14:16:34 user nova-compute[72129]:       <backend model="random">/dev/urandom</backend>
Aug 01 14:16:34 user nova-compute[72129]:     </rng>
Aug 01 14:16:34 user nova-compute[72129]:     <controller type="usb" index="0" model="none"/>
Aug 01 14:16:34 user nova-compute[72129]:     <memballoon model="virtio">
Aug 01 14:16:34 user nova-compute[72129]:       <stats period="10"/>
Aug 01 14:16:34 user nova-compute[72129]:     </memballoon>
Aug 01 14:16:34 user nova-compute[72129]:   </devices>
Aug 01 14:16:34 user nova-compute[72129]: </domain>
Aug 01 14:16:34 user nova-compute[72129]:  {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 14:16:34 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Instance destroyed successfully.
Aug 01 14:16:35 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:16:35 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:16:35 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-58119811-fc0e-4b27-be41-fbd4bf1b2be1 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:16:35 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-58119811-fc0e-4b27-be41-fbd4bf1b2be1 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:16:35 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-58119811-fc0e-4b27-be41-fbd4bf1b2be1 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] No VIF found with MAC fa:16:3e:52:40:4c, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 14:16:35 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:16:36 user nova-compute[72129]: DEBUG nova.compute.manager [req-73c0bb8e-257f-4453-90f9-f6dafe6eec74 req-3fefc47a-4e80-4cbe-93e7-bd61295fa3f9 service nova] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Received event network-vif-plugged-10889d2c-ec62-4b92-b325-0f5d7d67851f {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:16:36 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-73c0bb8e-257f-4453-90f9-f6dafe6eec74 req-3fefc47a-4e80-4cbe-93e7-bd61295fa3f9 service nova] Acquiring lock "3bdb8e41-8cd5-4c33-9624-d262cacd0f5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:16:36 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-73c0bb8e-257f-4453-90f9-f6dafe6eec74 req-3fefc47a-4e80-4cbe-93e7-bd61295fa3f9 service nova] Lock "3bdb8e41-8cd5-4c33-9624-d262cacd0f5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:16:36 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-73c0bb8e-257f-4453-90f9-f6dafe6eec74 req-3fefc47a-4e80-4cbe-93e7-bd61295fa3f9 service nova] Lock "3bdb8e41-8cd5-4c33-9624-d262cacd0f5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:16:36 user nova-compute[72129]: DEBUG nova.compute.manager [req-73c0bb8e-257f-4453-90f9-f6dafe6eec74 req-3fefc47a-4e80-4cbe-93e7-bd61295fa3f9 service nova] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] No waiting events found dispatching network-vif-plugged-10889d2c-ec62-4b92-b325-0f5d7d67851f {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:16:36 user nova-compute[72129]: WARNING nova.compute.manager [req-73c0bb8e-257f-4453-90f9-f6dafe6eec74 req-3fefc47a-4e80-4cbe-93e7-bd61295fa3f9 service nova] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Received unexpected event network-vif-plugged-10889d2c-ec62-4b92-b325-0f5d7d67851f for instance with vm_state active and task_state rescuing.
Aug 01 14:16:36 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:16:36 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:16:36 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:16:36 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:16:36 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:16:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:16:38 user nova-compute[72129]: DEBUG nova.compute.manager [req-061f292a-1ae4-497e-9fbc-cc7b713109c5 req-417cd571-3aa5-4d19-88c0-311381e97569 service nova] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Received event network-vif-plugged-10889d2c-ec62-4b92-b325-0f5d7d67851f {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:16:38 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-061f292a-1ae4-497e-9fbc-cc7b713109c5 req-417cd571-3aa5-4d19-88c0-311381e97569 service nova] Acquiring lock "3bdb8e41-8cd5-4c33-9624-d262cacd0f5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:16:38 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-061f292a-1ae4-497e-9fbc-cc7b713109c5 req-417cd571-3aa5-4d19-88c0-311381e97569 service nova] Lock "3bdb8e41-8cd5-4c33-9624-d262cacd0f5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:16:38 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-061f292a-1ae4-497e-9fbc-cc7b713109c5 req-417cd571-3aa5-4d19-88c0-311381e97569 service nova] Lock "3bdb8e41-8cd5-4c33-9624-d262cacd0f5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:16:38 user nova-compute[72129]: DEBUG nova.compute.manager [req-061f292a-1ae4-497e-9fbc-cc7b713109c5 req-417cd571-3aa5-4d19-88c0-311381e97569 service nova] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] No waiting events found dispatching network-vif-plugged-10889d2c-ec62-4b92-b325-0f5d7d67851f {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:16:38 user nova-compute[72129]: WARNING nova.compute.manager [req-061f292a-1ae4-497e-9fbc-cc7b713109c5 req-417cd571-3aa5-4d19-88c0-311381e97569 service nova] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Received unexpected event network-vif-plugged-10889d2c-ec62-4b92-b325-0f5d7d67851f for instance with vm_state active and task_state rescuing.
Aug 01 14:16:38 user nova-compute[72129]: DEBUG nova.compute.manager [req-061f292a-1ae4-497e-9fbc-cc7b713109c5 req-417cd571-3aa5-4d19-88c0-311381e97569 service nova] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Received event network-vif-plugged-10889d2c-ec62-4b92-b325-0f5d7d67851f {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:16:38 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-061f292a-1ae4-497e-9fbc-cc7b713109c5 req-417cd571-3aa5-4d19-88c0-311381e97569 service nova] Acquiring lock "3bdb8e41-8cd5-4c33-9624-d262cacd0f5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:16:38 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-061f292a-1ae4-497e-9fbc-cc7b713109c5 req-417cd571-3aa5-4d19-88c0-311381e97569 service nova] Lock "3bdb8e41-8cd5-4c33-9624-d262cacd0f5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:16:38 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-061f292a-1ae4-497e-9fbc-cc7b713109c5 req-417cd571-3aa5-4d19-88c0-311381e97569 service nova] Lock "3bdb8e41-8cd5-4c33-9624-d262cacd0f5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:16:38 user nova-compute[72129]: DEBUG nova.compute.manager [req-061f292a-1ae4-497e-9fbc-cc7b713109c5 req-417cd571-3aa5-4d19-88c0-311381e97569 service nova] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] No waiting events found dispatching network-vif-plugged-10889d2c-ec62-4b92-b325-0f5d7d67851f {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:16:38 user nova-compute[72129]: WARNING nova.compute.manager [req-061f292a-1ae4-497e-9fbc-cc7b713109c5 req-417cd571-3aa5-4d19-88c0-311381e97569 service nova] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Received unexpected event network-vif-plugged-10889d2c-ec62-4b92-b325-0f5d7d67851f for instance with vm_state active and task_state rescuing.
Aug 01 14:16:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Removed pending event for 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d due to event {{(pid=72129) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 14:16:38 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690899398.8005514, 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:16:38 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] VM Resumed (Lifecycle Event)
Aug 01 14:16:38 user nova-compute[72129]: DEBUG nova.compute.manager [None req-58119811-fc0e-4b27-be41-fbd4bf1b2be1 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:16:38 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:16:38 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:16:38 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 01 14:16:38 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690899398.8025134, 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:16:38 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] VM Started (Lifecycle Event)
Aug 01 14:16:38 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:16:38 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:16:41 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:16:42 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:16:44 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:16:44 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Triggering sync for uuid 5c3a4469-30fd-4f27-a3b7-957422dd2746 {{(pid=72129) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 14:16:44 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Triggering sync for uuid b3f54430-8d5d-478b-8dc7-d7592ee3db36 {{(pid=72129) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 14:16:44 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Triggering sync for uuid 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d {{(pid=72129) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 14:16:44 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Triggering sync for uuid 8043d318-06fd-4fb3-bd9f-533bff05d91a {{(pid=72129) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 14:16:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "5c3a4469-30fd-4f27-a3b7-957422dd2746" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:16:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "5c3a4469-30fd-4f27-a3b7-957422dd2746" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:16:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "b3f54430-8d5d-478b-8dc7-d7592ee3db36" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:16:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "b3f54430-8d5d-478b-8dc7-d7592ee3db36" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:16:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "3bdb8e41-8cd5-4c33-9624-d262cacd0f5d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:16:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "3bdb8e41-8cd5-4c33-9624-d262cacd0f5d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:16:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "8043d318-06fd-4fb3-bd9f-533bff05d91a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:16:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "8043d318-06fd-4fb3-bd9f-533bff05d91a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:16:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "5c3a4469-30fd-4f27-a3b7-957422dd2746" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:16:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "b3f54430-8d5d-478b-8dc7-d7592ee3db36" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:16:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "3bdb8e41-8cd5-4c33-9624-d262cacd0f5d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:16:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "8043d318-06fd-4fb3-bd9f-533bff05d91a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:16:46 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:16:47 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:16:47 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:16:51 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:16:52 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:16:53 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:16:55 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:16:55 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72129) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 14:16:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:16:56 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:16:57 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:16:59 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:16:59 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Starting heal instance info cache {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 14:16:59 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Rebuilding the list of instances to heal {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 14:16:59 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "refresh_cache-5c3a4469-30fd-4f27-a3b7-957422dd2746" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:16:59 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquired lock "refresh_cache-5c3a4469-30fd-4f27-a3b7-957422dd2746" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:16:59 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Forcefully refreshing network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 14:16:59 user nova-compute[72129]: DEBUG nova.objects.instance [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lazy-loading 'info_cache' on Instance uuid 5c3a4469-30fd-4f27-a3b7-957422dd2746 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:16:59 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Updating instance_info_cache with network_info: [{"id": "7f4ef5f0-b138-43aa-ad82-ced2ff871e3d", "address": "fa:16:3e:5d:46:e3", "network": {"id": "9d4effd9-bf5c-41a7-a8e2-18d2177ace34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333645199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5d5ede0f2e44eaab914ffc17aef8aa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f4ef5f0-b1", "ovs_interfaceid": "7f4ef5f0-b138-43aa-ad82-ced2ff871e3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:16:59 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Releasing lock "refresh_cache-5c3a4469-30fd-4f27-a3b7-957422dd2746" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:16:59 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Updated the network info_cache for instance {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 14:16:59 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:17:00 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:17:01 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:17:01 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:17:01 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:17:01 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:17:01 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Auditing locally available compute resources for user (node: user) {{(pid=72129) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 14:17:01 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8043d318-06fd-4fb3-bd9f-533bff05d91a/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:17:01 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8043d318-06fd-4fb3-bd9f-533bff05d91a/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:17:01 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8043d318-06fd-4fb3-bd9f-533bff05d91a/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:17:01 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:17:01 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8043d318-06fd-4fb3-bd9f-533bff05d91a/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:17:01 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3a4469-30fd-4f27-a3b7-957422dd2746/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:17:01 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3a4469-30fd-4f27-a3b7-957422dd2746/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:17:01 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3a4469-30fd-4f27-a3b7-957422dd2746/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:17:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3a4469-30fd-4f27-a3b7-957422dd2746/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:17:02 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 14:17:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:17:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:17:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:17:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:17:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk.rescue --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:17:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:17:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk.rescue --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:17:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:17:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:17:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:17:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:17:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:17:03 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:17:03 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:17:03 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:17:03 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Hypervisor/Node resource view: name=user free_ram=8382MB free_disk=25.13550567626953GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72129) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 14:17:03 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:17:03 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:17:03 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 5c3a4469-30fd-4f27-a3b7-957422dd2746 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:17:03 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance b3f54430-8d5d-478b-8dc7-d7592ee3db36 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:17:03 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:17:03 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 8043d318-06fd-4fb3-bd9f-533bff05d91a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:17:03 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 14:17:03 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 14:17:03 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:17:03 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:17:03 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Compute_service record updated for user:user {{(pid=72129) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 14:17:03 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.302s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:17:05 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:17:05 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:17:05 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:17:05 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:17:06 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:17:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Acquiring lock "804fb4da-65b9-449a-8e4d-e58e64250a20" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:17:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Lock "804fb4da-65b9-449a-8e4d-e58e64250a20" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:17:07 user nova-compute[72129]: DEBUG nova.compute.manager [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Starting instance... {{(pid=72129) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 14:17:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:17:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:17:07 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72129) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 14:17:07 user nova-compute[72129]: INFO nova.compute.claims [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Claim successful on node user
Aug 01 14:17:07 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:17:07 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:17:08 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.255s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:17:08 user nova-compute[72129]: DEBUG nova.compute.manager [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Start building networks asynchronously for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 14:17:08 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:17:08 user nova-compute[72129]: DEBUG nova.compute.manager [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Allocating IP information in the background. {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 14:17:08 user nova-compute[72129]: DEBUG nova.network.neutron [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] allocate_for_instance() {{(pid=72129) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 14:17:08 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 14:17:08 user nova-compute[72129]: DEBUG nova.compute.manager [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Start building block device mappings for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 14:17:08 user nova-compute[72129]: DEBUG nova.policy [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cab6f7398341468dbd829d828b3a7b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd203d0ad6e3c4379ae26ad8fb44f877d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72129) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 14:17:08 user nova-compute[72129]: DEBUG nova.compute.manager [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Start spawning the instance on the hypervisor. {{(pid=72129) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 14:17:08 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Creating instance directory {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 14:17:08 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Creating image(s)
Aug 01 14:17:08 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Acquiring lock "/opt/stack/data/nova/instances/804fb4da-65b9-449a-8e4d-e58e64250a20/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:17:08 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Lock "/opt/stack/data/nova/instances/804fb4da-65b9-449a-8e4d-e58e64250a20/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:17:08 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Lock "/opt/stack/data/nova/instances/804fb4da-65b9-449a-8e4d-e58e64250a20/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:17:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:17:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.146s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:17:08 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Acquiring lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:17:08 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:17:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:17:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.130s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:17:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/804fb4da-65b9-449a-8e4d-e58e64250a20/disk 1073741824 {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:17:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/804fb4da-65b9-449a-8e4d-e58e64250a20/disk 1073741824" returned: 0 in 0.048s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:17:08 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.187s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:17:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:17:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.130s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:17:09 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Checking if we can resize image /opt/stack/data/nova/instances/804fb4da-65b9-449a-8e4d-e58e64250a20/disk. size=1073741824 {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 14:17:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/804fb4da-65b9-449a-8e4d-e58e64250a20/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:17:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/804fb4da-65b9-449a-8e4d-e58e64250a20/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:17:09 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Cannot resize image /opt/stack/data/nova/instances/804fb4da-65b9-449a-8e4d-e58e64250a20/disk to a smaller size. {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 14:17:09 user nova-compute[72129]: DEBUG nova.objects.instance [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Lazy-loading 'migration_context' on Instance uuid 804fb4da-65b9-449a-8e4d-e58e64250a20 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:17:09 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Created local disks {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 14:17:09 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Ensure instance console log exists: /opt/stack/data/nova/instances/804fb4da-65b9-449a-8e4d-e58e64250a20/console.log {{(pid=72129) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 14:17:09 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:17:09 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:17:09 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:17:09 user nova-compute[72129]: DEBUG nova.network.neutron [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Successfully created port: 9383cfe2-3f3d-4a37-b8f4-5199fcab6f2f {{(pid=72129) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 14:17:10 user nova-compute[72129]: DEBUG nova.network.neutron [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Successfully updated port: 9383cfe2-3f3d-4a37-b8f4-5199fcab6f2f {{(pid=72129) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 14:17:10 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Acquiring lock "refresh_cache-804fb4da-65b9-449a-8e4d-e58e64250a20" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:17:10 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Acquired lock "refresh_cache-804fb4da-65b9-449a-8e4d-e58e64250a20" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:17:10 user nova-compute[72129]: DEBUG nova.network.neutron [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 14:17:10 user nova-compute[72129]: DEBUG nova.network.neutron [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Instance cache missing network info. {{(pid=72129) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 14:17:10 user nova-compute[72129]: DEBUG nova.compute.manager [req-2e88302f-7104-4722-8fa1-f16c1b354d6f req-a9b61e50-1f0c-4009-b9aa-83729afaf74f service nova] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Received event network-changed-9383cfe2-3f3d-4a37-b8f4-5199fcab6f2f {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:17:10 user nova-compute[72129]: DEBUG nova.compute.manager [req-2e88302f-7104-4722-8fa1-f16c1b354d6f req-a9b61e50-1f0c-4009-b9aa-83729afaf74f service nova] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Refreshing instance network info cache due to event network-changed-9383cfe2-3f3d-4a37-b8f4-5199fcab6f2f. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 14:17:10 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-2e88302f-7104-4722-8fa1-f16c1b354d6f req-a9b61e50-1f0c-4009-b9aa-83729afaf74f service nova] Acquiring lock "refresh_cache-804fb4da-65b9-449a-8e4d-e58e64250a20" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:17:10 user nova-compute[72129]: DEBUG nova.network.neutron [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Updating instance_info_cache with network_info: [{"id": "9383cfe2-3f3d-4a37-b8f4-5199fcab6f2f", "address": "fa:16:3e:9b:9b:19", "network": {"id": "814dffe9-8861-4a81-bf68-d86f2a4b4faf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1760326136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d203d0ad6e3c4379ae26ad8fb44f877d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9383cfe2-3f", "ovs_interfaceid": "9383cfe2-3f3d-4a37-b8f4-5199fcab6f2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:17:10 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Releasing lock "refresh_cache-804fb4da-65b9-449a-8e4d-e58e64250a20" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:17:10 user nova-compute[72129]: DEBUG nova.compute.manager [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Instance network_info: |[{"id": "9383cfe2-3f3d-4a37-b8f4-5199fcab6f2f", "address": "fa:16:3e:9b:9b:19", "network": {"id": "814dffe9-8861-4a81-bf68-d86f2a4b4faf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1760326136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d203d0ad6e3c4379ae26ad8fb44f877d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9383cfe2-3f", "ovs_interfaceid": "9383cfe2-3f3d-4a37-b8f4-5199fcab6f2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 14:17:10 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-2e88302f-7104-4722-8fa1-f16c1b354d6f req-a9b61e50-1f0c-4009-b9aa-83729afaf74f service nova] Acquired lock "refresh_cache-804fb4da-65b9-449a-8e4d-e58e64250a20" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:17:10 user nova-compute[72129]: DEBUG nova.network.neutron [req-2e88302f-7104-4722-8fa1-f16c1b354d6f req-a9b61e50-1f0c-4009-b9aa-83729afaf74f service nova] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Refreshing network info cache for port 9383cfe2-3f3d-4a37-b8f4-5199fcab6f2f {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 14:17:10 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Start _get_guest_xml network_info=[{"id": "9383cfe2-3f3d-4a37-b8f4-5199fcab6f2f", "address": "fa:16:3e:9b:9b:19", "network": {"id": "814dffe9-8861-4a81-bf68-d86f2a4b4faf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1760326136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d203d0ad6e3c4379ae26ad8fb44f877d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9383cfe2-3f", "ovs_interfaceid": "9383cfe2-3f3d-4a37-b8f4-5199fcab6f2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'image_id': 'b6472c34-1b0f-4034-ba3a-7e8eb5103715'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 14:17:10 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:17:10 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:17:10 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 14:17:10 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] CPU controller missing on host. {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 14:17:10 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 14:17:10 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] CPU controller found on host. {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 14:17:10 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72129) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 14:17:10 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T13:45:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 14:17:10 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Flavor limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 14:17:10 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Image limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 14:17:10 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Flavor pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 14:17:10 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Image pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 14:17:10 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 14:17:10 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 14:17:10 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 14:17:10 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Got 1 possible topologies {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 14:17:10 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 14:17:10 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 14:17:10 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:17:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1113772352',display_name='tempest-VolumesSnapshotTestJSON-instance-1113772352',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1113772352',id=44,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNamDqmx7rpTYVJLILoo4uYc4ZG8MPFlFDUfH4PE1TtIGntDKy13JHuP62zVbalJIe9JpXq8QS/okuU39oB1q5/GETOv1C/tgCzEJWHSoryQD9T5m4LUGrJz/j9phh/Kdw==',key_name='tempest-keypair-1095635327',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d203d0ad6e3c4379ae26ad8fb44f877d',ramdisk_id='',reservation_id='r-qvi290e5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-171675326',owner_user_name='tempest-VolumesSnapshotTestJSON-171675326-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T14:17:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cab6f7398341468dbd829d828b3a7b8c',uuid=804fb4da-65b9-449a-8e4d-e58e64250a20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9383cfe2-3f3d-4a37-b8f4-5199fcab6f2f", "address": "fa:16:3e:9b:9b:19", "network": {"id": "814dffe9-8861-4a81-bf68-d86f2a4b4faf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1760326136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d203d0ad6e3c4379ae26ad8fb44f877d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9383cfe2-3f", "ovs_interfaceid": "9383cfe2-3f3d-4a37-b8f4-5199fcab6f2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 14:17:10 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Converting VIF {"id": "9383cfe2-3f3d-4a37-b8f4-5199fcab6f2f", "address": "fa:16:3e:9b:9b:19", "network": {"id": "814dffe9-8861-4a81-bf68-d86f2a4b4faf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1760326136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d203d0ad6e3c4379ae26ad8fb44f877d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9383cfe2-3f", "ovs_interfaceid": "9383cfe2-3f3d-4a37-b8f4-5199fcab6f2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:17:10 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:9b:19,bridge_name='br-int',has_traffic_filtering=True,id=9383cfe2-3f3d-4a37-b8f4-5199fcab6f2f,network=Network(814dffe9-8861-4a81-bf68-d86f2a4b4faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9383cfe2-3f') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:17:10 user nova-compute[72129]: DEBUG nova.objects.instance [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Lazy-loading 'pci_devices' on Instance uuid 804fb4da-65b9-449a-8e4d-e58e64250a20 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:17:10 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] End _get_guest_xml xml=<domain type="kvm">
Aug 01 14:17:10 user nova-compute[72129]:   <uuid>804fb4da-65b9-449a-8e4d-e58e64250a20</uuid>
Aug 01 14:17:10 user nova-compute[72129]:   <name>instance-0000002c</name>
Aug 01 14:17:10 user nova-compute[72129]:   <memory>524288</memory>
Aug 01 14:17:10 user nova-compute[72129]:   <vcpu>1</vcpu>
Aug 01 14:17:10 user nova-compute[72129]:   <metadata>
Aug 01 14:17:10 user nova-compute[72129]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 14:17:10 user nova-compute[72129]:       <nova:package version="0.0.0"/>
Aug 01 14:17:10 user nova-compute[72129]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1113772352</nova:name>
Aug 01 14:17:10 user nova-compute[72129]:       <nova:creationTime>2023-08-01 14:17:10</nova:creationTime>
Aug 01 14:17:10 user nova-compute[72129]:       <nova:flavor name="m1.tiny">
Aug 01 14:17:10 user nova-compute[72129]:         <nova:memory>512</nova:memory>
Aug 01 14:17:10 user nova-compute[72129]:         <nova:disk>1</nova:disk>
Aug 01 14:17:10 user nova-compute[72129]:         <nova:swap>0</nova:swap>
Aug 01 14:17:10 user nova-compute[72129]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 14:17:10 user nova-compute[72129]:         <nova:vcpus>1</nova:vcpus>
Aug 01 14:17:10 user nova-compute[72129]:       </nova:flavor>
Aug 01 14:17:10 user nova-compute[72129]:       <nova:owner>
Aug 01 14:17:10 user nova-compute[72129]:         <nova:user uuid="cab6f7398341468dbd829d828b3a7b8c">tempest-VolumesSnapshotTestJSON-171675326-project-member</nova:user>
Aug 01 14:17:10 user nova-compute[72129]:         <nova:project uuid="d203d0ad6e3c4379ae26ad8fb44f877d">tempest-VolumesSnapshotTestJSON-171675326</nova:project>
Aug 01 14:17:10 user nova-compute[72129]:       </nova:owner>
Aug 01 14:17:10 user nova-compute[72129]:       <nova:root type="image" uuid="b6472c34-1b0f-4034-ba3a-7e8eb5103715"/>
Aug 01 14:17:10 user nova-compute[72129]:       <nova:ports>
Aug 01 14:17:10 user nova-compute[72129]:         <nova:port uuid="9383cfe2-3f3d-4a37-b8f4-5199fcab6f2f">
Aug 01 14:17:10 user nova-compute[72129]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 01 14:17:10 user nova-compute[72129]:         </nova:port>
Aug 01 14:17:10 user nova-compute[72129]:       </nova:ports>
Aug 01 14:17:10 user nova-compute[72129]:     </nova:instance>
Aug 01 14:17:10 user nova-compute[72129]:   </metadata>
Aug 01 14:17:10 user nova-compute[72129]:   <sysinfo type="smbios">
Aug 01 14:17:10 user nova-compute[72129]:     <system>
Aug 01 14:17:10 user nova-compute[72129]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 14:17:10 user nova-compute[72129]:       <entry name="product">OpenStack Nova</entry>
Aug 01 14:17:10 user nova-compute[72129]:       <entry name="version">0.0.0</entry>
Aug 01 14:17:10 user nova-compute[72129]:       <entry name="serial">804fb4da-65b9-449a-8e4d-e58e64250a20</entry>
Aug 01 14:17:10 user nova-compute[72129]:       <entry name="uuid">804fb4da-65b9-449a-8e4d-e58e64250a20</entry>
Aug 01 14:17:10 user nova-compute[72129]:       <entry name="family">Virtual Machine</entry>
Aug 01 14:17:10 user nova-compute[72129]:     </system>
Aug 01 14:17:10 user nova-compute[72129]:   </sysinfo>
Aug 01 14:17:10 user nova-compute[72129]:   <os>
Aug 01 14:17:10 user nova-compute[72129]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 14:17:10 user nova-compute[72129]:     <boot dev="hd"/>
Aug 01 14:17:10 user nova-compute[72129]:     <smbios mode="sysinfo"/>
Aug 01 14:17:10 user nova-compute[72129]:   </os>
Aug 01 14:17:10 user nova-compute[72129]:   <features>
Aug 01 14:17:10 user nova-compute[72129]:     <acpi/>
Aug 01 14:17:10 user nova-compute[72129]:     <apic/>
Aug 01 14:17:10 user nova-compute[72129]:     <vmcoreinfo/>
Aug 01 14:17:10 user nova-compute[72129]:   </features>
Aug 01 14:17:10 user nova-compute[72129]:   <clock offset="utc">
Aug 01 14:17:10 user nova-compute[72129]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 14:17:10 user nova-compute[72129]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 14:17:10 user nova-compute[72129]:     <timer name="hpet" present="no"/>
Aug 01 14:17:10 user nova-compute[72129]:   </clock>
Aug 01 14:17:10 user nova-compute[72129]:   <cpu mode="custom" match="exact">
Aug 01 14:17:10 user nova-compute[72129]:     <model>Nehalem</model>
Aug 01 14:17:10 user nova-compute[72129]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 14:17:10 user nova-compute[72129]:   </cpu>
Aug 01 14:17:10 user nova-compute[72129]:   <devices>
Aug 01 14:17:10 user nova-compute[72129]:     <disk type="file" device="disk">
Aug 01 14:17:10 user nova-compute[72129]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 14:17:10 user nova-compute[72129]:       <source file="/opt/stack/data/nova/instances/804fb4da-65b9-449a-8e4d-e58e64250a20/disk"/>
Aug 01 14:17:10 user nova-compute[72129]:       <target dev="vda" bus="virtio"/>
Aug 01 14:17:10 user nova-compute[72129]:     </disk>
Aug 01 14:17:10 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 14:17:10 user nova-compute[72129]:       <mac address="fa:16:3e:9b:9b:19"/>
Aug 01 14:17:10 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:17:10 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 14:17:10 user nova-compute[72129]:       <target dev="tap9383cfe2-3f"/>
Aug 01 14:17:10 user nova-compute[72129]:     </interface>
Aug 01 14:17:10 user nova-compute[72129]:     <serial type="pty">
Aug 01 14:17:10 user nova-compute[72129]:       <log file="/opt/stack/data/nova/instances/804fb4da-65b9-449a-8e4d-e58e64250a20/console.log" append="off"/>
Aug 01 14:17:10 user nova-compute[72129]:     </serial>
Aug 01 14:17:10 user nova-compute[72129]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 14:17:10 user nova-compute[72129]:     <video>
Aug 01 14:17:10 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:17:10 user nova-compute[72129]:     </video>
Aug 01 14:17:10 user nova-compute[72129]:     <rng model="virtio">
Aug 01 14:17:10 user nova-compute[72129]:       <backend model="random">/dev/urandom</backend>
Aug 01 14:17:10 user nova-compute[72129]:     </rng>
Aug 01 14:17:10 user nova-compute[72129]:     <controller type="usb" index="0" model="none"/>
Aug 01 14:17:10 user nova-compute[72129]:     <memballoon model="virtio">
Aug 01 14:17:10 user nova-compute[72129]:       <stats period="10"/>
Aug 01 14:17:10 user nova-compute[72129]:     </memballoon>
Aug 01 14:17:10 user nova-compute[72129]:   </devices>
Aug 01 14:17:10 user nova-compute[72129]: </domain>
Aug 01 14:17:10 user nova-compute[72129]:  {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 14:17:10 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:17:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1113772352',display_name='tempest-VolumesSnapshotTestJSON-instance-1113772352',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1113772352',id=44,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNamDqmx7rpTYVJLILoo4uYc4ZG8MPFlFDUfH4PE1TtIGntDKy13JHuP62zVbalJIe9JpXq8QS/okuU39oB1q5/GETOv1C/tgCzEJWHSoryQD9T5m4LUGrJz/j9phh/Kdw==',key_name='tempest-keypair-1095635327',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d203d0ad6e3c4379ae26ad8fb44f877d',ramdisk_id='',reservation_id='r-qvi290e5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-171675326',owner_user_name='tempest-VolumesSnapshotTestJSON-171675326-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T14:17:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cab6f7398341468dbd829d828b3a7b8c',uuid=804fb4da-65b9-449a-8e4d-e58e64250a20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9383cfe2-3f3d-4a37-b8f4-5199fcab6f2f", "address": "fa:16:3e:9b:9b:19", "network": {"id": "814dffe9-8861-4a81-bf68-d86f2a4b4faf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1760326136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d203d0ad6e3c4379ae26ad8fb44f877d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9383cfe2-3f", "ovs_interfaceid": "9383cfe2-3f3d-4a37-b8f4-5199fcab6f2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 14:17:10 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Converting VIF {"id": "9383cfe2-3f3d-4a37-b8f4-5199fcab6f2f", "address": "fa:16:3e:9b:9b:19", "network": {"id": "814dffe9-8861-4a81-bf68-d86f2a4b4faf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1760326136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d203d0ad6e3c4379ae26ad8fb44f877d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9383cfe2-3f", "ovs_interfaceid": "9383cfe2-3f3d-4a37-b8f4-5199fcab6f2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:17:10 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:9b:19,bridge_name='br-int',has_traffic_filtering=True,id=9383cfe2-3f3d-4a37-b8f4-5199fcab6f2f,network=Network(814dffe9-8861-4a81-bf68-d86f2a4b4faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9383cfe2-3f') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:17:10 user nova-compute[72129]: DEBUG os_vif [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:9b:19,bridge_name='br-int',has_traffic_filtering=True,id=9383cfe2-3f3d-4a37-b8f4-5199fcab6f2f,network=Network(814dffe9-8861-4a81-bf68-d86f2a4b4faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9383cfe2-3f') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 14:17:10 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:17:10 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:17:10 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 14:17:10 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:17:10 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9383cfe2-3f, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:17:10 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9383cfe2-3f, col_values=(('external_ids', {'iface-id': '9383cfe2-3f3d-4a37-b8f4-5199fcab6f2f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:9b:19', 'vm-uuid': '804fb4da-65b9-449a-8e4d-e58e64250a20'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:17:10 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:17:10 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:17:10 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:17:10 user nova-compute[72129]: INFO os_vif [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:9b:19,bridge_name='br-int',has_traffic_filtering=True,id=9383cfe2-3f3d-4a37-b8f4-5199fcab6f2f,network=Network(814dffe9-8861-4a81-bf68-d86f2a4b4faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9383cfe2-3f')
Aug 01 14:17:10 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:17:10 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] No VIF found with MAC fa:16:3e:9b:9b:19, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 14:17:11 user nova-compute[72129]: DEBUG nova.network.neutron [req-2e88302f-7104-4722-8fa1-f16c1b354d6f req-a9b61e50-1f0c-4009-b9aa-83729afaf74f service nova] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Updated VIF entry in instance network info cache for port 9383cfe2-3f3d-4a37-b8f4-5199fcab6f2f. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 14:17:11 user nova-compute[72129]: DEBUG nova.network.neutron [req-2e88302f-7104-4722-8fa1-f16c1b354d6f req-a9b61e50-1f0c-4009-b9aa-83729afaf74f service nova] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Updating instance_info_cache with network_info: [{"id": "9383cfe2-3f3d-4a37-b8f4-5199fcab6f2f", "address": "fa:16:3e:9b:9b:19", "network": {"id": "814dffe9-8861-4a81-bf68-d86f2a4b4faf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1760326136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d203d0ad6e3c4379ae26ad8fb44f877d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9383cfe2-3f", "ovs_interfaceid": "9383cfe2-3f3d-4a37-b8f4-5199fcab6f2f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:17:11 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-2e88302f-7104-4722-8fa1-f16c1b354d6f req-a9b61e50-1f0c-4009-b9aa-83729afaf74f service nova] Releasing lock "refresh_cache-804fb4da-65b9-449a-8e4d-e58e64250a20" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:17:11 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:17:12 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:17:12 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:17:12 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:17:12 user nova-compute[72129]: DEBUG nova.compute.manager [req-03cc7cbf-7d60-47c2-87bd-dac4ba61c89e req-12ea7c4a-9d5f-4006-b7ad-9d246ee2ad95 service nova] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Received event network-vif-plugged-9383cfe2-3f3d-4a37-b8f4-5199fcab6f2f {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:17:12 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-03cc7cbf-7d60-47c2-87bd-dac4ba61c89e req-12ea7c4a-9d5f-4006-b7ad-9d246ee2ad95 service nova] Acquiring lock "804fb4da-65b9-449a-8e4d-e58e64250a20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:17:12 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-03cc7cbf-7d60-47c2-87bd-dac4ba61c89e req-12ea7c4a-9d5f-4006-b7ad-9d246ee2ad95 service nova] Lock "804fb4da-65b9-449a-8e4d-e58e64250a20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:17:12 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-03cc7cbf-7d60-47c2-87bd-dac4ba61c89e req-12ea7c4a-9d5f-4006-b7ad-9d246ee2ad95 service nova] Lock "804fb4da-65b9-449a-8e4d-e58e64250a20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:17:12 user nova-compute[72129]: DEBUG nova.compute.manager [req-03cc7cbf-7d60-47c2-87bd-dac4ba61c89e req-12ea7c4a-9d5f-4006-b7ad-9d246ee2ad95 service nova] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] No waiting events found dispatching network-vif-plugged-9383cfe2-3f3d-4a37-b8f4-5199fcab6f2f {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:17:12 user nova-compute[72129]: WARNING nova.compute.manager [req-03cc7cbf-7d60-47c2-87bd-dac4ba61c89e req-12ea7c4a-9d5f-4006-b7ad-9d246ee2ad95 service nova] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Received unexpected event network-vif-plugged-9383cfe2-3f3d-4a37-b8f4-5199fcab6f2f for instance with vm_state building and task_state spawning.
Aug 01 14:17:12 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:17:12 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:17:12 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:17:12 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:17:14 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690899434.2214484, 804fb4da-65b9-449a-8e4d-e58e64250a20 => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:17:14 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] VM Resumed (Lifecycle Event)
Aug 01 14:17:14 user nova-compute[72129]: DEBUG nova.compute.manager [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Instance event wait completed in 0 seconds for  {{(pid=72129) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 14:17:14 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Guest created on hypervisor {{(pid=72129) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 14:17:14 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Instance spawned successfully.
Aug 01 14:17:14 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 14:17:14 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:17:14 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:17:14 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Found default for hw_cdrom_bus of ide {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:17:14 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Found default for hw_disk_bus of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:17:14 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Found default for hw_input_bus of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:17:14 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Found default for hw_pointer_model of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:17:14 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Found default for hw_video_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:17:14 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Found default for hw_vif_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:17:14 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 14:17:14 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690899434.222764, 804fb4da-65b9-449a-8e4d-e58e64250a20 => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:17:14 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] VM Started (Lifecycle Event)
Aug 01 14:17:14 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:17:14 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:17:14 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 14:17:14 user nova-compute[72129]: INFO nova.compute.manager [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Took 5.80 seconds to spawn the instance on the hypervisor.
Aug 01 14:17:14 user nova-compute[72129]: DEBUG nova.compute.manager [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:17:14 user nova-compute[72129]: INFO nova.compute.manager [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Took 6.68 seconds to build instance.
Aug 01 14:17:14 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-5ead403a-9705-4b88-8ef8-3ff8ef3697d5 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Lock "804fb4da-65b9-449a-8e4d-e58e64250a20" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.778s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:17:14 user nova-compute[72129]: DEBUG nova.compute.manager [req-b42eeb24-36c0-4aca-adf1-82d64b7164aa req-2b73ce7d-01eb-46ed-95f6-1e7fff350b0f service nova] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Received event network-vif-plugged-9383cfe2-3f3d-4a37-b8f4-5199fcab6f2f {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:17:14 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-b42eeb24-36c0-4aca-adf1-82d64b7164aa req-2b73ce7d-01eb-46ed-95f6-1e7fff350b0f service nova] Acquiring lock "804fb4da-65b9-449a-8e4d-e58e64250a20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:17:14 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-b42eeb24-36c0-4aca-adf1-82d64b7164aa req-2b73ce7d-01eb-46ed-95f6-1e7fff350b0f service nova] Lock "804fb4da-65b9-449a-8e4d-e58e64250a20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:17:14 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-b42eeb24-36c0-4aca-adf1-82d64b7164aa req-2b73ce7d-01eb-46ed-95f6-1e7fff350b0f service nova] Lock "804fb4da-65b9-449a-8e4d-e58e64250a20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:17:14 user nova-compute[72129]: DEBUG nova.compute.manager [req-b42eeb24-36c0-4aca-adf1-82d64b7164aa req-2b73ce7d-01eb-46ed-95f6-1e7fff350b0f service nova] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] No waiting events found dispatching network-vif-plugged-9383cfe2-3f3d-4a37-b8f4-5199fcab6f2f {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:17:14 user nova-compute[72129]: WARNING nova.compute.manager [req-b42eeb24-36c0-4aca-adf1-82d64b7164aa req-2b73ce7d-01eb-46ed-95f6-1e7fff350b0f service nova] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Received unexpected event network-vif-plugged-9383cfe2-3f3d-4a37-b8f4-5199fcab6f2f for instance with vm_state active and task_state None.
Aug 01 14:17:15 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:17:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:17:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:17:25 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:17:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:17:30 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:17:31 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:17:35 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:17:36 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:17:40 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:17:41 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:17:45 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:17:50 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:17:55 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:17:55 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72129) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 14:17:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:17:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:17:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72129) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 14:17:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:17:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:17:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:18:00 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:18:00 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Starting heal instance info cache {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 14:18:00 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "refresh_cache-b3f54430-8d5d-478b-8dc7-d7592ee3db36" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:18:00 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquired lock "refresh_cache-b3f54430-8d5d-478b-8dc7-d7592ee3db36" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:18:00 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Forcefully refreshing network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 14:18:00 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Updating instance_info_cache with network_info: [{"id": "77cb18a9-2c41-4aa6-8784-ffcbafeb1341", "address": "fa:16:3e:d2:d6:8b", "network": {"id": "6ffcec16-7b44-472a-b7cd-af16ebd4a653", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-901464581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cca3e17d4e4df79c94c4b94fb3fcec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77cb18a9-2c", "ovs_interfaceid": "77cb18a9-2c41-4aa6-8784-ffcbafeb1341", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:18:00 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Releasing lock "refresh_cache-b3f54430-8d5d-478b-8dc7-d7592ee3db36" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:18:00 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Updated the network info_cache for instance {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 14:18:00 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:18:01 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:18:01 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:18:02 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:18:02 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:18:02 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:18:02 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:18:02 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Auditing locally available compute resources for user (node: user) {{(pid=72129) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 14:18:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8043d318-06fd-4fb3-bd9f-533bff05d91a/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:18:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8043d318-06fd-4fb3-bd9f-533bff05d91a/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:18:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8043d318-06fd-4fb3-bd9f-533bff05d91a/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:18:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8043d318-06fd-4fb3-bd9f-533bff05d91a/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:18:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3a4469-30fd-4f27-a3b7-957422dd2746/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:18:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3a4469-30fd-4f27-a3b7-957422dd2746/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:18:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3a4469-30fd-4f27-a3b7-957422dd2746/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:18:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3a4469-30fd-4f27-a3b7-957422dd2746/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:18:02 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 14:18:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:18:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:18:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:18:03 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:18:03 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/804fb4da-65b9-449a-8e4d-e58e64250a20/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:18:03 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/804fb4da-65b9-449a-8e4d-e58e64250a20/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:18:03 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/804fb4da-65b9-449a-8e4d-e58e64250a20/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:18:03 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/804fb4da-65b9-449a-8e4d-e58e64250a20/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:18:03 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk.rescue --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:18:03 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:18:03 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk.rescue --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:18:03 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:18:03 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:18:03 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:18:03 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:18:03 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:18:04 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:18:04 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:18:04 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Hypervisor/Node resource view: name=user free_ram=8324MB free_disk=25.10565185546875GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72129) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 14:18:04 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:18:04 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:18:04 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 5c3a4469-30fd-4f27-a3b7-957422dd2746 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:18:04 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance b3f54430-8d5d-478b-8dc7-d7592ee3db36 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:18:04 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:18:04 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 8043d318-06fd-4fb3-bd9f-533bff05d91a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:18:04 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 804fb4da-65b9-449a-8e4d-e58e64250a20 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:18:04 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 14:18:04 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 14:18:04 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:18:04 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:18:04 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Compute_service record updated for user:user {{(pid=72129) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 14:18:04 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.333s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:18:05 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:18:05 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:18:05 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:18:05 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:18:06 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:18:07 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:18:10 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:18:10 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:18:10 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72129) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 14:18:10 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:18:10 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:18:10 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:18:11 user nova-compute[72129]: DEBUG nova.compute.manager [req-5da74c7a-8773-40d4-b250-7ba354dfe745 req-2b782638-eb5f-40f7-b015-d9e6f0ebfc5b service nova] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] Received event network-changed-4be76ebe-2106-4cff-9aba-a9c1acef3c57 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:18:11 user nova-compute[72129]: DEBUG nova.compute.manager [req-5da74c7a-8773-40d4-b250-7ba354dfe745 req-2b782638-eb5f-40f7-b015-d9e6f0ebfc5b service nova] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] Refreshing instance network info cache due to event network-changed-4be76ebe-2106-4cff-9aba-a9c1acef3c57. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 14:18:11 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-5da74c7a-8773-40d4-b250-7ba354dfe745 req-2b782638-eb5f-40f7-b015-d9e6f0ebfc5b service nova] Acquiring lock "refresh_cache-8043d318-06fd-4fb3-bd9f-533bff05d91a" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:18:11 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-5da74c7a-8773-40d4-b250-7ba354dfe745 req-2b782638-eb5f-40f7-b015-d9e6f0ebfc5b service nova] Acquired lock "refresh_cache-8043d318-06fd-4fb3-bd9f-533bff05d91a" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:18:11 user nova-compute[72129]: DEBUG nova.network.neutron [req-5da74c7a-8773-40d4-b250-7ba354dfe745 req-2b782638-eb5f-40f7-b015-d9e6f0ebfc5b service nova] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] Refreshing network info cache for port 4be76ebe-2106-4cff-9aba-a9c1acef3c57 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 14:18:11 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:18:11 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a0b5836c-91ff-40cc-aec2-87ad43b8de37 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Acquiring lock "8043d318-06fd-4fb3-bd9f-533bff05d91a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:18:11 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a0b5836c-91ff-40cc-aec2-87ad43b8de37 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "8043d318-06fd-4fb3-bd9f-533bff05d91a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:18:11 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a0b5836c-91ff-40cc-aec2-87ad43b8de37 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Acquiring lock "8043d318-06fd-4fb3-bd9f-533bff05d91a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:18:11 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a0b5836c-91ff-40cc-aec2-87ad43b8de37 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "8043d318-06fd-4fb3-bd9f-533bff05d91a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:18:11 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a0b5836c-91ff-40cc-aec2-87ad43b8de37 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "8043d318-06fd-4fb3-bd9f-533bff05d91a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:18:11 user nova-compute[72129]: INFO nova.compute.manager [None req-a0b5836c-91ff-40cc-aec2-87ad43b8de37 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] Terminating instance
Aug 01 14:18:11 user nova-compute[72129]: DEBUG nova.compute.manager [None req-a0b5836c-91ff-40cc-aec2-87ad43b8de37 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] Start destroying the instance on the hypervisor. {{(pid=72129) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 14:18:11 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:18:11 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:18:11 user nova-compute[72129]: DEBUG nova.network.neutron [req-5da74c7a-8773-40d4-b250-7ba354dfe745 req-2b782638-eb5f-40f7-b015-d9e6f0ebfc5b service nova] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] Updated VIF entry in instance network info cache for port 4be76ebe-2106-4cff-9aba-a9c1acef3c57. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 14:18:11 user nova-compute[72129]: DEBUG nova.network.neutron [req-5da74c7a-8773-40d4-b250-7ba354dfe745 req-2b782638-eb5f-40f7-b015-d9e6f0ebfc5b service nova] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] Updating instance_info_cache with network_info: [{"id": "4be76ebe-2106-4cff-9aba-a9c1acef3c57", "address": "fa:16:3e:b9:b0:19", "network": {"id": "9d4effd9-bf5c-41a7-a8e2-18d2177ace34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333645199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5d5ede0f2e44eaab914ffc17aef8aa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4be76ebe-21", "ovs_interfaceid": "4be76ebe-2106-4cff-9aba-a9c1acef3c57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:18:11 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-5da74c7a-8773-40d4-b250-7ba354dfe745 req-2b782638-eb5f-40f7-b015-d9e6f0ebfc5b service nova] Releasing lock "refresh_cache-8043d318-06fd-4fb3-bd9f-533bff05d91a" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:18:12 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:18:12 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:18:12 user nova-compute[72129]: DEBUG nova.compute.manager [req-bd853295-9f17-4ea0-8e94-46dc79ef99b0 req-1608d477-c48c-47bd-8a66-45a6ce797dbb service nova] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] Received event network-vif-unplugged-4be76ebe-2106-4cff-9aba-a9c1acef3c57 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:18:12 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-bd853295-9f17-4ea0-8e94-46dc79ef99b0 req-1608d477-c48c-47bd-8a66-45a6ce797dbb service nova] Acquiring lock "8043d318-06fd-4fb3-bd9f-533bff05d91a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:18:12 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-bd853295-9f17-4ea0-8e94-46dc79ef99b0 req-1608d477-c48c-47bd-8a66-45a6ce797dbb service nova] Lock "8043d318-06fd-4fb3-bd9f-533bff05d91a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:18:12 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-bd853295-9f17-4ea0-8e94-46dc79ef99b0 req-1608d477-c48c-47bd-8a66-45a6ce797dbb service nova] Lock "8043d318-06fd-4fb3-bd9f-533bff05d91a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:18:12 user nova-compute[72129]: DEBUG nova.compute.manager [req-bd853295-9f17-4ea0-8e94-46dc79ef99b0 req-1608d477-c48c-47bd-8a66-45a6ce797dbb service nova] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] No waiting events found dispatching network-vif-unplugged-4be76ebe-2106-4cff-9aba-a9c1acef3c57 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:18:12 user nova-compute[72129]: DEBUG nova.compute.manager [req-bd853295-9f17-4ea0-8e94-46dc79ef99b0 req-1608d477-c48c-47bd-8a66-45a6ce797dbb service nova] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] Received event network-vif-unplugged-4be76ebe-2106-4cff-9aba-a9c1acef3c57 for instance with task_state deleting. {{(pid=72129) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 14:18:12 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] Instance destroyed successfully.
Aug 01 14:18:12 user nova-compute[72129]: DEBUG nova.objects.instance [None req-a0b5836c-91ff-40cc-aec2-87ad43b8de37 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lazy-loading 'resources' on Instance uuid 8043d318-06fd-4fb3-bd9f-533bff05d91a {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:18:12 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-a0b5836c-91ff-40cc-aec2-87ad43b8de37 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:16:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1911490303',display_name='tempest-AttachVolumeNegativeTest-server-1911490303',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1911490303',id=43,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNlLEDDO8UZAAe7st+wafBwmBvjvlQL+99FkpCUaq7Wv7eLrrzSHXawb76osq3LmniuaoMtsCmQb+p7rkMHTabIahPh5C37PkmdPayYp6Y9uaRR6hJwMt7yoZf1zUQS0JA==',key_name='tempest-keypair-429919159',keypairs=<?>,launch_index=0,launched_at=2023-08-01T14:16:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f5d5ede0f2e44eaab914ffc17aef8aa8',ramdisk_id='',reservation_id='r-i630gard',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2079788087',owner_user_name='tempest-AttachVolumeNegativeTest-2079788087-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T14:16:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85308332b4084e9f8c1bf605f540434b',uuid=8043d318-06fd-4fb3-bd9f-533bff05d91a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4be76ebe-2106-4cff-9aba-a9c1acef3c57", "address": "fa:16:3e:b9:b0:19", "network": {"id": "9d4effd9-bf5c-41a7-a8e2-18d2177ace34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333645199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5d5ede0f2e44eaab914ffc17aef8aa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4be76ebe-21", "ovs_interfaceid": "4be76ebe-2106-4cff-9aba-a9c1acef3c57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 14:18:12 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-a0b5836c-91ff-40cc-aec2-87ad43b8de37 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Converting VIF {"id": "4be76ebe-2106-4cff-9aba-a9c1acef3c57", "address": "fa:16:3e:b9:b0:19", "network": {"id": "9d4effd9-bf5c-41a7-a8e2-18d2177ace34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333645199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5d5ede0f2e44eaab914ffc17aef8aa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4be76ebe-21", "ovs_interfaceid": "4be76ebe-2106-4cff-9aba-a9c1acef3c57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:18:12 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-a0b5836c-91ff-40cc-aec2-87ad43b8de37 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:b0:19,bridge_name='br-int',has_traffic_filtering=True,id=4be76ebe-2106-4cff-9aba-a9c1acef3c57,network=Network(9d4effd9-bf5c-41a7-a8e2-18d2177ace34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4be76ebe-21') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:18:12 user nova-compute[72129]: DEBUG os_vif [None req-a0b5836c-91ff-40cc-aec2-87ad43b8de37 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:b0:19,bridge_name='br-int',has_traffic_filtering=True,id=4be76ebe-2106-4cff-9aba-a9c1acef3c57,network=Network(9d4effd9-bf5c-41a7-a8e2-18d2177ace34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4be76ebe-21') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 14:18:12 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:18:12 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4be76ebe-21, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:18:12 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:18:12 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:18:12 user nova-compute[72129]: INFO os_vif [None req-a0b5836c-91ff-40cc-aec2-87ad43b8de37 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:b0:19,bridge_name='br-int',has_traffic_filtering=True,id=4be76ebe-2106-4cff-9aba-a9c1acef3c57,network=Network(9d4effd9-bf5c-41a7-a8e2-18d2177ace34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4be76ebe-21')
Aug 01 14:18:12 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-a0b5836c-91ff-40cc-aec2-87ad43b8de37 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] Deleting instance files /opt/stack/data/nova/instances/8043d318-06fd-4fb3-bd9f-533bff05d91a_del
Aug 01 14:18:12 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-a0b5836c-91ff-40cc-aec2-87ad43b8de37 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] Deletion of /opt/stack/data/nova/instances/8043d318-06fd-4fb3-bd9f-533bff05d91a_del complete
Aug 01 14:18:12 user nova-compute[72129]: INFO nova.compute.manager [None req-a0b5836c-91ff-40cc-aec2-87ad43b8de37 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] Took 0.65 seconds to destroy the instance on the hypervisor.
Aug 01 14:18:12 user nova-compute[72129]: DEBUG oslo.service.loopingcall [None req-a0b5836c-91ff-40cc-aec2-87ad43b8de37 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72129) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 14:18:12 user nova-compute[72129]: DEBUG nova.compute.manager [-] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] Deallocating network for instance {{(pid=72129) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 14:18:12 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] deallocate_for_instance() {{(pid=72129) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 14:18:12 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:18:13 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:18:13 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] Took 0.81 seconds to deallocate network for instance.
Aug 01 14:18:13 user nova-compute[72129]: DEBUG nova.compute.manager [req-2d8e4e24-b1cf-4831-affc-9f5d615ba65d req-b30b926c-558d-47de-84c4-95302c02e2f0 service nova] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] Received event network-vif-deleted-4be76ebe-2106-4cff-9aba-a9c1acef3c57 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:18:13 user nova-compute[72129]: INFO nova.compute.manager [req-2d8e4e24-b1cf-4831-affc-9f5d615ba65d req-b30b926c-558d-47de-84c4-95302c02e2f0 service nova] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] Neutron deleted interface 4be76ebe-2106-4cff-9aba-a9c1acef3c57; detaching it from the instance and deleting it from the info cache
Aug 01 14:18:13 user nova-compute[72129]: DEBUG nova.network.neutron [req-2d8e4e24-b1cf-4831-affc-9f5d615ba65d req-b30b926c-558d-47de-84c4-95302c02e2f0 service nova] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:18:13 user nova-compute[72129]: DEBUG nova.compute.manager [req-2d8e4e24-b1cf-4831-affc-9f5d615ba65d req-b30b926c-558d-47de-84c4-95302c02e2f0 service nova] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] Detach interface failed, port_id=4be76ebe-2106-4cff-9aba-a9c1acef3c57, reason: Instance 8043d318-06fd-4fb3-bd9f-533bff05d91a could not be found. {{(pid=72129) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 14:18:13 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a0b5836c-91ff-40cc-aec2-87ad43b8de37 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:18:13 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a0b5836c-91ff-40cc-aec2-87ad43b8de37 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:18:13 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-a0b5836c-91ff-40cc-aec2-87ad43b8de37 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:18:13 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-a0b5836c-91ff-40cc-aec2-87ad43b8de37 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:18:13 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a0b5836c-91ff-40cc-aec2-87ad43b8de37 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.183s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:18:13 user nova-compute[72129]: INFO nova.scheduler.client.report [None req-a0b5836c-91ff-40cc-aec2-87ad43b8de37 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Deleted allocations for instance 8043d318-06fd-4fb3-bd9f-533bff05d91a
Aug 01 14:18:13 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a0b5836c-91ff-40cc-aec2-87ad43b8de37 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "8043d318-06fd-4fb3-bd9f-533bff05d91a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.816s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:18:14 user nova-compute[72129]: DEBUG nova.compute.manager [req-19a3a1e2-225a-40f3-9bb1-c2ad0ce15f6d req-d1d27df8-aaa3-41bb-9eb7-295690df63eb service nova] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] Received event network-vif-plugged-4be76ebe-2106-4cff-9aba-a9c1acef3c57 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:18:14 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-19a3a1e2-225a-40f3-9bb1-c2ad0ce15f6d req-d1d27df8-aaa3-41bb-9eb7-295690df63eb service nova] Acquiring lock "8043d318-06fd-4fb3-bd9f-533bff05d91a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:18:14 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-19a3a1e2-225a-40f3-9bb1-c2ad0ce15f6d req-d1d27df8-aaa3-41bb-9eb7-295690df63eb service nova] Lock "8043d318-06fd-4fb3-bd9f-533bff05d91a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:18:14 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-19a3a1e2-225a-40f3-9bb1-c2ad0ce15f6d req-d1d27df8-aaa3-41bb-9eb7-295690df63eb service nova] Lock "8043d318-06fd-4fb3-bd9f-533bff05d91a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:18:14 user nova-compute[72129]: DEBUG nova.compute.manager [req-19a3a1e2-225a-40f3-9bb1-c2ad0ce15f6d req-d1d27df8-aaa3-41bb-9eb7-295690df63eb service nova] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] No waiting events found dispatching network-vif-plugged-4be76ebe-2106-4cff-9aba-a9c1acef3c57 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:18:14 user nova-compute[72129]: WARNING nova.compute.manager [req-19a3a1e2-225a-40f3-9bb1-c2ad0ce15f6d req-d1d27df8-aaa3-41bb-9eb7-295690df63eb service nova] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] Received unexpected event network-vif-plugged-4be76ebe-2106-4cff-9aba-a9c1acef3c57 for instance with vm_state deleted and task_state None.
Aug 01 14:18:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:18:17 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:18:22 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:18:27 user nova-compute[72129]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690899492.234736, 8043d318-06fd-4fb3-bd9f-533bff05d91a => Stopped> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:18:27 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] VM Stopped (Lifecycle Event)
Aug 01 14:18:27 user nova-compute[72129]: DEBUG nova.compute.manager [None req-6e1195c4-88a3-4512-bcf5-b034e0584d31 None None] [instance: 8043d318-06fd-4fb3-bd9f-533bff05d91a] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:18:27 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:18:32 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:18:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:18:42 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:18:47 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:18:52 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:18:57 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:18:57 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72129) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 14:18:57 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:18:57 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:18:57 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72129) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 14:18:57 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:18:57 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:18:57 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:18:58 user nova-compute[72129]: DEBUG nova.compute.manager [req-170aa173-026e-4969-80a4-c5e045211465 req-5e77b0a1-7c7c-439e-b862-ddcbaa5bbb81 service nova] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Received event network-changed-9383cfe2-3f3d-4a37-b8f4-5199fcab6f2f {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:18:58 user nova-compute[72129]: DEBUG nova.compute.manager [req-170aa173-026e-4969-80a4-c5e045211465 req-5e77b0a1-7c7c-439e-b862-ddcbaa5bbb81 service nova] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Refreshing instance network info cache due to event network-changed-9383cfe2-3f3d-4a37-b8f4-5199fcab6f2f. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 14:18:58 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-170aa173-026e-4969-80a4-c5e045211465 req-5e77b0a1-7c7c-439e-b862-ddcbaa5bbb81 service nova] Acquiring lock "refresh_cache-804fb4da-65b9-449a-8e4d-e58e64250a20" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:18:58 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-170aa173-026e-4969-80a4-c5e045211465 req-5e77b0a1-7c7c-439e-b862-ddcbaa5bbb81 service nova] Acquired lock "refresh_cache-804fb4da-65b9-449a-8e4d-e58e64250a20" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:18:58 user nova-compute[72129]: DEBUG nova.network.neutron [req-170aa173-026e-4969-80a4-c5e045211465 req-5e77b0a1-7c7c-439e-b862-ddcbaa5bbb81 service nova] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Refreshing network info cache for port 9383cfe2-3f3d-4a37-b8f4-5199fcab6f2f {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 14:18:59 user nova-compute[72129]: DEBUG nova.network.neutron [req-170aa173-026e-4969-80a4-c5e045211465 req-5e77b0a1-7c7c-439e-b862-ddcbaa5bbb81 service nova] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Updated VIF entry in instance network info cache for port 9383cfe2-3f3d-4a37-b8f4-5199fcab6f2f. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 14:18:59 user nova-compute[72129]: DEBUG nova.network.neutron [req-170aa173-026e-4969-80a4-c5e045211465 req-5e77b0a1-7c7c-439e-b862-ddcbaa5bbb81 service nova] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Updating instance_info_cache with network_info: [{"id": "9383cfe2-3f3d-4a37-b8f4-5199fcab6f2f", "address": "fa:16:3e:9b:9b:19", "network": {"id": "814dffe9-8861-4a81-bf68-d86f2a4b4faf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1760326136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d203d0ad6e3c4379ae26ad8fb44f877d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9383cfe2-3f", "ovs_interfaceid": "9383cfe2-3f3d-4a37-b8f4-5199fcab6f2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:18:59 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-170aa173-026e-4969-80a4-c5e045211465 req-5e77b0a1-7c7c-439e-b862-ddcbaa5bbb81 service nova] Releasing lock "refresh_cache-804fb4da-65b9-449a-8e4d-e58e64250a20" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:19:00 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-945c61cc-6334-4e37-ac39-13156e6d695c tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Acquiring lock "804fb4da-65b9-449a-8e4d-e58e64250a20" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:19:00 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-945c61cc-6334-4e37-ac39-13156e6d695c tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Lock "804fb4da-65b9-449a-8e4d-e58e64250a20" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:19:00 user nova-compute[72129]: DEBUG nova.objects.instance [None req-945c61cc-6334-4e37-ac39-13156e6d695c tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Lazy-loading 'flavor' on Instance uuid 804fb4da-65b9-449a-8e4d-e58e64250a20 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:19:00 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-945c61cc-6334-4e37-ac39-13156e6d695c tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Ignoring supplied device name: /dev/vdb
Aug 01 14:19:00 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-945c61cc-6334-4e37-ac39-13156e6d695c tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Lock "804fb4da-65b9-449a-8e4d-e58e64250a20" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.197s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:19:00 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-945c61cc-6334-4e37-ac39-13156e6d695c tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Acquiring lock "804fb4da-65b9-449a-8e4d-e58e64250a20" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:19:00 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-945c61cc-6334-4e37-ac39-13156e6d695c tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Lock "804fb4da-65b9-449a-8e4d-e58e64250a20" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:19:00 user nova-compute[72129]: INFO nova.compute.manager [None req-945c61cc-6334-4e37-ac39-13156e6d695c tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Attaching volume c0358169-269d-4f6d-9ac5-480166ddd801 to /dev/vdb
Aug 01 14:19:00 user nova-compute[72129]: DEBUG os_brick.utils [None req-945c61cc-6334-4e37-ac39-13156e6d695c tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:19:00 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:19:00 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:19:00 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f869be-7119-4400-bd74-d5b49d0aa7d3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f9b449c2cd3d\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:19:00 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:19:00 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:19:00 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0caccd3-8433-4940-8554-a564b45dc551]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:19:00 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:19:00 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:19:00 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d22aa6-7220-4f24-b2f0-d1c90b0489f3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:19:00 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf27923-d691-4ad7-8539-ce7e708de7c0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:19:00 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-945c61cc-6334-4e37-ac39-13156e6d695c tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Running cmd (subprocess): nvme version {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:19:00 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-945c61cc-6334-4e37-ac39-13156e6d695c tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] 'nvme version' failed. Not Retrying. {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 14:19:00 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.nvmeof [None req-945c61cc-6334-4e37-ac39-13156e6d695c tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] nvme not present on system {{(pid=72129) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 14:19:00 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:19:00 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 14:19:00 user nova-compute[72129]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 14:19:00 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a1b4cf-c7c8-4019-8099-f22dc97daa7d]: (4, '') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:19:00 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-945c61cc-6334-4e37-ac39-13156e6d695c tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72129) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 14:19:00 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-945c61cc-6334-4e37-ac39-13156e6d695c tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 14:19:00 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-945c61cc-6334-4e37-ac39-13156e6d695c tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] LIGHTOS: no hostnqn found. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 14:19:00 user nova-compute[72129]: DEBUG os_brick.utils [None req-945c61cc-6334-4e37-ac39-13156e6d695c tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f9b449c2cd3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:19:00 user nova-compute[72129]: DEBUG nova.virt.block_device [None req-945c61cc-6334-4e37-ac39-13156e6d695c tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Updating existing volume attachment record: 7777733a-eaff-4354-9de5-72c8e3492637 {{(pid=72129) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 14:19:01 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:19:01 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:19:02 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:19:02 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Starting heal instance info cache {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 14:19:02 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "refresh_cache-3bdb8e41-8cd5-4c33-9624-d262cacd0f5d" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:19:02 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquired lock "refresh_cache-3bdb8e41-8cd5-4c33-9624-d262cacd0f5d" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:19:02 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Forcefully refreshing network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 14:19:02 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:19:02 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:19:02 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Updating instance_info_cache with network_info: [{"id": "10889d2c-ec62-4b92-b325-0f5d7d67851f", "address": "fa:16:3e:52:40:4c", "network": {"id": "6ffcec16-7b44-472a-b7cd-af16ebd4a653", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-901464581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cca3e17d4e4df79c94c4b94fb3fcec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10889d2c-ec", "ovs_interfaceid": "10889d2c-ec62-4b92-b325-0f5d7d67851f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:19:02 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Releasing lock "refresh_cache-3bdb8e41-8cd5-4c33-9624-d262cacd0f5d" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:19:02 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Updated the network info_cache for instance {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 14:19:02 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:19:02 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:19:02 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:19:02 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:19:02 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Auditing locally available compute resources for user (node: user) {{(pid=72129) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 14:19:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3a4469-30fd-4f27-a3b7-957422dd2746/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:19:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3a4469-30fd-4f27-a3b7-957422dd2746/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:19:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3a4469-30fd-4f27-a3b7-957422dd2746/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:19:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5c3a4469-30fd-4f27-a3b7-957422dd2746/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:19:02 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 14:19:03 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:19:03 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:19:03 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:19:03 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:19:03 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/804fb4da-65b9-449a-8e4d-e58e64250a20/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:19:03 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/804fb4da-65b9-449a-8e4d-e58e64250a20/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:19:03 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/804fb4da-65b9-449a-8e4d-e58e64250a20/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:19:03 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-aa8b3ac8-59c4-478b-995d-a6b4c8dde33e tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Acquiring lock "5c3a4469-30fd-4f27-a3b7-957422dd2746" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:19:03 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-aa8b3ac8-59c4-478b-995d-a6b4c8dde33e tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "5c3a4469-30fd-4f27-a3b7-957422dd2746" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:19:03 user nova-compute[72129]: INFO nova.compute.manager [None req-aa8b3ac8-59c4-478b-995d-a6b4c8dde33e tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Detaching volume 7fd044df-fc7f-4e7e-972b-e7e430dbb010
Aug 01 14:19:03 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/804fb4da-65b9-449a-8e4d-e58e64250a20/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:19:03 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk.rescue --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:19:03 user nova-compute[72129]: INFO nova.virt.block_device [None req-aa8b3ac8-59c4-478b-995d-a6b4c8dde33e tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Attempting to driver detach volume 7fd044df-fc7f-4e7e-972b-e7e430dbb010 from mountpoint /dev/vdb
Aug 01 14:19:03 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-aa8b3ac8-59c4-478b-995d-a6b4c8dde33e tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Attempting to detach device vdb from instance 5c3a4469-30fd-4f27-a3b7-957422dd2746 from the persistent domain config. {{(pid=72129) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 14:19:03 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-aa8b3ac8-59c4-478b-995d-a6b4c8dde33e tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 14:19:03 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:19:03 user nova-compute[72129]:   <source dev="/dev/sdb"/>
Aug 01 14:19:03 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 14:19:03 user nova-compute[72129]:   <serial>7fd044df-fc7f-4e7e-972b-e7e430dbb010</serial>
Aug 01 14:19:03 user nova-compute[72129]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 14:19:03 user nova-compute[72129]: </disk>
Aug 01 14:19:03 user nova-compute[72129]:  {{(pid=72129) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 14:19:03 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-aa8b3ac8-59c4-478b-995d-a6b4c8dde33e tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Successfully detached device vdb from instance 5c3a4469-30fd-4f27-a3b7-957422dd2746 from the persistent domain config.
Aug 01 14:19:03 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-aa8b3ac8-59c4-478b-995d-a6b4c8dde33e tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5c3a4469-30fd-4f27-a3b7-957422dd2746 from the live domain config. {{(pid=72129) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 14:19:03 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-aa8b3ac8-59c4-478b-995d-a6b4c8dde33e tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 14:19:03 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:19:03 user nova-compute[72129]:   <source dev="/dev/sdb"/>
Aug 01 14:19:03 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 14:19:03 user nova-compute[72129]:   <serial>7fd044df-fc7f-4e7e-972b-e7e430dbb010</serial>
Aug 01 14:19:03 user nova-compute[72129]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 14:19:03 user nova-compute[72129]: </disk>
Aug 01 14:19:03 user nova-compute[72129]:  {{(pid=72129) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 14:19:03 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk.rescue --force-share --output=json" returned: 0 in 0.146s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:19:03 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk.rescue --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:19:03 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:19:03 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:19:04 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:19:04 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:19:04 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Received event <DeviceRemovedEvent: 1690899544.0800898, 5c3a4469-30fd-4f27-a3b7-957422dd2746 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72129) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 14:19:04 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-aa8b3ac8-59c4-478b-995d-a6b4c8dde33e tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5c3a4469-30fd-4f27-a3b7-957422dd2746 {{(pid=72129) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 14:19:04 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-aa8b3ac8-59c4-478b-995d-a6b4c8dde33e tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Successfully detached device vdb from instance 5c3a4469-30fd-4f27-a3b7-957422dd2746 from the live domain config.
Aug 01 14:19:04 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa8b3ac8-59c4-478b-995d-a6b4c8dde33e tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] calling os-brick to detach iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 14:19:04 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8b3ac8-59c4-478b-995d-a6b4c8dde33e tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, {'target_iqns': ['iqn.2010-10.org.openstack:7fd044df-fc7f-4e7e-972b-e7e430dbb010'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QdvTGJAi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:19:04 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-aa8b3ac8-59c4-478b-995d-a6b4c8dde33e tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:19:04 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-aa8b3ac8-59c4-478b-995d-a6b4c8dde33e tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:19:04 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-aa8b3ac8-59c4-478b-995d-a6b4c8dde33e tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:19:04 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8b3ac8-59c4-478b-995d-a6b4c8dde33e tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7fd044df-fc7f-4e7e-972b-e7e430dbb010', 0)] {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 14:19:04 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:19:04 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:19:04 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[565cf852-e6a0-4fd5-b24c-34dead6475be]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7fd044df-fc7f-4e7e-972b-e7e430dbb010\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:19:04 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:19:04 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:19:04 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd17701b-b569-45a1-92e2-68db25eeafe5]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fd044df-fc7f-4e7e-972b-e7e430dbb010 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:19:04 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8b3ac8-59c4-478b-995d-a6b4c8dde33e tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fd044df-fc7f-4e7e-972b-e7e430dbb010 (non-flash)
Aug 01 14:19:04 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:19:04 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8b3ac8-59c4-478b-995d-a6b4c8dde33e tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7fd044df-fc7f-4e7e-972b-e7e430dbb010 (non-flash)
Aug 01 14:19:04 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:19:04 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8b3ac8-59c4-478b-995d-a6b4c8dde33e tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f28102b7880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7fd044df-fc7f-4e7e-972b-e7e430dbb010'): ({'sdb'}, set())}) {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 14:19:04 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-aa8b3ac8-59c4-478b-995d-a6b4c8dde33e tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Removing single pathed devices sdb {{(pid=72129) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 14:19:04 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:19:04 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:19:04 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ec9241-c970-418f-97ba-7f73fffb989e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:19:04 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:19:04 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:19:04 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:19:04 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b5c786-64e9-4411-b4e6-4b96e15e18cf]: (4, ('ok\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:19:04 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-aa8b3ac8-59c4-478b-995d-a6b4c8dde33e tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Flushing IO for device /dev/sdb {{(pid=72129) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 14:19:04 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:19:04 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:19:04 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[082a072b-42f8-486c-85e4-43a720ff4180]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:19:04 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-aa8b3ac8-59c4-478b-995d-a6b4c8dde33e tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72129) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 14:19:04 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:19:04 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:19:04 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:19:04 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Hypervisor/Node resource view: name=user free_ram=8532MB free_disk=25.124725341796875GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72129) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 14:19:04 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:19:04 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:19:04 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:19:04 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca712af-23fb-4df4-b2b2-b11db50d2ea4]: (4, ('1', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:19:04 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-aa8b3ac8-59c4-478b-995d-a6b4c8dde33e tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 14:19:04 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-aa8b3ac8-59c4-478b-995d-a6b4c8dde33e tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] SCSI volumes sdb have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 14:19:04 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8b3ac8-59c4-478b-995d-a6b4c8dde33e tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7fd044df-fc7f-4e7e-972b-e7e430dbb010')] {{(pid=72129) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 14:19:04 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fd044df-fc7f-4e7e-972b-e7e430dbb010 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:19:04 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fd044df-fc7f-4e7e-972b-e7e430dbb010 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:19:04 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89d6120-1b3f-4aa3-9243-f4601bfe1f2b]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:19:04 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8b3ac8-59c4-478b-995d-a6b4c8dde33e tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:19:04 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fd044df-fc7f-4e7e-972b-e7e430dbb010 -p 172.16.0.220:3260 --logout {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:19:04 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 5c3a4469-30fd-4f27-a3b7-957422dd2746 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:19:04 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance b3f54430-8d5d-478b-8dc7-d7592ee3db36 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:19:04 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:19:04 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 804fb4da-65b9-449a-8e4d-e58e64250a20 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:19:04 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 14:19:04 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 14:19:04 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fd044df-fc7f-4e7e-972b-e7e430dbb010 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:19:04 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e45055-32f1-4aec-ada8-452a8d737d61]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:7fd044df-fc7f-4e7e-972b-e7e430dbb010, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:7fd044df-fc7f-4e7e-972b-e7e430dbb010, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:19:04 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8b3ac8-59c4-478b-995d-a6b4c8dde33e tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:7fd044df-fc7f-4e7e-972b-e7e430dbb010, portal: 172.16.0.220,3260]
Aug 01 14:19:04 user nova-compute[72129]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:7fd044df-fc7f-4e7e-972b-e7e430dbb010, portal: 172.16.0.220,3260] successful.
Aug 01 14:19:04 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:19:04 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7fd044df-fc7f-4e7e-972b-e7e430dbb010 -p 172.16.0.220:3260 --op delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:19:04 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7fd044df-fc7f-4e7e-972b-e7e430dbb010 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:19:04 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[4061913c-f506-4e65-83fc-bda2e1210e9c]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:19:04 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8b3ac8-59c4-478b-995d-a6b4c8dde33e tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:19:04 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-aa8b3ac8-59c4-478b-995d-a6b4c8dde33e tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.632s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:19:04 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa8b3ac8-59c4-478b-995d-a6b4c8dde33e tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] <== disconnect_volume: return (635ms) None {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:19:04 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa8b3ac8-59c4-478b-995d-a6b4c8dde33e tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Disconnected iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 14:19:04 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:19:04 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:19:04 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Compute_service record updated for user:user {{(pid=72129) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 14:19:04 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.321s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:19:05 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:19:05 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:19:05 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:19:06 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:19:06 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:19:07 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:19:07 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:19:08 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-945c61cc-6334-4e37-ac39-13156e6d695c tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Calling os-brick to attach iSCSI Volume {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 14:19:08 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-945c61cc-6334-4e37-ac39-13156e6d695c tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c0358169-269d-4f6d-9ac5-480166ddd801'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XeqwCFKb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:19:08 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-945c61cc-6334-4e37-ac39-13156e6d695c tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:19:08 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-945c61cc-6334-4e37-ac39-13156e6d695c tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:19:08 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-945c61cc-6334-4e37-ac39-13156e6d695c tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:19:08 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-945c61cc-6334-4e37-ac39-13156e6d695c tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:19:08 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-945c61cc-6334-4e37-ac39-13156e6d695c tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0358169-269d-4f6d-9ac5-480166ddd801" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:19:08 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-945c61cc-6334-4e37-ac39-13156e6d695c tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0358169-269d-4f6d-9ac5-480166ddd801" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:19:08 user nova-compute[72129]: INFO os_brick.initiator.connectors.iscsi [None req-945c61cc-6334-4e37-ac39-13156e6d695c tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 14:19:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0358169-269d-4f6d-9ac5-480166ddd801 -p 172.16.0.220:3260 {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:19:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0358169-269d-4f6d-9ac5-480166ddd801 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:19:08 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6833de9-25c0-4a8a-a604-adbe25253260]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:19:08 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-945c61cc-6334-4e37-ac39-13156e6d695c tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 14:19:08 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:19:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0358169-269d-4f6d-9ac5-480166ddd801 -p 172.16.0.220:3260 --interface default --op new {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:19:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0358169-269d-4f6d-9ac5-480166ddd801 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:19:08 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f22cc5-baa3-4f7e-be79-7f281f70d0e9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0358169-269d-4f6d-9ac5-480166ddd801] added\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:19:08 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-945c61cc-6334-4e37-ac39-13156e6d695c tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0358169-269d-4f6d-9ac5-480166ddd801] added
Aug 01 14:19:08 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:19:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0358169-269d-4f6d-9ac5-480166ddd801 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:19:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0358169-269d-4f6d-9ac5-480166ddd801 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:19:08 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9670f97-b9d3-4b7b-ad7b-f0246b519fc2]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:19:08 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-945c61cc-6334-4e37-ac39-13156e6d695c tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:19:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0358169-269d-4f6d-9ac5-480166ddd801 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:19:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0358169-269d-4f6d-9ac5-480166ddd801 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:19:08 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af29759-a93b-499d-b16a-da70d4ea5375]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:19:08 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-945c61cc-6334-4e37-ac39-13156e6d695c tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:19:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0358169-269d-4f6d-9ac5-480166ddd801 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XeqwCFKb {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:19:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0358169-269d-4f6d-9ac5-480166ddd801 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XeqwCFKb" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:19:08 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4124dd9-7187-4352-bc86-ad588e94eb44]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:19:08 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-945c61cc-6334-4e37-ac39-13156e6d695c tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XeqwCFKb'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:19:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0358169-269d-4f6d-9ac5-480166ddd801 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:19:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0358169-269d-4f6d-9ac5-480166ddd801 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:19:08 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[496a4f48-985f-46aa-9d68-2e5a1db3f5bd]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:19:08 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-945c61cc-6334-4e37-ac39-13156e6d695c tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:19:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:19:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:19:08 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98a518a-04bb-4f24-bb91-615698231152]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:19:08 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-945c61cc-6334-4e37-ac39-13156e6d695c tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 14:19:08 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:19:08 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-945c61cc-6334-4e37-ac39-13156e6d695c tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 14:19:08 user nova-compute[72129]:  {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:19:08 user nova-compute[72129]: WARNING os_brick.initiator.connectors.iscsi [None req-945c61cc-6334-4e37-ac39-13156e6d695c tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 14:19:08 user nova-compute[72129]: 
Aug 01 14:19:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0358169-269d-4f6d-9ac5-480166ddd801 -p 172.16.0.220:3260 --login {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:19:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0358169-269d-4f6d-9ac5-480166ddd801 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:19:08 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ff7910-841c-4677-9c95-dbc35ce05c17]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0358169-269d-4f6d-9ac5-480166ddd801, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c0358169-269d-4f6d-9ac5-480166ddd801, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:19:08 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-945c61cc-6334-4e37-ac39-13156e6d695c tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0358169-269d-4f6d-9ac5-480166ddd801, portal: 172.16.0.220,3260]
Aug 01 14:19:08 user nova-compute[72129]: Login to [iface: default, target: iqn.2010-10.org.openstack:c0358169-269d-4f6d-9ac5-480166ddd801, portal: 172.16.0.220,3260] successful.
Aug 01 14:19:08 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:19:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0358169-269d-4f6d-9ac5-480166ddd801 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:19:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0358169-269d-4f6d-9ac5-480166ddd801 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:19:08 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[85eb8982-ea7f-4397-9f47-1db211025b3d]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:19:08 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-945c61cc-6334-4e37-ac39-13156e6d695c tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:19:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:19:08 user nova-compute[72129]: DEBUG nova.objects.instance [None req-aa8b3ac8-59c4-478b-995d-a6b4c8dde33e tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lazy-loading 'flavor' on Instance uuid 5c3a4469-30fd-4f27-a3b7-957422dd2746 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:19:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:19:08 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d46ee9b0-ba95-4ce6-ada5-b1e4316396b5]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0358169-269d-4f6d-9ac5-480166ddd801 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:19:08 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-945c61cc-6334-4e37-ac39-13156e6d695c tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0358169-269d-4f6d-9ac5-480166ddd801 (non-flash)
Aug 01 14:19:08 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:19:08 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-945c61cc-6334-4e37-ac39-13156e6d695c tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0358169-269d-4f6d-9ac5-480166ddd801 (non-flash)
Aug 01 14:19:08 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:19:08 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-945c61cc-6334-4e37-ac39-13156e6d695c tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0358169-269d-4f6d-9ac5-480166ddd801" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:19:08 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-945c61cc-6334-4e37-ac39-13156e6d695c tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Connected to 172.16.0.220:3260 {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 14:19:08 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-945c61cc-6334-4e37-ac39-13156e6d695c tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=72129) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 14:19:08 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-945c61cc-6334-4e37-ac39-13156e6d695c tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72129) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 14:19:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:19:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:19:08 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[7509dd2f-23d7-4f23-9b8a-3750a1613e63]: (4, ('- - 0', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:19:08 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-945c61cc-6334-4e37-ac39-13156e6d695c tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 14:19:08 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-945c61cc-6334-4e37-ac39-13156e6d695c tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XeqwCFKb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 14:19:08 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-aa8b3ac8-59c4-478b-995d-a6b4c8dde33e tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "5c3a4469-30fd-4f27-a3b7-957422dd2746" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.871s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:19:09 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-945c61cc-6334-4e37-ac39-13156e6d695c tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:19:09 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-945c61cc-6334-4e37-ac39-13156e6d695c tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '26665323435613237', 'path': '/dev/sdb'} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:19:09 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-945c61cc-6334-4e37-ac39-13156e6d695c tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26665323435613237', 'path': '/dev/sdb'} {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 14:19:09 user nova-compute[72129]: DEBUG nova.objects.instance [None req-945c61cc-6334-4e37-ac39-13156e6d695c tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Lazy-loading 'flavor' on Instance uuid 804fb4da-65b9-449a-8e4d-e58e64250a20 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:19:09 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-945c61cc-6334-4e37-ac39-13156e6d695c tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 14:19:09 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:19:09 user nova-compute[72129]:   <source dev="/dev/sdb"/>
Aug 01 14:19:09 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 14:19:09 user nova-compute[72129]:   <serial>c0358169-269d-4f6d-9ac5-480166ddd801</serial>
Aug 01 14:19:09 user nova-compute[72129]: </disk>
Aug 01 14:19:09 user nova-compute[72129]:  {{(pid=72129) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 14:19:09 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-945c61cc-6334-4e37-ac39-13156e6d695c tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:19:09 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-945c61cc-6334-4e37-ac39-13156e6d695c tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:19:09 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-945c61cc-6334-4e37-ac39-13156e6d695c tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] No VIF found with MAC fa:16:3e:9b:9b:19, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 14:19:10 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-945c61cc-6334-4e37-ac39-13156e6d695c tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Lock "804fb4da-65b9-449a-8e4d-e58e64250a20" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.591s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:19:12 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:19:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:19:17 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:19:22 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:19:27 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:19:27 user nova-compute[72129]: INFO nova.compute.manager [None req-a11aca0c-9724-4fcc-a0f8-d79f53eb86e7 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Rescuing
Aug 01 14:19:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a11aca0c-9724-4fcc-a0f8-d79f53eb86e7 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Acquiring lock "refresh_cache-b3f54430-8d5d-478b-8dc7-d7592ee3db36" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:19:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a11aca0c-9724-4fcc-a0f8-d79f53eb86e7 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Acquired lock "refresh_cache-b3f54430-8d5d-478b-8dc7-d7592ee3db36" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:19:27 user nova-compute[72129]: DEBUG nova.network.neutron [None req-a11aca0c-9724-4fcc-a0f8-d79f53eb86e7 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 14:19:28 user nova-compute[72129]: DEBUG nova.network.neutron [None req-a11aca0c-9724-4fcc-a0f8-d79f53eb86e7 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Updating instance_info_cache with network_info: [{"id": "77cb18a9-2c41-4aa6-8784-ffcbafeb1341", "address": "fa:16:3e:d2:d6:8b", "network": {"id": "6ffcec16-7b44-472a-b7cd-af16ebd4a653", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-901464581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cca3e17d4e4df79c94c4b94fb3fcec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77cb18a9-2c", "ovs_interfaceid": "77cb18a9-2c41-4aa6-8784-ffcbafeb1341", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:19:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a11aca0c-9724-4fcc-a0f8-d79f53eb86e7 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Releasing lock "refresh_cache-b3f54430-8d5d-478b-8dc7-d7592ee3db36" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:19:28 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:19:28 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:19:28 user nova-compute[72129]: DEBUG nova.compute.manager [req-e84b6847-3954-41d4-a623-591ca3a4fc63 req-c0ba8018-084b-46ec-9cea-9f8944e108ec service nova] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Received event network-vif-unplugged-77cb18a9-2c41-4aa6-8784-ffcbafeb1341 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:19:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-e84b6847-3954-41d4-a623-591ca3a4fc63 req-c0ba8018-084b-46ec-9cea-9f8944e108ec service nova] Acquiring lock "b3f54430-8d5d-478b-8dc7-d7592ee3db36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:19:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-e84b6847-3954-41d4-a623-591ca3a4fc63 req-c0ba8018-084b-46ec-9cea-9f8944e108ec service nova] Lock "b3f54430-8d5d-478b-8dc7-d7592ee3db36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:19:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-e84b6847-3954-41d4-a623-591ca3a4fc63 req-c0ba8018-084b-46ec-9cea-9f8944e108ec service nova] Lock "b3f54430-8d5d-478b-8dc7-d7592ee3db36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:19:28 user nova-compute[72129]: DEBUG nova.compute.manager [req-e84b6847-3954-41d4-a623-591ca3a4fc63 req-c0ba8018-084b-46ec-9cea-9f8944e108ec service nova] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] No waiting events found dispatching network-vif-unplugged-77cb18a9-2c41-4aa6-8784-ffcbafeb1341 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:19:28 user nova-compute[72129]: WARNING nova.compute.manager [req-e84b6847-3954-41d4-a623-591ca3a4fc63 req-c0ba8018-084b-46ec-9cea-9f8944e108ec service nova] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Received unexpected event network-vif-unplugged-77cb18a9-2c41-4aa6-8784-ffcbafeb1341 for instance with vm_state active and task_state rescuing.
Aug 01 14:19:28 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:19:28 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:19:29 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Instance destroyed successfully.
Aug 01 14:19:29 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-a11aca0c-9724-4fcc-a0f8-d79f53eb86e7 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Attempting rescue
Aug 01 14:19:29 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-a11aca0c-9724-4fcc-a0f8-d79f53eb86e7 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72129) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 01 14:19:29 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-a11aca0c-9724-4fcc-a0f8-d79f53eb86e7 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Instance directory exists: not creating {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 01 14:19:29 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-a11aca0c-9724-4fcc-a0f8-d79f53eb86e7 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Creating image(s)
Aug 01 14:19:29 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a11aca0c-9724-4fcc-a0f8-d79f53eb86e7 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Acquiring lock "/opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:19:29 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a11aca0c-9724-4fcc-a0f8-d79f53eb86e7 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lock "/opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:19:29 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a11aca0c-9724-4fcc-a0f8-d79f53eb86e7 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lock "/opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:19:29 user nova-compute[72129]: DEBUG nova.objects.instance [None req-a11aca0c-9724-4fcc-a0f8-d79f53eb86e7 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lazy-loading 'trusted_certs' on Instance uuid b3f54430-8d5d-478b-8dc7-d7592ee3db36 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:19:29 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a11aca0c-9724-4fcc-a0f8-d79f53eb86e7 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Acquiring lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:19:29 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a11aca0c-9724-4fcc-a0f8-d79f53eb86e7 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:19:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-a11aca0c-9724-4fcc-a0f8-d79f53eb86e7 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:19:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-a11aca0c-9724-4fcc-a0f8-d79f53eb86e7 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.139s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:19:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-a11aca0c-9724-4fcc-a0f8-d79f53eb86e7 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk.rescue {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:19:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-a11aca0c-9724-4fcc-a0f8-d79f53eb86e7 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk.rescue" returned: 0 in 0.054s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:19:29 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-a11aca0c-9724-4fcc-a0f8-d79f53eb86e7 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:19:29 user nova-compute[72129]: DEBUG nova.objects.instance [None req-a11aca0c-9724-4fcc-a0f8-d79f53eb86e7 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lazy-loading 'migration_context' on Instance uuid b3f54430-8d5d-478b-8dc7-d7592ee3db36 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:19:29 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-a11aca0c-9724-4fcc-a0f8-d79f53eb86e7 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Created local disks {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 14:19:29 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-a11aca0c-9724-4fcc-a0f8-d79f53eb86e7 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Start _get_guest_xml network_info=[{"id": "77cb18a9-2c41-4aa6-8784-ffcbafeb1341", "address": "fa:16:3e:d2:d6:8b", "network": {"id": "6ffcec16-7b44-472a-b7cd-af16ebd4a653", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-901464581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-901464581-network", "vif_mac": "fa:16:3e:d2:d6:8b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cca3e17d4e4df79c94c4b94fb3fcec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77cb18a9-2c", "ovs_interfaceid": "77cb18a9-2c41-4aa6-8784-ffcbafeb1341", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'b6472c34-1b0f-4034-ba3a-7e8eb5103715', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 14:19:29 user nova-compute[72129]: DEBUG nova.objects.instance [None req-a11aca0c-9724-4fcc-a0f8-d79f53eb86e7 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lazy-loading 'resources' on Instance uuid b3f54430-8d5d-478b-8dc7-d7592ee3db36 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:19:29 user nova-compute[72129]: DEBUG nova.objects.instance [None req-a11aca0c-9724-4fcc-a0f8-d79f53eb86e7 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lazy-loading 'numa_topology' on Instance uuid b3f54430-8d5d-478b-8dc7-d7592ee3db36 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:19:29 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-a11aca0c-9724-4fcc-a0f8-d79f53eb86e7 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:19:29 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-a11aca0c-9724-4fcc-a0f8-d79f53eb86e7 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:19:29 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-a11aca0c-9724-4fcc-a0f8-d79f53eb86e7 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 14:19:29 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-a11aca0c-9724-4fcc-a0f8-d79f53eb86e7 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] CPU controller missing on host. {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 14:19:29 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-a11aca0c-9724-4fcc-a0f8-d79f53eb86e7 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 14:19:29 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-a11aca0c-9724-4fcc-a0f8-d79f53eb86e7 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] CPU controller found on host. {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 14:19:29 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-a11aca0c-9724-4fcc-a0f8-d79f53eb86e7 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72129) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 14:19:29 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-a11aca0c-9724-4fcc-a0f8-d79f53eb86e7 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T13:45:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 14:19:29 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-a11aca0c-9724-4fcc-a0f8-d79f53eb86e7 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Flavor limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 14:19:29 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-a11aca0c-9724-4fcc-a0f8-d79f53eb86e7 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Image limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 14:19:29 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-a11aca0c-9724-4fcc-a0f8-d79f53eb86e7 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Flavor pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 14:19:29 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-a11aca0c-9724-4fcc-a0f8-d79f53eb86e7 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Image pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 14:19:29 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-a11aca0c-9724-4fcc-a0f8-d79f53eb86e7 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 14:19:29 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-a11aca0c-9724-4fcc-a0f8-d79f53eb86e7 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 14:19:29 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-a11aca0c-9724-4fcc-a0f8-d79f53eb86e7 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 14:19:29 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-a11aca0c-9724-4fcc-a0f8-d79f53eb86e7 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Got 1 possible topologies {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 14:19:29 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-a11aca0c-9724-4fcc-a0f8-d79f53eb86e7 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 14:19:29 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-a11aca0c-9724-4fcc-a0f8-d79f53eb86e7 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 14:19:29 user nova-compute[72129]: DEBUG nova.objects.instance [None req-a11aca0c-9724-4fcc-a0f8-d79f53eb86e7 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lazy-loading 'vcpu_model' on Instance uuid b3f54430-8d5d-478b-8dc7-d7592ee3db36 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:19:29 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-a11aca0c-9724-4fcc-a0f8-d79f53eb86e7 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:14:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-998646471',display_name='tempest-ServerRescueNegativeTestJSON-server-998646471',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-998646471',id=41,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T14:14:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='42cca3e17d4e4df79c94c4b94fb3fcec',ramdisk_id='',reservation_id='r-3w5r0zro',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-481576424',owner_user_name='tempest-ServerRescueNegativeTestJSON-481576424-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T14:14:49Z,user_data=None,user_id='deb1597afdc647598ee893dd51880173',uuid=b3f54430-8d5d-478b-8dc7-d7592ee3db36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "77cb18a9-2c41-4aa6-8784-ffcbafeb1341", "address": "fa:16:3e:d2:d6:8b", "network": {"id": "6ffcec16-7b44-472a-b7cd-af16ebd4a653", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-901464581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-901464581-network", "vif_mac": "fa:16:3e:d2:d6:8b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cca3e17d4e4df79c94c4b94fb3fcec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77cb18a9-2c", "ovs_interfaceid": "77cb18a9-2c41-4aa6-8784-ffcbafeb1341", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 14:19:29 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-a11aca0c-9724-4fcc-a0f8-d79f53eb86e7 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Converting VIF {"id": "77cb18a9-2c41-4aa6-8784-ffcbafeb1341", "address": "fa:16:3e:d2:d6:8b", "network": {"id": "6ffcec16-7b44-472a-b7cd-af16ebd4a653", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-901464581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-901464581-network", "vif_mac": "fa:16:3e:d2:d6:8b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cca3e17d4e4df79c94c4b94fb3fcec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77cb18a9-2c", "ovs_interfaceid": "77cb18a9-2c41-4aa6-8784-ffcbafeb1341", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:19:29 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-a11aca0c-9724-4fcc-a0f8-d79f53eb86e7 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d2:d6:8b,bridge_name='br-int',has_traffic_filtering=True,id=77cb18a9-2c41-4aa6-8784-ffcbafeb1341,network=Network(6ffcec16-7b44-472a-b7cd-af16ebd4a653),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77cb18a9-2c') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:19:29 user nova-compute[72129]: DEBUG nova.objects.instance [None req-a11aca0c-9724-4fcc-a0f8-d79f53eb86e7 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lazy-loading 'pci_devices' on Instance uuid b3f54430-8d5d-478b-8dc7-d7592ee3db36 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:19:29 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-a11aca0c-9724-4fcc-a0f8-d79f53eb86e7 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] End _get_guest_xml xml=<domain type="kvm">
Aug 01 14:19:29 user nova-compute[72129]:   <uuid>b3f54430-8d5d-478b-8dc7-d7592ee3db36</uuid>
Aug 01 14:19:29 user nova-compute[72129]:   <name>instance-00000029</name>
Aug 01 14:19:29 user nova-compute[72129]:   <memory>524288</memory>
Aug 01 14:19:29 user nova-compute[72129]:   <vcpu>1</vcpu>
Aug 01 14:19:29 user nova-compute[72129]:   <metadata>
Aug 01 14:19:29 user nova-compute[72129]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 14:19:29 user nova-compute[72129]:       <nova:package version="0.0.0"/>
Aug 01 14:19:29 user nova-compute[72129]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-998646471</nova:name>
Aug 01 14:19:29 user nova-compute[72129]:       <nova:creationTime>2023-08-01 14:19:29</nova:creationTime>
Aug 01 14:19:29 user nova-compute[72129]:       <nova:flavor name="m1.tiny">
Aug 01 14:19:29 user nova-compute[72129]:         <nova:memory>512</nova:memory>
Aug 01 14:19:29 user nova-compute[72129]:         <nova:disk>1</nova:disk>
Aug 01 14:19:29 user nova-compute[72129]:         <nova:swap>0</nova:swap>
Aug 01 14:19:29 user nova-compute[72129]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 14:19:29 user nova-compute[72129]:         <nova:vcpus>1</nova:vcpus>
Aug 01 14:19:29 user nova-compute[72129]:       </nova:flavor>
Aug 01 14:19:29 user nova-compute[72129]:       <nova:owner>
Aug 01 14:19:29 user nova-compute[72129]:         <nova:user uuid="deb1597afdc647598ee893dd51880173">tempest-ServerRescueNegativeTestJSON-481576424-project-member</nova:user>
Aug 01 14:19:29 user nova-compute[72129]:         <nova:project uuid="42cca3e17d4e4df79c94c4b94fb3fcec">tempest-ServerRescueNegativeTestJSON-481576424</nova:project>
Aug 01 14:19:29 user nova-compute[72129]:       </nova:owner>
Aug 01 14:19:29 user nova-compute[72129]:       <nova:root type="image" uuid="b6472c34-1b0f-4034-ba3a-7e8eb5103715"/>
Aug 01 14:19:29 user nova-compute[72129]:       <nova:ports>
Aug 01 14:19:29 user nova-compute[72129]:         <nova:port uuid="77cb18a9-2c41-4aa6-8784-ffcbafeb1341">
Aug 01 14:19:29 user nova-compute[72129]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 01 14:19:29 user nova-compute[72129]:         </nova:port>
Aug 01 14:19:29 user nova-compute[72129]:       </nova:ports>
Aug 01 14:19:29 user nova-compute[72129]:     </nova:instance>
Aug 01 14:19:29 user nova-compute[72129]:   </metadata>
Aug 01 14:19:29 user nova-compute[72129]:   <sysinfo type="smbios">
Aug 01 14:19:29 user nova-compute[72129]:     <system>
Aug 01 14:19:29 user nova-compute[72129]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 14:19:29 user nova-compute[72129]:       <entry name="product">OpenStack Nova</entry>
Aug 01 14:19:29 user nova-compute[72129]:       <entry name="version">0.0.0</entry>
Aug 01 14:19:29 user nova-compute[72129]:       <entry name="serial">b3f54430-8d5d-478b-8dc7-d7592ee3db36</entry>
Aug 01 14:19:29 user nova-compute[72129]:       <entry name="uuid">b3f54430-8d5d-478b-8dc7-d7592ee3db36</entry>
Aug 01 14:19:29 user nova-compute[72129]:       <entry name="family">Virtual Machine</entry>
Aug 01 14:19:29 user nova-compute[72129]:     </system>
Aug 01 14:19:29 user nova-compute[72129]:   </sysinfo>
Aug 01 14:19:29 user nova-compute[72129]:   <os>
Aug 01 14:19:29 user nova-compute[72129]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 14:19:29 user nova-compute[72129]:     <smbios mode="sysinfo"/>
Aug 01 14:19:29 user nova-compute[72129]:   </os>
Aug 01 14:19:29 user nova-compute[72129]:   <features>
Aug 01 14:19:29 user nova-compute[72129]:     <acpi/>
Aug 01 14:19:29 user nova-compute[72129]:     <apic/>
Aug 01 14:19:29 user nova-compute[72129]:     <vmcoreinfo/>
Aug 01 14:19:29 user nova-compute[72129]:   </features>
Aug 01 14:19:29 user nova-compute[72129]:   <clock offset="utc">
Aug 01 14:19:29 user nova-compute[72129]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 14:19:29 user nova-compute[72129]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 14:19:29 user nova-compute[72129]:     <timer name="hpet" present="no"/>
Aug 01 14:19:29 user nova-compute[72129]:   </clock>
Aug 01 14:19:29 user nova-compute[72129]:   <cpu mode="custom" match="exact">
Aug 01 14:19:29 user nova-compute[72129]:     <model>Nehalem</model>
Aug 01 14:19:29 user nova-compute[72129]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 14:19:29 user nova-compute[72129]:   </cpu>
Aug 01 14:19:29 user nova-compute[72129]:   <devices>
Aug 01 14:19:29 user nova-compute[72129]:     <disk type="file" device="disk">
Aug 01 14:19:29 user nova-compute[72129]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 14:19:29 user nova-compute[72129]:       <source file="/opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk.rescue"/>
Aug 01 14:19:29 user nova-compute[72129]:       <target dev="vda" bus="virtio"/>
Aug 01 14:19:29 user nova-compute[72129]:     </disk>
Aug 01 14:19:29 user nova-compute[72129]:     <disk type="file" device="disk">
Aug 01 14:19:29 user nova-compute[72129]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 14:19:29 user nova-compute[72129]:       <source file="/opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk"/>
Aug 01 14:19:29 user nova-compute[72129]:       <target dev="vdb" bus="virtio"/>
Aug 01 14:19:29 user nova-compute[72129]:     </disk>
Aug 01 14:19:29 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 14:19:29 user nova-compute[72129]:       <mac address="fa:16:3e:d2:d6:8b"/>
Aug 01 14:19:29 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:19:29 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 14:19:29 user nova-compute[72129]:       <target dev="tap77cb18a9-2c"/>
Aug 01 14:19:29 user nova-compute[72129]:     </interface>
Aug 01 14:19:29 user nova-compute[72129]:     <serial type="pty">
Aug 01 14:19:29 user nova-compute[72129]:       <log file="/opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/console.log" append="off"/>
Aug 01 14:19:29 user nova-compute[72129]:     </serial>
Aug 01 14:19:29 user nova-compute[72129]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 14:19:29 user nova-compute[72129]:     <video>
Aug 01 14:19:29 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:19:29 user nova-compute[72129]:     </video>
Aug 01 14:19:29 user nova-compute[72129]:     <rng model="virtio">
Aug 01 14:19:29 user nova-compute[72129]:       <backend model="random">/dev/urandom</backend>
Aug 01 14:19:29 user nova-compute[72129]:     </rng>
Aug 01 14:19:29 user nova-compute[72129]:     <controller type="usb" index="0" model="none"/>
Aug 01 14:19:29 user nova-compute[72129]:     <memballoon model="virtio">
Aug 01 14:19:29 user nova-compute[72129]:       <stats period="10"/>
Aug 01 14:19:29 user nova-compute[72129]:     </memballoon>
Aug 01 14:19:29 user nova-compute[72129]:   </devices>
Aug 01 14:19:29 user nova-compute[72129]: </domain>
Aug 01 14:19:29 user nova-compute[72129]:  {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 14:19:29 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Instance destroyed successfully.
Aug 01 14:19:29 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-a11aca0c-9724-4fcc-a0f8-d79f53eb86e7 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:19:29 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-a11aca0c-9724-4fcc-a0f8-d79f53eb86e7 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:19:29 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-a11aca0c-9724-4fcc-a0f8-d79f53eb86e7 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] No VIF found with MAC fa:16:3e:d2:d6:8b, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 14:19:30 user nova-compute[72129]: DEBUG nova.compute.manager [req-034f0804-7b6f-4cde-b7ba-0b1edd481d3d req-e5b69dd0-4f8a-47e3-b027-bcb96c54d677 service nova] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Received event network-vif-plugged-77cb18a9-2c41-4aa6-8784-ffcbafeb1341 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:19:30 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-034f0804-7b6f-4cde-b7ba-0b1edd481d3d req-e5b69dd0-4f8a-47e3-b027-bcb96c54d677 service nova] Acquiring lock "b3f54430-8d5d-478b-8dc7-d7592ee3db36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:19:30 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-034f0804-7b6f-4cde-b7ba-0b1edd481d3d req-e5b69dd0-4f8a-47e3-b027-bcb96c54d677 service nova] Lock "b3f54430-8d5d-478b-8dc7-d7592ee3db36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:19:30 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-034f0804-7b6f-4cde-b7ba-0b1edd481d3d req-e5b69dd0-4f8a-47e3-b027-bcb96c54d677 service nova] Lock "b3f54430-8d5d-478b-8dc7-d7592ee3db36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:19:30 user nova-compute[72129]: DEBUG nova.compute.manager [req-034f0804-7b6f-4cde-b7ba-0b1edd481d3d req-e5b69dd0-4f8a-47e3-b027-bcb96c54d677 service nova] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] No waiting events found dispatching network-vif-plugged-77cb18a9-2c41-4aa6-8784-ffcbafeb1341 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:19:30 user nova-compute[72129]: WARNING nova.compute.manager [req-034f0804-7b6f-4cde-b7ba-0b1edd481d3d req-e5b69dd0-4f8a-47e3-b027-bcb96c54d677 service nova] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Received unexpected event network-vif-plugged-77cb18a9-2c41-4aa6-8784-ffcbafeb1341 for instance with vm_state active and task_state rescuing.
Aug 01 14:19:31 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:19:31 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:19:31 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:19:31 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:19:31 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:19:32 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:19:32 user nova-compute[72129]: DEBUG nova.compute.manager [req-37f9bfdd-46d1-45d3-9b9e-9cdb51cdb0d5 req-b01cf33f-bcda-42fe-a832-f668e01de7a1 service nova] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Received event network-vif-plugged-77cb18a9-2c41-4aa6-8784-ffcbafeb1341 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:19:32 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-37f9bfdd-46d1-45d3-9b9e-9cdb51cdb0d5 req-b01cf33f-bcda-42fe-a832-f668e01de7a1 service nova] Acquiring lock "b3f54430-8d5d-478b-8dc7-d7592ee3db36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:19:32 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-37f9bfdd-46d1-45d3-9b9e-9cdb51cdb0d5 req-b01cf33f-bcda-42fe-a832-f668e01de7a1 service nova] Lock "b3f54430-8d5d-478b-8dc7-d7592ee3db36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:19:32 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-37f9bfdd-46d1-45d3-9b9e-9cdb51cdb0d5 req-b01cf33f-bcda-42fe-a832-f668e01de7a1 service nova] Lock "b3f54430-8d5d-478b-8dc7-d7592ee3db36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:19:32 user nova-compute[72129]: DEBUG nova.compute.manager [req-37f9bfdd-46d1-45d3-9b9e-9cdb51cdb0d5 req-b01cf33f-bcda-42fe-a832-f668e01de7a1 service nova] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] No waiting events found dispatching network-vif-plugged-77cb18a9-2c41-4aa6-8784-ffcbafeb1341 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:19:32 user nova-compute[72129]: WARNING nova.compute.manager [req-37f9bfdd-46d1-45d3-9b9e-9cdb51cdb0d5 req-b01cf33f-bcda-42fe-a832-f668e01de7a1 service nova] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Received unexpected event network-vif-plugged-77cb18a9-2c41-4aa6-8784-ffcbafeb1341 for instance with vm_state active and task_state rescuing.
Aug 01 14:19:32 user nova-compute[72129]: DEBUG nova.compute.manager [req-37f9bfdd-46d1-45d3-9b9e-9cdb51cdb0d5 req-b01cf33f-bcda-42fe-a832-f668e01de7a1 service nova] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Received event network-vif-plugged-77cb18a9-2c41-4aa6-8784-ffcbafeb1341 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:19:32 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-37f9bfdd-46d1-45d3-9b9e-9cdb51cdb0d5 req-b01cf33f-bcda-42fe-a832-f668e01de7a1 service nova] Acquiring lock "b3f54430-8d5d-478b-8dc7-d7592ee3db36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:19:32 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-37f9bfdd-46d1-45d3-9b9e-9cdb51cdb0d5 req-b01cf33f-bcda-42fe-a832-f668e01de7a1 service nova] Lock "b3f54430-8d5d-478b-8dc7-d7592ee3db36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:19:32 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-37f9bfdd-46d1-45d3-9b9e-9cdb51cdb0d5 req-b01cf33f-bcda-42fe-a832-f668e01de7a1 service nova] Lock "b3f54430-8d5d-478b-8dc7-d7592ee3db36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:19:32 user nova-compute[72129]: DEBUG nova.compute.manager [req-37f9bfdd-46d1-45d3-9b9e-9cdb51cdb0d5 req-b01cf33f-bcda-42fe-a832-f668e01de7a1 service nova] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] No waiting events found dispatching network-vif-plugged-77cb18a9-2c41-4aa6-8784-ffcbafeb1341 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:19:32 user nova-compute[72129]: WARNING nova.compute.manager [req-37f9bfdd-46d1-45d3-9b9e-9cdb51cdb0d5 req-b01cf33f-bcda-42fe-a832-f668e01de7a1 service nova] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Received unexpected event network-vif-plugged-77cb18a9-2c41-4aa6-8784-ffcbafeb1341 for instance with vm_state active and task_state rescuing.
Aug 01 14:19:33 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Removed pending event for b3f54430-8d5d-478b-8dc7-d7592ee3db36 due to event {{(pid=72129) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 14:19:33 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690899573.1703122, b3f54430-8d5d-478b-8dc7-d7592ee3db36 => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:19:33 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] VM Resumed (Lifecycle Event)
Aug 01 14:19:33 user nova-compute[72129]: DEBUG nova.compute.manager [None req-a11aca0c-9724-4fcc-a0f8-d79f53eb86e7 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:19:33 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:19:33 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:19:33 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 01 14:19:33 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690899573.1714802, b3f54430-8d5d-478b-8dc7-d7592ee3db36 => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:19:33 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] VM Started (Lifecycle Event)
Aug 01 14:19:33 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:19:33 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:19:33 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 01 14:19:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-52126595-6264-4120-bffe-47f3220b6d1b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Acquiring lock "804fb4da-65b9-449a-8e4d-e58e64250a20" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:19:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-52126595-6264-4120-bffe-47f3220b6d1b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Lock "804fb4da-65b9-449a-8e4d-e58e64250a20" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:19:35 user nova-compute[72129]: INFO nova.compute.manager [None req-52126595-6264-4120-bffe-47f3220b6d1b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Detaching volume c0358169-269d-4f6d-9ac5-480166ddd801
Aug 01 14:19:35 user nova-compute[72129]: INFO nova.virt.block_device [None req-52126595-6264-4120-bffe-47f3220b6d1b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Attempting to driver detach volume c0358169-269d-4f6d-9ac5-480166ddd801 from mountpoint /dev/vdb
Aug 01 14:19:35 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-52126595-6264-4120-bffe-47f3220b6d1b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Attempting to detach device vdb from instance 804fb4da-65b9-449a-8e4d-e58e64250a20 from the persistent domain config. {{(pid=72129) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 14:19:35 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-52126595-6264-4120-bffe-47f3220b6d1b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 14:19:35 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:19:35 user nova-compute[72129]:   <source dev="/dev/sdb"/>
Aug 01 14:19:35 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 14:19:35 user nova-compute[72129]:   <serial>c0358169-269d-4f6d-9ac5-480166ddd801</serial>
Aug 01 14:19:35 user nova-compute[72129]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 14:19:35 user nova-compute[72129]: </disk>
Aug 01 14:19:35 user nova-compute[72129]:  {{(pid=72129) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 14:19:35 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-52126595-6264-4120-bffe-47f3220b6d1b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Successfully detached device vdb from instance 804fb4da-65b9-449a-8e4d-e58e64250a20 from the persistent domain config.
Aug 01 14:19:35 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-52126595-6264-4120-bffe-47f3220b6d1b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 804fb4da-65b9-449a-8e4d-e58e64250a20 from the live domain config. {{(pid=72129) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 14:19:35 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-52126595-6264-4120-bffe-47f3220b6d1b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 14:19:35 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:19:35 user nova-compute[72129]:   <source dev="/dev/sdb"/>
Aug 01 14:19:35 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 14:19:35 user nova-compute[72129]:   <serial>c0358169-269d-4f6d-9ac5-480166ddd801</serial>
Aug 01 14:19:35 user nova-compute[72129]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 14:19:35 user nova-compute[72129]: </disk>
Aug 01 14:19:35 user nova-compute[72129]:  {{(pid=72129) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 14:19:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-10194f26-e4dc-4cde-9464-16f30d72821b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Acquiring lock "804fb4da-65b9-449a-8e4d-e58e64250a20" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:19:35 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Received event <DeviceRemovedEvent: 1690899575.6123607, 804fb4da-65b9-449a-8e4d-e58e64250a20 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72129) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 14:19:35 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-52126595-6264-4120-bffe-47f3220b6d1b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 804fb4da-65b9-449a-8e4d-e58e64250a20 {{(pid=72129) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 14:19:35 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-52126595-6264-4120-bffe-47f3220b6d1b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Successfully detached device vdb from instance 804fb4da-65b9-449a-8e4d-e58e64250a20 from the live domain config.
Aug 01 14:19:35 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52126595-6264-4120-bffe-47f3220b6d1b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] calling os-brick to detach iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 14:19:35 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-52126595-6264-4120-bffe-47f3220b6d1b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, {'target_iqns': ['iqn.2010-10.org.openstack:c0358169-269d-4f6d-9ac5-480166ddd801'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XeqwCFKb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:19:35 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-52126595-6264-4120-bffe-47f3220b6d1b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:19:35 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-52126595-6264-4120-bffe-47f3220b6d1b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:19:35 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-52126595-6264-4120-bffe-47f3220b6d1b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:19:35 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-52126595-6264-4120-bffe-47f3220b6d1b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0358169-269d-4f6d-9ac5-480166ddd801', 0)] {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 14:19:35 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:19:35 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:19:35 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebbc4727-0e54-491a-bfad-32e34b9cae29]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0358169-269d-4f6d-9ac5-480166ddd801\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:19:35 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:19:35 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:19:35 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[193881c1-5cb0-496f-8720-f7ebe0e9714f]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0358169-269d-4f6d-9ac5-480166ddd801 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:19:35 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-52126595-6264-4120-bffe-47f3220b6d1b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0358169-269d-4f6d-9ac5-480166ddd801 (non-flash)
Aug 01 14:19:35 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:19:35 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-52126595-6264-4120-bffe-47f3220b6d1b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0358169-269d-4f6d-9ac5-480166ddd801 (non-flash)
Aug 01 14:19:35 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:19:35 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-52126595-6264-4120-bffe-47f3220b6d1b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2828192c20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0358169-269d-4f6d-9ac5-480166ddd801'): ({'sdb'}, set())}) {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 14:19:35 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-52126595-6264-4120-bffe-47f3220b6d1b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Removing single pathed devices sdb {{(pid=72129) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 14:19:35 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:19:35 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:19:35 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e65b845-312a-46c3-96d1-c80a9c8e823a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:19:35 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:19:35 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:19:35 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec7622c-2439-4036-8b0d-435914b45677]: (4, ('ok\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:19:35 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-52126595-6264-4120-bffe-47f3220b6d1b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Flushing IO for device /dev/sdb {{(pid=72129) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 14:19:35 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:19:35 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:19:35 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96b4c4a-db66-49d4-93ec-67da9b225213]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:19:35 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-52126595-6264-4120-bffe-47f3220b6d1b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72129) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 14:19:35 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:19:35 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:19:35 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c9fafe-fcdd-4ba0-8979-077e040a5b3a]: (4, ('1', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:19:35 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-52126595-6264-4120-bffe-47f3220b6d1b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 14:19:35 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-52126595-6264-4120-bffe-47f3220b6d1b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] SCSI volumes sdb have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 14:19:35 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-52126595-6264-4120-bffe-47f3220b6d1b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0358169-269d-4f6d-9ac5-480166ddd801')] {{(pid=72129) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 14:19:35 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0358169-269d-4f6d-9ac5-480166ddd801 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:19:35 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0358169-269d-4f6d-9ac5-480166ddd801 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:19:35 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[517094c7-8b68-41aa-bdfe-69b70dea7713]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:19:35 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-52126595-6264-4120-bffe-47f3220b6d1b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:19:35 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0358169-269d-4f6d-9ac5-480166ddd801 -p 172.16.0.220:3260 --logout {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:19:35 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0358169-269d-4f6d-9ac5-480166ddd801 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:19:35 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5352fc4-9025-49b8-b63d-285e55435b9c]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:c0358169-269d-4f6d-9ac5-480166ddd801, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:c0358169-269d-4f6d-9ac5-480166ddd801, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:19:35 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-52126595-6264-4120-bffe-47f3220b6d1b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:c0358169-269d-4f6d-9ac5-480166ddd801, portal: 172.16.0.220,3260]
Aug 01 14:19:35 user nova-compute[72129]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:c0358169-269d-4f6d-9ac5-480166ddd801, portal: 172.16.0.220,3260] successful.
Aug 01 14:19:35 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:19:35 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0358169-269d-4f6d-9ac5-480166ddd801 -p 172.16.0.220:3260 --op delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:19:35 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0358169-269d-4f6d-9ac5-480166ddd801 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:19:35 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6393b78-1e85-467a-a749-82cb0456d01c]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:19:35 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-52126595-6264-4120-bffe-47f3220b6d1b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:19:35 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-52126595-6264-4120-bffe-47f3220b6d1b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:19:35 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-52126595-6264-4120-bffe-47f3220b6d1b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] <== disconnect_volume: return (281ms) None {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:19:35 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52126595-6264-4120-bffe-47f3220b6d1b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Disconnected iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 14:19:36 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:19:36 user nova-compute[72129]: DEBUG nova.objects.instance [None req-52126595-6264-4120-bffe-47f3220b6d1b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Lazy-loading 'flavor' on Instance uuid 804fb4da-65b9-449a-8e4d-e58e64250a20 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:19:36 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-52126595-6264-4120-bffe-47f3220b6d1b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Lock "804fb4da-65b9-449a-8e4d-e58e64250a20" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.647s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:19:36 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-10194f26-e4dc-4cde-9464-16f30d72821b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Lock "804fb4da-65b9-449a-8e4d-e58e64250a20" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.519s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:19:36 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-10194f26-e4dc-4cde-9464-16f30d72821b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Acquiring lock "804fb4da-65b9-449a-8e4d-e58e64250a20-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:19:36 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-10194f26-e4dc-4cde-9464-16f30d72821b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Lock "804fb4da-65b9-449a-8e4d-e58e64250a20-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:19:36 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-10194f26-e4dc-4cde-9464-16f30d72821b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Lock "804fb4da-65b9-449a-8e4d-e58e64250a20-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:19:36 user nova-compute[72129]: INFO nova.compute.manager [None req-10194f26-e4dc-4cde-9464-16f30d72821b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Terminating instance
Aug 01 14:19:36 user nova-compute[72129]: DEBUG nova.compute.manager [None req-10194f26-e4dc-4cde-9464-16f30d72821b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Start destroying the instance on the hypervisor. {{(pid=72129) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 14:19:36 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:19:36 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:19:36 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:19:36 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:19:36 user nova-compute[72129]: DEBUG nova.compute.manager [req-e5668730-280d-48e4-aef3-31682697629d req-bb0aa005-a9b7-4a9c-99fb-5bf43abc5c1d service nova] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Received event network-vif-unplugged-9383cfe2-3f3d-4a37-b8f4-5199fcab6f2f {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:19:36 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-e5668730-280d-48e4-aef3-31682697629d req-bb0aa005-a9b7-4a9c-99fb-5bf43abc5c1d service nova] Acquiring lock "804fb4da-65b9-449a-8e4d-e58e64250a20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:19:36 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-e5668730-280d-48e4-aef3-31682697629d req-bb0aa005-a9b7-4a9c-99fb-5bf43abc5c1d service nova] Lock "804fb4da-65b9-449a-8e4d-e58e64250a20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:19:36 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-e5668730-280d-48e4-aef3-31682697629d req-bb0aa005-a9b7-4a9c-99fb-5bf43abc5c1d service nova] Lock "804fb4da-65b9-449a-8e4d-e58e64250a20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:19:36 user nova-compute[72129]: DEBUG nova.compute.manager [req-e5668730-280d-48e4-aef3-31682697629d req-bb0aa005-a9b7-4a9c-99fb-5bf43abc5c1d service nova] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] No waiting events found dispatching network-vif-unplugged-9383cfe2-3f3d-4a37-b8f4-5199fcab6f2f {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:19:36 user nova-compute[72129]: DEBUG nova.compute.manager [req-e5668730-280d-48e4-aef3-31682697629d req-bb0aa005-a9b7-4a9c-99fb-5bf43abc5c1d service nova] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Received event network-vif-unplugged-9383cfe2-3f3d-4a37-b8f4-5199fcab6f2f for instance with task_state deleting. {{(pid=72129) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 14:19:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:19:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:19:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:19:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:19:37 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Instance destroyed successfully.
Aug 01 14:19:37 user nova-compute[72129]: DEBUG nova.objects.instance [None req-10194f26-e4dc-4cde-9464-16f30d72821b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Lazy-loading 'resources' on Instance uuid 804fb4da-65b9-449a-8e4d-e58e64250a20 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:19:37 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-10194f26-e4dc-4cde-9464-16f30d72821b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:17:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1113772352',display_name='tempest-VolumesSnapshotTestJSON-instance-1113772352',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1113772352',id=44,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNamDqmx7rpTYVJLILoo4uYc4ZG8MPFlFDUfH4PE1TtIGntDKy13JHuP62zVbalJIe9JpXq8QS/okuU39oB1q5/GETOv1C/tgCzEJWHSoryQD9T5m4LUGrJz/j9phh/Kdw==',key_name='tempest-keypair-1095635327',keypairs=<?>,launch_index=0,launched_at=2023-08-01T14:17:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d203d0ad6e3c4379ae26ad8fb44f877d',ramdisk_id='',reservation_id='r-qvi290e5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-171675326',owner_user_name='tempest-VolumesSnapshotTestJSON-171675326-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T14:17:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cab6f7398341468dbd829d828b3a7b8c',uuid=804fb4da-65b9-449a-8e4d-e58e64250a20,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9383cfe2-3f3d-4a37-b8f4-5199fcab6f2f", "address": "fa:16:3e:9b:9b:19", "network": {"id": "814dffe9-8861-4a81-bf68-d86f2a4b4faf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1760326136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d203d0ad6e3c4379ae26ad8fb44f877d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9383cfe2-3f", "ovs_interfaceid": "9383cfe2-3f3d-4a37-b8f4-5199fcab6f2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 14:19:37 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-10194f26-e4dc-4cde-9464-16f30d72821b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Converting VIF {"id": "9383cfe2-3f3d-4a37-b8f4-5199fcab6f2f", "address": "fa:16:3e:9b:9b:19", "network": {"id": "814dffe9-8861-4a81-bf68-d86f2a4b4faf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1760326136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d203d0ad6e3c4379ae26ad8fb44f877d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9383cfe2-3f", "ovs_interfaceid": "9383cfe2-3f3d-4a37-b8f4-5199fcab6f2f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:19:37 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-10194f26-e4dc-4cde-9464-16f30d72821b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9b:9b:19,bridge_name='br-int',has_traffic_filtering=True,id=9383cfe2-3f3d-4a37-b8f4-5199fcab6f2f,network=Network(814dffe9-8861-4a81-bf68-d86f2a4b4faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9383cfe2-3f') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:19:37 user nova-compute[72129]: DEBUG os_vif [None req-10194f26-e4dc-4cde-9464-16f30d72821b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:9b:19,bridge_name='br-int',has_traffic_filtering=True,id=9383cfe2-3f3d-4a37-b8f4-5199fcab6f2f,network=Network(814dffe9-8861-4a81-bf68-d86f2a4b4faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9383cfe2-3f') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 14:19:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:19:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9383cfe2-3f, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:19:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:19:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:19:37 user nova-compute[72129]: INFO os_vif [None req-10194f26-e4dc-4cde-9464-16f30d72821b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:9b:19,bridge_name='br-int',has_traffic_filtering=True,id=9383cfe2-3f3d-4a37-b8f4-5199fcab6f2f,network=Network(814dffe9-8861-4a81-bf68-d86f2a4b4faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9383cfe2-3f')
Aug 01 14:19:37 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10194f26-e4dc-4cde-9464-16f30d72821b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] calling os-brick to detach iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 14:19:37 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-10194f26-e4dc-4cde-9464-16f30d72821b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, {'target_iqns': ['iqn.2010-10.org.openstack:c0358169-269d-4f6d-9ac5-480166ddd801'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XeqwCFKb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:19:37 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-10194f26-e4dc-4cde-9464-16f30d72821b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:19:37 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-10194f26-e4dc-4cde-9464-16f30d72821b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:19:37 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-10194f26-e4dc-4cde-9464-16f30d72821b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:19:37 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-10194f26-e4dc-4cde-9464-16f30d72821b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0358169-269d-4f6d-9ac5-480166ddd801', 0)] {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 14:19:37 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:19:37 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 21 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:19:37 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[53bb98e0-fe58-49ae-8b42-39316be6877f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:19:37 user nova-compute[72129]: WARNING os_brick.initiator.connectors.iscsi [None req-10194f26-e4dc-4cde-9464-16f30d72821b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Couldn't find iSCSI nodes because iscsiadm err: iscsiadm: No records found
Aug 01 14:19:37 user nova-compute[72129]: 
Aug 01 14:19:37 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:19:37 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:19:37 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[46bc0fd7-c9a5-40d8-abf1-0696b91bc03d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:19:37 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-10194f26-e4dc-4cde-9464-16f30d72821b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 14:19:37 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:19:37 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-10194f26-e4dc-4cde-9464-16f30d72821b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 14:19:37 user nova-compute[72129]:  {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:19:37 user nova-compute[72129]: WARNING os_brick.initiator.connectors.iscsi [None req-10194f26-e4dc-4cde-9464-16f30d72821b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 14:19:37 user nova-compute[72129]: 
Aug 01 14:19:37 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-10194f26-e4dc-4cde-9464-16f30d72821b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f28201770a0>, {}) {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 14:19:37 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-10194f26-e4dc-4cde-9464-16f30d72821b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Disconnecting from: [] {{(pid=72129) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 14:19:37 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-10194f26-e4dc-4cde-9464-16f30d72821b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.048s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:19:37 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-10194f26-e4dc-4cde-9464-16f30d72821b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] <== disconnect_volume: return (49ms) None {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:19:37 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10194f26-e4dc-4cde-9464-16f30d72821b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Disconnected iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 14:19:37 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-10194f26-e4dc-4cde-9464-16f30d72821b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Deleting instance files /opt/stack/data/nova/instances/804fb4da-65b9-449a-8e4d-e58e64250a20_del
Aug 01 14:19:37 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-10194f26-e4dc-4cde-9464-16f30d72821b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Deletion of /opt/stack/data/nova/instances/804fb4da-65b9-449a-8e4d-e58e64250a20_del complete
Aug 01 14:19:37 user nova-compute[72129]: INFO nova.compute.manager [None req-10194f26-e4dc-4cde-9464-16f30d72821b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Took 0.96 seconds to destroy the instance on the hypervisor.
Aug 01 14:19:37 user nova-compute[72129]: DEBUG oslo.service.loopingcall [None req-10194f26-e4dc-4cde-9464-16f30d72821b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72129) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 14:19:37 user nova-compute[72129]: DEBUG nova.compute.manager [-] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Deallocating network for instance {{(pid=72129) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 14:19:37 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] deallocate_for_instance() {{(pid=72129) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 14:19:38 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:19:38 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:19:38 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:19:38 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:19:38 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:19:38 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:19:38 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Took 1.24 seconds to deallocate network for instance.
Aug 01 14:19:38 user nova-compute[72129]: WARNING nova.volume.cinder [None req-10194f26-e4dc-4cde-9464-16f30d72821b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Attachment 7777733a-eaff-4354-9de5-72c8e3492637 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 7777733a-eaff-4354-9de5-72c8e3492637. (HTTP 404) (Request-ID: req-8c359861-89e3-42d8-bdaa-1bce099eb90d)
Aug 01 14:19:38 user nova-compute[72129]: INFO nova.compute.manager [None req-10194f26-e4dc-4cde-9464-16f30d72821b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Took 0.02 seconds to detach 1 volumes for instance.
Aug 01 14:19:39 user nova-compute[72129]: DEBUG nova.compute.manager [req-da89a804-b8ad-4e33-8eab-3da1418510c7 req-bc479c4a-215d-426b-817a-86f83d90e3ed service nova] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Received event network-vif-plugged-9383cfe2-3f3d-4a37-b8f4-5199fcab6f2f {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:19:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-da89a804-b8ad-4e33-8eab-3da1418510c7 req-bc479c4a-215d-426b-817a-86f83d90e3ed service nova] Acquiring lock "804fb4da-65b9-449a-8e4d-e58e64250a20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:19:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-da89a804-b8ad-4e33-8eab-3da1418510c7 req-bc479c4a-215d-426b-817a-86f83d90e3ed service nova] Lock "804fb4da-65b9-449a-8e4d-e58e64250a20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:19:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-da89a804-b8ad-4e33-8eab-3da1418510c7 req-bc479c4a-215d-426b-817a-86f83d90e3ed service nova] Lock "804fb4da-65b9-449a-8e4d-e58e64250a20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:19:39 user nova-compute[72129]: DEBUG nova.compute.manager [req-da89a804-b8ad-4e33-8eab-3da1418510c7 req-bc479c4a-215d-426b-817a-86f83d90e3ed service nova] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] No waiting events found dispatching network-vif-plugged-9383cfe2-3f3d-4a37-b8f4-5199fcab6f2f {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:19:39 user nova-compute[72129]: WARNING nova.compute.manager [req-da89a804-b8ad-4e33-8eab-3da1418510c7 req-bc479c4a-215d-426b-817a-86f83d90e3ed service nova] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Received unexpected event network-vif-plugged-9383cfe2-3f3d-4a37-b8f4-5199fcab6f2f for instance with vm_state active and task_state deleting.
Aug 01 14:19:39 user nova-compute[72129]: DEBUG nova.compute.manager [req-da89a804-b8ad-4e33-8eab-3da1418510c7 req-bc479c4a-215d-426b-817a-86f83d90e3ed service nova] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Received event network-vif-plugged-9383cfe2-3f3d-4a37-b8f4-5199fcab6f2f {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:19:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-da89a804-b8ad-4e33-8eab-3da1418510c7 req-bc479c4a-215d-426b-817a-86f83d90e3ed service nova] Acquiring lock "804fb4da-65b9-449a-8e4d-e58e64250a20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:19:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-da89a804-b8ad-4e33-8eab-3da1418510c7 req-bc479c4a-215d-426b-817a-86f83d90e3ed service nova] Lock "804fb4da-65b9-449a-8e4d-e58e64250a20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:19:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-da89a804-b8ad-4e33-8eab-3da1418510c7 req-bc479c4a-215d-426b-817a-86f83d90e3ed service nova] Lock "804fb4da-65b9-449a-8e4d-e58e64250a20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:19:39 user nova-compute[72129]: DEBUG nova.compute.manager [req-da89a804-b8ad-4e33-8eab-3da1418510c7 req-bc479c4a-215d-426b-817a-86f83d90e3ed service nova] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] No waiting events found dispatching network-vif-plugged-9383cfe2-3f3d-4a37-b8f4-5199fcab6f2f {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:19:39 user nova-compute[72129]: WARNING nova.compute.manager [req-da89a804-b8ad-4e33-8eab-3da1418510c7 req-bc479c4a-215d-426b-817a-86f83d90e3ed service nova] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Received unexpected event network-vif-plugged-9383cfe2-3f3d-4a37-b8f4-5199fcab6f2f for instance with vm_state active and task_state deleting.
Aug 01 14:19:39 user nova-compute[72129]: DEBUG nova.compute.manager [req-da89a804-b8ad-4e33-8eab-3da1418510c7 req-bc479c4a-215d-426b-817a-86f83d90e3ed service nova] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Received event network-vif-plugged-9383cfe2-3f3d-4a37-b8f4-5199fcab6f2f {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:19:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-da89a804-b8ad-4e33-8eab-3da1418510c7 req-bc479c4a-215d-426b-817a-86f83d90e3ed service nova] Acquiring lock "804fb4da-65b9-449a-8e4d-e58e64250a20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:19:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-da89a804-b8ad-4e33-8eab-3da1418510c7 req-bc479c4a-215d-426b-817a-86f83d90e3ed service nova] Lock "804fb4da-65b9-449a-8e4d-e58e64250a20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:19:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-da89a804-b8ad-4e33-8eab-3da1418510c7 req-bc479c4a-215d-426b-817a-86f83d90e3ed service nova] Lock "804fb4da-65b9-449a-8e4d-e58e64250a20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:19:39 user nova-compute[72129]: DEBUG nova.compute.manager [req-da89a804-b8ad-4e33-8eab-3da1418510c7 req-bc479c4a-215d-426b-817a-86f83d90e3ed service nova] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] No waiting events found dispatching network-vif-plugged-9383cfe2-3f3d-4a37-b8f4-5199fcab6f2f {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:19:39 user nova-compute[72129]: WARNING nova.compute.manager [req-da89a804-b8ad-4e33-8eab-3da1418510c7 req-bc479c4a-215d-426b-817a-86f83d90e3ed service nova] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Received unexpected event network-vif-plugged-9383cfe2-3f3d-4a37-b8f4-5199fcab6f2f for instance with vm_state active and task_state deleting.
Aug 01 14:19:39 user nova-compute[72129]: DEBUG nova.compute.manager [req-da89a804-b8ad-4e33-8eab-3da1418510c7 req-bc479c4a-215d-426b-817a-86f83d90e3ed service nova] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Received event network-vif-unplugged-9383cfe2-3f3d-4a37-b8f4-5199fcab6f2f {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:19:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-da89a804-b8ad-4e33-8eab-3da1418510c7 req-bc479c4a-215d-426b-817a-86f83d90e3ed service nova] Acquiring lock "804fb4da-65b9-449a-8e4d-e58e64250a20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:19:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-da89a804-b8ad-4e33-8eab-3da1418510c7 req-bc479c4a-215d-426b-817a-86f83d90e3ed service nova] Lock "804fb4da-65b9-449a-8e4d-e58e64250a20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:19:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-da89a804-b8ad-4e33-8eab-3da1418510c7 req-bc479c4a-215d-426b-817a-86f83d90e3ed service nova] Lock "804fb4da-65b9-449a-8e4d-e58e64250a20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:19:39 user nova-compute[72129]: DEBUG nova.compute.manager [req-da89a804-b8ad-4e33-8eab-3da1418510c7 req-bc479c4a-215d-426b-817a-86f83d90e3ed service nova] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] No waiting events found dispatching network-vif-unplugged-9383cfe2-3f3d-4a37-b8f4-5199fcab6f2f {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:19:39 user nova-compute[72129]: DEBUG nova.compute.manager [req-da89a804-b8ad-4e33-8eab-3da1418510c7 req-bc479c4a-215d-426b-817a-86f83d90e3ed service nova] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Received event network-vif-unplugged-9383cfe2-3f3d-4a37-b8f4-5199fcab6f2f for instance with task_state deleting. {{(pid=72129) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 14:19:39 user nova-compute[72129]: DEBUG nova.compute.manager [req-da89a804-b8ad-4e33-8eab-3da1418510c7 req-bc479c4a-215d-426b-817a-86f83d90e3ed service nova] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Received event network-vif-plugged-9383cfe2-3f3d-4a37-b8f4-5199fcab6f2f {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:19:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-da89a804-b8ad-4e33-8eab-3da1418510c7 req-bc479c4a-215d-426b-817a-86f83d90e3ed service nova] Acquiring lock "804fb4da-65b9-449a-8e4d-e58e64250a20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:19:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-da89a804-b8ad-4e33-8eab-3da1418510c7 req-bc479c4a-215d-426b-817a-86f83d90e3ed service nova] Lock "804fb4da-65b9-449a-8e4d-e58e64250a20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:19:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-da89a804-b8ad-4e33-8eab-3da1418510c7 req-bc479c4a-215d-426b-817a-86f83d90e3ed service nova] Lock "804fb4da-65b9-449a-8e4d-e58e64250a20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:19:39 user nova-compute[72129]: DEBUG nova.compute.manager [req-da89a804-b8ad-4e33-8eab-3da1418510c7 req-bc479c4a-215d-426b-817a-86f83d90e3ed service nova] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] No waiting events found dispatching network-vif-plugged-9383cfe2-3f3d-4a37-b8f4-5199fcab6f2f {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:19:39 user nova-compute[72129]: WARNING nova.compute.manager [req-da89a804-b8ad-4e33-8eab-3da1418510c7 req-bc479c4a-215d-426b-817a-86f83d90e3ed service nova] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Received unexpected event network-vif-plugged-9383cfe2-3f3d-4a37-b8f4-5199fcab6f2f for instance with vm_state active and task_state deleting.
Aug 01 14:19:39 user nova-compute[72129]: DEBUG nova.compute.manager [req-da89a804-b8ad-4e33-8eab-3da1418510c7 req-bc479c4a-215d-426b-817a-86f83d90e3ed service nova] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Received event network-vif-deleted-9383cfe2-3f3d-4a37-b8f4-5199fcab6f2f {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:19:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-10194f26-e4dc-4cde-9464-16f30d72821b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:19:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-10194f26-e4dc-4cde-9464-16f30d72821b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:19:39 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-10194f26-e4dc-4cde-9464-16f30d72821b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:19:39 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-10194f26-e4dc-4cde-9464-16f30d72821b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:19:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-10194f26-e4dc-4cde-9464-16f30d72821b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.212s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:19:39 user nova-compute[72129]: INFO nova.scheduler.client.report [None req-10194f26-e4dc-4cde-9464-16f30d72821b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Deleted allocations for instance 804fb4da-65b9-449a-8e4d-e58e64250a20
Aug 01 14:19:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-10194f26-e4dc-4cde-9464-16f30d72821b tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Lock "804fb4da-65b9-449a-8e4d-e58e64250a20" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.642s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:19:42 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:19:46 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:19:47 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:19:51 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:19:52 user nova-compute[72129]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690899577.5025043, 804fb4da-65b9-449a-8e4d-e58e64250a20 => Stopped> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:19:52 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] VM Stopped (Lifecycle Event)
Aug 01 14:19:52 user nova-compute[72129]: DEBUG nova.compute.manager [None req-8f7696ac-faa1-4779-bf2c-ce9f92dbd48d None None] [instance: 804fb4da-65b9-449a-8e4d-e58e64250a20] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:19:52 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:19:53 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e709bfc6-c470-4c3e-b8ce-e0a2f502b3d7 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Acquiring lock "5c3a4469-30fd-4f27-a3b7-957422dd2746" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:19:53 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e709bfc6-c470-4c3e-b8ce-e0a2f502b3d7 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "5c3a4469-30fd-4f27-a3b7-957422dd2746" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:19:53 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e709bfc6-c470-4c3e-b8ce-e0a2f502b3d7 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Acquiring lock "5c3a4469-30fd-4f27-a3b7-957422dd2746-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:19:53 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e709bfc6-c470-4c3e-b8ce-e0a2f502b3d7 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "5c3a4469-30fd-4f27-a3b7-957422dd2746-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:19:53 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e709bfc6-c470-4c3e-b8ce-e0a2f502b3d7 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "5c3a4469-30fd-4f27-a3b7-957422dd2746-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:19:53 user nova-compute[72129]: INFO nova.compute.manager [None req-e709bfc6-c470-4c3e-b8ce-e0a2f502b3d7 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Terminating instance
Aug 01 14:19:53 user nova-compute[72129]: DEBUG nova.compute.manager [None req-e709bfc6-c470-4c3e-b8ce-e0a2f502b3d7 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Start destroying the instance on the hypervisor. {{(pid=72129) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 14:19:54 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:19:54 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:19:54 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:19:54 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:19:54 user nova-compute[72129]: DEBUG nova.compute.manager [req-1eb4413d-7300-40f8-afc1-217740e019de req-45d10131-e085-47f0-8a23-4059cddc58b3 service nova] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Received event network-vif-unplugged-7f4ef5f0-b138-43aa-ad82-ced2ff871e3d {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:19:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-1eb4413d-7300-40f8-afc1-217740e019de req-45d10131-e085-47f0-8a23-4059cddc58b3 service nova] Acquiring lock "5c3a4469-30fd-4f27-a3b7-957422dd2746-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:19:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-1eb4413d-7300-40f8-afc1-217740e019de req-45d10131-e085-47f0-8a23-4059cddc58b3 service nova] Lock "5c3a4469-30fd-4f27-a3b7-957422dd2746-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:19:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-1eb4413d-7300-40f8-afc1-217740e019de req-45d10131-e085-47f0-8a23-4059cddc58b3 service nova] Lock "5c3a4469-30fd-4f27-a3b7-957422dd2746-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:19:54 user nova-compute[72129]: DEBUG nova.compute.manager [req-1eb4413d-7300-40f8-afc1-217740e019de req-45d10131-e085-47f0-8a23-4059cddc58b3 service nova] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] No waiting events found dispatching network-vif-unplugged-7f4ef5f0-b138-43aa-ad82-ced2ff871e3d {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:19:54 user nova-compute[72129]: DEBUG nova.compute.manager [req-1eb4413d-7300-40f8-afc1-217740e019de req-45d10131-e085-47f0-8a23-4059cddc58b3 service nova] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Received event network-vif-unplugged-7f4ef5f0-b138-43aa-ad82-ced2ff871e3d for instance with task_state deleting. {{(pid=72129) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 14:19:54 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Instance destroyed successfully.
Aug 01 14:19:54 user nova-compute[72129]: DEBUG nova.objects.instance [None req-e709bfc6-c470-4c3e-b8ce-e0a2f502b3d7 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lazy-loading 'resources' on Instance uuid 5c3a4469-30fd-4f27-a3b7-957422dd2746 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:19:54 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-e709bfc6-c470-4c3e-b8ce-e0a2f502b3d7 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:14:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1764116350',display_name='tempest-AttachVolumeNegativeTest-server-1764116350',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1764116350',id=40,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5AOOX6iS6ZoVlJVsbEDFw2v2ug9zPmHb6G55Oi/9APMMv0fvM3QGtRVL9M6EpF0I7uoWOIwS+cq4kenUzLa77uuwaPtKA+zqMr3v6GGfADyF3FLrwb7wLyBQqdzFkv+w==',key_name='tempest-keypair-1609805560',keypairs=<?>,launch_index=0,launched_at=2023-08-01T14:14:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f5d5ede0f2e44eaab914ffc17aef8aa8',ramdisk_id='',reservation_id='r-28ey4k9b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2079788087',owner_user_name='tempest-AttachVolumeNegativeTest-2079788087-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T14:14:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85308332b4084e9f8c1bf605f540434b',uuid=5c3a4469-30fd-4f27-a3b7-957422dd2746,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7f4ef5f0-b138-43aa-ad82-ced2ff871e3d", "address": "fa:16:3e:5d:46:e3", "network": {"id": "9d4effd9-bf5c-41a7-a8e2-18d2177ace34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333645199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5d5ede0f2e44eaab914ffc17aef8aa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f4ef5f0-b1", "ovs_interfaceid": "7f4ef5f0-b138-43aa-ad82-ced2ff871e3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 14:19:54 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-e709bfc6-c470-4c3e-b8ce-e0a2f502b3d7 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Converting VIF {"id": "7f4ef5f0-b138-43aa-ad82-ced2ff871e3d", "address": "fa:16:3e:5d:46:e3", "network": {"id": "9d4effd9-bf5c-41a7-a8e2-18d2177ace34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333645199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5d5ede0f2e44eaab914ffc17aef8aa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f4ef5f0-b1", "ovs_interfaceid": "7f4ef5f0-b138-43aa-ad82-ced2ff871e3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:19:54 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-e709bfc6-c470-4c3e-b8ce-e0a2f502b3d7 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5d:46:e3,bridge_name='br-int',has_traffic_filtering=True,id=7f4ef5f0-b138-43aa-ad82-ced2ff871e3d,network=Network(9d4effd9-bf5c-41a7-a8e2-18d2177ace34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f4ef5f0-b1') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:19:54 user nova-compute[72129]: DEBUG os_vif [None req-e709bfc6-c470-4c3e-b8ce-e0a2f502b3d7 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:46:e3,bridge_name='br-int',has_traffic_filtering=True,id=7f4ef5f0-b138-43aa-ad82-ced2ff871e3d,network=Network(9d4effd9-bf5c-41a7-a8e2-18d2177ace34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f4ef5f0-b1') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 14:19:54 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:19:54 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7f4ef5f0-b1, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:19:54 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:19:54 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:19:54 user nova-compute[72129]: INFO os_vif [None req-e709bfc6-c470-4c3e-b8ce-e0a2f502b3d7 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:46:e3,bridge_name='br-int',has_traffic_filtering=True,id=7f4ef5f0-b138-43aa-ad82-ced2ff871e3d,network=Network(9d4effd9-bf5c-41a7-a8e2-18d2177ace34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f4ef5f0-b1')
Aug 01 14:19:54 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-e709bfc6-c470-4c3e-b8ce-e0a2f502b3d7 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Deleting instance files /opt/stack/data/nova/instances/5c3a4469-30fd-4f27-a3b7-957422dd2746_del
Aug 01 14:19:54 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-e709bfc6-c470-4c3e-b8ce-e0a2f502b3d7 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Deletion of /opt/stack/data/nova/instances/5c3a4469-30fd-4f27-a3b7-957422dd2746_del complete
Aug 01 14:19:54 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:19:54 user nova-compute[72129]: INFO nova.compute.manager [None req-e709bfc6-c470-4c3e-b8ce-e0a2f502b3d7 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 01 14:19:54 user nova-compute[72129]: DEBUG oslo.service.loopingcall [None req-e709bfc6-c470-4c3e-b8ce-e0a2f502b3d7 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72129) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 14:19:54 user nova-compute[72129]: DEBUG nova.compute.manager [-] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Deallocating network for instance {{(pid=72129) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 14:19:54 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] deallocate_for_instance() {{(pid=72129) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 14:19:55 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:19:55 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Took 0.84 seconds to deallocate network for instance.
Aug 01 14:19:55 user nova-compute[72129]: DEBUG nova.compute.manager [req-b4099ddc-1dee-4f34-9c0f-03a035e7f32c req-076383a0-ff26-4ec1-b21b-c06d91b9929b service nova] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Received event network-vif-deleted-7f4ef5f0-b138-43aa-ad82-ced2ff871e3d {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:19:55 user nova-compute[72129]: INFO nova.compute.manager [req-b4099ddc-1dee-4f34-9c0f-03a035e7f32c req-076383a0-ff26-4ec1-b21b-c06d91b9929b service nova] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Neutron deleted interface 7f4ef5f0-b138-43aa-ad82-ced2ff871e3d; detaching it from the instance and deleting it from the info cache
Aug 01 14:19:55 user nova-compute[72129]: DEBUG nova.network.neutron [req-b4099ddc-1dee-4f34-9c0f-03a035e7f32c req-076383a0-ff26-4ec1-b21b-c06d91b9929b service nova] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:19:55 user nova-compute[72129]: DEBUG nova.compute.manager [req-b4099ddc-1dee-4f34-9c0f-03a035e7f32c req-076383a0-ff26-4ec1-b21b-c06d91b9929b service nova] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Detach interface failed, port_id=7f4ef5f0-b138-43aa-ad82-ced2ff871e3d, reason: Instance 5c3a4469-30fd-4f27-a3b7-957422dd2746 could not be found. {{(pid=72129) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 14:19:55 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e709bfc6-c470-4c3e-b8ce-e0a2f502b3d7 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:19:55 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e709bfc6-c470-4c3e-b8ce-e0a2f502b3d7 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:19:55 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-e709bfc6-c470-4c3e-b8ce-e0a2f502b3d7 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:19:55 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-e709bfc6-c470-4c3e-b8ce-e0a2f502b3d7 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:19:55 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e709bfc6-c470-4c3e-b8ce-e0a2f502b3d7 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.150s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:19:55 user nova-compute[72129]: INFO nova.scheduler.client.report [None req-e709bfc6-c470-4c3e-b8ce-e0a2f502b3d7 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Deleted allocations for instance 5c3a4469-30fd-4f27-a3b7-957422dd2746
Aug 01 14:19:55 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e709bfc6-c470-4c3e-b8ce-e0a2f502b3d7 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "5c3a4469-30fd-4f27-a3b7-957422dd2746" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.013s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:19:56 user nova-compute[72129]: DEBUG nova.compute.manager [req-a402fb62-49d3-4964-bb58-cc8eaab55042 req-4c35237a-d936-4f6c-b1b2-e2ce234f227d service nova] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Received event network-vif-plugged-7f4ef5f0-b138-43aa-ad82-ced2ff871e3d {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:19:56 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-a402fb62-49d3-4964-bb58-cc8eaab55042 req-4c35237a-d936-4f6c-b1b2-e2ce234f227d service nova] Acquiring lock "5c3a4469-30fd-4f27-a3b7-957422dd2746-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:19:56 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-a402fb62-49d3-4964-bb58-cc8eaab55042 req-4c35237a-d936-4f6c-b1b2-e2ce234f227d service nova] Lock "5c3a4469-30fd-4f27-a3b7-957422dd2746-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:19:56 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-a402fb62-49d3-4964-bb58-cc8eaab55042 req-4c35237a-d936-4f6c-b1b2-e2ce234f227d service nova] Lock "5c3a4469-30fd-4f27-a3b7-957422dd2746-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:19:56 user nova-compute[72129]: DEBUG nova.compute.manager [req-a402fb62-49d3-4964-bb58-cc8eaab55042 req-4c35237a-d936-4f6c-b1b2-e2ce234f227d service nova] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] No waiting events found dispatching network-vif-plugged-7f4ef5f0-b138-43aa-ad82-ced2ff871e3d {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:19:56 user nova-compute[72129]: WARNING nova.compute.manager [req-a402fb62-49d3-4964-bb58-cc8eaab55042 req-4c35237a-d936-4f6c-b1b2-e2ce234f227d service nova] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Received unexpected event network-vif-plugged-7f4ef5f0-b138-43aa-ad82-ced2ff871e3d for instance with vm_state deleted and task_state None.
Aug 01 14:19:56 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:19:59 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:19:59 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72129) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 14:19:59 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:20:01 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:20:02 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:20:02 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:20:02 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:20:02 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:20:02 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Auditing locally available compute resources for user (node: user) {{(pid=72129) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 14:20:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk.rescue --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:20:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:20:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk.rescue --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:20:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:20:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:20:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:20:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:20:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:20:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk.rescue --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:20:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:20:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk.rescue --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:20:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:20:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:20:03 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:20:03 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:20:03 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:20:03 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:20:03 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:20:03 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Hypervisor/Node resource view: name=user free_ram=8656MB free_disk=25.17766571044922GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72129) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 14:20:03 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:20:03 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:20:03 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance b3f54430-8d5d-478b-8dc7-d7592ee3db36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:20:03 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:20:03 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 14:20:03 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 14:20:03 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:20:03 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:20:03 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Compute_service record updated for user:user {{(pid=72129) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 14:20:03 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.239s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:20:04 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:20:04 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:20:04 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Starting heal instance info cache {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 14:20:04 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Didn't find any instances for network info cache update. {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 14:20:04 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:20:04 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:20:06 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:20:06 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:20:07 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:20:08 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:20:08 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:20:09 user nova-compute[72129]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690899594.6943676, 5c3a4469-30fd-4f27-a3b7-957422dd2746 => Stopped> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:20:09 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] VM Stopped (Lifecycle Event)
Aug 01 14:20:09 user nova-compute[72129]: DEBUG nova.compute.manager [None req-e71fe6fe-5769-4596-9309-98b04ddf6fd5 None None] [instance: 5c3a4469-30fd-4f27-a3b7-957422dd2746] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:20:09 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:20:09 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:20:09 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72129) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 14:20:09 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:20:09 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:20:09 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:20:14 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:20:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:20:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:20:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72129) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 14:20:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:20:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:20:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:20:24 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:20:29 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:20:34 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:20:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:20:42 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:20:44 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:20:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Acquiring lock "9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:20:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Lock "9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:20:45 user nova-compute[72129]: DEBUG nova.compute.manager [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Starting instance... {{(pid=72129) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 14:20:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:20:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:20:45 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72129) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 14:20:45 user nova-compute[72129]: INFO nova.compute.claims [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Claim successful on node user
Aug 01 14:20:45 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:20:45 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:20:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.228s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:20:45 user nova-compute[72129]: DEBUG nova.compute.manager [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Start building networks asynchronously for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 14:20:45 user nova-compute[72129]: DEBUG nova.compute.manager [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Allocating IP information in the background. {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 14:20:45 user nova-compute[72129]: DEBUG nova.network.neutron [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] allocate_for_instance() {{(pid=72129) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 14:20:45 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 14:20:45 user nova-compute[72129]: DEBUG nova.compute.manager [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Start building block device mappings for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 14:20:45 user nova-compute[72129]: DEBUG nova.compute.manager [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Start spawning the instance on the hypervisor. {{(pid=72129) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 14:20:45 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Creating instance directory {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 14:20:45 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Creating image(s)
Aug 01 14:20:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Acquiring lock "/opt/stack/data/nova/instances/9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:20:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Lock "/opt/stack/data/nova/instances/9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:20:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Lock "/opt/stack/data/nova/instances/9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:20:45 user nova-compute[72129]: DEBUG nova.policy [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cab6f7398341468dbd829d828b3a7b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd203d0ad6e3c4379ae26ad8fb44f877d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72129) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 14:20:45 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:20:45 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.138s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:20:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Acquiring lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:20:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:20:45 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:20:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.152s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:20:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60/disk 1073741824 {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:20:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60/disk 1073741824" returned: 0 in 0.066s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:20:46 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:20:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:20:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.139s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:20:46 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60/disk. size=1073741824 {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 14:20:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:20:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:20:46 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Cannot resize image /opt/stack/data/nova/instances/9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60/disk to a smaller size. {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 14:20:46 user nova-compute[72129]: DEBUG nova.objects.instance [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Lazy-loading 'migration_context' on Instance uuid 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:20:46 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Created local disks {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 14:20:46 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Ensure instance console log exists: /opt/stack/data/nova/instances/9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60/console.log {{(pid=72129) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 14:20:46 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:20:46 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:20:46 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:20:46 user nova-compute[72129]: DEBUG nova.network.neutron [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Successfully created port: d9687bd9-62f9-4b39-8c41-7b3c32127a71 {{(pid=72129) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 14:20:47 user nova-compute[72129]: DEBUG nova.network.neutron [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Successfully updated port: d9687bd9-62f9-4b39-8c41-7b3c32127a71 {{(pid=72129) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 14:20:47 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Acquiring lock "refresh_cache-9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:20:47 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Acquired lock "refresh_cache-9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:20:47 user nova-compute[72129]: DEBUG nova.network.neutron [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 14:20:47 user nova-compute[72129]: DEBUG nova.compute.manager [req-ff2c2fb6-313e-48dc-89e1-2bc8796bfaa2 req-3dc6d23a-05cf-406a-80fd-8e44f9ecb869 service nova] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Received event network-changed-d9687bd9-62f9-4b39-8c41-7b3c32127a71 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:20:47 user nova-compute[72129]: DEBUG nova.compute.manager [req-ff2c2fb6-313e-48dc-89e1-2bc8796bfaa2 req-3dc6d23a-05cf-406a-80fd-8e44f9ecb869 service nova] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Refreshing instance network info cache due to event network-changed-d9687bd9-62f9-4b39-8c41-7b3c32127a71. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 14:20:47 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ff2c2fb6-313e-48dc-89e1-2bc8796bfaa2 req-3dc6d23a-05cf-406a-80fd-8e44f9ecb869 service nova] Acquiring lock "refresh_cache-9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:20:47 user nova-compute[72129]: DEBUG nova.network.neutron [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Instance cache missing network info. {{(pid=72129) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 14:20:47 user nova-compute[72129]: DEBUG nova.network.neutron [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Updating instance_info_cache with network_info: [{"id": "d9687bd9-62f9-4b39-8c41-7b3c32127a71", "address": "fa:16:3e:b8:e3:cc", "network": {"id": "814dffe9-8861-4a81-bf68-d86f2a4b4faf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1760326136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d203d0ad6e3c4379ae26ad8fb44f877d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9687bd9-62", "ovs_interfaceid": "d9687bd9-62f9-4b39-8c41-7b3c32127a71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:20:47 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Releasing lock "refresh_cache-9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:20:47 user nova-compute[72129]: DEBUG nova.compute.manager [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Instance network_info: |[{"id": "d9687bd9-62f9-4b39-8c41-7b3c32127a71", "address": "fa:16:3e:b8:e3:cc", "network": {"id": "814dffe9-8861-4a81-bf68-d86f2a4b4faf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1760326136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d203d0ad6e3c4379ae26ad8fb44f877d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9687bd9-62", "ovs_interfaceid": "d9687bd9-62f9-4b39-8c41-7b3c32127a71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 14:20:47 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ff2c2fb6-313e-48dc-89e1-2bc8796bfaa2 req-3dc6d23a-05cf-406a-80fd-8e44f9ecb869 service nova] Acquired lock "refresh_cache-9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:20:47 user nova-compute[72129]: DEBUG nova.network.neutron [req-ff2c2fb6-313e-48dc-89e1-2bc8796bfaa2 req-3dc6d23a-05cf-406a-80fd-8e44f9ecb869 service nova] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Refreshing network info cache for port d9687bd9-62f9-4b39-8c41-7b3c32127a71 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 14:20:47 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Start _get_guest_xml network_info=[{"id": "d9687bd9-62f9-4b39-8c41-7b3c32127a71", "address": "fa:16:3e:b8:e3:cc", "network": {"id": "814dffe9-8861-4a81-bf68-d86f2a4b4faf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1760326136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d203d0ad6e3c4379ae26ad8fb44f877d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9687bd9-62", "ovs_interfaceid": "d9687bd9-62f9-4b39-8c41-7b3c32127a71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'image_id': 'b6472c34-1b0f-4034-ba3a-7e8eb5103715'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 14:20:47 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:20:47 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:20:47 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 14:20:47 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] CPU controller missing on host. {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 14:20:47 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 14:20:47 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] CPU controller found on host. {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 14:20:47 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72129) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 14:20:47 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T13:45:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 14:20:47 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Flavor limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 14:20:47 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Image limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 14:20:47 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Flavor pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 14:20:47 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Image pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 14:20:47 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 14:20:47 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 14:20:47 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 14:20:47 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Got 1 possible topologies {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 14:20:47 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 14:20:47 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 14:20:47 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:20:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-470151363',display_name='tempest-VolumesSnapshotTestJSON-instance-470151363',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-470151363',id=45,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBONwHem2VDw1oPfsQ/OLZop1uHEnjY4m+Ep1+mdxDnhU2VVWfQLln5QRo62XXRLOo34qsN8NjQ9If7JfJeCvQ4NTu5+Z/id01C5rchoHiMWJq/GRZ7BqH1LSVS89PpZujA==',key_name='tempest-keypair-1765059854',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d203d0ad6e3c4379ae26ad8fb44f877d',ramdisk_id='',reservation_id='r-lc8j7srf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-171675326',owner_user_name='tempest-VolumesSnapshotTestJSON-171675326-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T14:20:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cab6f7398341468dbd829d828b3a7b8c',uuid=9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9687bd9-62f9-4b39-8c41-7b3c32127a71", "address": "fa:16:3e:b8:e3:cc", "network": {"id": "814dffe9-8861-4a81-bf68-d86f2a4b4faf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1760326136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d203d0ad6e3c4379ae26ad8fb44f877d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9687bd9-62", "ovs_interfaceid": "d9687bd9-62f9-4b39-8c41-7b3c32127a71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 14:20:47 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Converting VIF {"id": "d9687bd9-62f9-4b39-8c41-7b3c32127a71", "address": "fa:16:3e:b8:e3:cc", "network": {"id": "814dffe9-8861-4a81-bf68-d86f2a4b4faf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1760326136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d203d0ad6e3c4379ae26ad8fb44f877d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9687bd9-62", "ovs_interfaceid": "d9687bd9-62f9-4b39-8c41-7b3c32127a71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:20:47 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:e3:cc,bridge_name='br-int',has_traffic_filtering=True,id=d9687bd9-62f9-4b39-8c41-7b3c32127a71,network=Network(814dffe9-8861-4a81-bf68-d86f2a4b4faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9687bd9-62') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:20:47 user nova-compute[72129]: DEBUG nova.objects.instance [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Lazy-loading 'pci_devices' on Instance uuid 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:20:47 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] End _get_guest_xml xml=<domain type="kvm">
Aug 01 14:20:47 user nova-compute[72129]:   <uuid>9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60</uuid>
Aug 01 14:20:47 user nova-compute[72129]:   <name>instance-0000002d</name>
Aug 01 14:20:47 user nova-compute[72129]:   <memory>524288</memory>
Aug 01 14:20:47 user nova-compute[72129]:   <vcpu>1</vcpu>
Aug 01 14:20:47 user nova-compute[72129]:   <metadata>
Aug 01 14:20:47 user nova-compute[72129]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 14:20:47 user nova-compute[72129]:       <nova:package version="0.0.0"/>
Aug 01 14:20:47 user nova-compute[72129]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-470151363</nova:name>
Aug 01 14:20:47 user nova-compute[72129]:       <nova:creationTime>2023-08-01 14:20:47</nova:creationTime>
Aug 01 14:20:47 user nova-compute[72129]:       <nova:flavor name="m1.tiny">
Aug 01 14:20:47 user nova-compute[72129]:         <nova:memory>512</nova:memory>
Aug 01 14:20:47 user nova-compute[72129]:         <nova:disk>1</nova:disk>
Aug 01 14:20:47 user nova-compute[72129]:         <nova:swap>0</nova:swap>
Aug 01 14:20:47 user nova-compute[72129]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 14:20:47 user nova-compute[72129]:         <nova:vcpus>1</nova:vcpus>
Aug 01 14:20:47 user nova-compute[72129]:       </nova:flavor>
Aug 01 14:20:47 user nova-compute[72129]:       <nova:owner>
Aug 01 14:20:47 user nova-compute[72129]:         <nova:user uuid="cab6f7398341468dbd829d828b3a7b8c">tempest-VolumesSnapshotTestJSON-171675326-project-member</nova:user>
Aug 01 14:20:47 user nova-compute[72129]:         <nova:project uuid="d203d0ad6e3c4379ae26ad8fb44f877d">tempest-VolumesSnapshotTestJSON-171675326</nova:project>
Aug 01 14:20:47 user nova-compute[72129]:       </nova:owner>
Aug 01 14:20:47 user nova-compute[72129]:       <nova:root type="image" uuid="b6472c34-1b0f-4034-ba3a-7e8eb5103715"/>
Aug 01 14:20:47 user nova-compute[72129]:       <nova:ports>
Aug 01 14:20:47 user nova-compute[72129]:         <nova:port uuid="d9687bd9-62f9-4b39-8c41-7b3c32127a71">
Aug 01 14:20:47 user nova-compute[72129]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 01 14:20:47 user nova-compute[72129]:         </nova:port>
Aug 01 14:20:47 user nova-compute[72129]:       </nova:ports>
Aug 01 14:20:47 user nova-compute[72129]:     </nova:instance>
Aug 01 14:20:47 user nova-compute[72129]:   </metadata>
Aug 01 14:20:47 user nova-compute[72129]:   <sysinfo type="smbios">
Aug 01 14:20:47 user nova-compute[72129]:     <system>
Aug 01 14:20:47 user nova-compute[72129]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 14:20:47 user nova-compute[72129]:       <entry name="product">OpenStack Nova</entry>
Aug 01 14:20:47 user nova-compute[72129]:       <entry name="version">0.0.0</entry>
Aug 01 14:20:47 user nova-compute[72129]:       <entry name="serial">9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60</entry>
Aug 01 14:20:47 user nova-compute[72129]:       <entry name="uuid">9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60</entry>
Aug 01 14:20:47 user nova-compute[72129]:       <entry name="family">Virtual Machine</entry>
Aug 01 14:20:47 user nova-compute[72129]:     </system>
Aug 01 14:20:47 user nova-compute[72129]:   </sysinfo>
Aug 01 14:20:47 user nova-compute[72129]:   <os>
Aug 01 14:20:47 user nova-compute[72129]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 14:20:47 user nova-compute[72129]:     <boot dev="hd"/>
Aug 01 14:20:47 user nova-compute[72129]:     <smbios mode="sysinfo"/>
Aug 01 14:20:47 user nova-compute[72129]:   </os>
Aug 01 14:20:47 user nova-compute[72129]:   <features>
Aug 01 14:20:47 user nova-compute[72129]:     <acpi/>
Aug 01 14:20:47 user nova-compute[72129]:     <apic/>
Aug 01 14:20:47 user nova-compute[72129]:     <vmcoreinfo/>
Aug 01 14:20:47 user nova-compute[72129]:   </features>
Aug 01 14:20:47 user nova-compute[72129]:   <clock offset="utc">
Aug 01 14:20:47 user nova-compute[72129]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 14:20:47 user nova-compute[72129]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 14:20:47 user nova-compute[72129]:     <timer name="hpet" present="no"/>
Aug 01 14:20:47 user nova-compute[72129]:   </clock>
Aug 01 14:20:47 user nova-compute[72129]:   <cpu mode="custom" match="exact">
Aug 01 14:20:47 user nova-compute[72129]:     <model>Nehalem</model>
Aug 01 14:20:47 user nova-compute[72129]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 14:20:47 user nova-compute[72129]:   </cpu>
Aug 01 14:20:47 user nova-compute[72129]:   <devices>
Aug 01 14:20:47 user nova-compute[72129]:     <disk type="file" device="disk">
Aug 01 14:20:47 user nova-compute[72129]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 14:20:47 user nova-compute[72129]:       <source file="/opt/stack/data/nova/instances/9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60/disk"/>
Aug 01 14:20:47 user nova-compute[72129]:       <target dev="vda" bus="virtio"/>
Aug 01 14:20:47 user nova-compute[72129]:     </disk>
Aug 01 14:20:47 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 14:20:47 user nova-compute[72129]:       <mac address="fa:16:3e:b8:e3:cc"/>
Aug 01 14:20:47 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:20:47 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 14:20:47 user nova-compute[72129]:       <target dev="tapd9687bd9-62"/>
Aug 01 14:20:47 user nova-compute[72129]:     </interface>
Aug 01 14:20:47 user nova-compute[72129]:     <serial type="pty">
Aug 01 14:20:47 user nova-compute[72129]:       <log file="/opt/stack/data/nova/instances/9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60/console.log" append="off"/>
Aug 01 14:20:47 user nova-compute[72129]:     </serial>
Aug 01 14:20:47 user nova-compute[72129]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 14:20:47 user nova-compute[72129]:     <video>
Aug 01 14:20:47 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:20:47 user nova-compute[72129]:     </video>
Aug 01 14:20:47 user nova-compute[72129]:     <rng model="virtio">
Aug 01 14:20:47 user nova-compute[72129]:       <backend model="random">/dev/urandom</backend>
Aug 01 14:20:47 user nova-compute[72129]:     </rng>
Aug 01 14:20:47 user nova-compute[72129]:     <controller type="usb" index="0" model="none"/>
Aug 01 14:20:47 user nova-compute[72129]:     <memballoon model="virtio">
Aug 01 14:20:47 user nova-compute[72129]:       <stats period="10"/>
Aug 01 14:20:47 user nova-compute[72129]:     </memballoon>
Aug 01 14:20:47 user nova-compute[72129]:   </devices>
Aug 01 14:20:47 user nova-compute[72129]: </domain>
Aug 01 14:20:47 user nova-compute[72129]:  {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 14:20:47 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:20:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-470151363',display_name='tempest-VolumesSnapshotTestJSON-instance-470151363',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-470151363',id=45,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBONwHem2VDw1oPfsQ/OLZop1uHEnjY4m+Ep1+mdxDnhU2VVWfQLln5QRo62XXRLOo34qsN8NjQ9If7JfJeCvQ4NTu5+Z/id01C5rchoHiMWJq/GRZ7BqH1LSVS89PpZujA==',key_name='tempest-keypair-1765059854',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d203d0ad6e3c4379ae26ad8fb44f877d',ramdisk_id='',reservation_id='r-lc8j7srf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-171675326',owner_user_name='tempest-VolumesSnapshotTestJSON-171675326-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T14:20:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cab6f7398341468dbd829d828b3a7b8c',uuid=9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9687bd9-62f9-4b39-8c41-7b3c32127a71", "address": "fa:16:3e:b8:e3:cc", "network": {"id": "814dffe9-8861-4a81-bf68-d86f2a4b4faf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1760326136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d203d0ad6e3c4379ae26ad8fb44f877d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9687bd9-62", "ovs_interfaceid": "d9687bd9-62f9-4b39-8c41-7b3c32127a71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 14:20:47 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Converting VIF {"id": "d9687bd9-62f9-4b39-8c41-7b3c32127a71", "address": "fa:16:3e:b8:e3:cc", "network": {"id": "814dffe9-8861-4a81-bf68-d86f2a4b4faf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1760326136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d203d0ad6e3c4379ae26ad8fb44f877d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9687bd9-62", "ovs_interfaceid": "d9687bd9-62f9-4b39-8c41-7b3c32127a71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:20:47 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:e3:cc,bridge_name='br-int',has_traffic_filtering=True,id=d9687bd9-62f9-4b39-8c41-7b3c32127a71,network=Network(814dffe9-8861-4a81-bf68-d86f2a4b4faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9687bd9-62') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:20:47 user nova-compute[72129]: DEBUG os_vif [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:e3:cc,bridge_name='br-int',has_traffic_filtering=True,id=d9687bd9-62f9-4b39-8c41-7b3c32127a71,network=Network(814dffe9-8861-4a81-bf68-d86f2a4b4faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9687bd9-62') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 14:20:47 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:20:47 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:20:47 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 14:20:47 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:20:47 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd9687bd9-62, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:20:47 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd9687bd9-62, col_values=(('external_ids', {'iface-id': 'd9687bd9-62f9-4b39-8c41-7b3c32127a71', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:e3:cc', 'vm-uuid': '9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:20:47 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:20:47 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:20:47 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:20:47 user nova-compute[72129]: INFO os_vif [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:e3:cc,bridge_name='br-int',has_traffic_filtering=True,id=d9687bd9-62f9-4b39-8c41-7b3c32127a71,network=Network(814dffe9-8861-4a81-bf68-d86f2a4b4faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9687bd9-62')
Aug 01 14:20:47 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:20:47 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] No VIF found with MAC fa:16:3e:b8:e3:cc, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 14:20:48 user nova-compute[72129]: DEBUG nova.network.neutron [req-ff2c2fb6-313e-48dc-89e1-2bc8796bfaa2 req-3dc6d23a-05cf-406a-80fd-8e44f9ecb869 service nova] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Updated VIF entry in instance network info cache for port d9687bd9-62f9-4b39-8c41-7b3c32127a71. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 14:20:48 user nova-compute[72129]: DEBUG nova.network.neutron [req-ff2c2fb6-313e-48dc-89e1-2bc8796bfaa2 req-3dc6d23a-05cf-406a-80fd-8e44f9ecb869 service nova] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Updating instance_info_cache with network_info: [{"id": "d9687bd9-62f9-4b39-8c41-7b3c32127a71", "address": "fa:16:3e:b8:e3:cc", "network": {"id": "814dffe9-8861-4a81-bf68-d86f2a4b4faf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1760326136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d203d0ad6e3c4379ae26ad8fb44f877d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9687bd9-62", "ovs_interfaceid": "d9687bd9-62f9-4b39-8c41-7b3c32127a71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:20:48 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Acquiring lock "6281d027-b30b-413d-b86e-e612a5a6d14d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:20:48 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "6281d027-b30b-413d-b86e-e612a5a6d14d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:20:48 user nova-compute[72129]: DEBUG nova.compute.manager [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] Starting instance... {{(pid=72129) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 14:20:48 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ff2c2fb6-313e-48dc-89e1-2bc8796bfaa2 req-3dc6d23a-05cf-406a-80fd-8e44f9ecb869 service nova] Releasing lock "refresh_cache-9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:20:48 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:20:48 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:20:48 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72129) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 14:20:48 user nova-compute[72129]: INFO nova.compute.claims [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] Claim successful on node user
Aug 01 14:20:48 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:20:48 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:20:48 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.270s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:20:48 user nova-compute[72129]: DEBUG nova.compute.manager [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] Start building networks asynchronously for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 14:20:48 user nova-compute[72129]: DEBUG nova.compute.manager [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] Allocating IP information in the background. {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 14:20:48 user nova-compute[72129]: DEBUG nova.network.neutron [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] allocate_for_instance() {{(pid=72129) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 14:20:48 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 14:20:48 user nova-compute[72129]: DEBUG nova.compute.manager [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] Start building block device mappings for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 14:20:48 user nova-compute[72129]: DEBUG nova.policy [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '85308332b4084e9f8c1bf605f540434b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d5ede0f2e44eaab914ffc17aef8aa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72129) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 14:20:48 user nova-compute[72129]: DEBUG nova.compute.manager [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] Start spawning the instance on the hypervisor. {{(pid=72129) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 14:20:48 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] Creating instance directory {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 14:20:48 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] Creating image(s)
Aug 01 14:20:48 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Acquiring lock "/opt/stack/data/nova/instances/6281d027-b30b-413d-b86e-e612a5a6d14d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:20:48 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "/opt/stack/data/nova/instances/6281d027-b30b-413d-b86e-e612a5a6d14d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:20:48 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "/opt/stack/data/nova/instances/6281d027-b30b-413d-b86e-e612a5a6d14d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:20:48 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:20:49 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.130s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:20:49 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Acquiring lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:20:49 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:20:49 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:20:49 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.139s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:20:49 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/6281d027-b30b-413d-b86e-e612a5a6d14d/disk 1073741824 {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:20:49 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/6281d027-b30b-413d-b86e-e612a5a6d14d/disk 1073741824" returned: 0 in 0.055s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:20:49 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.201s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:20:49 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:20:49 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:20:49 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.307s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:20:49 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6281d027-b30b-413d-b86e-e612a5a6d14d/disk. size=1073741824 {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 14:20:49 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6281d027-b30b-413d-b86e-e612a5a6d14d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:20:49 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6281d027-b30b-413d-b86e-e612a5a6d14d/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:20:49 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Cannot resize image /opt/stack/data/nova/instances/6281d027-b30b-413d-b86e-e612a5a6d14d/disk to a smaller size. {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 14:20:49 user nova-compute[72129]: DEBUG nova.objects.instance [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lazy-loading 'migration_context' on Instance uuid 6281d027-b30b-413d-b86e-e612a5a6d14d {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:20:49 user nova-compute[72129]: DEBUG nova.compute.manager [req-c710d563-4dc1-4a39-803b-b30d55243fa9 req-6e9c96b7-60bc-49a8-baf1-1c745a954645 service nova] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Received event network-vif-plugged-d9687bd9-62f9-4b39-8c41-7b3c32127a71 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:20:49 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-c710d563-4dc1-4a39-803b-b30d55243fa9 req-6e9c96b7-60bc-49a8-baf1-1c745a954645 service nova] Acquiring lock "9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:20:49 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-c710d563-4dc1-4a39-803b-b30d55243fa9 req-6e9c96b7-60bc-49a8-baf1-1c745a954645 service nova] Lock "9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:20:49 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-c710d563-4dc1-4a39-803b-b30d55243fa9 req-6e9c96b7-60bc-49a8-baf1-1c745a954645 service nova] Lock "9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:20:49 user nova-compute[72129]: DEBUG nova.compute.manager [req-c710d563-4dc1-4a39-803b-b30d55243fa9 req-6e9c96b7-60bc-49a8-baf1-1c745a954645 service nova] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] No waiting events found dispatching network-vif-plugged-d9687bd9-62f9-4b39-8c41-7b3c32127a71 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:20:49 user nova-compute[72129]: WARNING nova.compute.manager [req-c710d563-4dc1-4a39-803b-b30d55243fa9 req-6e9c96b7-60bc-49a8-baf1-1c745a954645 service nova] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Received unexpected event network-vif-plugged-d9687bd9-62f9-4b39-8c41-7b3c32127a71 for instance with vm_state building and task_state spawning.
Aug 01 14:20:49 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] Created local disks {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 14:20:49 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] Ensure instance console log exists: /opt/stack/data/nova/instances/6281d027-b30b-413d-b86e-e612a5a6d14d/console.log {{(pid=72129) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 14:20:49 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:20:49 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:20:49 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:20:49 user nova-compute[72129]: DEBUG nova.network.neutron [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] Successfully created port: c3e9c75c-81cc-48d6-a458-c4ddafed5b44 {{(pid=72129) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 14:20:50 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:20:50 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:20:50 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:20:50 user nova-compute[72129]: DEBUG nova.network.neutron [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] Successfully updated port: c3e9c75c-81cc-48d6-a458-c4ddafed5b44 {{(pid=72129) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 14:20:50 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Acquiring lock "refresh_cache-6281d027-b30b-413d-b86e-e612a5a6d14d" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:20:50 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Acquired lock "refresh_cache-6281d027-b30b-413d-b86e-e612a5a6d14d" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:20:50 user nova-compute[72129]: DEBUG nova.network.neutron [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 14:20:50 user nova-compute[72129]: DEBUG nova.compute.manager [req-4a7670d7-8b83-43aa-84c2-1681a0dfbceb req-32d122c9-49fd-4d7f-bf21-4b83005e9b4f service nova] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] Received event network-changed-c3e9c75c-81cc-48d6-a458-c4ddafed5b44 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:20:50 user nova-compute[72129]: DEBUG nova.compute.manager [req-4a7670d7-8b83-43aa-84c2-1681a0dfbceb req-32d122c9-49fd-4d7f-bf21-4b83005e9b4f service nova] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] Refreshing instance network info cache due to event network-changed-c3e9c75c-81cc-48d6-a458-c4ddafed5b44. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 14:20:50 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-4a7670d7-8b83-43aa-84c2-1681a0dfbceb req-32d122c9-49fd-4d7f-bf21-4b83005e9b4f service nova] Acquiring lock "refresh_cache-6281d027-b30b-413d-b86e-e612a5a6d14d" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:20:50 user nova-compute[72129]: DEBUG nova.network.neutron [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] Instance cache missing network info. {{(pid=72129) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 14:20:50 user nova-compute[72129]: DEBUG nova.network.neutron [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] Updating instance_info_cache with network_info: [{"id": "c3e9c75c-81cc-48d6-a458-c4ddafed5b44", "address": "fa:16:3e:29:20:d9", "network": {"id": "9d4effd9-bf5c-41a7-a8e2-18d2177ace34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333645199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5d5ede0f2e44eaab914ffc17aef8aa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3e9c75c-81", "ovs_interfaceid": "c3e9c75c-81cc-48d6-a458-c4ddafed5b44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:20:50 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Releasing lock "refresh_cache-6281d027-b30b-413d-b86e-e612a5a6d14d" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:20:50 user nova-compute[72129]: DEBUG nova.compute.manager [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] Instance network_info: |[{"id": "c3e9c75c-81cc-48d6-a458-c4ddafed5b44", "address": "fa:16:3e:29:20:d9", "network": {"id": "9d4effd9-bf5c-41a7-a8e2-18d2177ace34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333645199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5d5ede0f2e44eaab914ffc17aef8aa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3e9c75c-81", "ovs_interfaceid": "c3e9c75c-81cc-48d6-a458-c4ddafed5b44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 14:20:50 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-4a7670d7-8b83-43aa-84c2-1681a0dfbceb req-32d122c9-49fd-4d7f-bf21-4b83005e9b4f service nova] Acquired lock "refresh_cache-6281d027-b30b-413d-b86e-e612a5a6d14d" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:20:50 user nova-compute[72129]: DEBUG nova.network.neutron [req-4a7670d7-8b83-43aa-84c2-1681a0dfbceb req-32d122c9-49fd-4d7f-bf21-4b83005e9b4f service nova] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] Refreshing network info cache for port c3e9c75c-81cc-48d6-a458-c4ddafed5b44 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 14:20:50 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] Start _get_guest_xml network_info=[{"id": "c3e9c75c-81cc-48d6-a458-c4ddafed5b44", "address": "fa:16:3e:29:20:d9", "network": {"id": "9d4effd9-bf5c-41a7-a8e2-18d2177ace34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333645199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5d5ede0f2e44eaab914ffc17aef8aa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3e9c75c-81", "ovs_interfaceid": "c3e9c75c-81cc-48d6-a458-c4ddafed5b44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'image_id': 'b6472c34-1b0f-4034-ba3a-7e8eb5103715'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 14:20:50 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:20:50 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:20:50 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 14:20:50 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] CPU controller missing on host. {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 14:20:50 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 14:20:50 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] CPU controller found on host. {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 14:20:50 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72129) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 14:20:50 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T13:45:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 14:20:50 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Flavor limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 14:20:50 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Image limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 14:20:50 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Flavor pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 14:20:50 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Image pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 14:20:50 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 14:20:50 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 14:20:50 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 14:20:50 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Got 1 possible topologies {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 14:20:50 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 14:20:50 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 14:20:51 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:20:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1838299992',display_name='tempest-AttachVolumeNegativeTest-server-1838299992',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1838299992',id=46,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMXolHl8tvvtIUXp++ydfavqWagu49d2LHeyeDiuP15l2wvYJCJ4lHrrR4rdyf9EM18Iei1S6faZemt87uIXyGNYlBVdCJdX6WsMqmP93pf/CKCiM0z6ZZV3Wdsdj+HYZw==',key_name='tempest-keypair-1270898053',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f5d5ede0f2e44eaab914ffc17aef8aa8',ramdisk_id='',reservation_id='r-bqvd4sga',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2079788087',owner_user_name='tempest-AttachVolumeNegativeTest-2079788087-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T14:20:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85308332b4084e9f8c1bf605f540434b',uuid=6281d027-b30b-413d-b86e-e612a5a6d14d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3e9c75c-81cc-48d6-a458-c4ddafed5b44", "address": "fa:16:3e:29:20:d9", "network": {"id": "9d4effd9-bf5c-41a7-a8e2-18d2177ace34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333645199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5d5ede0f2e44eaab914ffc17aef8aa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3e9c75c-81", "ovs_interfaceid": "c3e9c75c-81cc-48d6-a458-c4ddafed5b44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 14:20:51 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Converting VIF {"id": "c3e9c75c-81cc-48d6-a458-c4ddafed5b44", "address": "fa:16:3e:29:20:d9", "network": {"id": "9d4effd9-bf5c-41a7-a8e2-18d2177ace34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333645199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5d5ede0f2e44eaab914ffc17aef8aa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3e9c75c-81", "ovs_interfaceid": "c3e9c75c-81cc-48d6-a458-c4ddafed5b44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:20:51 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:20:d9,bridge_name='br-int',has_traffic_filtering=True,id=c3e9c75c-81cc-48d6-a458-c4ddafed5b44,network=Network(9d4effd9-bf5c-41a7-a8e2-18d2177ace34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3e9c75c-81') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:20:51 user nova-compute[72129]: DEBUG nova.objects.instance [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lazy-loading 'pci_devices' on Instance uuid 6281d027-b30b-413d-b86e-e612a5a6d14d {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:20:51 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] End _get_guest_xml xml=<domain type="kvm">
Aug 01 14:20:51 user nova-compute[72129]:   <uuid>6281d027-b30b-413d-b86e-e612a5a6d14d</uuid>
Aug 01 14:20:51 user nova-compute[72129]:   <name>instance-0000002e</name>
Aug 01 14:20:51 user nova-compute[72129]:   <memory>524288</memory>
Aug 01 14:20:51 user nova-compute[72129]:   <vcpu>1</vcpu>
Aug 01 14:20:51 user nova-compute[72129]:   <metadata>
Aug 01 14:20:51 user nova-compute[72129]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 14:20:51 user nova-compute[72129]:       <nova:package version="0.0.0"/>
Aug 01 14:20:51 user nova-compute[72129]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1838299992</nova:name>
Aug 01 14:20:51 user nova-compute[72129]:       <nova:creationTime>2023-08-01 14:20:50</nova:creationTime>
Aug 01 14:20:51 user nova-compute[72129]:       <nova:flavor name="m1.tiny">
Aug 01 14:20:51 user nova-compute[72129]:         <nova:memory>512</nova:memory>
Aug 01 14:20:51 user nova-compute[72129]:         <nova:disk>1</nova:disk>
Aug 01 14:20:51 user nova-compute[72129]:         <nova:swap>0</nova:swap>
Aug 01 14:20:51 user nova-compute[72129]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 14:20:51 user nova-compute[72129]:         <nova:vcpus>1</nova:vcpus>
Aug 01 14:20:51 user nova-compute[72129]:       </nova:flavor>
Aug 01 14:20:51 user nova-compute[72129]:       <nova:owner>
Aug 01 14:20:51 user nova-compute[72129]:         <nova:user uuid="85308332b4084e9f8c1bf605f540434b">tempest-AttachVolumeNegativeTest-2079788087-project-member</nova:user>
Aug 01 14:20:51 user nova-compute[72129]:         <nova:project uuid="f5d5ede0f2e44eaab914ffc17aef8aa8">tempest-AttachVolumeNegativeTest-2079788087</nova:project>
Aug 01 14:20:51 user nova-compute[72129]:       </nova:owner>
Aug 01 14:20:51 user nova-compute[72129]:       <nova:root type="image" uuid="b6472c34-1b0f-4034-ba3a-7e8eb5103715"/>
Aug 01 14:20:51 user nova-compute[72129]:       <nova:ports>
Aug 01 14:20:51 user nova-compute[72129]:         <nova:port uuid="c3e9c75c-81cc-48d6-a458-c4ddafed5b44">
Aug 01 14:20:51 user nova-compute[72129]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 01 14:20:51 user nova-compute[72129]:         </nova:port>
Aug 01 14:20:51 user nova-compute[72129]:       </nova:ports>
Aug 01 14:20:51 user nova-compute[72129]:     </nova:instance>
Aug 01 14:20:51 user nova-compute[72129]:   </metadata>
Aug 01 14:20:51 user nova-compute[72129]:   <sysinfo type="smbios">
Aug 01 14:20:51 user nova-compute[72129]:     <system>
Aug 01 14:20:51 user nova-compute[72129]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 14:20:51 user nova-compute[72129]:       <entry name="product">OpenStack Nova</entry>
Aug 01 14:20:51 user nova-compute[72129]:       <entry name="version">0.0.0</entry>
Aug 01 14:20:51 user nova-compute[72129]:       <entry name="serial">6281d027-b30b-413d-b86e-e612a5a6d14d</entry>
Aug 01 14:20:51 user nova-compute[72129]:       <entry name="uuid">6281d027-b30b-413d-b86e-e612a5a6d14d</entry>
Aug 01 14:20:51 user nova-compute[72129]:       <entry name="family">Virtual Machine</entry>
Aug 01 14:20:51 user nova-compute[72129]:     </system>
Aug 01 14:20:51 user nova-compute[72129]:   </sysinfo>
Aug 01 14:20:51 user nova-compute[72129]:   <os>
Aug 01 14:20:51 user nova-compute[72129]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 14:20:51 user nova-compute[72129]:     <boot dev="hd"/>
Aug 01 14:20:51 user nova-compute[72129]:     <smbios mode="sysinfo"/>
Aug 01 14:20:51 user nova-compute[72129]:   </os>
Aug 01 14:20:51 user nova-compute[72129]:   <features>
Aug 01 14:20:51 user nova-compute[72129]:     <acpi/>
Aug 01 14:20:51 user nova-compute[72129]:     <apic/>
Aug 01 14:20:51 user nova-compute[72129]:     <vmcoreinfo/>
Aug 01 14:20:51 user nova-compute[72129]:   </features>
Aug 01 14:20:51 user nova-compute[72129]:   <clock offset="utc">
Aug 01 14:20:51 user nova-compute[72129]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 14:20:51 user nova-compute[72129]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 14:20:51 user nova-compute[72129]:     <timer name="hpet" present="no"/>
Aug 01 14:20:51 user nova-compute[72129]:   </clock>
Aug 01 14:20:51 user nova-compute[72129]:   <cpu mode="custom" match="exact">
Aug 01 14:20:51 user nova-compute[72129]:     <model>Nehalem</model>
Aug 01 14:20:51 user nova-compute[72129]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 14:20:51 user nova-compute[72129]:   </cpu>
Aug 01 14:20:51 user nova-compute[72129]:   <devices>
Aug 01 14:20:51 user nova-compute[72129]:     <disk type="file" device="disk">
Aug 01 14:20:51 user nova-compute[72129]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 14:20:51 user nova-compute[72129]:       <source file="/opt/stack/data/nova/instances/6281d027-b30b-413d-b86e-e612a5a6d14d/disk"/>
Aug 01 14:20:51 user nova-compute[72129]:       <target dev="vda" bus="virtio"/>
Aug 01 14:20:51 user nova-compute[72129]:     </disk>
Aug 01 14:20:51 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 14:20:51 user nova-compute[72129]:       <mac address="fa:16:3e:29:20:d9"/>
Aug 01 14:20:51 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:20:51 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 14:20:51 user nova-compute[72129]:       <target dev="tapc3e9c75c-81"/>
Aug 01 14:20:51 user nova-compute[72129]:     </interface>
Aug 01 14:20:51 user nova-compute[72129]:     <serial type="pty">
Aug 01 14:20:51 user nova-compute[72129]:       <log file="/opt/stack/data/nova/instances/6281d027-b30b-413d-b86e-e612a5a6d14d/console.log" append="off"/>
Aug 01 14:20:51 user nova-compute[72129]:     </serial>
Aug 01 14:20:51 user nova-compute[72129]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 14:20:51 user nova-compute[72129]:     <video>
Aug 01 14:20:51 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:20:51 user nova-compute[72129]:     </video>
Aug 01 14:20:51 user nova-compute[72129]:     <rng model="virtio">
Aug 01 14:20:51 user nova-compute[72129]:       <backend model="random">/dev/urandom</backend>
Aug 01 14:20:51 user nova-compute[72129]:     </rng>
Aug 01 14:20:51 user nova-compute[72129]:     <controller type="usb" index="0" model="none"/>
Aug 01 14:20:51 user nova-compute[72129]:     <memballoon model="virtio">
Aug 01 14:20:51 user nova-compute[72129]:       <stats period="10"/>
Aug 01 14:20:51 user nova-compute[72129]:     </memballoon>
Aug 01 14:20:51 user nova-compute[72129]:   </devices>
Aug 01 14:20:51 user nova-compute[72129]: </domain>
Aug 01 14:20:51 user nova-compute[72129]:  {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 14:20:51 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:20:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1838299992',display_name='tempest-AttachVolumeNegativeTest-server-1838299992',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1838299992',id=46,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMXolHl8tvvtIUXp++ydfavqWagu49d2LHeyeDiuP15l2wvYJCJ4lHrrR4rdyf9EM18Iei1S6faZemt87uIXyGNYlBVdCJdX6WsMqmP93pf/CKCiM0z6ZZV3Wdsdj+HYZw==',key_name='tempest-keypair-1270898053',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f5d5ede0f2e44eaab914ffc17aef8aa8',ramdisk_id='',reservation_id='r-bqvd4sga',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2079788087',owner_user_name='tempest-AttachVolumeNegativeTest-2079788087-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T14:20:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85308332b4084e9f8c1bf605f540434b',uuid=6281d027-b30b-413d-b86e-e612a5a6d14d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3e9c75c-81cc-48d6-a458-c4ddafed5b44", "address": "fa:16:3e:29:20:d9", "network": {"id": "9d4effd9-bf5c-41a7-a8e2-18d2177ace34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333645199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5d5ede0f2e44eaab914ffc17aef8aa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3e9c75c-81", "ovs_interfaceid": "c3e9c75c-81cc-48d6-a458-c4ddafed5b44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 14:20:51 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Converting VIF {"id": "c3e9c75c-81cc-48d6-a458-c4ddafed5b44", "address": "fa:16:3e:29:20:d9", "network": {"id": "9d4effd9-bf5c-41a7-a8e2-18d2177ace34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333645199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5d5ede0f2e44eaab914ffc17aef8aa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3e9c75c-81", "ovs_interfaceid": "c3e9c75c-81cc-48d6-a458-c4ddafed5b44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:20:51 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:20:d9,bridge_name='br-int',has_traffic_filtering=True,id=c3e9c75c-81cc-48d6-a458-c4ddafed5b44,network=Network(9d4effd9-bf5c-41a7-a8e2-18d2177ace34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3e9c75c-81') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:20:51 user nova-compute[72129]: DEBUG os_vif [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:20:d9,bridge_name='br-int',has_traffic_filtering=True,id=c3e9c75c-81cc-48d6-a458-c4ddafed5b44,network=Network(9d4effd9-bf5c-41a7-a8e2-18d2177ace34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3e9c75c-81') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 14:20:51 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:20:51 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:20:51 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 14:20:51 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:20:51 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc3e9c75c-81, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:20:51 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc3e9c75c-81, col_values=(('external_ids', {'iface-id': 'c3e9c75c-81cc-48d6-a458-c4ddafed5b44', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:20:d9', 'vm-uuid': '6281d027-b30b-413d-b86e-e612a5a6d14d'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:20:51 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:20:51 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:20:51 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:20:51 user nova-compute[72129]: INFO os_vif [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:20:d9,bridge_name='br-int',has_traffic_filtering=True,id=c3e9c75c-81cc-48d6-a458-c4ddafed5b44,network=Network(9d4effd9-bf5c-41a7-a8e2-18d2177ace34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3e9c75c-81')
Aug 01 14:20:51 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:20:51 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] No VIF found with MAC fa:16:3e:29:20:d9, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 14:20:51 user nova-compute[72129]: DEBUG nova.network.neutron [req-4a7670d7-8b83-43aa-84c2-1681a0dfbceb req-32d122c9-49fd-4d7f-bf21-4b83005e9b4f service nova] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] Updated VIF entry in instance network info cache for port c3e9c75c-81cc-48d6-a458-c4ddafed5b44. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 14:20:51 user nova-compute[72129]: DEBUG nova.network.neutron [req-4a7670d7-8b83-43aa-84c2-1681a0dfbceb req-32d122c9-49fd-4d7f-bf21-4b83005e9b4f service nova] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] Updating instance_info_cache with network_info: [{"id": "c3e9c75c-81cc-48d6-a458-c4ddafed5b44", "address": "fa:16:3e:29:20:d9", "network": {"id": "9d4effd9-bf5c-41a7-a8e2-18d2177ace34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333645199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5d5ede0f2e44eaab914ffc17aef8aa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3e9c75c-81", "ovs_interfaceid": "c3e9c75c-81cc-48d6-a458-c4ddafed5b44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:20:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-4a7670d7-8b83-43aa-84c2-1681a0dfbceb req-32d122c9-49fd-4d7f-bf21-4b83005e9b4f service nova] Releasing lock "refresh_cache-6281d027-b30b-413d-b86e-e612a5a6d14d" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:20:51 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:20:51 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690899651.5087316, 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60 => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:20:51 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] VM Resumed (Lifecycle Event)
Aug 01 14:20:51 user nova-compute[72129]: DEBUG nova.compute.manager [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Instance event wait completed in 0 seconds for  {{(pid=72129) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 14:20:51 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Guest created on hypervisor {{(pid=72129) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 14:20:51 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Instance spawned successfully.
Aug 01 14:20:51 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 14:20:51 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:20:51 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:20:51 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Found default for hw_cdrom_bus of ide {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:20:51 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Found default for hw_disk_bus of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:20:51 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Found default for hw_input_bus of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:20:51 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Found default for hw_pointer_model of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:20:51 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Found default for hw_video_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:20:51 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Found default for hw_vif_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:20:51 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 14:20:51 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690899651.5100372, 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60 => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:20:51 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] VM Started (Lifecycle Event)
Aug 01 14:20:51 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:20:51 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:20:51 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 14:20:51 user nova-compute[72129]: INFO nova.compute.manager [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Took 5.91 seconds to spawn the instance on the hypervisor.
Aug 01 14:20:51 user nova-compute[72129]: DEBUG nova.compute.manager [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:20:51 user nova-compute[72129]: INFO nova.compute.manager [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Took 6.47 seconds to build instance.
Aug 01 14:20:51 user nova-compute[72129]: DEBUG nova.compute.manager [req-6a394fca-6a31-4ba0-97cf-fe4f46ec2b40 req-56f0a53e-9ad9-43b0-811e-4bdbfa686ac3 service nova] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Received event network-vif-plugged-d9687bd9-62f9-4b39-8c41-7b3c32127a71 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:20:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-6a394fca-6a31-4ba0-97cf-fe4f46ec2b40 req-56f0a53e-9ad9-43b0-811e-4bdbfa686ac3 service nova] Acquiring lock "9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:20:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-6a394fca-6a31-4ba0-97cf-fe4f46ec2b40 req-56f0a53e-9ad9-43b0-811e-4bdbfa686ac3 service nova] Lock "9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:20:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-6a394fca-6a31-4ba0-97cf-fe4f46ec2b40 req-56f0a53e-9ad9-43b0-811e-4bdbfa686ac3 service nova] Lock "9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:20:51 user nova-compute[72129]: DEBUG nova.compute.manager [req-6a394fca-6a31-4ba0-97cf-fe4f46ec2b40 req-56f0a53e-9ad9-43b0-811e-4bdbfa686ac3 service nova] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] No waiting events found dispatching network-vif-plugged-d9687bd9-62f9-4b39-8c41-7b3c32127a71 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:20:51 user nova-compute[72129]: WARNING nova.compute.manager [req-6a394fca-6a31-4ba0-97cf-fe4f46ec2b40 req-56f0a53e-9ad9-43b0-811e-4bdbfa686ac3 service nova] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Received unexpected event network-vif-plugged-d9687bd9-62f9-4b39-8c41-7b3c32127a71 for instance with vm_state active and task_state None.
Aug 01 14:20:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-2b044c3c-92e0-413b-8526-722c9a020456 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Lock "9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.571s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:20:52 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:20:52 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:20:52 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:20:52 user nova-compute[72129]: DEBUG nova.compute.manager [req-adbc0da5-5c1e-4cbf-b61c-4f37456c9224 req-79e0d27a-b641-4d95-9143-c9f8183a5960 service nova] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] Received event network-vif-plugged-c3e9c75c-81cc-48d6-a458-c4ddafed5b44 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:20:52 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-adbc0da5-5c1e-4cbf-b61c-4f37456c9224 req-79e0d27a-b641-4d95-9143-c9f8183a5960 service nova] Acquiring lock "6281d027-b30b-413d-b86e-e612a5a6d14d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:20:52 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-adbc0da5-5c1e-4cbf-b61c-4f37456c9224 req-79e0d27a-b641-4d95-9143-c9f8183a5960 service nova] Lock "6281d027-b30b-413d-b86e-e612a5a6d14d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:20:52 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-adbc0da5-5c1e-4cbf-b61c-4f37456c9224 req-79e0d27a-b641-4d95-9143-c9f8183a5960 service nova] Lock "6281d027-b30b-413d-b86e-e612a5a6d14d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:20:52 user nova-compute[72129]: DEBUG nova.compute.manager [req-adbc0da5-5c1e-4cbf-b61c-4f37456c9224 req-79e0d27a-b641-4d95-9143-c9f8183a5960 service nova] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] No waiting events found dispatching network-vif-plugged-c3e9c75c-81cc-48d6-a458-c4ddafed5b44 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:20:52 user nova-compute[72129]: WARNING nova.compute.manager [req-adbc0da5-5c1e-4cbf-b61c-4f37456c9224 req-79e0d27a-b641-4d95-9143-c9f8183a5960 service nova] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] Received unexpected event network-vif-plugged-c3e9c75c-81cc-48d6-a458-c4ddafed5b44 for instance with vm_state building and task_state spawning.
Aug 01 14:20:52 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:20:53 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:20:54 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690899654.5055277, 6281d027-b30b-413d-b86e-e612a5a6d14d => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:20:54 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] VM Resumed (Lifecycle Event)
Aug 01 14:20:54 user nova-compute[72129]: DEBUG nova.compute.manager [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] Instance event wait completed in 0 seconds for  {{(pid=72129) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 14:20:54 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] Guest created on hypervisor {{(pid=72129) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 14:20:54 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] Instance spawned successfully.
Aug 01 14:20:54 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 14:20:54 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:20:54 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:20:54 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] Found default for hw_cdrom_bus of ide {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:20:54 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] Found default for hw_disk_bus of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:20:54 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] Found default for hw_input_bus of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:20:54 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] Found default for hw_pointer_model of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:20:54 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] Found default for hw_video_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:20:54 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] Found default for hw_vif_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:20:54 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 14:20:54 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690899654.5065098, 6281d027-b30b-413d-b86e-e612a5a6d14d => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:20:54 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] VM Started (Lifecycle Event)
Aug 01 14:20:54 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:20:54 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:20:54 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 14:20:54 user nova-compute[72129]: INFO nova.compute.manager [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] Took 5.76 seconds to spawn the instance on the hypervisor.
Aug 01 14:20:54 user nova-compute[72129]: DEBUG nova.compute.manager [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:20:54 user nova-compute[72129]: DEBUG nova.compute.manager [req-3645c545-4a9c-4df7-932f-206df94a09f6 req-9a015fea-d7fb-4367-8151-01f87e55e240 service nova] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] Received event network-vif-plugged-c3e9c75c-81cc-48d6-a458-c4ddafed5b44 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:20:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-3645c545-4a9c-4df7-932f-206df94a09f6 req-9a015fea-d7fb-4367-8151-01f87e55e240 service nova] Acquiring lock "6281d027-b30b-413d-b86e-e612a5a6d14d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:20:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-3645c545-4a9c-4df7-932f-206df94a09f6 req-9a015fea-d7fb-4367-8151-01f87e55e240 service nova] Lock "6281d027-b30b-413d-b86e-e612a5a6d14d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:20:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-3645c545-4a9c-4df7-932f-206df94a09f6 req-9a015fea-d7fb-4367-8151-01f87e55e240 service nova] Lock "6281d027-b30b-413d-b86e-e612a5a6d14d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:20:54 user nova-compute[72129]: DEBUG nova.compute.manager [req-3645c545-4a9c-4df7-932f-206df94a09f6 req-9a015fea-d7fb-4367-8151-01f87e55e240 service nova] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] No waiting events found dispatching network-vif-plugged-c3e9c75c-81cc-48d6-a458-c4ddafed5b44 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:20:54 user nova-compute[72129]: WARNING nova.compute.manager [req-3645c545-4a9c-4df7-932f-206df94a09f6 req-9a015fea-d7fb-4367-8151-01f87e55e240 service nova] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] Received unexpected event network-vif-plugged-c3e9c75c-81cc-48d6-a458-c4ddafed5b44 for instance with vm_state building and task_state spawning.
Aug 01 14:20:54 user nova-compute[72129]: INFO nova.compute.manager [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] Took 6.35 seconds to build instance.
Aug 01 14:20:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c210bfa7-f7d0-4be1-a370-345a8975bd85 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "6281d027-b30b-413d-b86e-e612a5a6d14d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.459s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:20:56 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:20:56 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:21:01 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:21:01 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72129) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 14:21:01 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:21:03 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:21:04 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:21:04 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Starting heal instance info cache {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 14:21:04 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Rebuilding the list of instances to heal {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 14:21:04 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "refresh_cache-b3f54430-8d5d-478b-8dc7-d7592ee3db36" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:21:04 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquired lock "refresh_cache-b3f54430-8d5d-478b-8dc7-d7592ee3db36" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:21:04 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Forcefully refreshing network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 14:21:04 user nova-compute[72129]: DEBUG nova.objects.instance [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lazy-loading 'info_cache' on Instance uuid b3f54430-8d5d-478b-8dc7-d7592ee3db36 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:21:04 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Updating instance_info_cache with network_info: [{"id": "77cb18a9-2c41-4aa6-8784-ffcbafeb1341", "address": "fa:16:3e:d2:d6:8b", "network": {"id": "6ffcec16-7b44-472a-b7cd-af16ebd4a653", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-901464581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cca3e17d4e4df79c94c4b94fb3fcec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77cb18a9-2c", "ovs_interfaceid": "77cb18a9-2c41-4aa6-8784-ffcbafeb1341", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:21:04 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Releasing lock "refresh_cache-b3f54430-8d5d-478b-8dc7-d7592ee3db36" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:21:04 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Updated the network info_cache for instance {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 14:21:04 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:21:04 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:21:04 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:21:04 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:21:04 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Auditing locally available compute resources for user (node: user) {{(pid=72129) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 14:21:04 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:21:04 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:21:04 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:21:04 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:21:05 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6281d027-b30b-413d-b86e-e612a5a6d14d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:21:05 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6281d027-b30b-413d-b86e-e612a5a6d14d/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:21:05 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6281d027-b30b-413d-b86e-e612a5a6d14d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:21:05 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6281d027-b30b-413d-b86e-e612a5a6d14d/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:21:05 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk.rescue --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:21:05 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk.rescue --force-share --output=json" returned: 0 in 0.151s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:21:05 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk.rescue --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:21:05 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:21:05 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:21:05 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:21:05 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:21:05 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:21:05 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk.rescue --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:21:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:21:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk.rescue --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:21:06 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:21:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:21:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:21:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:21:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:21:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:21:06 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:21:06 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:21:06 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:21:06 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Hypervisor/Node resource view: name=user free_ram=8362MB free_disk=25.147846221923828GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72129) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 14:21:06 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:21:06 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:21:07 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance b3f54430-8d5d-478b-8dc7-d7592ee3db36 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:21:07 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:21:07 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:21:07 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 6281d027-b30b-413d-b86e-e612a5a6d14d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:21:07 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 14:21:07 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 14:21:07 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Refreshing inventories for resource provider c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 14:21:07 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Updating ProviderTree inventory for provider c2f345c3-9b82-4164-b21d-1eef8e661842 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 14:21:07 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Updating inventory in ProviderTree for provider c2f345c3-9b82-4164-b21d-1eef8e661842 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 14:21:07 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Refreshing aggregate associations for resource provider c2f345c3-9b82-4164-b21d-1eef8e661842, aggregates: None {{(pid=72129) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 14:21:07 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Refreshing trait associations for resource provider c2f345c3-9b82-4164-b21d-1eef8e661842, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE {{(pid=72129) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 14:21:07 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:21:07 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:21:07 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Compute_service record updated for user:user {{(pid=72129) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 14:21:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.438s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:21:07 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:21:07 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:21:07 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:21:08 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:21:09 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:21:11 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:21:11 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:21:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:21:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:21:18 user nova-compute[72129]: INFO nova.compute.manager [None req-ba35ce7e-ac2e-441b-9218-45611f56de71 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Unrescuing
Aug 01 14:21:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-ba35ce7e-ac2e-441b-9218-45611f56de71 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Acquiring lock "refresh_cache-b3f54430-8d5d-478b-8dc7-d7592ee3db36" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:21:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-ba35ce7e-ac2e-441b-9218-45611f56de71 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Acquired lock "refresh_cache-b3f54430-8d5d-478b-8dc7-d7592ee3db36" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:21:18 user nova-compute[72129]: DEBUG nova.network.neutron [None req-ba35ce7e-ac2e-441b-9218-45611f56de71 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 14:21:19 user nova-compute[72129]: DEBUG nova.network.neutron [None req-ba35ce7e-ac2e-441b-9218-45611f56de71 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Updating instance_info_cache with network_info: [{"id": "77cb18a9-2c41-4aa6-8784-ffcbafeb1341", "address": "fa:16:3e:d2:d6:8b", "network": {"id": "6ffcec16-7b44-472a-b7cd-af16ebd4a653", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-901464581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cca3e17d4e4df79c94c4b94fb3fcec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77cb18a9-2c", "ovs_interfaceid": "77cb18a9-2c41-4aa6-8784-ffcbafeb1341", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:21:19 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-ba35ce7e-ac2e-441b-9218-45611f56de71 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Releasing lock "refresh_cache-b3f54430-8d5d-478b-8dc7-d7592ee3db36" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:21:19 user nova-compute[72129]: DEBUG nova.objects.instance [None req-ba35ce7e-ac2e-441b-9218-45611f56de71 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lazy-loading 'flavor' on Instance uuid b3f54430-8d5d-478b-8dc7-d7592ee3db36 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:21:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:21:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:21:19 user nova-compute[72129]: DEBUG nova.compute.manager [req-ec37eb4a-2deb-4a54-92c9-09ba03e6621e req-a8dd2920-4b23-42a5-8565-d8b608e0cc86 service nova] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Received event network-vif-unplugged-77cb18a9-2c41-4aa6-8784-ffcbafeb1341 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:21:19 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ec37eb4a-2deb-4a54-92c9-09ba03e6621e req-a8dd2920-4b23-42a5-8565-d8b608e0cc86 service nova] Acquiring lock "b3f54430-8d5d-478b-8dc7-d7592ee3db36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:21:19 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ec37eb4a-2deb-4a54-92c9-09ba03e6621e req-a8dd2920-4b23-42a5-8565-d8b608e0cc86 service nova] Lock "b3f54430-8d5d-478b-8dc7-d7592ee3db36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:21:19 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ec37eb4a-2deb-4a54-92c9-09ba03e6621e req-a8dd2920-4b23-42a5-8565-d8b608e0cc86 service nova] Lock "b3f54430-8d5d-478b-8dc7-d7592ee3db36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:21:19 user nova-compute[72129]: DEBUG nova.compute.manager [req-ec37eb4a-2deb-4a54-92c9-09ba03e6621e req-a8dd2920-4b23-42a5-8565-d8b608e0cc86 service nova] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] No waiting events found dispatching network-vif-unplugged-77cb18a9-2c41-4aa6-8784-ffcbafeb1341 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:21:19 user nova-compute[72129]: WARNING nova.compute.manager [req-ec37eb4a-2deb-4a54-92c9-09ba03e6621e req-a8dd2920-4b23-42a5-8565-d8b608e0cc86 service nova] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Received unexpected event network-vif-unplugged-77cb18a9-2c41-4aa6-8784-ffcbafeb1341 for instance with vm_state rescued and task_state unrescuing.
Aug 01 14:21:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:21:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:21:20 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Instance destroyed successfully.
Aug 01 14:21:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:21:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:21:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:21:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:21:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:21:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:21:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:21:21 user nova-compute[72129]: DEBUG nova.compute.manager [req-d1a7fe82-defa-4167-a7ce-57e239eaa49d req-28c19cbb-7156-49d5-8b6e-98b35077fe71 service nova] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Received event network-vif-plugged-77cb18a9-2c41-4aa6-8784-ffcbafeb1341 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:21:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-d1a7fe82-defa-4167-a7ce-57e239eaa49d req-28c19cbb-7156-49d5-8b6e-98b35077fe71 service nova] Acquiring lock "b3f54430-8d5d-478b-8dc7-d7592ee3db36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:21:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-d1a7fe82-defa-4167-a7ce-57e239eaa49d req-28c19cbb-7156-49d5-8b6e-98b35077fe71 service nova] Lock "b3f54430-8d5d-478b-8dc7-d7592ee3db36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:21:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-d1a7fe82-defa-4167-a7ce-57e239eaa49d req-28c19cbb-7156-49d5-8b6e-98b35077fe71 service nova] Lock "b3f54430-8d5d-478b-8dc7-d7592ee3db36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:21:21 user nova-compute[72129]: DEBUG nova.compute.manager [req-d1a7fe82-defa-4167-a7ce-57e239eaa49d req-28c19cbb-7156-49d5-8b6e-98b35077fe71 service nova] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] No waiting events found dispatching network-vif-plugged-77cb18a9-2c41-4aa6-8784-ffcbafeb1341 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:21:21 user nova-compute[72129]: WARNING nova.compute.manager [req-d1a7fe82-defa-4167-a7ce-57e239eaa49d req-28c19cbb-7156-49d5-8b6e-98b35077fe71 service nova] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Received unexpected event network-vif-plugged-77cb18a9-2c41-4aa6-8784-ffcbafeb1341 for instance with vm_state rescued and task_state unrescuing.
Aug 01 14:21:21 user nova-compute[72129]: DEBUG nova.compute.manager [req-d1a7fe82-defa-4167-a7ce-57e239eaa49d req-28c19cbb-7156-49d5-8b6e-98b35077fe71 service nova] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Received event network-vif-plugged-77cb18a9-2c41-4aa6-8784-ffcbafeb1341 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:21:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-d1a7fe82-defa-4167-a7ce-57e239eaa49d req-28c19cbb-7156-49d5-8b6e-98b35077fe71 service nova] Acquiring lock "b3f54430-8d5d-478b-8dc7-d7592ee3db36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:21:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-d1a7fe82-defa-4167-a7ce-57e239eaa49d req-28c19cbb-7156-49d5-8b6e-98b35077fe71 service nova] Lock "b3f54430-8d5d-478b-8dc7-d7592ee3db36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:21:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-d1a7fe82-defa-4167-a7ce-57e239eaa49d req-28c19cbb-7156-49d5-8b6e-98b35077fe71 service nova] Lock "b3f54430-8d5d-478b-8dc7-d7592ee3db36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:21:21 user nova-compute[72129]: DEBUG nova.compute.manager [req-d1a7fe82-defa-4167-a7ce-57e239eaa49d req-28c19cbb-7156-49d5-8b6e-98b35077fe71 service nova] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] No waiting events found dispatching network-vif-plugged-77cb18a9-2c41-4aa6-8784-ffcbafeb1341 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:21:21 user nova-compute[72129]: WARNING nova.compute.manager [req-d1a7fe82-defa-4167-a7ce-57e239eaa49d req-28c19cbb-7156-49d5-8b6e-98b35077fe71 service nova] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Received unexpected event network-vif-plugged-77cb18a9-2c41-4aa6-8784-ffcbafeb1341 for instance with vm_state rescued and task_state unrescuing.
Aug 01 14:21:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Removed pending event for b3f54430-8d5d-478b-8dc7-d7592ee3db36 due to event {{(pid=72129) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 14:21:23 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690899683.452142, b3f54430-8d5d-478b-8dc7-d7592ee3db36 => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:21:23 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] VM Resumed (Lifecycle Event)
Aug 01 14:21:23 user nova-compute[72129]: DEBUG nova.compute.manager [None req-ba35ce7e-ac2e-441b-9218-45611f56de71 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:21:23 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:21:23 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:21:23 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 01 14:21:23 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690899683.4572911, b3f54430-8d5d-478b-8dc7-d7592ee3db36 => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:21:23 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] VM Started (Lifecycle Event)
Aug 01 14:21:23 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:21:23 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:21:23 user nova-compute[72129]: DEBUG nova.compute.manager [req-5557fe2e-39ab-4483-9fda-1e1360fcb688 req-69b590fb-af91-4a3d-a8b1-a1336b7706fa service nova] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Received event network-vif-plugged-77cb18a9-2c41-4aa6-8784-ffcbafeb1341 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:21:23 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-5557fe2e-39ab-4483-9fda-1e1360fcb688 req-69b590fb-af91-4a3d-a8b1-a1336b7706fa service nova] Acquiring lock "b3f54430-8d5d-478b-8dc7-d7592ee3db36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:21:23 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-5557fe2e-39ab-4483-9fda-1e1360fcb688 req-69b590fb-af91-4a3d-a8b1-a1336b7706fa service nova] Lock "b3f54430-8d5d-478b-8dc7-d7592ee3db36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:21:23 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-5557fe2e-39ab-4483-9fda-1e1360fcb688 req-69b590fb-af91-4a3d-a8b1-a1336b7706fa service nova] Lock "b3f54430-8d5d-478b-8dc7-d7592ee3db36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:21:23 user nova-compute[72129]: DEBUG nova.compute.manager [req-5557fe2e-39ab-4483-9fda-1e1360fcb688 req-69b590fb-af91-4a3d-a8b1-a1336b7706fa service nova] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] No waiting events found dispatching network-vif-plugged-77cb18a9-2c41-4aa6-8784-ffcbafeb1341 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:21:23 user nova-compute[72129]: WARNING nova.compute.manager [req-5557fe2e-39ab-4483-9fda-1e1360fcb688 req-69b590fb-af91-4a3d-a8b1-a1336b7706fa service nova] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Received unexpected event network-vif-plugged-77cb18a9-2c41-4aa6-8784-ffcbafeb1341 for instance with vm_state active and task_state None.
Aug 01 14:21:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:21:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:21:28 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:21:29 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:21:29 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Cleaning up deleted instances {{(pid=72129) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 14:21:29 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] There are 0 instances to clean {{(pid=72129) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 14:21:29 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:21:29 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72129) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 14:21:31 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:21:36 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:21:36 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:21:41 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:21:41 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:21:46 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:21:46 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:21:51 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:21:51 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:21:56 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:21:56 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:22:01 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:22:03 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:22:03 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72129) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 14:22:05 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:22:05 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Starting heal instance info cache {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 14:22:05 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "refresh_cache-3bdb8e41-8cd5-4c33-9624-d262cacd0f5d" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:22:05 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquired lock "refresh_cache-3bdb8e41-8cd5-4c33-9624-d262cacd0f5d" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:22:05 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Forcefully refreshing network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 14:22:05 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Updating instance_info_cache with network_info: [{"id": "10889d2c-ec62-4b92-b325-0f5d7d67851f", "address": "fa:16:3e:52:40:4c", "network": {"id": "6ffcec16-7b44-472a-b7cd-af16ebd4a653", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-901464581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cca3e17d4e4df79c94c4b94fb3fcec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10889d2c-ec", "ovs_interfaceid": "10889d2c-ec62-4b92-b325-0f5d7d67851f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:22:05 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Releasing lock "refresh_cache-3bdb8e41-8cd5-4c33-9624-d262cacd0f5d" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:22:05 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Updated the network info_cache for instance {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 14:22:05 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:22:05 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:22:05 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:22:05 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:22:05 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:22:05 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Auditing locally available compute resources for user (node: user) {{(pid=72129) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 14:22:05 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:22:05 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:22:05 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:22:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:22:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6281d027-b30b-413d-b86e-e612a5a6d14d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:22:06 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:22:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6281d027-b30b-413d-b86e-e612a5a6d14d/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:22:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6281d027-b30b-413d-b86e-e612a5a6d14d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:22:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6281d027-b30b-413d-b86e-e612a5a6d14d/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:22:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:22:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:22:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:22:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:22:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk.rescue --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:22:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:22:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk.rescue --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:22:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk.rescue --force-share --output=json" returned: 0 in 0.146s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:22:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:22:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:22:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:22:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:22:07 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:22:07 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:22:07 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Hypervisor/Node resource view: name=user free_ram=8445MB free_disk=25.117008209228516GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72129) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 14:22:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:22:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:22:07 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance b3f54430-8d5d-478b-8dc7-d7592ee3db36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:22:07 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:22:07 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:22:07 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 6281d027-b30b-413d-b86e-e612a5a6d14d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:22:07 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 14:22:07 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 14:22:07 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:22:07 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:22:07 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Compute_service record updated for user:user {{(pid=72129) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 14:22:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.337s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:22:08 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:22:08 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:22:08 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:22:09 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:22:10 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:22:10 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:22:11 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:22:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:22:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:22:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:22:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:22:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72129) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 14:22:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:22:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:22:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:22:31 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4996-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:22:31 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:22:31 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72129) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 14:22:31 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:22:31 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:22:31 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:22:36 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4996-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:22:37 user nova-compute[72129]: DEBUG nova.compute.manager [req-c4cadb96-58d0-4933-93a8-bb87ad192aa0 req-60ef88d1-a70a-4ac8-b551-265b9bad2528 service nova] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Received event network-changed-d9687bd9-62f9-4b39-8c41-7b3c32127a71 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:22:37 user nova-compute[72129]: DEBUG nova.compute.manager [req-c4cadb96-58d0-4933-93a8-bb87ad192aa0 req-60ef88d1-a70a-4ac8-b551-265b9bad2528 service nova] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Refreshing instance network info cache due to event network-changed-d9687bd9-62f9-4b39-8c41-7b3c32127a71. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 14:22:37 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-c4cadb96-58d0-4933-93a8-bb87ad192aa0 req-60ef88d1-a70a-4ac8-b551-265b9bad2528 service nova] Acquiring lock "refresh_cache-9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:22:37 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-c4cadb96-58d0-4933-93a8-bb87ad192aa0 req-60ef88d1-a70a-4ac8-b551-265b9bad2528 service nova] Acquired lock "refresh_cache-9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:22:37 user nova-compute[72129]: DEBUG nova.network.neutron [req-c4cadb96-58d0-4933-93a8-bb87ad192aa0 req-60ef88d1-a70a-4ac8-b551-265b9bad2528 service nova] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Refreshing network info cache for port d9687bd9-62f9-4b39-8c41-7b3c32127a71 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 14:22:37 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-7d67a119-c189-4bed-916d-e06c4e87c56f tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Acquiring lock "9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:22:37 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-7d67a119-c189-4bed-916d-e06c4e87c56f tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Lock "9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:22:37 user nova-compute[72129]: DEBUG nova.objects.instance [None req-7d67a119-c189-4bed-916d-e06c4e87c56f tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Lazy-loading 'flavor' on Instance uuid 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:22:37 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-7d67a119-c189-4bed-916d-e06c4e87c56f tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Ignoring supplied device name: /dev/vdb
Aug 01 14:22:37 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-7d67a119-c189-4bed-916d-e06c4e87c56f tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Lock "9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:22:37 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-7d67a119-c189-4bed-916d-e06c4e87c56f tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Acquiring lock "9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:22:37 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-7d67a119-c189-4bed-916d-e06c4e87c56f tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Lock "9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:22:37 user nova-compute[72129]: INFO nova.compute.manager [None req-7d67a119-c189-4bed-916d-e06c4e87c56f tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Attaching volume 9b0efb0d-72a6-46eb-a62b-5dc14973d945 to /dev/vdb
Aug 01 14:22:37 user nova-compute[72129]: DEBUG os_brick.utils [None req-7d67a119-c189-4bed-916d-e06c4e87c56f tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:22:37 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:22:37 user nova-compute[72129]: DEBUG nova.network.neutron [req-c4cadb96-58d0-4933-93a8-bb87ad192aa0 req-60ef88d1-a70a-4ac8-b551-265b9bad2528 service nova] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Updated VIF entry in instance network info cache for port d9687bd9-62f9-4b39-8c41-7b3c32127a71. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 14:22:37 user nova-compute[72129]: DEBUG nova.network.neutron [req-c4cadb96-58d0-4933-93a8-bb87ad192aa0 req-60ef88d1-a70a-4ac8-b551-265b9bad2528 service nova] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Updating instance_info_cache with network_info: [{"id": "d9687bd9-62f9-4b39-8c41-7b3c32127a71", "address": "fa:16:3e:b8:e3:cc", "network": {"id": "814dffe9-8861-4a81-bf68-d86f2a4b4faf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1760326136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d203d0ad6e3c4379ae26ad8fb44f877d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9687bd9-62", "ovs_interfaceid": "d9687bd9-62f9-4b39-8c41-7b3c32127a71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:22:37 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:22:37 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[239bda10-7f1f-4e9f-afae-85ecf7afd976]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f9b449c2cd3d\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:22:37 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:22:37 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:22:37 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[befc9bde-df16-4c92-97e1-6e7778d7313d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:22:37 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:22:37 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-c4cadb96-58d0-4933-93a8-bb87ad192aa0 req-60ef88d1-a70a-4ac8-b551-265b9bad2528 service nova] Releasing lock "refresh_cache-9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:22:37 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:22:37 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[33daecf0-7def-407c-a324-225224e193f5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:22:37 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a1c5fb-798a-4fa0-9a8a-0bbe7ecc4f26]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:22:37 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-7d67a119-c189-4bed-916d-e06c4e87c56f tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Running cmd (subprocess): nvme version {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:22:37 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-7d67a119-c189-4bed-916d-e06c4e87c56f tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] 'nvme version' failed. Not Retrying. {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 14:22:37 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7d67a119-c189-4bed-916d-e06c4e87c56f tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] nvme not present on system {{(pid=72129) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 14:22:37 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:22:37 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 14:22:37 user nova-compute[72129]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 14:22:37 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c2e5b94-d560-4080-86ef-e36989cb7280]: (4, '') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:22:37 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-7d67a119-c189-4bed-916d-e06c4e87c56f tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72129) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 14:22:37 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-7d67a119-c189-4bed-916d-e06c4e87c56f tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 14:22:37 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-7d67a119-c189-4bed-916d-e06c4e87c56f tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] LIGHTOS: no hostnqn found. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 14:22:37 user nova-compute[72129]: DEBUG os_brick.utils [None req-7d67a119-c189-4bed-916d-e06c4e87c56f tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f9b449c2cd3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:22:37 user nova-compute[72129]: DEBUG nova.virt.block_device [None req-7d67a119-c189-4bed-916d-e06c4e87c56f tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Updating existing volume attachment record: c90e33cc-4a25-4cce-a587-43eadb7e5bfe {{(pid=72129) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 14:22:39 user nova-compute[72129]: DEBUG nova.compute.manager [req-a3fde15d-265d-4e40-a47a-9deb9adbede9 req-07733442-ef17-4e69-84c7-008483a74d4c service nova] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] Received event network-changed-c3e9c75c-81cc-48d6-a458-c4ddafed5b44 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:22:39 user nova-compute[72129]: DEBUG nova.compute.manager [req-a3fde15d-265d-4e40-a47a-9deb9adbede9 req-07733442-ef17-4e69-84c7-008483a74d4c service nova] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] Refreshing instance network info cache due to event network-changed-c3e9c75c-81cc-48d6-a458-c4ddafed5b44. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 14:22:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-a3fde15d-265d-4e40-a47a-9deb9adbede9 req-07733442-ef17-4e69-84c7-008483a74d4c service nova] Acquiring lock "refresh_cache-6281d027-b30b-413d-b86e-e612a5a6d14d" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:22:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-a3fde15d-265d-4e40-a47a-9deb9adbede9 req-07733442-ef17-4e69-84c7-008483a74d4c service nova] Acquired lock "refresh_cache-6281d027-b30b-413d-b86e-e612a5a6d14d" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:22:39 user nova-compute[72129]: DEBUG nova.network.neutron [req-a3fde15d-265d-4e40-a47a-9deb9adbede9 req-07733442-ef17-4e69-84c7-008483a74d4c service nova] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] Refreshing network info cache for port c3e9c75c-81cc-48d6-a458-c4ddafed5b44 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 14:22:39 user nova-compute[72129]: DEBUG nova.network.neutron [req-a3fde15d-265d-4e40-a47a-9deb9adbede9 req-07733442-ef17-4e69-84c7-008483a74d4c service nova] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] Updated VIF entry in instance network info cache for port c3e9c75c-81cc-48d6-a458-c4ddafed5b44. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 14:22:39 user nova-compute[72129]: DEBUG nova.network.neutron [req-a3fde15d-265d-4e40-a47a-9deb9adbede9 req-07733442-ef17-4e69-84c7-008483a74d4c service nova] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] Updating instance_info_cache with network_info: [{"id": "c3e9c75c-81cc-48d6-a458-c4ddafed5b44", "address": "fa:16:3e:29:20:d9", "network": {"id": "9d4effd9-bf5c-41a7-a8e2-18d2177ace34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333645199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5d5ede0f2e44eaab914ffc17aef8aa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3e9c75c-81", "ovs_interfaceid": "c3e9c75c-81cc-48d6-a458-c4ddafed5b44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:22:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-a3fde15d-265d-4e40-a47a-9deb9adbede9 req-07733442-ef17-4e69-84c7-008483a74d4c service nova] Releasing lock "refresh_cache-6281d027-b30b-413d-b86e-e612a5a6d14d" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:22:41 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:22:41 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:22:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-0860a000-8ef4-452d-a28c-c4e9efedb80f tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Acquiring lock "6281d027-b30b-413d-b86e-e612a5a6d14d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:22:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-0860a000-8ef4-452d-a28c-c4e9efedb80f tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "6281d027-b30b-413d-b86e-e612a5a6d14d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:22:42 user nova-compute[72129]: DEBUG nova.objects.instance [None req-0860a000-8ef4-452d-a28c-c4e9efedb80f tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lazy-loading 'flavor' on Instance uuid 6281d027-b30b-413d-b86e-e612a5a6d14d {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:22:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-0860a000-8ef4-452d-a28c-c4e9efedb80f tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "6281d027-b30b-413d-b86e-e612a5a6d14d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:22:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-0860a000-8ef4-452d-a28c-c4e9efedb80f tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Acquiring lock "6281d027-b30b-413d-b86e-e612a5a6d14d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:22:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-0860a000-8ef4-452d-a28c-c4e9efedb80f tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "6281d027-b30b-413d-b86e-e612a5a6d14d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:22:43 user nova-compute[72129]: INFO nova.compute.manager [None req-0860a000-8ef4-452d-a28c-c4e9efedb80f tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] Attaching volume 73aeb9f7-1b79-480f-934e-4558107b307a to /dev/vdb
Aug 01 14:22:43 user nova-compute[72129]: DEBUG os_brick.utils [None req-0860a000-8ef4-452d-a28c-c4e9efedb80f tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:22:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:22:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:22:43 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[8363fc6e-92d0-4a7f-900d-5bc807105abd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f9b449c2cd3d\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:22:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:22:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:22:43 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48857fb-71f0-45b4-bb6f-678cd3ba0cc6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:22:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:22:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:22:43 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff6b2ac-e8bf-4ef8-ad13-f0d2b0687fc4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:22:43 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[544856a1-aa98-4b0f-970e-57f6d605fdd4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:22:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-0860a000-8ef4-452d-a28c-c4e9efedb80f tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Running cmd (subprocess): nvme version {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:22:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-0860a000-8ef4-452d-a28c-c4e9efedb80f tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] 'nvme version' failed. Not Retrying. {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 14:22:43 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0860a000-8ef4-452d-a28c-c4e9efedb80f tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] nvme not present on system {{(pid=72129) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 14:22:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:22:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 14:22:43 user nova-compute[72129]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 14:22:43 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[06485ea7-bc86-4b38-a6e0-b378ff753e78]: (4, '') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:22:43 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-0860a000-8ef4-452d-a28c-c4e9efedb80f tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72129) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 14:22:43 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-0860a000-8ef4-452d-a28c-c4e9efedb80f tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 14:22:43 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-0860a000-8ef4-452d-a28c-c4e9efedb80f tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] LIGHTOS: no hostnqn found. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 14:22:43 user nova-compute[72129]: DEBUG os_brick.utils [None req-0860a000-8ef4-452d-a28c-c4e9efedb80f tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f9b449c2cd3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:22:43 user nova-compute[72129]: DEBUG nova.virt.block_device [None req-0860a000-8ef4-452d-a28c-c4e9efedb80f tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] Updating existing volume attachment record: cf9e2219-a691-498d-a714-54152a1d6b5f {{(pid=72129) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 14:22:46 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:22:46 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:22:49 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d67a119-c189-4bed-916d-e06c4e87c56f tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Calling os-brick to attach iSCSI Volume {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 14:22:49 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d67a119-c189-4bed-916d-e06c4e87c56f tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9b0efb0d-72a6-46eb-a62b-5dc14973d945'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'edvzIBqX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:22:49 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-7d67a119-c189-4bed-916d-e06c4e87c56f tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:22:49 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-7d67a119-c189-4bed-916d-e06c4e87c56f tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:22:49 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-7d67a119-c189-4bed-916d-e06c4e87c56f tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:22:49 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-7d67a119-c189-4bed-916d-e06c4e87c56f tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:22:49 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-7d67a119-c189-4bed-916d-e06c4e87c56f tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b0efb0d-72a6-46eb-a62b-5dc14973d945" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:22:49 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-7d67a119-c189-4bed-916d-e06c4e87c56f tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b0efb0d-72a6-46eb-a62b-5dc14973d945" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:22:49 user nova-compute[72129]: INFO os_brick.initiator.connectors.iscsi [None req-7d67a119-c189-4bed-916d-e06c4e87c56f tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 14:22:49 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b0efb0d-72a6-46eb-a62b-5dc14973d945 -p 172.16.0.220:3260 {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:22:49 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b0efb0d-72a6-46eb-a62b-5dc14973d945 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:22:49 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4084720-a459-4e8a-a274-019476779014]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:22:49 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d67a119-c189-4bed-916d-e06c4e87c56f tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 14:22:49 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:22:49 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b0efb0d-72a6-46eb-a62b-5dc14973d945 -p 172.16.0.220:3260 --interface default --op new {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:22:49 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b0efb0d-72a6-46eb-a62b-5dc14973d945 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:22:49 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6a29cb-3e87-4775-a70c-32a31eb3182c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9b0efb0d-72a6-46eb-a62b-5dc14973d945] added\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:22:49 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d67a119-c189-4bed-916d-e06c4e87c56f tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9b0efb0d-72a6-46eb-a62b-5dc14973d945] added
Aug 01 14:22:49 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:22:49 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b0efb0d-72a6-46eb-a62b-5dc14973d945 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:22:49 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b0efb0d-72a6-46eb-a62b-5dc14973d945 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:22:49 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e0f427-8ffc-4724-b106-9f09c61532fe]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:22:49 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d67a119-c189-4bed-916d-e06c4e87c56f tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:22:49 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b0efb0d-72a6-46eb-a62b-5dc14973d945 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:22:49 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b0efb0d-72a6-46eb-a62b-5dc14973d945 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:22:49 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f3861ee-3b27-4651-aa6b-50b1e84c1f16]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:22:49 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d67a119-c189-4bed-916d-e06c4e87c56f tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:22:49 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b0efb0d-72a6-46eb-a62b-5dc14973d945 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v edvzIBqX {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:22:49 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b0efb0d-72a6-46eb-a62b-5dc14973d945 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v edvzIBqX" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:22:49 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[509ab299-0668-4a7e-a880-a7f35d55f329]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:22:49 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d67a119-c189-4bed-916d-e06c4e87c56f tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'edvzIBqX'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:22:49 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b0efb0d-72a6-46eb-a62b-5dc14973d945 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:22:49 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b0efb0d-72a6-46eb-a62b-5dc14973d945 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:22:49 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[483993b9-0fe5-4920-9027-c6968bd35226]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:22:49 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d67a119-c189-4bed-916d-e06c4e87c56f tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:22:49 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:22:49 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:22:49 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf53e4c-88e3-4359-b328-03de4d7a0caa]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:22:49 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d67a119-c189-4bed-916d-e06c4e87c56f tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 14:22:49 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:22:49 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d67a119-c189-4bed-916d-e06c4e87c56f tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 14:22:49 user nova-compute[72129]:  {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:22:49 user nova-compute[72129]: WARNING os_brick.initiator.connectors.iscsi [None req-7d67a119-c189-4bed-916d-e06c4e87c56f tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 14:22:49 user nova-compute[72129]: 
Aug 01 14:22:49 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b0efb0d-72a6-46eb-a62b-5dc14973d945 -p 172.16.0.220:3260 --login {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:22:49 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b0efb0d-72a6-46eb-a62b-5dc14973d945 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:22:49 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c748b4-2728-44ff-84b1-48e17ca41e86]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9b0efb0d-72a6-46eb-a62b-5dc14973d945, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9b0efb0d-72a6-46eb-a62b-5dc14973d945, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:22:49 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d67a119-c189-4bed-916d-e06c4e87c56f tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9b0efb0d-72a6-46eb-a62b-5dc14973d945, portal: 172.16.0.220,3260]
Aug 01 14:22:49 user nova-compute[72129]: Login to [iface: default, target: iqn.2010-10.org.openstack:9b0efb0d-72a6-46eb-a62b-5dc14973d945, portal: 172.16.0.220,3260] successful.
Aug 01 14:22:49 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:22:49 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b0efb0d-72a6-46eb-a62b-5dc14973d945 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:22:49 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b0efb0d-72a6-46eb-a62b-5dc14973d945 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:22:49 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[482a8aa8-d6aa-4a72-bcb8-d641a9a4517b]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:22:49 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d67a119-c189-4bed-916d-e06c4e87c56f tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:22:49 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:22:49 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:22:49 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b73a030-354a-49df-9925-5f6dc382188e]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b0efb0d-72a6-46eb-a62b-5dc14973d945 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:22:49 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d67a119-c189-4bed-916d-e06c4e87c56f tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b0efb0d-72a6-46eb-a62b-5dc14973d945 (non-flash)
Aug 01 14:22:49 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:22:49 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d67a119-c189-4bed-916d-e06c4e87c56f tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b0efb0d-72a6-46eb-a62b-5dc14973d945 (non-flash)
Aug 01 14:22:49 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:22:49 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-7d67a119-c189-4bed-916d-e06c4e87c56f tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b0efb0d-72a6-46eb-a62b-5dc14973d945" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:22:49 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d67a119-c189-4bed-916d-e06c4e87c56f tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Connected to 172.16.0.220:3260 {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 14:22:49 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-7d67a119-c189-4bed-916d-e06c4e87c56f tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=72129) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 14:22:49 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-7d67a119-c189-4bed-916d-e06c4e87c56f tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72129) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 14:22:49 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:22:49 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:22:49 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb5b353-fafc-4d05-933a-4c491346ae87]: (4, ('- - 0', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:22:49 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-7d67a119-c189-4bed-916d-e06c4e87c56f tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 14:22:49 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d67a119-c189-4bed-916d-e06c4e87c56f tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'edvzIBqX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 14:22:50 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0860a000-8ef4-452d-a28c-c4e9efedb80f tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] Calling os-brick to attach iSCSI Volume {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 14:22:50 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-0860a000-8ef4-452d-a28c-c4e9efedb80f tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:73aeb9f7-1b79-480f-934e-4558107b307a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xeOUbnXC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:22:50 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-0860a000-8ef4-452d-a28c-c4e9efedb80f tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:22:50 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-0860a000-8ef4-452d-a28c-c4e9efedb80f tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:22:50 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-7d67a119-c189-4bed-916d-e06c4e87c56f tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:22:50 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d67a119-c189-4bed-916d-e06c4e87c56f tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '26663613530636361', 'path': '/dev/sdb'} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:22:50 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d67a119-c189-4bed-916d-e06c4e87c56f tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26663613530636361', 'path': '/dev/sdb'} {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 14:22:50 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-0860a000-8ef4-452d-a28c-c4e9efedb80f tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.178s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:22:50 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-0860a000-8ef4-452d-a28c-c4e9efedb80f tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:22:50 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-0860a000-8ef4-452d-a28c-c4e9efedb80f tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73aeb9f7-1b79-480f-934e-4558107b307a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:22:50 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-0860a000-8ef4-452d-a28c-c4e9efedb80f tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73aeb9f7-1b79-480f-934e-4558107b307a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:22:50 user nova-compute[72129]: INFO os_brick.initiator.connectors.iscsi [None req-0860a000-8ef4-452d-a28c-c4e9efedb80f tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 14:22:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73aeb9f7-1b79-480f-934e-4558107b307a -p 172.16.0.220:3260 {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:22:50 user nova-compute[72129]: DEBUG nova.objects.instance [None req-7d67a119-c189-4bed-916d-e06c4e87c56f tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Lazy-loading 'flavor' on Instance uuid 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:22:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73aeb9f7-1b79-480f-934e-4558107b307a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:22:50 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a5baf7-c1f6-430b-8ddc-45d113a4587a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:22:50 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-0860a000-8ef4-452d-a28c-c4e9efedb80f tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 14:22:50 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:22:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73aeb9f7-1b79-480f-934e-4558107b307a -p 172.16.0.220:3260 --interface default --op new {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:22:50 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-7d67a119-c189-4bed-916d-e06c4e87c56f tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 14:22:50 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:22:50 user nova-compute[72129]:   <source dev="/dev/sdb"/>
Aug 01 14:22:50 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 14:22:50 user nova-compute[72129]:   <serial>9b0efb0d-72a6-46eb-a62b-5dc14973d945</serial>
Aug 01 14:22:50 user nova-compute[72129]: </disk>
Aug 01 14:22:50 user nova-compute[72129]:  {{(pid=72129) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 14:22:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73aeb9f7-1b79-480f-934e-4558107b307a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:22:50 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d30b32-5301-4721-ba61-9b6b1f828e84]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:73aeb9f7-1b79-480f-934e-4558107b307a] added\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:22:50 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-0860a000-8ef4-452d-a28c-c4e9efedb80f tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:73aeb9f7-1b79-480f-934e-4558107b307a] added
Aug 01 14:22:50 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:22:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73aeb9f7-1b79-480f-934e-4558107b307a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:22:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73aeb9f7-1b79-480f-934e-4558107b307a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:22:50 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[8170e46c-153a-4a35-ba5a-bb5b391f3cf9]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:22:50 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-0860a000-8ef4-452d-a28c-c4e9efedb80f tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:22:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73aeb9f7-1b79-480f-934e-4558107b307a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:22:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73aeb9f7-1b79-480f-934e-4558107b307a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:22:50 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[f03a9928-22af-4b44-8532-4bd358a08f00]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:22:50 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-0860a000-8ef4-452d-a28c-c4e9efedb80f tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:22:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73aeb9f7-1b79-480f-934e-4558107b307a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xeOUbnXC {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:22:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73aeb9f7-1b79-480f-934e-4558107b307a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xeOUbnXC" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:22:50 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[0820fd35-f428-4caf-9af7-3e7544ebd6db]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:22:50 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-0860a000-8ef4-452d-a28c-c4e9efedb80f tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xeOUbnXC'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:22:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73aeb9f7-1b79-480f-934e-4558107b307a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:22:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73aeb9f7-1b79-480f-934e-4558107b307a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:22:50 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ffe9fff-7c28-46bf-b247-da29de813779]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:22:50 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-0860a000-8ef4-452d-a28c-c4e9efedb80f tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:22:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:22:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:22:50 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[422d2ebe-01d6-460f-9e2d-1bc319a2e9e8]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b0efb0d-72a6-46eb-a62b-5dc14973d945 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:22:50 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-0860a000-8ef4-452d-a28c-c4e9efedb80f tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b0efb0d-72a6-46eb-a62b-5dc14973d945 (non-flash)
Aug 01 14:22:50 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:22:50 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-0860a000-8ef4-452d-a28c-c4e9efedb80f tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b0efb0d-72a6-46eb-a62b-5dc14973d945 (non-flash)
Aug 01 14:22:50 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:22:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73aeb9f7-1b79-480f-934e-4558107b307a -p 172.16.0.220:3260 --login {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:22:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73aeb9f7-1b79-480f-934e-4558107b307a -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:22:50 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[3221f8cc-7021-4b7e-95cf-c791dd546f99]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:73aeb9f7-1b79-480f-934e-4558107b307a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:73aeb9f7-1b79-480f-934e-4558107b307a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:22:50 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-0860a000-8ef4-452d-a28c-c4e9efedb80f tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:73aeb9f7-1b79-480f-934e-4558107b307a, portal: 172.16.0.220,3260]
Aug 01 14:22:50 user nova-compute[72129]: Login to [iface: default, target: iqn.2010-10.org.openstack:73aeb9f7-1b79-480f-934e-4558107b307a, portal: 172.16.0.220,3260] successful.
Aug 01 14:22:50 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:22:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73aeb9f7-1b79-480f-934e-4558107b307a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:22:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73aeb9f7-1b79-480f-934e-4558107b307a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:22:50 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ade403-e006-4675-8704-69f87520fb14]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:22:50 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-0860a000-8ef4-452d-a28c-c4e9efedb80f tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:22:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:22:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:22:50 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a9a1bd-273e-4cd6-9c88-3dae0b2f6ce1]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b0efb0d-72a6-46eb-a62b-5dc14973d945 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73aeb9f7-1b79-480f-934e-4558107b307a (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:22:50 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-0860a000-8ef4-452d-a28c-c4e9efedb80f tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b0efb0d-72a6-46eb-a62b-5dc14973d945 (non-flash)
Aug 01 14:22:50 user nova-compute[72129]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73aeb9f7-1b79-480f-934e-4558107b307a (non-flash)
Aug 01 14:22:50 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:22:50 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-0860a000-8ef4-452d-a28c-c4e9efedb80f tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b0efb0d-72a6-46eb-a62b-5dc14973d945 (non-flash)
Aug 01 14:22:50 user nova-compute[72129]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73aeb9f7-1b79-480f-934e-4558107b307a (non-flash)
Aug 01 14:22:50 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:22:50 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-0860a000-8ef4-452d-a28c-c4e9efedb80f tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73aeb9f7-1b79-480f-934e-4558107b307a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:22:50 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-0860a000-8ef4-452d-a28c-c4e9efedb80f tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Connected to 172.16.0.220:3260 {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 14:22:50 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-0860a000-8ef4-452d-a28c-c4e9efedb80f tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] HCTL ('34', '-', '-', 0) found on session 56 with lun 0 {{(pid=72129) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 14:22:50 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-0860a000-8ef4-452d-a28c-c4e9efedb80f tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72129) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 14:22:50 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:22:51 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:22:51 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[5acc2e25-258b-4d4e-9d62-27da4f50cc02]: (4, ('- - 0', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:22:51 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-0860a000-8ef4-452d-a28c-c4e9efedb80f tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 14:22:51 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-0860a000-8ef4-452d-a28c-c4e9efedb80f tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xeOUbnXC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 14:22:51 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:22:51 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-7d67a119-c189-4bed-916d-e06c4e87c56f tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:22:51 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-7d67a119-c189-4bed-916d-e06c4e87c56f tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:22:51 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-7d67a119-c189-4bed-916d-e06c4e87c56f tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] No VIF found with MAC fa:16:3e:b8:e3:cc, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 14:22:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-7d67a119-c189-4bed-916d-e06c4e87c56f tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Lock "9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.910s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:22:52 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-0860a000-8ef4-452d-a28c-c4e9efedb80f tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:22:52 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-0860a000-8ef4-452d-a28c-c4e9efedb80f tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] <== connect_volume: return (1474ms) {'type': 'block', 'scsi_wwn': '26564333365393434', 'path': '/dev/sdc'} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:22:52 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0860a000-8ef4-452d-a28c-c4e9efedb80f tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564333365393434', 'path': '/dev/sdc'} {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 14:22:52 user nova-compute[72129]: DEBUG nova.objects.instance [None req-0860a000-8ef4-452d-a28c-c4e9efedb80f tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lazy-loading 'flavor' on Instance uuid 6281d027-b30b-413d-b86e-e612a5a6d14d {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:22:52 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-0860a000-8ef4-452d-a28c-c4e9efedb80f tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 14:22:52 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:22:52 user nova-compute[72129]:   <source dev="/dev/sdc"/>
Aug 01 14:22:52 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 14:22:52 user nova-compute[72129]:   <serial>73aeb9f7-1b79-480f-934e-4558107b307a</serial>
Aug 01 14:22:52 user nova-compute[72129]: </disk>
Aug 01 14:22:52 user nova-compute[72129]:  {{(pid=72129) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 14:22:52 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-0860a000-8ef4-452d-a28c-c4e9efedb80f tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:22:52 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-0860a000-8ef4-452d-a28c-c4e9efedb80f tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:22:52 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-0860a000-8ef4-452d-a28c-c4e9efedb80f tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] No VIF found with MAC fa:16:3e:29:20:d9, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 14:22:52 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-0860a000-8ef4-452d-a28c-c4e9efedb80f tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "6281d027-b30b-413d-b86e-e612a5a6d14d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.427s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:22:53 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-027ce0a1-13e1-4d45-a09b-8e468025f0ca tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Acquiring lock "6281d027-b30b-413d-b86e-e612a5a6d14d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:22:53 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-027ce0a1-13e1-4d45-a09b-8e468025f0ca tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "6281d027-b30b-413d-b86e-e612a5a6d14d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:22:53 user nova-compute[72129]: INFO nova.compute.manager [None req-027ce0a1-13e1-4d45-a09b-8e468025f0ca tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] Detaching volume 73aeb9f7-1b79-480f-934e-4558107b307a
Aug 01 14:22:53 user nova-compute[72129]: INFO nova.virt.block_device [None req-027ce0a1-13e1-4d45-a09b-8e468025f0ca tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] Attempting to driver detach volume 73aeb9f7-1b79-480f-934e-4558107b307a from mountpoint /dev/vdb
Aug 01 14:22:53 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-027ce0a1-13e1-4d45-a09b-8e468025f0ca tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Attempting to detach device vdb from instance 6281d027-b30b-413d-b86e-e612a5a6d14d from the persistent domain config. {{(pid=72129) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 14:22:53 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-027ce0a1-13e1-4d45-a09b-8e468025f0ca tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 14:22:53 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:22:53 user nova-compute[72129]:   <source dev="/dev/sdc"/>
Aug 01 14:22:53 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 14:22:53 user nova-compute[72129]:   <serial>73aeb9f7-1b79-480f-934e-4558107b307a</serial>
Aug 01 14:22:53 user nova-compute[72129]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 14:22:53 user nova-compute[72129]: </disk>
Aug 01 14:22:53 user nova-compute[72129]:  {{(pid=72129) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 14:22:53 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-027ce0a1-13e1-4d45-a09b-8e468025f0ca tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Successfully detached device vdb from instance 6281d027-b30b-413d-b86e-e612a5a6d14d from the persistent domain config.
Aug 01 14:22:53 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-027ce0a1-13e1-4d45-a09b-8e468025f0ca tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6281d027-b30b-413d-b86e-e612a5a6d14d from the live domain config. {{(pid=72129) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 14:22:53 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-027ce0a1-13e1-4d45-a09b-8e468025f0ca tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 14:22:53 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:22:53 user nova-compute[72129]:   <source dev="/dev/sdc"/>
Aug 01 14:22:53 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 14:22:53 user nova-compute[72129]:   <serial>73aeb9f7-1b79-480f-934e-4558107b307a</serial>
Aug 01 14:22:53 user nova-compute[72129]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 14:22:53 user nova-compute[72129]: </disk>
Aug 01 14:22:53 user nova-compute[72129]:  {{(pid=72129) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 14:22:53 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Received event <DeviceRemovedEvent: 1690899773.844382, 6281d027-b30b-413d-b86e-e612a5a6d14d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72129) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 14:22:53 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-027ce0a1-13e1-4d45-a09b-8e468025f0ca tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6281d027-b30b-413d-b86e-e612a5a6d14d {{(pid=72129) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 14:22:53 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-027ce0a1-13e1-4d45-a09b-8e468025f0ca tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Successfully detached device vdb from instance 6281d027-b30b-413d-b86e-e612a5a6d14d from the live domain config.
Aug 01 14:22:53 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-027ce0a1-13e1-4d45-a09b-8e468025f0ca tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] calling os-brick to detach iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 14:22:53 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-027ce0a1-13e1-4d45-a09b-8e468025f0ca tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, {'target_iqns': ['iqn.2010-10.org.openstack:73aeb9f7-1b79-480f-934e-4558107b307a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xeOUbnXC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:22:53 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-027ce0a1-13e1-4d45-a09b-8e468025f0ca tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:22:53 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-027ce0a1-13e1-4d45-a09b-8e468025f0ca tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:22:53 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-027ce0a1-13e1-4d45-a09b-8e468025f0ca tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:22:53 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-027ce0a1-13e1-4d45-a09b-8e468025f0ca tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73aeb9f7-1b79-480f-934e-4558107b307a', 0)] {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 14:22:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:22:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:22:53 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f20a12-573e-405d-8cff-0a99d1380a8b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73aeb9f7-1b79-480f-934e-4558107b307a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b0efb0d-72a6-46eb-a62b-5dc14973d945\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:22:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:22:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:22:53 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b381991a-d467-42f2-9328-771ba0713e71]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b0efb0d-72a6-46eb-a62b-5dc14973d945 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73aeb9f7-1b79-480f-934e-4558107b307a (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:22:53 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-027ce0a1-13e1-4d45-a09b-8e468025f0ca tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b0efb0d-72a6-46eb-a62b-5dc14973d945 (non-flash)
Aug 01 14:22:53 user nova-compute[72129]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73aeb9f7-1b79-480f-934e-4558107b307a (non-flash)
Aug 01 14:22:53 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:22:53 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-027ce0a1-13e1-4d45-a09b-8e468025f0ca tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b0efb0d-72a6-46eb-a62b-5dc14973d945 (non-flash)
Aug 01 14:22:53 user nova-compute[72129]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73aeb9f7-1b79-480f-934e-4558107b307a (non-flash)
Aug 01 14:22:53 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:22:53 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-027ce0a1-13e1-4d45-a09b-8e468025f0ca tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f28102b6dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73aeb9f7-1b79-480f-934e-4558107b307a'): ({'sdc'}, set())}) {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 14:22:53 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-027ce0a1-13e1-4d45-a09b-8e468025f0ca tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Removing single pathed devices sdc {{(pid=72129) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 14:22:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:22:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:22:53 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd86b7a-af48-470e-ba42-b3bb35c72c79]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:22:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:22:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:22:53 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9162db-dec5-4b02-a7db-d70cdd96dd3b]: (4, ('ok\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:22:53 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-027ce0a1-13e1-4d45-a09b-8e468025f0ca tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Flushing IO for device /dev/sdc {{(pid=72129) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 14:22:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:22:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:22:53 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a9b362-83d3-493f-952c-d5b7b3d0116b]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:22:53 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-027ce0a1-13e1-4d45-a09b-8e468025f0ca tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72129) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 14:22:53 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:22:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:22:54 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59f0641-2375-4bea-ac83-a85d1c51a38d]: (4, ('1', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:22:54 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-027ce0a1-13e1-4d45-a09b-8e468025f0ca tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 14:22:54 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-027ce0a1-13e1-4d45-a09b-8e468025f0ca tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] SCSI volumes sdc have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 14:22:54 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-027ce0a1-13e1-4d45-a09b-8e468025f0ca tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73aeb9f7-1b79-480f-934e-4558107b307a')] {{(pid=72129) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 14:22:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73aeb9f7-1b79-480f-934e-4558107b307a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:22:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73aeb9f7-1b79-480f-934e-4558107b307a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:22:54 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[5401d474-445c-4c61-812f-49dd6bf731b1]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:22:54 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-027ce0a1-13e1-4d45-a09b-8e468025f0ca tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:22:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73aeb9f7-1b79-480f-934e-4558107b307a -p 172.16.0.220:3260 --logout {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:22:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73aeb9f7-1b79-480f-934e-4558107b307a -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:22:54 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfadf3ac-3e6c-4b50-94c4-8d4261a7a8fe]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:73aeb9f7-1b79-480f-934e-4558107b307a, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:73aeb9f7-1b79-480f-934e-4558107b307a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:22:54 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-027ce0a1-13e1-4d45-a09b-8e468025f0ca tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:73aeb9f7-1b79-480f-934e-4558107b307a, portal: 172.16.0.220,3260]
Aug 01 14:22:54 user nova-compute[72129]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:73aeb9f7-1b79-480f-934e-4558107b307a, portal: 172.16.0.220,3260] successful.
Aug 01 14:22:54 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:22:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73aeb9f7-1b79-480f-934e-4558107b307a -p 172.16.0.220:3260 --op delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:22:54 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73aeb9f7-1b79-480f-934e-4558107b307a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:22:54 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9f5c1c-8213-49c1-b8c1-ffecf72fc349]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:22:54 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-027ce0a1-13e1-4d45-a09b-8e468025f0ca tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:22:54 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-027ce0a1-13e1-4d45-a09b-8e468025f0ca tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:22:54 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-027ce0a1-13e1-4d45-a09b-8e468025f0ca tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] <== disconnect_volume: return (282ms) None {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:22:54 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-027ce0a1-13e1-4d45-a09b-8e468025f0ca tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] Disconnected iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 14:22:54 user nova-compute[72129]: DEBUG nova.objects.instance [None req-027ce0a1-13e1-4d45-a09b-8e468025f0ca tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lazy-loading 'flavor' on Instance uuid 6281d027-b30b-413d-b86e-e612a5a6d14d {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:22:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-027ce0a1-13e1-4d45-a09b-8e468025f0ca tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "6281d027-b30b-413d-b86e-e612a5a6d14d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.616s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:22:56 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:22:56 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:22:56 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72129) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 14:22:56 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:22:56 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:22:56 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:22:56 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:23:01 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:23:05 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:23:05 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Starting heal instance info cache {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 14:23:05 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "refresh_cache-9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:23:05 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquired lock "refresh_cache-9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:23:05 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Forcefully refreshing network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 14:23:05 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Updating instance_info_cache with network_info: [{"id": "d9687bd9-62f9-4b39-8c41-7b3c32127a71", "address": "fa:16:3e:b8:e3:cc", "network": {"id": "814dffe9-8861-4a81-bf68-d86f2a4b4faf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1760326136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d203d0ad6e3c4379ae26ad8fb44f877d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9687bd9-62", "ovs_interfaceid": "d9687bd9-62f9-4b39-8c41-7b3c32127a71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:23:05 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Releasing lock "refresh_cache-9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:23:05 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Updated the network info_cache for instance {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 14:23:05 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:23:05 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:23:05 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72129) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 14:23:06 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:23:06 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:23:06 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:23:06 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:23:06 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:23:06 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Auditing locally available compute resources for user (node: user) {{(pid=72129) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 14:23:06 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:23:06 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:23:06 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72129) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 14:23:06 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:23:06 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:23:06 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:23:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:23:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:23:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:23:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:23:06 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 14:23:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6281d027-b30b-413d-b86e-e612a5a6d14d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:23:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6281d027-b30b-413d-b86e-e612a5a6d14d/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:23:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6281d027-b30b-413d-b86e-e612a5a6d14d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:23:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6281d027-b30b-413d-b86e-e612a5a6d14d/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:23:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:23:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:23:06 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:23:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:23:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk.rescue --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:23:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:23:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk.rescue --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:23:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:23:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:23:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:23:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:23:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:23:08 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:23:08 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:23:08 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Hypervisor/Node resource view: name=user free_ram=8528MB free_disk=25.11547088623047GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72129) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 14:23:08 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:23:08 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:23:08 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance b3f54430-8d5d-478b-8dc7-d7592ee3db36 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:23:08 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:23:08 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:23:08 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 6281d027-b30b-413d-b86e-e612a5a6d14d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:23:08 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 14:23:08 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 14:23:08 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:23:08 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:23:08 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Compute_service record updated for user:user {{(pid=72129) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 14:23:08 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.290s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:23:09 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:23:09 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:23:10 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:23:10 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-f896d2cc-bcd4-4eed-beff-5bd05379f6a2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Acquiring lock "9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:23:10 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-f896d2cc-bcd4-4eed-beff-5bd05379f6a2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Lock "9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:23:10 user nova-compute[72129]: INFO nova.compute.manager [None req-f896d2cc-bcd4-4eed-beff-5bd05379f6a2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Detaching volume 9b0efb0d-72a6-46eb-a62b-5dc14973d945
Aug 01 14:23:10 user nova-compute[72129]: INFO nova.virt.block_device [None req-f896d2cc-bcd4-4eed-beff-5bd05379f6a2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Attempting to driver detach volume 9b0efb0d-72a6-46eb-a62b-5dc14973d945 from mountpoint /dev/vdb
Aug 01 14:23:10 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-f896d2cc-bcd4-4eed-beff-5bd05379f6a2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Attempting to detach device vdb from instance 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60 from the persistent domain config. {{(pid=72129) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 14:23:10 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-f896d2cc-bcd4-4eed-beff-5bd05379f6a2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 14:23:10 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:23:10 user nova-compute[72129]:   <source dev="/dev/sdb"/>
Aug 01 14:23:10 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 14:23:10 user nova-compute[72129]:   <serial>9b0efb0d-72a6-46eb-a62b-5dc14973d945</serial>
Aug 01 14:23:10 user nova-compute[72129]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 14:23:10 user nova-compute[72129]: </disk>
Aug 01 14:23:10 user nova-compute[72129]:  {{(pid=72129) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 14:23:10 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-f896d2cc-bcd4-4eed-beff-5bd05379f6a2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Successfully detached device vdb from instance 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60 from the persistent domain config.
Aug 01 14:23:10 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-f896d2cc-bcd4-4eed-beff-5bd05379f6a2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60 from the live domain config. {{(pid=72129) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 14:23:10 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-f896d2cc-bcd4-4eed-beff-5bd05379f6a2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 14:23:10 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:23:10 user nova-compute[72129]:   <source dev="/dev/sdb"/>
Aug 01 14:23:10 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 14:23:10 user nova-compute[72129]:   <serial>9b0efb0d-72a6-46eb-a62b-5dc14973d945</serial>
Aug 01 14:23:10 user nova-compute[72129]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 14:23:10 user nova-compute[72129]: </disk>
Aug 01 14:23:10 user nova-compute[72129]:  {{(pid=72129) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 14:23:10 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d39a71e2-66c5-447f-9d3a-5c87975f35e2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Acquiring lock "9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:23:11 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:23:11 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Received event <DeviceRemovedEvent: 1690899791.4225736, 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72129) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 14:23:11 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-f896d2cc-bcd4-4eed-beff-5bd05379f6a2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60 {{(pid=72129) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 14:23:11 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-f896d2cc-bcd4-4eed-beff-5bd05379f6a2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Successfully detached device vdb from instance 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60 from the live domain config.
Aug 01 14:23:11 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f896d2cc-bcd4-4eed-beff-5bd05379f6a2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] calling os-brick to detach iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 14:23:11 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-f896d2cc-bcd4-4eed-beff-5bd05379f6a2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, {'target_iqns': ['iqn.2010-10.org.openstack:9b0efb0d-72a6-46eb-a62b-5dc14973d945'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'edvzIBqX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:23:11 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-f896d2cc-bcd4-4eed-beff-5bd05379f6a2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:23:11 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-f896d2cc-bcd4-4eed-beff-5bd05379f6a2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:23:11 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-f896d2cc-bcd4-4eed-beff-5bd05379f6a2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:23:11 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-f896d2cc-bcd4-4eed-beff-5bd05379f6a2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b0efb0d-72a6-46eb-a62b-5dc14973d945', 0)] {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 14:23:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:23:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:23:11 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a76f372-7771-4e76-a9c1-f6c61e77f46c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b0efb0d-72a6-46eb-a62b-5dc14973d945\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:23:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:23:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:23:11 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cddd2c3-8cc9-4a3b-8f51-4931dbb276f7]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b0efb0d-72a6-46eb-a62b-5dc14973d945 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:23:11 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-f896d2cc-bcd4-4eed-beff-5bd05379f6a2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b0efb0d-72a6-46eb-a62b-5dc14973d945 (non-flash)
Aug 01 14:23:11 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:23:11 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-f896d2cc-bcd4-4eed-beff-5bd05379f6a2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b0efb0d-72a6-46eb-a62b-5dc14973d945 (non-flash)
Aug 01 14:23:11 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:23:11 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-f896d2cc-bcd4-4eed-beff-5bd05379f6a2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f282e1364d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b0efb0d-72a6-46eb-a62b-5dc14973d945'): ({'sdb'}, set())}) {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 14:23:11 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-f896d2cc-bcd4-4eed-beff-5bd05379f6a2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Removing single pathed devices sdb {{(pid=72129) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 14:23:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:23:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:23:11 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b92ea42-a817-484c-9686-f623f20cf8e8]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:23:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:23:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:23:11 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab170e6-c930-40e4-9c36-9d9509ac17d8]: (4, ('ok\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:23:11 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-f896d2cc-bcd4-4eed-beff-5bd05379f6a2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Flushing IO for device /dev/sdb {{(pid=72129) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 14:23:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:23:11 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:23:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:23:11 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[83fe7c75-6813-4030-850b-d2ed4fd99bb9]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:23:11 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-f896d2cc-bcd4-4eed-beff-5bd05379f6a2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72129) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 14:23:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:23:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:23:11 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[7547fa6f-1e53-4eb0-ab44-6cacc00e46c6]: (4, ('1', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:23:11 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-f896d2cc-bcd4-4eed-beff-5bd05379f6a2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 14:23:11 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-f896d2cc-bcd4-4eed-beff-5bd05379f6a2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] SCSI volumes sdb have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 14:23:11 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-f896d2cc-bcd4-4eed-beff-5bd05379f6a2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b0efb0d-72a6-46eb-a62b-5dc14973d945')] {{(pid=72129) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 14:23:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b0efb0d-72a6-46eb-a62b-5dc14973d945 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:23:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b0efb0d-72a6-46eb-a62b-5dc14973d945 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:23:11 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef85769d-7bd5-400a-b56d-5db4e082b81a]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:23:11 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-f896d2cc-bcd4-4eed-beff-5bd05379f6a2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:23:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b0efb0d-72a6-46eb-a62b-5dc14973d945 -p 172.16.0.220:3260 --logout {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:23:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b0efb0d-72a6-46eb-a62b-5dc14973d945 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:23:11 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa1f93ea-67ec-4418-bae6-d50bfba23c81]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:9b0efb0d-72a6-46eb-a62b-5dc14973d945, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:9b0efb0d-72a6-46eb-a62b-5dc14973d945, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:23:11 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-f896d2cc-bcd4-4eed-beff-5bd05379f6a2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:9b0efb0d-72a6-46eb-a62b-5dc14973d945, portal: 172.16.0.220,3260]
Aug 01 14:23:11 user nova-compute[72129]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:9b0efb0d-72a6-46eb-a62b-5dc14973d945, portal: 172.16.0.220,3260] successful.
Aug 01 14:23:11 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:23:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b0efb0d-72a6-46eb-a62b-5dc14973d945 -p 172.16.0.220:3260 --op delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:23:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b0efb0d-72a6-46eb-a62b-5dc14973d945 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:23:11 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef0977d-6e79-42ab-a309-de68fa0387c0]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:23:11 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-f896d2cc-bcd4-4eed-beff-5bd05379f6a2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:23:11 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-f896d2cc-bcd4-4eed-beff-5bd05379f6a2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:23:11 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-f896d2cc-bcd4-4eed-beff-5bd05379f6a2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] <== disconnect_volume: return (283ms) None {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:23:11 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f896d2cc-bcd4-4eed-beff-5bd05379f6a2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Disconnected iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 14:23:12 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:23:12 user nova-compute[72129]: DEBUG nova.objects.instance [None req-f896d2cc-bcd4-4eed-beff-5bd05379f6a2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Lazy-loading 'flavor' on Instance uuid 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:23:12 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-f896d2cc-bcd4-4eed-beff-5bd05379f6a2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Lock "9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.636s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:23:12 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d39a71e2-66c5-447f-9d3a-5c87975f35e2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Lock "9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.490s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:23:12 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d39a71e2-66c5-447f-9d3a-5c87975f35e2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Acquiring lock "9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:23:12 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d39a71e2-66c5-447f-9d3a-5c87975f35e2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Lock "9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:23:12 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d39a71e2-66c5-447f-9d3a-5c87975f35e2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Lock "9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:23:12 user nova-compute[72129]: INFO nova.compute.manager [None req-d39a71e2-66c5-447f-9d3a-5c87975f35e2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Terminating instance
Aug 01 14:23:12 user nova-compute[72129]: DEBUG nova.compute.manager [None req-d39a71e2-66c5-447f-9d3a-5c87975f35e2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Start destroying the instance on the hypervisor. {{(pid=72129) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 14:23:12 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:23:12 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:23:12 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:23:12 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:23:12 user nova-compute[72129]: DEBUG nova.compute.manager [req-29b1cf81-c460-4c87-ac7d-393eaa576926 req-99eed514-445e-45c6-b8e4-9bf0e8ff5a7e service nova] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Received event network-vif-unplugged-d9687bd9-62f9-4b39-8c41-7b3c32127a71 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:23:12 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-29b1cf81-c460-4c87-ac7d-393eaa576926 req-99eed514-445e-45c6-b8e4-9bf0e8ff5a7e service nova] Acquiring lock "9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:23:12 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-29b1cf81-c460-4c87-ac7d-393eaa576926 req-99eed514-445e-45c6-b8e4-9bf0e8ff5a7e service nova] Lock "9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:23:12 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-29b1cf81-c460-4c87-ac7d-393eaa576926 req-99eed514-445e-45c6-b8e4-9bf0e8ff5a7e service nova] Lock "9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:23:12 user nova-compute[72129]: DEBUG nova.compute.manager [req-29b1cf81-c460-4c87-ac7d-393eaa576926 req-99eed514-445e-45c6-b8e4-9bf0e8ff5a7e service nova] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] No waiting events found dispatching network-vif-unplugged-d9687bd9-62f9-4b39-8c41-7b3c32127a71 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:23:12 user nova-compute[72129]: DEBUG nova.compute.manager [req-29b1cf81-c460-4c87-ac7d-393eaa576926 req-99eed514-445e-45c6-b8e4-9bf0e8ff5a7e service nova] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Received event network-vif-unplugged-d9687bd9-62f9-4b39-8c41-7b3c32127a71 for instance with task_state deleting. {{(pid=72129) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 14:23:13 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:23:13 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Instance destroyed successfully.
Aug 01 14:23:13 user nova-compute[72129]: DEBUG nova.objects.instance [None req-d39a71e2-66c5-447f-9d3a-5c87975f35e2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Lazy-loading 'resources' on Instance uuid 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:23:13 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-d39a71e2-66c5-447f-9d3a-5c87975f35e2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:20:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-470151363',display_name='tempest-VolumesSnapshotTestJSON-instance-470151363',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-470151363',id=45,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBONwHem2VDw1oPfsQ/OLZop1uHEnjY4m+Ep1+mdxDnhU2VVWfQLln5QRo62XXRLOo34qsN8NjQ9If7JfJeCvQ4NTu5+Z/id01C5rchoHiMWJq/GRZ7BqH1LSVS89PpZujA==',key_name='tempest-keypair-1765059854',keypairs=<?>,launch_index=0,launched_at=2023-08-01T14:20:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d203d0ad6e3c4379ae26ad8fb44f877d',ramdisk_id='',reservation_id='r-lc8j7srf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-171675326',owner_user_name='tempest-VolumesSnapshotTestJSON-171675326-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T14:20:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cab6f7398341468dbd829d828b3a7b8c',uuid=9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d9687bd9-62f9-4b39-8c41-7b3c32127a71", "address": "fa:16:3e:b8:e3:cc", "network": {"id": "814dffe9-8861-4a81-bf68-d86f2a4b4faf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1760326136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d203d0ad6e3c4379ae26ad8fb44f877d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9687bd9-62", "ovs_interfaceid": "d9687bd9-62f9-4b39-8c41-7b3c32127a71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 14:23:13 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-d39a71e2-66c5-447f-9d3a-5c87975f35e2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Converting VIF {"id": "d9687bd9-62f9-4b39-8c41-7b3c32127a71", "address": "fa:16:3e:b8:e3:cc", "network": {"id": "814dffe9-8861-4a81-bf68-d86f2a4b4faf", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1760326136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d203d0ad6e3c4379ae26ad8fb44f877d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9687bd9-62", "ovs_interfaceid": "d9687bd9-62f9-4b39-8c41-7b3c32127a71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:23:13 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-d39a71e2-66c5-447f-9d3a-5c87975f35e2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b8:e3:cc,bridge_name='br-int',has_traffic_filtering=True,id=d9687bd9-62f9-4b39-8c41-7b3c32127a71,network=Network(814dffe9-8861-4a81-bf68-d86f2a4b4faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9687bd9-62') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:23:13 user nova-compute[72129]: DEBUG os_vif [None req-d39a71e2-66c5-447f-9d3a-5c87975f35e2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:e3:cc,bridge_name='br-int',has_traffic_filtering=True,id=d9687bd9-62f9-4b39-8c41-7b3c32127a71,network=Network(814dffe9-8861-4a81-bf68-d86f2a4b4faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9687bd9-62') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 14:23:13 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:23:13 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd9687bd9-62, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:23:13 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:23:13 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:23:13 user nova-compute[72129]: INFO os_vif [None req-d39a71e2-66c5-447f-9d3a-5c87975f35e2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:e3:cc,bridge_name='br-int',has_traffic_filtering=True,id=d9687bd9-62f9-4b39-8c41-7b3c32127a71,network=Network(814dffe9-8861-4a81-bf68-d86f2a4b4faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9687bd9-62')
Aug 01 14:23:13 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d39a71e2-66c5-447f-9d3a-5c87975f35e2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] calling os-brick to detach iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 14:23:13 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39a71e2-66c5-447f-9d3a-5c87975f35e2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, {'target_iqns': ['iqn.2010-10.org.openstack:9b0efb0d-72a6-46eb-a62b-5dc14973d945'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'edvzIBqX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:23:13 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-d39a71e2-66c5-447f-9d3a-5c87975f35e2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:23:13 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-d39a71e2-66c5-447f-9d3a-5c87975f35e2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:23:13 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-d39a71e2-66c5-447f-9d3a-5c87975f35e2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:23:13 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39a71e2-66c5-447f-9d3a-5c87975f35e2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b0efb0d-72a6-46eb-a62b-5dc14973d945', 0)] {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 14:23:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:23:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 21 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:23:13 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2ed35a-cb72-4ed6-a709-86f3566a89f1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:23:13 user nova-compute[72129]: WARNING os_brick.initiator.connectors.iscsi [None req-d39a71e2-66c5-447f-9d3a-5c87975f35e2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Couldn't find iSCSI nodes because iscsiadm err: iscsiadm: No records found
Aug 01 14:23:13 user nova-compute[72129]: 
Aug 01 14:23:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:23:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:23:13 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0edac4b-070f-404b-87a3-455e914c983a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:23:13 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39a71e2-66c5-447f-9d3a-5c87975f35e2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 14:23:13 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:23:13 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39a71e2-66c5-447f-9d3a-5c87975f35e2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 14:23:13 user nova-compute[72129]:  {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:23:13 user nova-compute[72129]: WARNING os_brick.initiator.connectors.iscsi [None req-d39a71e2-66c5-447f-9d3a-5c87975f35e2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 14:23:13 user nova-compute[72129]: 
Aug 01 14:23:13 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39a71e2-66c5-447f-9d3a-5c87975f35e2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f28105bae60>, {}) {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 14:23:13 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39a71e2-66c5-447f-9d3a-5c87975f35e2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Disconnecting from: [] {{(pid=72129) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 14:23:13 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-d39a71e2-66c5-447f-9d3a-5c87975f35e2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.047s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:23:13 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39a71e2-66c5-447f-9d3a-5c87975f35e2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] <== disconnect_volume: return (48ms) None {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:23:13 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d39a71e2-66c5-447f-9d3a-5c87975f35e2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Disconnected iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 14:23:13 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-d39a71e2-66c5-447f-9d3a-5c87975f35e2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Deleting instance files /opt/stack/data/nova/instances/9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60_del
Aug 01 14:23:13 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-d39a71e2-66c5-447f-9d3a-5c87975f35e2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Deletion of /opt/stack/data/nova/instances/9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60_del complete
Aug 01 14:23:13 user nova-compute[72129]: INFO nova.compute.manager [None req-d39a71e2-66c5-447f-9d3a-5c87975f35e2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 01 14:23:13 user nova-compute[72129]: DEBUG oslo.service.loopingcall [None req-d39a71e2-66c5-447f-9d3a-5c87975f35e2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72129) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 14:23:13 user nova-compute[72129]: DEBUG nova.compute.manager [-] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Deallocating network for instance {{(pid=72129) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 14:23:13 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] deallocate_for_instance() {{(pid=72129) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 14:23:14 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:23:14 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Took 0.82 seconds to deallocate network for instance.
Aug 01 14:23:14 user nova-compute[72129]: DEBUG nova.compute.manager [req-3ae95c07-62e8-47f1-8529-0b411e5e09c8 req-51bda36d-6c61-4191-879d-f25422e9aef2 service nova] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Received event network-vif-deleted-d9687bd9-62f9-4b39-8c41-7b3c32127a71 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:23:14 user nova-compute[72129]: WARNING nova.volume.cinder [None req-d39a71e2-66c5-447f-9d3a-5c87975f35e2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Attachment c90e33cc-4a25-4cce-a587-43eadb7e5bfe does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = c90e33cc-4a25-4cce-a587-43eadb7e5bfe. (HTTP 404) (Request-ID: req-94562cf7-5019-43ff-8174-c7ef2d1311b2)
Aug 01 14:23:14 user nova-compute[72129]: INFO nova.compute.manager [None req-d39a71e2-66c5-447f-9d3a-5c87975f35e2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Took 0.02 seconds to detach 1 volumes for instance.
Aug 01 14:23:14 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d39a71e2-66c5-447f-9d3a-5c87975f35e2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:23:14 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d39a71e2-66c5-447f-9d3a-5c87975f35e2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:23:14 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-d39a71e2-66c5-447f-9d3a-5c87975f35e2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:23:14 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-d39a71e2-66c5-447f-9d3a-5c87975f35e2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:23:14 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d39a71e2-66c5-447f-9d3a-5c87975f35e2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.181s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:23:14 user nova-compute[72129]: INFO nova.scheduler.client.report [None req-d39a71e2-66c5-447f-9d3a-5c87975f35e2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Deleted allocations for instance 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60
Aug 01 14:23:14 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d39a71e2-66c5-447f-9d3a-5c87975f35e2 tempest-VolumesSnapshotTestJSON-171675326 tempest-VolumesSnapshotTestJSON-171675326-project-member] Lock "9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.136s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:23:14 user nova-compute[72129]: DEBUG nova.compute.manager [req-e5830061-bd14-4caa-89cf-59a65035222d req-9d7dd845-efca-400e-9dc0-02ed82a7c0e7 service nova] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Received event network-vif-plugged-d9687bd9-62f9-4b39-8c41-7b3c32127a71 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:23:14 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-e5830061-bd14-4caa-89cf-59a65035222d req-9d7dd845-efca-400e-9dc0-02ed82a7c0e7 service nova] Acquiring lock "9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:23:14 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-e5830061-bd14-4caa-89cf-59a65035222d req-9d7dd845-efca-400e-9dc0-02ed82a7c0e7 service nova] Lock "9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:23:14 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-e5830061-bd14-4caa-89cf-59a65035222d req-9d7dd845-efca-400e-9dc0-02ed82a7c0e7 service nova] Lock "9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:23:14 user nova-compute[72129]: DEBUG nova.compute.manager [req-e5830061-bd14-4caa-89cf-59a65035222d req-9d7dd845-efca-400e-9dc0-02ed82a7c0e7 service nova] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] No waiting events found dispatching network-vif-plugged-d9687bd9-62f9-4b39-8c41-7b3c32127a71 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:23:14 user nova-compute[72129]: WARNING nova.compute.manager [req-e5830061-bd14-4caa-89cf-59a65035222d req-9d7dd845-efca-400e-9dc0-02ed82a7c0e7 service nova] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Received unexpected event network-vif-plugged-d9687bd9-62f9-4b39-8c41-7b3c32127a71 for instance with vm_state deleted and task_state None.
Aug 01 14:23:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Acquiring lock "5e602ce0-ffe8-4737-86cb-5caee367f2b4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:23:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lock "5e602ce0-ffe8-4737-86cb-5caee367f2b4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:23:15 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Starting instance... {{(pid=72129) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 14:23:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:23:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:23:15 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72129) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 14:23:15 user nova-compute[72129]: INFO nova.compute.claims [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Claim successful on node user
Aug 01 14:23:16 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:23:16 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:23:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.454s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:23:16 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Start building networks asynchronously for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 14:23:16 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Allocating IP information in the background. {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 14:23:16 user nova-compute[72129]: DEBUG nova.network.neutron [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] allocate_for_instance() {{(pid=72129) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 14:23:16 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 14:23:16 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Start building block device mappings for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 14:23:16 user nova-compute[72129]: DEBUG nova.policy [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'deb1597afdc647598ee893dd51880173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42cca3e17d4e4df79c94c4b94fb3fcec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72129) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 14:23:16 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Start spawning the instance on the hypervisor. {{(pid=72129) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 14:23:16 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Creating instance directory {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 14:23:16 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Creating image(s)
Aug 01 14:23:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Acquiring lock "/opt/stack/data/nova/instances/5e602ce0-ffe8-4737-86cb-5caee367f2b4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:23:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lock "/opt/stack/data/nova/instances/5e602ce0-ffe8-4737-86cb-5caee367f2b4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:23:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lock "/opt/stack/data/nova/instances/5e602ce0-ffe8-4737-86cb-5caee367f2b4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:23:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:23:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.144s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:23:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Acquiring lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:23:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:23:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:23:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.136s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:23:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/5e602ce0-ffe8-4737-86cb-5caee367f2b4/disk 1073741824 {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:23:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/5e602ce0-ffe8-4737-86cb-5caee367f2b4/disk 1073741824" returned: 0 in 0.046s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:23:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.189s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:23:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:23:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.135s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:23:16 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5e602ce0-ffe8-4737-86cb-5caee367f2b4/disk. size=1073741824 {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 14:23:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e602ce0-ffe8-4737-86cb-5caee367f2b4/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:23:16 user nova-compute[72129]: DEBUG nova.network.neutron [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Successfully created port: 7cc66f81-8cb9-416d-b9c3-03451989c713 {{(pid=72129) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 14:23:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e602ce0-ffe8-4737-86cb-5caee367f2b4/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:23:17 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Cannot resize image /opt/stack/data/nova/instances/5e602ce0-ffe8-4737-86cb-5caee367f2b4/disk to a smaller size. {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 14:23:17 user nova-compute[72129]: DEBUG nova.objects.instance [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lazy-loading 'migration_context' on Instance uuid 5e602ce0-ffe8-4737-86cb-5caee367f2b4 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:23:17 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Created local disks {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 14:23:17 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Ensure instance console log exists: /opt/stack/data/nova/instances/5e602ce0-ffe8-4737-86cb-5caee367f2b4/console.log {{(pid=72129) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 14:23:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:23:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:23:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:23:17 user nova-compute[72129]: DEBUG nova.network.neutron [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Successfully updated port: 7cc66f81-8cb9-416d-b9c3-03451989c713 {{(pid=72129) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 14:23:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Acquiring lock "refresh_cache-5e602ce0-ffe8-4737-86cb-5caee367f2b4" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:23:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Acquired lock "refresh_cache-5e602ce0-ffe8-4737-86cb-5caee367f2b4" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:23:17 user nova-compute[72129]: DEBUG nova.network.neutron [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 14:23:17 user nova-compute[72129]: DEBUG nova.compute.manager [req-c5a387b6-b657-4dbd-9ca1-9ca2cb417400 req-6c856f91-5dee-47ac-802e-4e54a787c644 service nova] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Received event network-changed-7cc66f81-8cb9-416d-b9c3-03451989c713 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:23:17 user nova-compute[72129]: DEBUG nova.compute.manager [req-c5a387b6-b657-4dbd-9ca1-9ca2cb417400 req-6c856f91-5dee-47ac-802e-4e54a787c644 service nova] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Refreshing instance network info cache due to event network-changed-7cc66f81-8cb9-416d-b9c3-03451989c713. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 14:23:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-c5a387b6-b657-4dbd-9ca1-9ca2cb417400 req-6c856f91-5dee-47ac-802e-4e54a787c644 service nova] Acquiring lock "refresh_cache-5e602ce0-ffe8-4737-86cb-5caee367f2b4" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:23:17 user nova-compute[72129]: DEBUG nova.network.neutron [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Instance cache missing network info. {{(pid=72129) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 14:23:18 user nova-compute[72129]: DEBUG nova.network.neutron [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Updating instance_info_cache with network_info: [{"id": "7cc66f81-8cb9-416d-b9c3-03451989c713", "address": "fa:16:3e:f6:cb:d3", "network": {"id": "6ffcec16-7b44-472a-b7cd-af16ebd4a653", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-901464581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cca3e17d4e4df79c94c4b94fb3fcec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc66f81-8c", "ovs_interfaceid": "7cc66f81-8cb9-416d-b9c3-03451989c713", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:23:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Releasing lock "refresh_cache-5e602ce0-ffe8-4737-86cb-5caee367f2b4" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:23:18 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Instance network_info: |[{"id": "7cc66f81-8cb9-416d-b9c3-03451989c713", "address": "fa:16:3e:f6:cb:d3", "network": {"id": "6ffcec16-7b44-472a-b7cd-af16ebd4a653", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-901464581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cca3e17d4e4df79c94c4b94fb3fcec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc66f81-8c", "ovs_interfaceid": "7cc66f81-8cb9-416d-b9c3-03451989c713", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 14:23:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-c5a387b6-b657-4dbd-9ca1-9ca2cb417400 req-6c856f91-5dee-47ac-802e-4e54a787c644 service nova] Acquired lock "refresh_cache-5e602ce0-ffe8-4737-86cb-5caee367f2b4" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:23:18 user nova-compute[72129]: DEBUG nova.network.neutron [req-c5a387b6-b657-4dbd-9ca1-9ca2cb417400 req-6c856f91-5dee-47ac-802e-4e54a787c644 service nova] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Refreshing network info cache for port 7cc66f81-8cb9-416d-b9c3-03451989c713 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 14:23:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Start _get_guest_xml network_info=[{"id": "7cc66f81-8cb9-416d-b9c3-03451989c713", "address": "fa:16:3e:f6:cb:d3", "network": {"id": "6ffcec16-7b44-472a-b7cd-af16ebd4a653", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-901464581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cca3e17d4e4df79c94c4b94fb3fcec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc66f81-8c", "ovs_interfaceid": "7cc66f81-8cb9-416d-b9c3-03451989c713", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'image_id': 'b6472c34-1b0f-4034-ba3a-7e8eb5103715'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 14:23:18 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:23:18 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:23:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 14:23:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] CPU controller missing on host. {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 14:23:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 14:23:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] CPU controller found on host. {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 14:23:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72129) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 14:23:18 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T13:45:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 14:23:18 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Flavor limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 14:23:18 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Image limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 14:23:18 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Flavor pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 14:23:18 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Image pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 14:23:18 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 14:23:18 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 14:23:18 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 14:23:18 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Got 1 possible topologies {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 14:23:18 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 14:23:18 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 14:23:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:23:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1551117721',display_name='tempest-ServerRescueNegativeTestJSON-server-1551117721',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1551117721',id=47,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDeGC2OYrAuhdtsQ12w8hkrsQ4BStQKdcxMAGWGF9i5CEavjy55aog2hOysoEWEG4SBA9Pa0TYoxd11hOhqvXgl0N1sUSAtZyoNVLM//3QjvgWjRgJBjm0nAZ0L+/1WReA==',key_name='tempest-keypair-592319693',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42cca3e17d4e4df79c94c4b94fb3fcec',ramdisk_id='',reservation_id='r-mfltbgi9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-481576424',owner_user_name='tempest-ServerRescueNegativeTestJSON-481576424-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T14:23:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='deb1597afdc647598ee893dd51880173',uuid=5e602ce0-ffe8-4737-86cb-5caee367f2b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7cc66f81-8cb9-416d-b9c3-03451989c713", "address": "fa:16:3e:f6:cb:d3", "network": {"id": "6ffcec16-7b44-472a-b7cd-af16ebd4a653", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-901464581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cca3e17d4e4df79c94c4b94fb3fcec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc66f81-8c", "ovs_interfaceid": "7cc66f81-8cb9-416d-b9c3-03451989c713", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 14:23:18 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Converting VIF {"id": "7cc66f81-8cb9-416d-b9c3-03451989c713", "address": "fa:16:3e:f6:cb:d3", "network": {"id": "6ffcec16-7b44-472a-b7cd-af16ebd4a653", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-901464581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cca3e17d4e4df79c94c4b94fb3fcec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc66f81-8c", "ovs_interfaceid": "7cc66f81-8cb9-416d-b9c3-03451989c713", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:23:18 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:cb:d3,bridge_name='br-int',has_traffic_filtering=True,id=7cc66f81-8cb9-416d-b9c3-03451989c713,network=Network(6ffcec16-7b44-472a-b7cd-af16ebd4a653),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cc66f81-8c') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:23:18 user nova-compute[72129]: DEBUG nova.objects.instance [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lazy-loading 'pci_devices' on Instance uuid 5e602ce0-ffe8-4737-86cb-5caee367f2b4 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:23:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] End _get_guest_xml xml=<domain type="kvm">
Aug 01 14:23:18 user nova-compute[72129]:   <uuid>5e602ce0-ffe8-4737-86cb-5caee367f2b4</uuid>
Aug 01 14:23:18 user nova-compute[72129]:   <name>instance-0000002f</name>
Aug 01 14:23:18 user nova-compute[72129]:   <memory>524288</memory>
Aug 01 14:23:18 user nova-compute[72129]:   <vcpu>1</vcpu>
Aug 01 14:23:18 user nova-compute[72129]:   <metadata>
Aug 01 14:23:18 user nova-compute[72129]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 14:23:18 user nova-compute[72129]:       <nova:package version="0.0.0"/>
Aug 01 14:23:18 user nova-compute[72129]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1551117721</nova:name>
Aug 01 14:23:18 user nova-compute[72129]:       <nova:creationTime>2023-08-01 14:23:18</nova:creationTime>
Aug 01 14:23:18 user nova-compute[72129]:       <nova:flavor name="m1.tiny">
Aug 01 14:23:18 user nova-compute[72129]:         <nova:memory>512</nova:memory>
Aug 01 14:23:18 user nova-compute[72129]:         <nova:disk>1</nova:disk>
Aug 01 14:23:18 user nova-compute[72129]:         <nova:swap>0</nova:swap>
Aug 01 14:23:18 user nova-compute[72129]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 14:23:18 user nova-compute[72129]:         <nova:vcpus>1</nova:vcpus>
Aug 01 14:23:18 user nova-compute[72129]:       </nova:flavor>
Aug 01 14:23:18 user nova-compute[72129]:       <nova:owner>
Aug 01 14:23:18 user nova-compute[72129]:         <nova:user uuid="deb1597afdc647598ee893dd51880173">tempest-ServerRescueNegativeTestJSON-481576424-project-member</nova:user>
Aug 01 14:23:18 user nova-compute[72129]:         <nova:project uuid="42cca3e17d4e4df79c94c4b94fb3fcec">tempest-ServerRescueNegativeTestJSON-481576424</nova:project>
Aug 01 14:23:18 user nova-compute[72129]:       </nova:owner>
Aug 01 14:23:18 user nova-compute[72129]:       <nova:root type="image" uuid="b6472c34-1b0f-4034-ba3a-7e8eb5103715"/>
Aug 01 14:23:18 user nova-compute[72129]:       <nova:ports>
Aug 01 14:23:18 user nova-compute[72129]:         <nova:port uuid="7cc66f81-8cb9-416d-b9c3-03451989c713">
Aug 01 14:23:18 user nova-compute[72129]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 01 14:23:18 user nova-compute[72129]:         </nova:port>
Aug 01 14:23:18 user nova-compute[72129]:       </nova:ports>
Aug 01 14:23:18 user nova-compute[72129]:     </nova:instance>
Aug 01 14:23:18 user nova-compute[72129]:   </metadata>
Aug 01 14:23:18 user nova-compute[72129]:   <sysinfo type="smbios">
Aug 01 14:23:18 user nova-compute[72129]:     <system>
Aug 01 14:23:18 user nova-compute[72129]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 14:23:18 user nova-compute[72129]:       <entry name="product">OpenStack Nova</entry>
Aug 01 14:23:18 user nova-compute[72129]:       <entry name="version">0.0.0</entry>
Aug 01 14:23:18 user nova-compute[72129]:       <entry name="serial">5e602ce0-ffe8-4737-86cb-5caee367f2b4</entry>
Aug 01 14:23:18 user nova-compute[72129]:       <entry name="uuid">5e602ce0-ffe8-4737-86cb-5caee367f2b4</entry>
Aug 01 14:23:18 user nova-compute[72129]:       <entry name="family">Virtual Machine</entry>
Aug 01 14:23:18 user nova-compute[72129]:     </system>
Aug 01 14:23:18 user nova-compute[72129]:   </sysinfo>
Aug 01 14:23:18 user nova-compute[72129]:   <os>
Aug 01 14:23:18 user nova-compute[72129]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 14:23:18 user nova-compute[72129]:     <boot dev="hd"/>
Aug 01 14:23:18 user nova-compute[72129]:     <smbios mode="sysinfo"/>
Aug 01 14:23:18 user nova-compute[72129]:   </os>
Aug 01 14:23:18 user nova-compute[72129]:   <features>
Aug 01 14:23:18 user nova-compute[72129]:     <acpi/>
Aug 01 14:23:18 user nova-compute[72129]:     <apic/>
Aug 01 14:23:18 user nova-compute[72129]:     <vmcoreinfo/>
Aug 01 14:23:18 user nova-compute[72129]:   </features>
Aug 01 14:23:18 user nova-compute[72129]:   <clock offset="utc">
Aug 01 14:23:18 user nova-compute[72129]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 14:23:18 user nova-compute[72129]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 14:23:18 user nova-compute[72129]:     <timer name="hpet" present="no"/>
Aug 01 14:23:18 user nova-compute[72129]:   </clock>
Aug 01 14:23:18 user nova-compute[72129]:   <cpu mode="custom" match="exact">
Aug 01 14:23:18 user nova-compute[72129]:     <model>Nehalem</model>
Aug 01 14:23:18 user nova-compute[72129]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 14:23:18 user nova-compute[72129]:   </cpu>
Aug 01 14:23:18 user nova-compute[72129]:   <devices>
Aug 01 14:23:18 user nova-compute[72129]:     <disk type="file" device="disk">
Aug 01 14:23:18 user nova-compute[72129]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 14:23:18 user nova-compute[72129]:       <source file="/opt/stack/data/nova/instances/5e602ce0-ffe8-4737-86cb-5caee367f2b4/disk"/>
Aug 01 14:23:18 user nova-compute[72129]:       <target dev="vda" bus="virtio"/>
Aug 01 14:23:18 user nova-compute[72129]:     </disk>
Aug 01 14:23:18 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 14:23:18 user nova-compute[72129]:       <mac address="fa:16:3e:f6:cb:d3"/>
Aug 01 14:23:18 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:23:18 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 14:23:18 user nova-compute[72129]:       <target dev="tap7cc66f81-8c"/>
Aug 01 14:23:18 user nova-compute[72129]:     </interface>
Aug 01 14:23:18 user nova-compute[72129]:     <serial type="pty">
Aug 01 14:23:18 user nova-compute[72129]:       <log file="/opt/stack/data/nova/instances/5e602ce0-ffe8-4737-86cb-5caee367f2b4/console.log" append="off"/>
Aug 01 14:23:18 user nova-compute[72129]:     </serial>
Aug 01 14:23:18 user nova-compute[72129]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 14:23:18 user nova-compute[72129]:     <video>
Aug 01 14:23:18 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:23:18 user nova-compute[72129]:     </video>
Aug 01 14:23:18 user nova-compute[72129]:     <rng model="virtio">
Aug 01 14:23:18 user nova-compute[72129]:       <backend model="random">/dev/urandom</backend>
Aug 01 14:23:18 user nova-compute[72129]:     </rng>
Aug 01 14:23:18 user nova-compute[72129]:     <controller type="usb" index="0" model="none"/>
Aug 01 14:23:18 user nova-compute[72129]:     <memballoon model="virtio">
Aug 01 14:23:18 user nova-compute[72129]:       <stats period="10"/>
Aug 01 14:23:18 user nova-compute[72129]:     </memballoon>
Aug 01 14:23:18 user nova-compute[72129]:   </devices>
Aug 01 14:23:18 user nova-compute[72129]: </domain>
Aug 01 14:23:18 user nova-compute[72129]:  {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 14:23:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:23:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1551117721',display_name='tempest-ServerRescueNegativeTestJSON-server-1551117721',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1551117721',id=47,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDeGC2OYrAuhdtsQ12w8hkrsQ4BStQKdcxMAGWGF9i5CEavjy55aog2hOysoEWEG4SBA9Pa0TYoxd11hOhqvXgl0N1sUSAtZyoNVLM//3QjvgWjRgJBjm0nAZ0L+/1WReA==',key_name='tempest-keypair-592319693',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42cca3e17d4e4df79c94c4b94fb3fcec',ramdisk_id='',reservation_id='r-mfltbgi9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-481576424',owner_user_name='tempest-ServerRescueNegativeTestJSON-481576424-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T14:23:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='deb1597afdc647598ee893dd51880173',uuid=5e602ce0-ffe8-4737-86cb-5caee367f2b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7cc66f81-8cb9-416d-b9c3-03451989c713", "address": "fa:16:3e:f6:cb:d3", "network": {"id": "6ffcec16-7b44-472a-b7cd-af16ebd4a653", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-901464581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cca3e17d4e4df79c94c4b94fb3fcec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc66f81-8c", "ovs_interfaceid": "7cc66f81-8cb9-416d-b9c3-03451989c713", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 14:23:18 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Converting VIF {"id": "7cc66f81-8cb9-416d-b9c3-03451989c713", "address": "fa:16:3e:f6:cb:d3", "network": {"id": "6ffcec16-7b44-472a-b7cd-af16ebd4a653", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-901464581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cca3e17d4e4df79c94c4b94fb3fcec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc66f81-8c", "ovs_interfaceid": "7cc66f81-8cb9-416d-b9c3-03451989c713", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:23:18 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:cb:d3,bridge_name='br-int',has_traffic_filtering=True,id=7cc66f81-8cb9-416d-b9c3-03451989c713,network=Network(6ffcec16-7b44-472a-b7cd-af16ebd4a653),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cc66f81-8c') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:23:18 user nova-compute[72129]: DEBUG os_vif [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:cb:d3,bridge_name='br-int',has_traffic_filtering=True,id=7cc66f81-8cb9-416d-b9c3-03451989c713,network=Network(6ffcec16-7b44-472a-b7cd-af16ebd4a653),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cc66f81-8c') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 14:23:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:23:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:23:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 14:23:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:23:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7cc66f81-8c, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:23:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7cc66f81-8c, col_values=(('external_ids', {'iface-id': '7cc66f81-8cb9-416d-b9c3-03451989c713', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:cb:d3', 'vm-uuid': '5e602ce0-ffe8-4737-86cb-5caee367f2b4'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:23:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:23:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:23:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:23:18 user nova-compute[72129]: INFO os_vif [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:cb:d3,bridge_name='br-int',has_traffic_filtering=True,id=7cc66f81-8cb9-416d-b9c3-03451989c713,network=Network(6ffcec16-7b44-472a-b7cd-af16ebd4a653),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cc66f81-8c')
Aug 01 14:23:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:23:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] No VIF found with MAC fa:16:3e:f6:cb:d3, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 14:23:18 user nova-compute[72129]: DEBUG nova.network.neutron [req-c5a387b6-b657-4dbd-9ca1-9ca2cb417400 req-6c856f91-5dee-47ac-802e-4e54a787c644 service nova] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Updated VIF entry in instance network info cache for port 7cc66f81-8cb9-416d-b9c3-03451989c713. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 14:23:18 user nova-compute[72129]: DEBUG nova.network.neutron [req-c5a387b6-b657-4dbd-9ca1-9ca2cb417400 req-6c856f91-5dee-47ac-802e-4e54a787c644 service nova] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Updating instance_info_cache with network_info: [{"id": "7cc66f81-8cb9-416d-b9c3-03451989c713", "address": "fa:16:3e:f6:cb:d3", "network": {"id": "6ffcec16-7b44-472a-b7cd-af16ebd4a653", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-901464581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cca3e17d4e4df79c94c4b94fb3fcec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc66f81-8c", "ovs_interfaceid": "7cc66f81-8cb9-416d-b9c3-03451989c713", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:23:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-c5a387b6-b657-4dbd-9ca1-9ca2cb417400 req-6c856f91-5dee-47ac-802e-4e54a787c644 service nova] Releasing lock "refresh_cache-5e602ce0-ffe8-4737-86cb-5caee367f2b4" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:23:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:23:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:23:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:23:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:23:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:23:19 user nova-compute[72129]: DEBUG nova.compute.manager [req-7464a860-5d70-46ac-aa28-557fb52297a0 req-2f1fa26b-3357-46f5-a51d-bdd3171c97d9 service nova] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Received event network-vif-plugged-7cc66f81-8cb9-416d-b9c3-03451989c713 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:23:19 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-7464a860-5d70-46ac-aa28-557fb52297a0 req-2f1fa26b-3357-46f5-a51d-bdd3171c97d9 service nova] Acquiring lock "5e602ce0-ffe8-4737-86cb-5caee367f2b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:23:19 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-7464a860-5d70-46ac-aa28-557fb52297a0 req-2f1fa26b-3357-46f5-a51d-bdd3171c97d9 service nova] Lock "5e602ce0-ffe8-4737-86cb-5caee367f2b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:23:19 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-7464a860-5d70-46ac-aa28-557fb52297a0 req-2f1fa26b-3357-46f5-a51d-bdd3171c97d9 service nova] Lock "5e602ce0-ffe8-4737-86cb-5caee367f2b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:23:19 user nova-compute[72129]: DEBUG nova.compute.manager [req-7464a860-5d70-46ac-aa28-557fb52297a0 req-2f1fa26b-3357-46f5-a51d-bdd3171c97d9 service nova] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] No waiting events found dispatching network-vif-plugged-7cc66f81-8cb9-416d-b9c3-03451989c713 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:23:19 user nova-compute[72129]: WARNING nova.compute.manager [req-7464a860-5d70-46ac-aa28-557fb52297a0 req-2f1fa26b-3357-46f5-a51d-bdd3171c97d9 service nova] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Received unexpected event network-vif-plugged-7cc66f81-8cb9-416d-b9c3-03451989c713 for instance with vm_state building and task_state spawning.
Aug 01 14:23:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:23:21 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690899801.5943499, 5e602ce0-ffe8-4737-86cb-5caee367f2b4 => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:23:21 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] VM Resumed (Lifecycle Event)
Aug 01 14:23:21 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Instance event wait completed in 0 seconds for  {{(pid=72129) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 14:23:21 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Guest created on hypervisor {{(pid=72129) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 14:23:21 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Instance spawned successfully.
Aug 01 14:23:21 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 14:23:21 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:23:21 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:23:21 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Found default for hw_cdrom_bus of ide {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:23:21 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Found default for hw_disk_bus of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:23:21 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Found default for hw_input_bus of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:23:21 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Found default for hw_pointer_model of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:23:21 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Found default for hw_video_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:23:21 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Found default for hw_vif_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:23:21 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 14:23:21 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690899801.5957935, 5e602ce0-ffe8-4737-86cb-5caee367f2b4 => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:23:21 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] VM Started (Lifecycle Event)
Aug 01 14:23:21 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:23:21 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:23:21 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 14:23:21 user nova-compute[72129]: INFO nova.compute.manager [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Took 5.32 seconds to spawn the instance on the hypervisor.
Aug 01 14:23:21 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:23:21 user nova-compute[72129]: INFO nova.compute.manager [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Took 6.09 seconds to build instance.
Aug 01 14:23:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-9e053b93-6465-4a3f-b6ad-a5881e44699d tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lock "5e602ce0-ffe8-4737-86cb-5caee367f2b4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.201s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:23:21 user nova-compute[72129]: DEBUG nova.compute.manager [req-794ab380-daa9-4e9d-aabb-24cc423448a6 req-27a1b75e-8c87-4c12-8148-922bcc6ffe9e service nova] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Received event network-vif-plugged-7cc66f81-8cb9-416d-b9c3-03451989c713 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:23:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-794ab380-daa9-4e9d-aabb-24cc423448a6 req-27a1b75e-8c87-4c12-8148-922bcc6ffe9e service nova] Acquiring lock "5e602ce0-ffe8-4737-86cb-5caee367f2b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:23:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-794ab380-daa9-4e9d-aabb-24cc423448a6 req-27a1b75e-8c87-4c12-8148-922bcc6ffe9e service nova] Lock "5e602ce0-ffe8-4737-86cb-5caee367f2b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:23:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-794ab380-daa9-4e9d-aabb-24cc423448a6 req-27a1b75e-8c87-4c12-8148-922bcc6ffe9e service nova] Lock "5e602ce0-ffe8-4737-86cb-5caee367f2b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:23:21 user nova-compute[72129]: DEBUG nova.compute.manager [req-794ab380-daa9-4e9d-aabb-24cc423448a6 req-27a1b75e-8c87-4c12-8148-922bcc6ffe9e service nova] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] No waiting events found dispatching network-vif-plugged-7cc66f81-8cb9-416d-b9c3-03451989c713 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:23:21 user nova-compute[72129]: WARNING nova.compute.manager [req-794ab380-daa9-4e9d-aabb-24cc423448a6 req-27a1b75e-8c87-4c12-8148-922bcc6ffe9e service nova] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Received unexpected event network-vif-plugged-7cc66f81-8cb9-416d-b9c3-03451989c713 for instance with vm_state active and task_state None.
Aug 01 14:23:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:23:28 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:23:28 user nova-compute[72129]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690899793.245666, 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60 => Stopped> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:23:28 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] VM Stopped (Lifecycle Event)
Aug 01 14:23:28 user nova-compute[72129]: DEBUG nova.compute.manager [None req-2ef3410a-500a-4aaa-9cba-a0e8d2ab28ff None None] [instance: 9a6cccca-ebb1-43e3-9fef-4aa2a0d29d60] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:23:33 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:23:36 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:23:38 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:23:41 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:23:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:23:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-4bb334a9-4e96-47c1-91f5-8daca719022c tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Acquiring lock "6281d027-b30b-413d-b86e-e612a5a6d14d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:23:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-4bb334a9-4e96-47c1-91f5-8daca719022c tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "6281d027-b30b-413d-b86e-e612a5a6d14d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:23:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-4bb334a9-4e96-47c1-91f5-8daca719022c tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Acquiring lock "6281d027-b30b-413d-b86e-e612a5a6d14d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:23:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-4bb334a9-4e96-47c1-91f5-8daca719022c tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "6281d027-b30b-413d-b86e-e612a5a6d14d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:23:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-4bb334a9-4e96-47c1-91f5-8daca719022c tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "6281d027-b30b-413d-b86e-e612a5a6d14d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:23:43 user nova-compute[72129]: INFO nova.compute.manager [None req-4bb334a9-4e96-47c1-91f5-8daca719022c tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] Terminating instance
Aug 01 14:23:43 user nova-compute[72129]: DEBUG nova.compute.manager [None req-4bb334a9-4e96-47c1-91f5-8daca719022c tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] Start destroying the instance on the hypervisor. {{(pid=72129) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 14:23:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:23:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:23:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:23:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:23:43 user nova-compute[72129]: DEBUG nova.compute.manager [req-2bca0c2c-28a9-45d0-9666-bc08846cbab5 req-b0134596-8fbf-46e0-869d-40702d8faf07 service nova] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] Received event network-vif-unplugged-c3e9c75c-81cc-48d6-a458-c4ddafed5b44 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:23:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-2bca0c2c-28a9-45d0-9666-bc08846cbab5 req-b0134596-8fbf-46e0-869d-40702d8faf07 service nova] Acquiring lock "6281d027-b30b-413d-b86e-e612a5a6d14d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:23:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-2bca0c2c-28a9-45d0-9666-bc08846cbab5 req-b0134596-8fbf-46e0-869d-40702d8faf07 service nova] Lock "6281d027-b30b-413d-b86e-e612a5a6d14d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:23:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-2bca0c2c-28a9-45d0-9666-bc08846cbab5 req-b0134596-8fbf-46e0-869d-40702d8faf07 service nova] Lock "6281d027-b30b-413d-b86e-e612a5a6d14d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:23:43 user nova-compute[72129]: DEBUG nova.compute.manager [req-2bca0c2c-28a9-45d0-9666-bc08846cbab5 req-b0134596-8fbf-46e0-869d-40702d8faf07 service nova] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] No waiting events found dispatching network-vif-unplugged-c3e9c75c-81cc-48d6-a458-c4ddafed5b44 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:23:43 user nova-compute[72129]: DEBUG nova.compute.manager [req-2bca0c2c-28a9-45d0-9666-bc08846cbab5 req-b0134596-8fbf-46e0-869d-40702d8faf07 service nova] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] Received event network-vif-unplugged-c3e9c75c-81cc-48d6-a458-c4ddafed5b44 for instance with task_state deleting. {{(pid=72129) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 14:23:44 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] Instance destroyed successfully.
Aug 01 14:23:44 user nova-compute[72129]: DEBUG nova.objects.instance [None req-4bb334a9-4e96-47c1-91f5-8daca719022c tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lazy-loading 'resources' on Instance uuid 6281d027-b30b-413d-b86e-e612a5a6d14d {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:23:44 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-4bb334a9-4e96-47c1-91f5-8daca719022c tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:20:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1838299992',display_name='tempest-AttachVolumeNegativeTest-server-1838299992',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1838299992',id=46,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMXolHl8tvvtIUXp++ydfavqWagu49d2LHeyeDiuP15l2wvYJCJ4lHrrR4rdyf9EM18Iei1S6faZemt87uIXyGNYlBVdCJdX6WsMqmP93pf/CKCiM0z6ZZV3Wdsdj+HYZw==',key_name='tempest-keypair-1270898053',keypairs=<?>,launch_index=0,launched_at=2023-08-01T14:20:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f5d5ede0f2e44eaab914ffc17aef8aa8',ramdisk_id='',reservation_id='r-bqvd4sga',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2079788087',owner_user_name='tempest-AttachVolumeNegativeTest-2079788087-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T14:20:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85308332b4084e9f8c1bf605f540434b',uuid=6281d027-b30b-413d-b86e-e612a5a6d14d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c3e9c75c-81cc-48d6-a458-c4ddafed5b44", "address": "fa:16:3e:29:20:d9", "network": {"id": "9d4effd9-bf5c-41a7-a8e2-18d2177ace34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333645199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5d5ede0f2e44eaab914ffc17aef8aa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3e9c75c-81", "ovs_interfaceid": "c3e9c75c-81cc-48d6-a458-c4ddafed5b44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 14:23:44 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-4bb334a9-4e96-47c1-91f5-8daca719022c tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Converting VIF {"id": "c3e9c75c-81cc-48d6-a458-c4ddafed5b44", "address": "fa:16:3e:29:20:d9", "network": {"id": "9d4effd9-bf5c-41a7-a8e2-18d2177ace34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333645199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5d5ede0f2e44eaab914ffc17aef8aa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3e9c75c-81", "ovs_interfaceid": "c3e9c75c-81cc-48d6-a458-c4ddafed5b44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:23:44 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-4bb334a9-4e96-47c1-91f5-8daca719022c tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:29:20:d9,bridge_name='br-int',has_traffic_filtering=True,id=c3e9c75c-81cc-48d6-a458-c4ddafed5b44,network=Network(9d4effd9-bf5c-41a7-a8e2-18d2177ace34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3e9c75c-81') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:23:44 user nova-compute[72129]: DEBUG os_vif [None req-4bb334a9-4e96-47c1-91f5-8daca719022c tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:20:d9,bridge_name='br-int',has_traffic_filtering=True,id=c3e9c75c-81cc-48d6-a458-c4ddafed5b44,network=Network(9d4effd9-bf5c-41a7-a8e2-18d2177ace34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3e9c75c-81') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 14:23:44 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:23:44 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc3e9c75c-81, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:23:44 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:23:44 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:23:44 user nova-compute[72129]: INFO os_vif [None req-4bb334a9-4e96-47c1-91f5-8daca719022c tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:20:d9,bridge_name='br-int',has_traffic_filtering=True,id=c3e9c75c-81cc-48d6-a458-c4ddafed5b44,network=Network(9d4effd9-bf5c-41a7-a8e2-18d2177ace34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3e9c75c-81')
Aug 01 14:23:44 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-4bb334a9-4e96-47c1-91f5-8daca719022c tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] Deleting instance files /opt/stack/data/nova/instances/6281d027-b30b-413d-b86e-e612a5a6d14d_del
Aug 01 14:23:44 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-4bb334a9-4e96-47c1-91f5-8daca719022c tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] Deletion of /opt/stack/data/nova/instances/6281d027-b30b-413d-b86e-e612a5a6d14d_del complete
Aug 01 14:23:44 user nova-compute[72129]: INFO nova.compute.manager [None req-4bb334a9-4e96-47c1-91f5-8daca719022c tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 01 14:23:44 user nova-compute[72129]: DEBUG oslo.service.loopingcall [None req-4bb334a9-4e96-47c1-91f5-8daca719022c tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72129) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 14:23:44 user nova-compute[72129]: DEBUG nova.compute.manager [-] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] Deallocating network for instance {{(pid=72129) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 14:23:44 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] deallocate_for_instance() {{(pid=72129) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 14:23:45 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:23:45 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] Took 0.77 seconds to deallocate network for instance.
Aug 01 14:23:45 user nova-compute[72129]: DEBUG nova.compute.manager [req-08cdde43-ad61-4f04-a5ae-18b49002382a req-2d0ba8a9-3562-416a-9b81-14a9cb718327 service nova] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] Received event network-vif-deleted-c3e9c75c-81cc-48d6-a458-c4ddafed5b44 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:23:45 user nova-compute[72129]: INFO nova.compute.manager [req-08cdde43-ad61-4f04-a5ae-18b49002382a req-2d0ba8a9-3562-416a-9b81-14a9cb718327 service nova] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] Neutron deleted interface c3e9c75c-81cc-48d6-a458-c4ddafed5b44; detaching it from the instance and deleting it from the info cache
Aug 01 14:23:45 user nova-compute[72129]: DEBUG nova.network.neutron [req-08cdde43-ad61-4f04-a5ae-18b49002382a req-2d0ba8a9-3562-416a-9b81-14a9cb718327 service nova] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:23:45 user nova-compute[72129]: DEBUG nova.compute.manager [req-08cdde43-ad61-4f04-a5ae-18b49002382a req-2d0ba8a9-3562-416a-9b81-14a9cb718327 service nova] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] Detach interface failed, port_id=c3e9c75c-81cc-48d6-a458-c4ddafed5b44, reason: Instance 6281d027-b30b-413d-b86e-e612a5a6d14d could not be found. {{(pid=72129) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 14:23:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-4bb334a9-4e96-47c1-91f5-8daca719022c tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:23:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-4bb334a9-4e96-47c1-91f5-8daca719022c tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:23:45 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-4bb334a9-4e96-47c1-91f5-8daca719022c tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:23:45 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-4bb334a9-4e96-47c1-91f5-8daca719022c tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:23:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-4bb334a9-4e96-47c1-91f5-8daca719022c tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.197s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:23:45 user nova-compute[72129]: INFO nova.scheduler.client.report [None req-4bb334a9-4e96-47c1-91f5-8daca719022c tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Deleted allocations for instance 6281d027-b30b-413d-b86e-e612a5a6d14d
Aug 01 14:23:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-4bb334a9-4e96-47c1-91f5-8daca719022c tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "6281d027-b30b-413d-b86e-e612a5a6d14d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:23:46 user nova-compute[72129]: DEBUG nova.compute.manager [req-b033290a-ffeb-4246-9d2b-dec29b00f349 req-c826648d-0102-4679-b812-61e0d7ae0ff2 service nova] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] Received event network-vif-plugged-c3e9c75c-81cc-48d6-a458-c4ddafed5b44 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:23:46 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-b033290a-ffeb-4246-9d2b-dec29b00f349 req-c826648d-0102-4679-b812-61e0d7ae0ff2 service nova] Acquiring lock "6281d027-b30b-413d-b86e-e612a5a6d14d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:23:46 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-b033290a-ffeb-4246-9d2b-dec29b00f349 req-c826648d-0102-4679-b812-61e0d7ae0ff2 service nova] Lock "6281d027-b30b-413d-b86e-e612a5a6d14d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:23:46 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-b033290a-ffeb-4246-9d2b-dec29b00f349 req-c826648d-0102-4679-b812-61e0d7ae0ff2 service nova] Lock "6281d027-b30b-413d-b86e-e612a5a6d14d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:23:46 user nova-compute[72129]: DEBUG nova.compute.manager [req-b033290a-ffeb-4246-9d2b-dec29b00f349 req-c826648d-0102-4679-b812-61e0d7ae0ff2 service nova] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] No waiting events found dispatching network-vif-plugged-c3e9c75c-81cc-48d6-a458-c4ddafed5b44 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:23:46 user nova-compute[72129]: WARNING nova.compute.manager [req-b033290a-ffeb-4246-9d2b-dec29b00f349 req-c826648d-0102-4679-b812-61e0d7ae0ff2 service nova] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] Received unexpected event network-vif-plugged-c3e9c75c-81cc-48d6-a458-c4ddafed5b44 for instance with vm_state deleted and task_state None.
Aug 01 14:23:46 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:23:49 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:23:51 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:23:54 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:23:59 user nova-compute[72129]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690899824.4040608, 6281d027-b30b-413d-b86e-e612a5a6d14d => Stopped> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:23:59 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] VM Stopped (Lifecycle Event)
Aug 01 14:23:59 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9fbd23c5-e7b2-4a8f-94c8-774d2147c184 None None] [instance: 6281d027-b30b-413d-b86e-e612a5a6d14d] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:23:59 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:23:59 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:23:59 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72129) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 14:23:59 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:23:59 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:23:59 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:24:04 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:24:05 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:24:05 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72129) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 14:24:07 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:24:07 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Starting heal instance info cache {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 14:24:07 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Didn't find any instances for network info cache update. {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 14:24:07 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:24:07 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:24:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:24:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:24:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:24:07 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Auditing locally available compute resources for user (node: user) {{(pid=72129) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 14:24:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e602ce0-ffe8-4737-86cb-5caee367f2b4/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:24:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e602ce0-ffe8-4737-86cb-5caee367f2b4/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:24:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e602ce0-ffe8-4737-86cb-5caee367f2b4/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:24:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e602ce0-ffe8-4737-86cb-5caee367f2b4/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:24:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:24:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:24:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:24:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:24:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk.rescue --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:24:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:24:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk.rescue --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:24:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:24:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:24:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:24:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:24:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:24:08 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:24:08 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:24:08 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Hypervisor/Node resource view: name=user free_ram=8574MB free_disk=25.13309097290039GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72129) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 14:24:08 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:24:08 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:24:08 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance b3f54430-8d5d-478b-8dc7-d7592ee3db36 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:24:08 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:24:08 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 5e602ce0-ffe8-4737-86cb-5caee367f2b4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:24:08 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 14:24:08 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 14:24:08 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:24:08 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:24:08 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Compute_service record updated for user:user {{(pid=72129) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 14:24:08 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.252s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:24:09 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:24:09 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:24:09 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:24:10 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:24:12 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:24:13 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:24:13 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:24:14 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:24:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:24:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:24:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72129) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 14:24:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:24:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:24:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:24:24 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:24:29 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:24:34 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:24:34 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:24:37 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Acquiring lock "5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:24:37 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:24:37 user nova-compute[72129]: DEBUG nova.compute.manager [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Starting instance... {{(pid=72129) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 14:24:37 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:24:37 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:24:37 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72129) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 14:24:37 user nova-compute[72129]: INFO nova.compute.claims [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Claim successful on node user
Aug 01 14:24:37 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:24:37 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:24:37 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.274s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:24:37 user nova-compute[72129]: DEBUG nova.compute.manager [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Start building networks asynchronously for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 14:24:37 user nova-compute[72129]: DEBUG nova.compute.manager [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Allocating IP information in the background. {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 14:24:37 user nova-compute[72129]: DEBUG nova.network.neutron [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] allocate_for_instance() {{(pid=72129) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 14:24:37 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 14:24:37 user nova-compute[72129]: DEBUG nova.compute.manager [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Start building block device mappings for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 14:24:37 user nova-compute[72129]: DEBUG nova.policy [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '85308332b4084e9f8c1bf605f540434b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d5ede0f2e44eaab914ffc17aef8aa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72129) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 14:24:38 user nova-compute[72129]: DEBUG nova.compute.manager [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Start spawning the instance on the hypervisor. {{(pid=72129) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 14:24:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Creating instance directory {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 14:24:38 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Creating image(s)
Aug 01 14:24:38 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Acquiring lock "/opt/stack/data/nova/instances/5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:24:38 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "/opt/stack/data/nova/instances/5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:24:38 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "/opt/stack/data/nova/instances/5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:24:38 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:24:38 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.145s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:24:38 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Acquiring lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:24:38 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:24:38 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:24:38 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.150s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:24:38 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca/disk 1073741824 {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:24:38 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca/disk 1073741824" returned: 0 in 0.054s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:24:38 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.212s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:24:38 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:24:38 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.140s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:24:38 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca/disk. size=1073741824 {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 14:24:38 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:24:38 user nova-compute[72129]: DEBUG nova.network.neutron [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Successfully created port: ed958cf2-355f-460b-be85-8e7c2b1c34ca {{(pid=72129) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 14:24:38 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:24:38 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Cannot resize image /opt/stack/data/nova/instances/5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca/disk to a smaller size. {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 14:24:38 user nova-compute[72129]: DEBUG nova.objects.instance [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lazy-loading 'migration_context' on Instance uuid 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:24:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Created local disks {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 14:24:38 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Ensure instance console log exists: /opt/stack/data/nova/instances/5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca/console.log {{(pid=72129) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 14:24:38 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:24:38 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:24:38 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:24:39 user nova-compute[72129]: DEBUG nova.network.neutron [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Successfully updated port: ed958cf2-355f-460b-be85-8e7c2b1c34ca {{(pid=72129) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 14:24:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Acquiring lock "refresh_cache-5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:24:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Acquired lock "refresh_cache-5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:24:39 user nova-compute[72129]: DEBUG nova.network.neutron [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 14:24:39 user nova-compute[72129]: DEBUG nova.compute.manager [req-1931ecb6-bd16-4f6a-8ceb-9534e4ec7179 req-4a8e46a7-4ca9-41e2-b940-677be2f3c5ae service nova] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Received event network-changed-ed958cf2-355f-460b-be85-8e7c2b1c34ca {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:24:39 user nova-compute[72129]: DEBUG nova.compute.manager [req-1931ecb6-bd16-4f6a-8ceb-9534e4ec7179 req-4a8e46a7-4ca9-41e2-b940-677be2f3c5ae service nova] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Refreshing instance network info cache due to event network-changed-ed958cf2-355f-460b-be85-8e7c2b1c34ca. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 14:24:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-1931ecb6-bd16-4f6a-8ceb-9534e4ec7179 req-4a8e46a7-4ca9-41e2-b940-677be2f3c5ae service nova] Acquiring lock "refresh_cache-5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:24:39 user nova-compute[72129]: DEBUG nova.network.neutron [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Instance cache missing network info. {{(pid=72129) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 14:24:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:24:39 user nova-compute[72129]: DEBUG nova.network.neutron [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Updating instance_info_cache with network_info: [{"id": "ed958cf2-355f-460b-be85-8e7c2b1c34ca", "address": "fa:16:3e:f6:e8:d6", "network": {"id": "9d4effd9-bf5c-41a7-a8e2-18d2177ace34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333645199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5d5ede0f2e44eaab914ffc17aef8aa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped958cf2-35", "ovs_interfaceid": "ed958cf2-355f-460b-be85-8e7c2b1c34ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:24:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Releasing lock "refresh_cache-5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:24:39 user nova-compute[72129]: DEBUG nova.compute.manager [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Instance network_info: |[{"id": "ed958cf2-355f-460b-be85-8e7c2b1c34ca", "address": "fa:16:3e:f6:e8:d6", "network": {"id": "9d4effd9-bf5c-41a7-a8e2-18d2177ace34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333645199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5d5ede0f2e44eaab914ffc17aef8aa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped958cf2-35", "ovs_interfaceid": "ed958cf2-355f-460b-be85-8e7c2b1c34ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 14:24:39 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-1931ecb6-bd16-4f6a-8ceb-9534e4ec7179 req-4a8e46a7-4ca9-41e2-b940-677be2f3c5ae service nova] Acquired lock "refresh_cache-5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:24:39 user nova-compute[72129]: DEBUG nova.network.neutron [req-1931ecb6-bd16-4f6a-8ceb-9534e4ec7179 req-4a8e46a7-4ca9-41e2-b940-677be2f3c5ae service nova] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Refreshing network info cache for port ed958cf2-355f-460b-be85-8e7c2b1c34ca {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 14:24:39 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Start _get_guest_xml network_info=[{"id": "ed958cf2-355f-460b-be85-8e7c2b1c34ca", "address": "fa:16:3e:f6:e8:d6", "network": {"id": "9d4effd9-bf5c-41a7-a8e2-18d2177ace34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333645199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5d5ede0f2e44eaab914ffc17aef8aa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped958cf2-35", "ovs_interfaceid": "ed958cf2-355f-460b-be85-8e7c2b1c34ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'image_id': 'b6472c34-1b0f-4034-ba3a-7e8eb5103715'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 14:24:39 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:24:39 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:24:39 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 14:24:39 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] CPU controller missing on host. {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 14:24:39 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 14:24:39 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] CPU controller found on host. {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 14:24:39 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72129) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 14:24:39 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T13:45:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 14:24:39 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Flavor limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 14:24:39 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Image limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 14:24:39 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Flavor pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 14:24:39 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Image pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 14:24:39 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 14:24:39 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 14:24:39 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 14:24:39 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Got 1 possible topologies {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 14:24:39 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 14:24:39 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 14:24:39 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:24:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-138240537',display_name='tempest-AttachVolumeNegativeTest-server-138240537',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-138240537',id=48,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBqUjH2kno+mFYLbnS02dMeF3/rIpcKCnsXOX9li40nZYX1kfTsrWlLnGtYLSI/asPjtPMvU5s9lTM9olLagz6JqbqYPuGxg2Sy1oG8ihwZ877disRwgSx4nHcZzXtV7Ng==',key_name='tempest-keypair-1556347356',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f5d5ede0f2e44eaab914ffc17aef8aa8',ramdisk_id='',reservation_id='r-vm15gwel',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2079788087',owner_user_name='tempest-AttachVolumeNegativeTest-2079788087-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T14:24:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85308332b4084e9f8c1bf605f540434b',uuid=5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed958cf2-355f-460b-be85-8e7c2b1c34ca", "address": "fa:16:3e:f6:e8:d6", "network": {"id": "9d4effd9-bf5c-41a7-a8e2-18d2177ace34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333645199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5d5ede0f2e44eaab914ffc17aef8aa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped958cf2-35", "ovs_interfaceid": "ed958cf2-355f-460b-be85-8e7c2b1c34ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 14:24:39 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Converting VIF {"id": "ed958cf2-355f-460b-be85-8e7c2b1c34ca", "address": "fa:16:3e:f6:e8:d6", "network": {"id": "9d4effd9-bf5c-41a7-a8e2-18d2177ace34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333645199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5d5ede0f2e44eaab914ffc17aef8aa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped958cf2-35", "ovs_interfaceid": "ed958cf2-355f-460b-be85-8e7c2b1c34ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:24:39 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:e8:d6,bridge_name='br-int',has_traffic_filtering=True,id=ed958cf2-355f-460b-be85-8e7c2b1c34ca,network=Network(9d4effd9-bf5c-41a7-a8e2-18d2177ace34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped958cf2-35') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:24:39 user nova-compute[72129]: DEBUG nova.objects.instance [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lazy-loading 'pci_devices' on Instance uuid 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:24:39 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] End _get_guest_xml xml=<domain type="kvm">
Aug 01 14:24:39 user nova-compute[72129]:   <uuid>5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca</uuid>
Aug 01 14:24:39 user nova-compute[72129]:   <name>instance-00000030</name>
Aug 01 14:24:39 user nova-compute[72129]:   <memory>524288</memory>
Aug 01 14:24:39 user nova-compute[72129]:   <vcpu>1</vcpu>
Aug 01 14:24:39 user nova-compute[72129]:   <metadata>
Aug 01 14:24:39 user nova-compute[72129]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 14:24:39 user nova-compute[72129]:       <nova:package version="0.0.0"/>
Aug 01 14:24:39 user nova-compute[72129]:       <nova:name>tempest-AttachVolumeNegativeTest-server-138240537</nova:name>
Aug 01 14:24:39 user nova-compute[72129]:       <nova:creationTime>2023-08-01 14:24:39</nova:creationTime>
Aug 01 14:24:39 user nova-compute[72129]:       <nova:flavor name="m1.tiny">
Aug 01 14:24:39 user nova-compute[72129]:         <nova:memory>512</nova:memory>
Aug 01 14:24:39 user nova-compute[72129]:         <nova:disk>1</nova:disk>
Aug 01 14:24:39 user nova-compute[72129]:         <nova:swap>0</nova:swap>
Aug 01 14:24:39 user nova-compute[72129]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 14:24:39 user nova-compute[72129]:         <nova:vcpus>1</nova:vcpus>
Aug 01 14:24:39 user nova-compute[72129]:       </nova:flavor>
Aug 01 14:24:39 user nova-compute[72129]:       <nova:owner>
Aug 01 14:24:39 user nova-compute[72129]:         <nova:user uuid="85308332b4084e9f8c1bf605f540434b">tempest-AttachVolumeNegativeTest-2079788087-project-member</nova:user>
Aug 01 14:24:39 user nova-compute[72129]:         <nova:project uuid="f5d5ede0f2e44eaab914ffc17aef8aa8">tempest-AttachVolumeNegativeTest-2079788087</nova:project>
Aug 01 14:24:39 user nova-compute[72129]:       </nova:owner>
Aug 01 14:24:39 user nova-compute[72129]:       <nova:root type="image" uuid="b6472c34-1b0f-4034-ba3a-7e8eb5103715"/>
Aug 01 14:24:39 user nova-compute[72129]:       <nova:ports>
Aug 01 14:24:39 user nova-compute[72129]:         <nova:port uuid="ed958cf2-355f-460b-be85-8e7c2b1c34ca">
Aug 01 14:24:39 user nova-compute[72129]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 01 14:24:39 user nova-compute[72129]:         </nova:port>
Aug 01 14:24:39 user nova-compute[72129]:       </nova:ports>
Aug 01 14:24:39 user nova-compute[72129]:     </nova:instance>
Aug 01 14:24:39 user nova-compute[72129]:   </metadata>
Aug 01 14:24:39 user nova-compute[72129]:   <sysinfo type="smbios">
Aug 01 14:24:39 user nova-compute[72129]:     <system>
Aug 01 14:24:39 user nova-compute[72129]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 14:24:39 user nova-compute[72129]:       <entry name="product">OpenStack Nova</entry>
Aug 01 14:24:39 user nova-compute[72129]:       <entry name="version">0.0.0</entry>
Aug 01 14:24:39 user nova-compute[72129]:       <entry name="serial">5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca</entry>
Aug 01 14:24:39 user nova-compute[72129]:       <entry name="uuid">5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca</entry>
Aug 01 14:24:39 user nova-compute[72129]:       <entry name="family">Virtual Machine</entry>
Aug 01 14:24:39 user nova-compute[72129]:     </system>
Aug 01 14:24:39 user nova-compute[72129]:   </sysinfo>
Aug 01 14:24:39 user nova-compute[72129]:   <os>
Aug 01 14:24:39 user nova-compute[72129]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 14:24:39 user nova-compute[72129]:     <boot dev="hd"/>
Aug 01 14:24:39 user nova-compute[72129]:     <smbios mode="sysinfo"/>
Aug 01 14:24:39 user nova-compute[72129]:   </os>
Aug 01 14:24:39 user nova-compute[72129]:   <features>
Aug 01 14:24:39 user nova-compute[72129]:     <acpi/>
Aug 01 14:24:39 user nova-compute[72129]:     <apic/>
Aug 01 14:24:39 user nova-compute[72129]:     <vmcoreinfo/>
Aug 01 14:24:39 user nova-compute[72129]:   </features>
Aug 01 14:24:39 user nova-compute[72129]:   <clock offset="utc">
Aug 01 14:24:39 user nova-compute[72129]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 14:24:39 user nova-compute[72129]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 14:24:39 user nova-compute[72129]:     <timer name="hpet" present="no"/>
Aug 01 14:24:39 user nova-compute[72129]:   </clock>
Aug 01 14:24:39 user nova-compute[72129]:   <cpu mode="custom" match="exact">
Aug 01 14:24:39 user nova-compute[72129]:     <model>Nehalem</model>
Aug 01 14:24:39 user nova-compute[72129]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 14:24:39 user nova-compute[72129]:   </cpu>
Aug 01 14:24:39 user nova-compute[72129]:   <devices>
Aug 01 14:24:39 user nova-compute[72129]:     <disk type="file" device="disk">
Aug 01 14:24:39 user nova-compute[72129]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 14:24:39 user nova-compute[72129]:       <source file="/opt/stack/data/nova/instances/5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca/disk"/>
Aug 01 14:24:39 user nova-compute[72129]:       <target dev="vda" bus="virtio"/>
Aug 01 14:24:39 user nova-compute[72129]:     </disk>
Aug 01 14:24:39 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 14:24:39 user nova-compute[72129]:       <mac address="fa:16:3e:f6:e8:d6"/>
Aug 01 14:24:39 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:24:39 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 14:24:39 user nova-compute[72129]:       <target dev="taped958cf2-35"/>
Aug 01 14:24:39 user nova-compute[72129]:     </interface>
Aug 01 14:24:39 user nova-compute[72129]:     <serial type="pty">
Aug 01 14:24:39 user nova-compute[72129]:       <log file="/opt/stack/data/nova/instances/5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca/console.log" append="off"/>
Aug 01 14:24:39 user nova-compute[72129]:     </serial>
Aug 01 14:24:39 user nova-compute[72129]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 14:24:39 user nova-compute[72129]:     <video>
Aug 01 14:24:39 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:24:39 user nova-compute[72129]:     </video>
Aug 01 14:24:39 user nova-compute[72129]:     <rng model="virtio">
Aug 01 14:24:39 user nova-compute[72129]:       <backend model="random">/dev/urandom</backend>
Aug 01 14:24:39 user nova-compute[72129]:     </rng>
Aug 01 14:24:39 user nova-compute[72129]:     <controller type="usb" index="0" model="none"/>
Aug 01 14:24:39 user nova-compute[72129]:     <memballoon model="virtio">
Aug 01 14:24:39 user nova-compute[72129]:       <stats period="10"/>
Aug 01 14:24:39 user nova-compute[72129]:     </memballoon>
Aug 01 14:24:39 user nova-compute[72129]:   </devices>
Aug 01 14:24:39 user nova-compute[72129]: </domain>
Aug 01 14:24:39 user nova-compute[72129]:  {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 14:24:39 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:24:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-138240537',display_name='tempest-AttachVolumeNegativeTest-server-138240537',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-138240537',id=48,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBqUjH2kno+mFYLbnS02dMeF3/rIpcKCnsXOX9li40nZYX1kfTsrWlLnGtYLSI/asPjtPMvU5s9lTM9olLagz6JqbqYPuGxg2Sy1oG8ihwZ877disRwgSx4nHcZzXtV7Ng==',key_name='tempest-keypair-1556347356',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f5d5ede0f2e44eaab914ffc17aef8aa8',ramdisk_id='',reservation_id='r-vm15gwel',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2079788087',owner_user_name='tempest-AttachVolumeNegativeTest-2079788087-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T14:24:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85308332b4084e9f8c1bf605f540434b',uuid=5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed958cf2-355f-460b-be85-8e7c2b1c34ca", "address": "fa:16:3e:f6:e8:d6", "network": {"id": "9d4effd9-bf5c-41a7-a8e2-18d2177ace34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333645199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5d5ede0f2e44eaab914ffc17aef8aa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped958cf2-35", "ovs_interfaceid": "ed958cf2-355f-460b-be85-8e7c2b1c34ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 14:24:39 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Converting VIF {"id": "ed958cf2-355f-460b-be85-8e7c2b1c34ca", "address": "fa:16:3e:f6:e8:d6", "network": {"id": "9d4effd9-bf5c-41a7-a8e2-18d2177ace34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333645199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5d5ede0f2e44eaab914ffc17aef8aa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped958cf2-35", "ovs_interfaceid": "ed958cf2-355f-460b-be85-8e7c2b1c34ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:24:39 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:e8:d6,bridge_name='br-int',has_traffic_filtering=True,id=ed958cf2-355f-460b-be85-8e7c2b1c34ca,network=Network(9d4effd9-bf5c-41a7-a8e2-18d2177ace34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped958cf2-35') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:24:39 user nova-compute[72129]: DEBUG os_vif [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:e8:d6,bridge_name='br-int',has_traffic_filtering=True,id=ed958cf2-355f-460b-be85-8e7c2b1c34ca,network=Network(9d4effd9-bf5c-41a7-a8e2-18d2177ace34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped958cf2-35') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 14:24:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:24:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:24:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 14:24:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:24:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=taped958cf2-35, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:24:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=taped958cf2-35, col_values=(('external_ids', {'iface-id': 'ed958cf2-355f-460b-be85-8e7c2b1c34ca', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:e8:d6', 'vm-uuid': '5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:24:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:24:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:24:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:24:39 user nova-compute[72129]: INFO os_vif [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:e8:d6,bridge_name='br-int',has_traffic_filtering=True,id=ed958cf2-355f-460b-be85-8e7c2b1c34ca,network=Network(9d4effd9-bf5c-41a7-a8e2-18d2177ace34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped958cf2-35')
Aug 01 14:24:39 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:24:39 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] No VIF found with MAC fa:16:3e:f6:e8:d6, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 14:24:40 user nova-compute[72129]: DEBUG nova.network.neutron [req-1931ecb6-bd16-4f6a-8ceb-9534e4ec7179 req-4a8e46a7-4ca9-41e2-b940-677be2f3c5ae service nova] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Updated VIF entry in instance network info cache for port ed958cf2-355f-460b-be85-8e7c2b1c34ca. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 14:24:40 user nova-compute[72129]: DEBUG nova.network.neutron [req-1931ecb6-bd16-4f6a-8ceb-9534e4ec7179 req-4a8e46a7-4ca9-41e2-b940-677be2f3c5ae service nova] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Updating instance_info_cache with network_info: [{"id": "ed958cf2-355f-460b-be85-8e7c2b1c34ca", "address": "fa:16:3e:f6:e8:d6", "network": {"id": "9d4effd9-bf5c-41a7-a8e2-18d2177ace34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333645199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5d5ede0f2e44eaab914ffc17aef8aa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped958cf2-35", "ovs_interfaceid": "ed958cf2-355f-460b-be85-8e7c2b1c34ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:24:40 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-1931ecb6-bd16-4f6a-8ceb-9534e4ec7179 req-4a8e46a7-4ca9-41e2-b940-677be2f3c5ae service nova] Releasing lock "refresh_cache-5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:24:41 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:24:41 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:24:41 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:24:41 user nova-compute[72129]: DEBUG nova.compute.manager [req-8305cc84-6cac-4d47-bdbf-921abddf98b4 req-d38060f7-a72c-4248-af9f-16721099c89e service nova] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Received event network-vif-plugged-ed958cf2-355f-460b-be85-8e7c2b1c34ca {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:24:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-8305cc84-6cac-4d47-bdbf-921abddf98b4 req-d38060f7-a72c-4248-af9f-16721099c89e service nova] Acquiring lock "5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:24:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-8305cc84-6cac-4d47-bdbf-921abddf98b4 req-d38060f7-a72c-4248-af9f-16721099c89e service nova] Lock "5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:24:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-8305cc84-6cac-4d47-bdbf-921abddf98b4 req-d38060f7-a72c-4248-af9f-16721099c89e service nova] Lock "5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:24:41 user nova-compute[72129]: DEBUG nova.compute.manager [req-8305cc84-6cac-4d47-bdbf-921abddf98b4 req-d38060f7-a72c-4248-af9f-16721099c89e service nova] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] No waiting events found dispatching network-vif-plugged-ed958cf2-355f-460b-be85-8e7c2b1c34ca {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:24:41 user nova-compute[72129]: WARNING nova.compute.manager [req-8305cc84-6cac-4d47-bdbf-921abddf98b4 req-d38060f7-a72c-4248-af9f-16721099c89e service nova] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Received unexpected event network-vif-plugged-ed958cf2-355f-460b-be85-8e7c2b1c34ca for instance with vm_state building and task_state spawning.
Aug 01 14:24:41 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:24:41 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:24:41 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:24:43 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690899883.3673768, 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:24:43 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] VM Resumed (Lifecycle Event)
Aug 01 14:24:43 user nova-compute[72129]: DEBUG nova.compute.manager [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Instance event wait completed in 0 seconds for  {{(pid=72129) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 14:24:43 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Guest created on hypervisor {{(pid=72129) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 14:24:43 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Instance spawned successfully.
Aug 01 14:24:43 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 14:24:43 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:24:43 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:24:43 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Found default for hw_cdrom_bus of ide {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:24:43 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Found default for hw_disk_bus of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:24:43 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Found default for hw_input_bus of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:24:43 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Found default for hw_pointer_model of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:24:43 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Found default for hw_video_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:24:43 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Found default for hw_vif_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:24:43 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 14:24:43 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690899883.3690374, 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:24:43 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] VM Started (Lifecycle Event)
Aug 01 14:24:43 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:24:43 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:24:43 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 14:24:43 user nova-compute[72129]: INFO nova.compute.manager [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Took 5.47 seconds to spawn the instance on the hypervisor.
Aug 01 14:24:43 user nova-compute[72129]: DEBUG nova.compute.manager [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:24:43 user nova-compute[72129]: DEBUG nova.compute.manager [req-0468e158-98e9-4c47-8c3c-2a71b35ed61e req-69cb5777-9b4d-4847-85f8-ebcf92b7f539 service nova] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Received event network-vif-plugged-ed958cf2-355f-460b-be85-8e7c2b1c34ca {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:24:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-0468e158-98e9-4c47-8c3c-2a71b35ed61e req-69cb5777-9b4d-4847-85f8-ebcf92b7f539 service nova] Acquiring lock "5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:24:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-0468e158-98e9-4c47-8c3c-2a71b35ed61e req-69cb5777-9b4d-4847-85f8-ebcf92b7f539 service nova] Lock "5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:24:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-0468e158-98e9-4c47-8c3c-2a71b35ed61e req-69cb5777-9b4d-4847-85f8-ebcf92b7f539 service nova] Lock "5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:24:43 user nova-compute[72129]: DEBUG nova.compute.manager [req-0468e158-98e9-4c47-8c3c-2a71b35ed61e req-69cb5777-9b4d-4847-85f8-ebcf92b7f539 service nova] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] No waiting events found dispatching network-vif-plugged-ed958cf2-355f-460b-be85-8e7c2b1c34ca {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:24:43 user nova-compute[72129]: WARNING nova.compute.manager [req-0468e158-98e9-4c47-8c3c-2a71b35ed61e req-69cb5777-9b4d-4847-85f8-ebcf92b7f539 service nova] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Received unexpected event network-vif-plugged-ed958cf2-355f-460b-be85-8e7c2b1c34ca for instance with vm_state building and task_state spawning.
Aug 01 14:24:43 user nova-compute[72129]: INFO nova.compute.manager [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Took 6.13 seconds to build instance.
Aug 01 14:24:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-996dea67-da71-484e-9a06-171437c51df9 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.229s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:24:44 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:24:46 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:24:49 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:24:54 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:24:56 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:24:56 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:24:59 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:25:01 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:25:03 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:25:04 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:25:05 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:25:05 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72129) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 14:25:05 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:25:06 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:25:06 user nova-compute[72129]: DEBUG nova.compute.manager [req-76819be8-0850-4d72-8f28-c8d32e9a266b req-d6d3a315-7bff-4e95-b307-825580c7d48d service nova] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Received event network-changed-7cc66f81-8cb9-416d-b9c3-03451989c713 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:25:06 user nova-compute[72129]: DEBUG nova.compute.manager [req-76819be8-0850-4d72-8f28-c8d32e9a266b req-d6d3a315-7bff-4e95-b307-825580c7d48d service nova] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Refreshing instance network info cache due to event network-changed-7cc66f81-8cb9-416d-b9c3-03451989c713. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 14:25:06 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-76819be8-0850-4d72-8f28-c8d32e9a266b req-d6d3a315-7bff-4e95-b307-825580c7d48d service nova] Acquiring lock "refresh_cache-5e602ce0-ffe8-4737-86cb-5caee367f2b4" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:25:06 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-76819be8-0850-4d72-8f28-c8d32e9a266b req-d6d3a315-7bff-4e95-b307-825580c7d48d service nova] Acquired lock "refresh_cache-5e602ce0-ffe8-4737-86cb-5caee367f2b4" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:25:06 user nova-compute[72129]: DEBUG nova.network.neutron [req-76819be8-0850-4d72-8f28-c8d32e9a266b req-d6d3a315-7bff-4e95-b307-825580c7d48d service nova] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Refreshing network info cache for port 7cc66f81-8cb9-416d-b9c3-03451989c713 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 14:25:07 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:25:07 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Starting heal instance info cache {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 14:25:07 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Rebuilding the list of instances to heal {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 14:25:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-8918fb42-529e-4845-bc94-5e67a02a5922 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Acquiring lock "5e602ce0-ffe8-4737-86cb-5caee367f2b4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:25:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-8918fb42-529e-4845-bc94-5e67a02a5922 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lock "5e602ce0-ffe8-4737-86cb-5caee367f2b4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:25:07 user nova-compute[72129]: DEBUG nova.objects.instance [None req-8918fb42-529e-4845-bc94-5e67a02a5922 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lazy-loading 'flavor' on Instance uuid 5e602ce0-ffe8-4737-86cb-5caee367f2b4 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:25:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "refresh_cache-b3f54430-8d5d-478b-8dc7-d7592ee3db36" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:25:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquired lock "refresh_cache-b3f54430-8d5d-478b-8dc7-d7592ee3db36" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:25:07 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Forcefully refreshing network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 14:25:07 user nova-compute[72129]: DEBUG nova.objects.instance [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lazy-loading 'info_cache' on Instance uuid b3f54430-8d5d-478b-8dc7-d7592ee3db36 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:25:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-8918fb42-529e-4845-bc94-5e67a02a5922 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lock "5e602ce0-ffe8-4737-86cb-5caee367f2b4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:25:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-8918fb42-529e-4845-bc94-5e67a02a5922 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Acquiring lock "5e602ce0-ffe8-4737-86cb-5caee367f2b4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:25:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-8918fb42-529e-4845-bc94-5e67a02a5922 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lock "5e602ce0-ffe8-4737-86cb-5caee367f2b4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:25:07 user nova-compute[72129]: INFO nova.compute.manager [None req-8918fb42-529e-4845-bc94-5e67a02a5922 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Attaching volume d0a34f37-192e-4503-ae13-eb1f850bb189 to /dev/vdb
Aug 01 14:25:07 user nova-compute[72129]: DEBUG nova.network.neutron [req-76819be8-0850-4d72-8f28-c8d32e9a266b req-d6d3a315-7bff-4e95-b307-825580c7d48d service nova] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Updated VIF entry in instance network info cache for port 7cc66f81-8cb9-416d-b9c3-03451989c713. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 14:25:07 user nova-compute[72129]: DEBUG nova.network.neutron [req-76819be8-0850-4d72-8f28-c8d32e9a266b req-d6d3a315-7bff-4e95-b307-825580c7d48d service nova] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Updating instance_info_cache with network_info: [{"id": "7cc66f81-8cb9-416d-b9c3-03451989c713", "address": "fa:16:3e:f6:cb:d3", "network": {"id": "6ffcec16-7b44-472a-b7cd-af16ebd4a653", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-901464581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cca3e17d4e4df79c94c4b94fb3fcec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc66f81-8c", "ovs_interfaceid": "7cc66f81-8cb9-416d-b9c3-03451989c713", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:25:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-76819be8-0850-4d72-8f28-c8d32e9a266b req-d6d3a315-7bff-4e95-b307-825580c7d48d service nova] Releasing lock "refresh_cache-5e602ce0-ffe8-4737-86cb-5caee367f2b4" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:25:07 user nova-compute[72129]: DEBUG os_brick.utils [None req-8918fb42-529e-4845-bc94-5e67a02a5922 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:25:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:25:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:25:07 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07670eb-9b64-4a67-9442-c24d6456ab19]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f9b449c2cd3d\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:25:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:25:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:25:07 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ab789c-f315-4a82-8632-bdf5f6efd947]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:25:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:25:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:25:07 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d08e9d-13f3-4f94-8660-0530f0cce0e9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:25:07 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a122307-dc39-4930-8314-e98b4b15409e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:25:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-8918fb42-529e-4845-bc94-5e67a02a5922 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Running cmd (subprocess): nvme version {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:25:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-8918fb42-529e-4845-bc94-5e67a02a5922 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] 'nvme version' failed. Not Retrying. {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 14:25:07 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8918fb42-529e-4845-bc94-5e67a02a5922 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] nvme not present on system {{(pid=72129) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 14:25:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:25:07 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 14:25:07 user nova-compute[72129]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 14:25:07 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd97fce5-cb98-4aba-a403-215c0e276363]: (4, '') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:25:07 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-8918fb42-529e-4845-bc94-5e67a02a5922 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72129) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 14:25:07 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-8918fb42-529e-4845-bc94-5e67a02a5922 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 14:25:07 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-8918fb42-529e-4845-bc94-5e67a02a5922 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] LIGHTOS: no hostnqn found. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 14:25:07 user nova-compute[72129]: DEBUG os_brick.utils [None req-8918fb42-529e-4845-bc94-5e67a02a5922 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f9b449c2cd3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:25:07 user nova-compute[72129]: DEBUG nova.virt.block_device [None req-8918fb42-529e-4845-bc94-5e67a02a5922 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Updating existing volume attachment record: b0fa09fe-cbf1-4ccc-a775-bc76d3c0e90a {{(pid=72129) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 14:25:08 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Updating instance_info_cache with network_info: [{"id": "77cb18a9-2c41-4aa6-8784-ffcbafeb1341", "address": "fa:16:3e:d2:d6:8b", "network": {"id": "6ffcec16-7b44-472a-b7cd-af16ebd4a653", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-901464581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cca3e17d4e4df79c94c4b94fb3fcec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77cb18a9-2c", "ovs_interfaceid": "77cb18a9-2c41-4aa6-8784-ffcbafeb1341", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:25:08 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Releasing lock "refresh_cache-b3f54430-8d5d-478b-8dc7-d7592ee3db36" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:25:08 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Updated the network info_cache for instance {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 14:25:08 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:25:08 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:25:08 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:25:08 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:25:08 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:25:08 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Auditing locally available compute resources for user (node: user) {{(pid=72129) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 14:25:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e602ce0-ffe8-4737-86cb-5caee367f2b4/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:25:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e602ce0-ffe8-4737-86cb-5caee367f2b4/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:25:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e602ce0-ffe8-4737-86cb-5caee367f2b4/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:25:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e602ce0-ffe8-4737-86cb-5caee367f2b4/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:25:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:25:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:25:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:25:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:25:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:25:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:25:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:25:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:25:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk.rescue --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:25:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:25:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk.rescue --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:25:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:25:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:25:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:25:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:25:09 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:25:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:25:09 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:25:10 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:25:10 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:25:10 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Hypervisor/Node resource view: name=user free_ram=8425MB free_disk=25.101741790771484GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72129) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 14:25:10 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:25:10 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:25:10 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance b3f54430-8d5d-478b-8dc7-d7592ee3db36 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:25:10 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:25:10 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 5e602ce0-ffe8-4737-86cb-5caee367f2b4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:25:10 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:25:10 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 14:25:10 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 14:25:10 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:25:10 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:25:10 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Compute_service record updated for user:user {{(pid=72129) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 14:25:10 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.286s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:25:11 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:25:12 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:25:12 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:25:12 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:25:12 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:25:13 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:25:14 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:25:14 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8918fb42-529e-4845-bc94-5e67a02a5922 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Calling os-brick to attach iSCSI Volume {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 14:25:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-8918fb42-529e-4845-bc94-5e67a02a5922 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d0a34f37-192e-4503-ae13-eb1f850bb189'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ASEtQeXv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:25:14 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-8918fb42-529e-4845-bc94-5e67a02a5922 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:25:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-8918fb42-529e-4845-bc94-5e67a02a5922 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:25:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-8918fb42-529e-4845-bc94-5e67a02a5922 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:25:14 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-8918fb42-529e-4845-bc94-5e67a02a5922 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:25:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-8918fb42-529e-4845-bc94-5e67a02a5922 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0a34f37-192e-4503-ae13-eb1f850bb189" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:25:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-8918fb42-529e-4845-bc94-5e67a02a5922 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0a34f37-192e-4503-ae13-eb1f850bb189" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:25:14 user nova-compute[72129]: INFO os_brick.initiator.connectors.iscsi [None req-8918fb42-529e-4845-bc94-5e67a02a5922 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 14:25:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0a34f37-192e-4503-ae13-eb1f850bb189 -p 172.16.0.220:3260 {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:25:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0a34f37-192e-4503-ae13-eb1f850bb189 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:25:14 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebcd45aa-ca6a-4ff9-9bad-a45dc35c078d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:25:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-8918fb42-529e-4845-bc94-5e67a02a5922 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 14:25:14 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:25:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0a34f37-192e-4503-ae13-eb1f850bb189 -p 172.16.0.220:3260 --interface default --op new {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:25:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0a34f37-192e-4503-ae13-eb1f850bb189 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:25:14 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a862ec-bb9b-4576-b40f-21b8b946b59d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d0a34f37-192e-4503-ae13-eb1f850bb189] added\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:25:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-8918fb42-529e-4845-bc94-5e67a02a5922 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d0a34f37-192e-4503-ae13-eb1f850bb189] added
Aug 01 14:25:14 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:25:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0a34f37-192e-4503-ae13-eb1f850bb189 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:25:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0a34f37-192e-4503-ae13-eb1f850bb189 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:25:14 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[f590e3f0-ee30-46b7-b887-b127d160da3a]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:25:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-8918fb42-529e-4845-bc94-5e67a02a5922 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:25:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0a34f37-192e-4503-ae13-eb1f850bb189 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:25:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0a34f37-192e-4503-ae13-eb1f850bb189 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:25:14 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[9102f5be-6343-4168-a48e-fcc26fb2b2c8]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:25:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-8918fb42-529e-4845-bc94-5e67a02a5922 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:25:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0a34f37-192e-4503-ae13-eb1f850bb189 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ASEtQeXv {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:25:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0a34f37-192e-4503-ae13-eb1f850bb189 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ASEtQeXv" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:25:14 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[4470175a-de0a-4652-a5cc-dafe9863bbcd]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:25:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-8918fb42-529e-4845-bc94-5e67a02a5922 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ASEtQeXv'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:25:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0a34f37-192e-4503-ae13-eb1f850bb189 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:25:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0a34f37-192e-4503-ae13-eb1f850bb189 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:25:14 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f98687-4ec2-429d-860e-9b6ffb328e79]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:25:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-8918fb42-529e-4845-bc94-5e67a02a5922 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:25:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:25:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:25:14 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b336e0a-349d-450d-98df-a520840ad773]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:25:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-8918fb42-529e-4845-bc94-5e67a02a5922 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 14:25:14 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:25:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-8918fb42-529e-4845-bc94-5e67a02a5922 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 14:25:14 user nova-compute[72129]:  {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:25:14 user nova-compute[72129]: WARNING os_brick.initiator.connectors.iscsi [None req-8918fb42-529e-4845-bc94-5e67a02a5922 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 14:25:14 user nova-compute[72129]: 
Aug 01 14:25:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0a34f37-192e-4503-ae13-eb1f850bb189 -p 172.16.0.220:3260 --login {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:25:14 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:25:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0a34f37-192e-4503-ae13-eb1f850bb189 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:25:14 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[97484c20-9177-4aab-b5e6-357b0ee32652]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d0a34f37-192e-4503-ae13-eb1f850bb189, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d0a34f37-192e-4503-ae13-eb1f850bb189, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:25:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-8918fb42-529e-4845-bc94-5e67a02a5922 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d0a34f37-192e-4503-ae13-eb1f850bb189, portal: 172.16.0.220,3260]
Aug 01 14:25:14 user nova-compute[72129]: Login to [iface: default, target: iqn.2010-10.org.openstack:d0a34f37-192e-4503-ae13-eb1f850bb189, portal: 172.16.0.220,3260] successful.
Aug 01 14:25:14 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:25:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0a34f37-192e-4503-ae13-eb1f850bb189 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:25:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0a34f37-192e-4503-ae13-eb1f850bb189 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:25:14 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[e83b8fec-e424-4da6-ae50-f114103d8d30]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:25:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-8918fb42-529e-4845-bc94-5e67a02a5922 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:25:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:25:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:25:14 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece8af93-8273-4f75-b44f-0a8b18c90425]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0a34f37-192e-4503-ae13-eb1f850bb189 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:25:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-8918fb42-529e-4845-bc94-5e67a02a5922 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0a34f37-192e-4503-ae13-eb1f850bb189 (non-flash)
Aug 01 14:25:14 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:25:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-8918fb42-529e-4845-bc94-5e67a02a5922 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0a34f37-192e-4503-ae13-eb1f850bb189 (non-flash)
Aug 01 14:25:14 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:25:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-8918fb42-529e-4845-bc94-5e67a02a5922 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0a34f37-192e-4503-ae13-eb1f850bb189" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:25:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-8918fb42-529e-4845-bc94-5e67a02a5922 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Connected to 172.16.0.220:3260 {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 14:25:14 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-8918fb42-529e-4845-bc94-5e67a02a5922 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=72129) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 14:25:14 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-8918fb42-529e-4845-bc94-5e67a02a5922 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72129) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 14:25:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:25:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:25:14 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e8c75f-a750-47f4-9cbf-53775cd235a6]: (4, ('- - 0', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:25:14 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-8918fb42-529e-4845-bc94-5e67a02a5922 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 14:25:14 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-8918fb42-529e-4845-bc94-5e67a02a5922 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ASEtQeXv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 14:25:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Acquiring lock "a3319e68-8c91-404f-800b-6798fb16aa75" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:25:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Lock "a3319e68-8c91-404f-800b-6798fb16aa75" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:25:15 user nova-compute[72129]: DEBUG nova.compute.manager [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Starting instance... {{(pid=72129) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 14:25:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:25:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:25:15 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72129) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 14:25:15 user nova-compute[72129]: INFO nova.compute.claims [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Claim successful on node user
Aug 01 14:25:15 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-8918fb42-529e-4845-bc94-5e67a02a5922 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:25:15 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-8918fb42-529e-4845-bc94-5e67a02a5922 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23535646632366538', 'path': '/dev/sdb'} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:25:15 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8918fb42-529e-4845-bc94-5e67a02a5922 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23535646632366538', 'path': '/dev/sdb'} {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 14:25:15 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:25:15 user nova-compute[72129]: DEBUG nova.objects.instance [None req-8918fb42-529e-4845-bc94-5e67a02a5922 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lazy-loading 'flavor' on Instance uuid 5e602ce0-ffe8-4737-86cb-5caee367f2b4 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:25:16 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:25:16 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-8918fb42-529e-4845-bc94-5e67a02a5922 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 14:25:16 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:25:16 user nova-compute[72129]:   <source dev="/dev/sdb"/>
Aug 01 14:25:16 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 14:25:16 user nova-compute[72129]:   <serial>d0a34f37-192e-4503-ae13-eb1f850bb189</serial>
Aug 01 14:25:16 user nova-compute[72129]: </disk>
Aug 01 14:25:16 user nova-compute[72129]:  {{(pid=72129) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 14:25:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.285s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:25:16 user nova-compute[72129]: DEBUG nova.compute.manager [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Start building networks asynchronously for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 14:25:16 user nova-compute[72129]: DEBUG nova.compute.manager [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Allocating IP information in the background. {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 14:25:16 user nova-compute[72129]: DEBUG nova.network.neutron [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] allocate_for_instance() {{(pid=72129) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 14:25:16 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 14:25:16 user nova-compute[72129]: DEBUG nova.compute.manager [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Start building block device mappings for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 14:25:16 user nova-compute[72129]: DEBUG nova.policy [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9bf10b1642e642658bec5d0ac60b7abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91b43b1394048719e2ed69f5c3ae94f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72129) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 14:25:16 user nova-compute[72129]: DEBUG nova.compute.manager [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Start spawning the instance on the hypervisor. {{(pid=72129) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 14:25:16 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Creating instance directory {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 14:25:16 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Creating image(s)
Aug 01 14:25:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Acquiring lock "/opt/stack/data/nova/instances/a3319e68-8c91-404f-800b-6798fb16aa75/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:25:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Lock "/opt/stack/data/nova/instances/a3319e68-8c91-404f-800b-6798fb16aa75/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:25:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Lock "/opt/stack/data/nova/instances/a3319e68-8c91-404f-800b-6798fb16aa75/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:25:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:25:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.151s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:25:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Acquiring lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:25:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:25:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:25:16 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-8918fb42-529e-4845-bc94-5e67a02a5922 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:25:16 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-8918fb42-529e-4845-bc94-5e67a02a5922 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:25:16 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-8918fb42-529e-4845-bc94-5e67a02a5922 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] No VIF found with MAC fa:16:3e:f6:cb:d3, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 14:25:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.145s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:25:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/a3319e68-8c91-404f-800b-6798fb16aa75/disk 1073741824 {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:25:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:25:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/a3319e68-8c91-404f-800b-6798fb16aa75/disk 1073741824" returned: 0 in 0.051s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:25:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:25:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:25:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-8918fb42-529e-4845-bc94-5e67a02a5922 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lock "5e602ce0-ffe8-4737-86cb-5caee367f2b4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.403s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:25:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.145s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:25:16 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a3319e68-8c91-404f-800b-6798fb16aa75/disk. size=1073741824 {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 14:25:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3319e68-8c91-404f-800b-6798fb16aa75/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:25:16 user nova-compute[72129]: DEBUG nova.network.neutron [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Successfully created port: 9fa9db76-1de9-4e10-962f-7d1e07b9582d {{(pid=72129) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 14:25:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3319e68-8c91-404f-800b-6798fb16aa75/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:25:16 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Cannot resize image /opt/stack/data/nova/instances/a3319e68-8c91-404f-800b-6798fb16aa75/disk to a smaller size. {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 14:25:16 user nova-compute[72129]: DEBUG nova.objects.instance [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Lazy-loading 'migration_context' on Instance uuid a3319e68-8c91-404f-800b-6798fb16aa75 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:25:16 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Created local disks {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 14:25:16 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Ensure instance console log exists: /opt/stack/data/nova/instances/a3319e68-8c91-404f-800b-6798fb16aa75/console.log {{(pid=72129) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 14:25:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:25:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:25:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:25:17 user nova-compute[72129]: INFO nova.compute.manager [None req-643c47bc-5c5c-445b-9b41-38b89be9dc1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Rescuing
Aug 01 14:25:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-643c47bc-5c5c-445b-9b41-38b89be9dc1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Acquiring lock "refresh_cache-5e602ce0-ffe8-4737-86cb-5caee367f2b4" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:25:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-643c47bc-5c5c-445b-9b41-38b89be9dc1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Acquired lock "refresh_cache-5e602ce0-ffe8-4737-86cb-5caee367f2b4" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:25:17 user nova-compute[72129]: DEBUG nova.network.neutron [None req-643c47bc-5c5c-445b-9b41-38b89be9dc1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 14:25:17 user nova-compute[72129]: DEBUG nova.network.neutron [None req-643c47bc-5c5c-445b-9b41-38b89be9dc1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Updating instance_info_cache with network_info: [{"id": "7cc66f81-8cb9-416d-b9c3-03451989c713", "address": "fa:16:3e:f6:cb:d3", "network": {"id": "6ffcec16-7b44-472a-b7cd-af16ebd4a653", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-901464581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cca3e17d4e4df79c94c4b94fb3fcec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc66f81-8c", "ovs_interfaceid": "7cc66f81-8cb9-416d-b9c3-03451989c713", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:25:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-643c47bc-5c5c-445b-9b41-38b89be9dc1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Releasing lock "refresh_cache-5e602ce0-ffe8-4737-86cb-5caee367f2b4" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:25:17 user nova-compute[72129]: DEBUG nova.network.neutron [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Successfully updated port: 9fa9db76-1de9-4e10-962f-7d1e07b9582d {{(pid=72129) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 14:25:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Acquiring lock "refresh_cache-a3319e68-8c91-404f-800b-6798fb16aa75" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:25:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Acquired lock "refresh_cache-a3319e68-8c91-404f-800b-6798fb16aa75" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:25:17 user nova-compute[72129]: DEBUG nova.network.neutron [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 14:25:17 user nova-compute[72129]: DEBUG nova.compute.manager [req-d50297dc-7fe8-4e16-9f60-694684f227e4 req-e2f41c1b-ae8d-4e53-9829-7bd77e634ef6 service nova] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Received event network-changed-9fa9db76-1de9-4e10-962f-7d1e07b9582d {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:25:17 user nova-compute[72129]: DEBUG nova.compute.manager [req-d50297dc-7fe8-4e16-9f60-694684f227e4 req-e2f41c1b-ae8d-4e53-9829-7bd77e634ef6 service nova] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Refreshing instance network info cache due to event network-changed-9fa9db76-1de9-4e10-962f-7d1e07b9582d. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 14:25:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-d50297dc-7fe8-4e16-9f60-694684f227e4 req-e2f41c1b-ae8d-4e53-9829-7bd77e634ef6 service nova] Acquiring lock "refresh_cache-a3319e68-8c91-404f-800b-6798fb16aa75" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:25:17 user nova-compute[72129]: DEBUG nova.network.neutron [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Instance cache missing network info. {{(pid=72129) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 14:25:17 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:25:17 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:25:17 user nova-compute[72129]: DEBUG nova.compute.manager [req-277d2043-ad05-4e29-9333-b64d14c752fb req-f3435953-d83a-4ab9-9a3e-503ed2cf16e1 service nova] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Received event network-vif-unplugged-7cc66f81-8cb9-416d-b9c3-03451989c713 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:25:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-277d2043-ad05-4e29-9333-b64d14c752fb req-f3435953-d83a-4ab9-9a3e-503ed2cf16e1 service nova] Acquiring lock "5e602ce0-ffe8-4737-86cb-5caee367f2b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:25:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-277d2043-ad05-4e29-9333-b64d14c752fb req-f3435953-d83a-4ab9-9a3e-503ed2cf16e1 service nova] Lock "5e602ce0-ffe8-4737-86cb-5caee367f2b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:25:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-277d2043-ad05-4e29-9333-b64d14c752fb req-f3435953-d83a-4ab9-9a3e-503ed2cf16e1 service nova] Lock "5e602ce0-ffe8-4737-86cb-5caee367f2b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:25:17 user nova-compute[72129]: DEBUG nova.compute.manager [req-277d2043-ad05-4e29-9333-b64d14c752fb req-f3435953-d83a-4ab9-9a3e-503ed2cf16e1 service nova] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] No waiting events found dispatching network-vif-unplugged-7cc66f81-8cb9-416d-b9c3-03451989c713 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:25:17 user nova-compute[72129]: WARNING nova.compute.manager [req-277d2043-ad05-4e29-9333-b64d14c752fb req-f3435953-d83a-4ab9-9a3e-503ed2cf16e1 service nova] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Received unexpected event network-vif-unplugged-7cc66f81-8cb9-416d-b9c3-03451989c713 for instance with vm_state active and task_state rescuing.
Aug 01 14:25:18 user nova-compute[72129]: DEBUG nova.network.neutron [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Updating instance_info_cache with network_info: [{"id": "9fa9db76-1de9-4e10-962f-7d1e07b9582d", "address": "fa:16:3e:ff:ce:94", "network": {"id": "d4ba0665-71f8-48a1-b3a2-2c73c2c7db3a", "bridge": "br-int", "label": "tempest-TestStampPattern-1150922129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a91b43b1394048719e2ed69f5c3ae94f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fa9db76-1d", "ovs_interfaceid": "9fa9db76-1de9-4e10-962f-7d1e07b9582d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:25:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:25:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:25:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Releasing lock "refresh_cache-a3319e68-8c91-404f-800b-6798fb16aa75" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:25:18 user nova-compute[72129]: DEBUG nova.compute.manager [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Instance network_info: |[{"id": "9fa9db76-1de9-4e10-962f-7d1e07b9582d", "address": "fa:16:3e:ff:ce:94", "network": {"id": "d4ba0665-71f8-48a1-b3a2-2c73c2c7db3a", "bridge": "br-int", "label": "tempest-TestStampPattern-1150922129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a91b43b1394048719e2ed69f5c3ae94f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fa9db76-1d", "ovs_interfaceid": "9fa9db76-1de9-4e10-962f-7d1e07b9582d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 14:25:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-d50297dc-7fe8-4e16-9f60-694684f227e4 req-e2f41c1b-ae8d-4e53-9829-7bd77e634ef6 service nova] Acquired lock "refresh_cache-a3319e68-8c91-404f-800b-6798fb16aa75" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:25:18 user nova-compute[72129]: DEBUG nova.network.neutron [req-d50297dc-7fe8-4e16-9f60-694684f227e4 req-e2f41c1b-ae8d-4e53-9829-7bd77e634ef6 service nova] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Refreshing network info cache for port 9fa9db76-1de9-4e10-962f-7d1e07b9582d {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 14:25:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Start _get_guest_xml network_info=[{"id": "9fa9db76-1de9-4e10-962f-7d1e07b9582d", "address": "fa:16:3e:ff:ce:94", "network": {"id": "d4ba0665-71f8-48a1-b3a2-2c73c2c7db3a", "bridge": "br-int", "label": "tempest-TestStampPattern-1150922129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a91b43b1394048719e2ed69f5c3ae94f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fa9db76-1d", "ovs_interfaceid": "9fa9db76-1de9-4e10-962f-7d1e07b9582d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'image_id': 'b6472c34-1b0f-4034-ba3a-7e8eb5103715'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 14:25:18 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:25:18 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:25:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 14:25:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] CPU controller missing on host. {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 14:25:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 14:25:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] CPU controller found on host. {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 14:25:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72129) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 14:25:18 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T13:45:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 14:25:18 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Flavor limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 14:25:18 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Image limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 14:25:18 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Flavor pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 14:25:18 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Image pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 14:25:18 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 14:25:18 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 14:25:18 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 14:25:18 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Got 1 possible topologies {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 14:25:18 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 14:25:18 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 14:25:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:25:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1390289890',display_name='tempest-TestStampPattern-server-1390289890',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1390289890',id=49,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCwUi55JC6c3jIlHojlRSa1D75mKSh1IzavmHf9G22Ze9c8CmQkw8Ybb7RlOQs1lEv+npQyyXxQntVe596OJBfHyUJy8lfQ5nyhMK2bUKD87QJNIia//pC3lm7PdMjjyDQ==',key_name='tempest-TestStampPattern-1260661357',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a91b43b1394048719e2ed69f5c3ae94f',ramdisk_id='',reservation_id='r-m0y6keih',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1201126667',owner_user_name='tempest-TestStampPattern-1201126667-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T14:25:16Z,user_data=None,user_id='9bf10b1642e642658bec5d0ac60b7abe',uuid=a3319e68-8c91-404f-800b-6798fb16aa75,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9fa9db76-1de9-4e10-962f-7d1e07b9582d", "address": "fa:16:3e:ff:ce:94", "network": {"id": "d4ba0665-71f8-48a1-b3a2-2c73c2c7db3a", "bridge": "br-int", "label": "tempest-TestStampPattern-1150922129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a91b43b1394048719e2ed69f5c3ae94f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fa9db76-1d", "ovs_interfaceid": "9fa9db76-1de9-4e10-962f-7d1e07b9582d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 14:25:18 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Converting VIF {"id": "9fa9db76-1de9-4e10-962f-7d1e07b9582d", "address": "fa:16:3e:ff:ce:94", "network": {"id": "d4ba0665-71f8-48a1-b3a2-2c73c2c7db3a", "bridge": "br-int", "label": "tempest-TestStampPattern-1150922129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a91b43b1394048719e2ed69f5c3ae94f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fa9db76-1d", "ovs_interfaceid": "9fa9db76-1de9-4e10-962f-7d1e07b9582d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:25:18 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:ce:94,bridge_name='br-int',has_traffic_filtering=True,id=9fa9db76-1de9-4e10-962f-7d1e07b9582d,network=Network(d4ba0665-71f8-48a1-b3a2-2c73c2c7db3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fa9db76-1d') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:25:18 user nova-compute[72129]: DEBUG nova.objects.instance [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Lazy-loading 'pci_devices' on Instance uuid a3319e68-8c91-404f-800b-6798fb16aa75 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:25:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] End _get_guest_xml xml=<domain type="kvm">
Aug 01 14:25:18 user nova-compute[72129]:   <uuid>a3319e68-8c91-404f-800b-6798fb16aa75</uuid>
Aug 01 14:25:18 user nova-compute[72129]:   <name>instance-00000031</name>
Aug 01 14:25:18 user nova-compute[72129]:   <memory>524288</memory>
Aug 01 14:25:18 user nova-compute[72129]:   <vcpu>1</vcpu>
Aug 01 14:25:18 user nova-compute[72129]:   <metadata>
Aug 01 14:25:18 user nova-compute[72129]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 14:25:18 user nova-compute[72129]:       <nova:package version="0.0.0"/>
Aug 01 14:25:18 user nova-compute[72129]:       <nova:name>tempest-TestStampPattern-server-1390289890</nova:name>
Aug 01 14:25:18 user nova-compute[72129]:       <nova:creationTime>2023-08-01 14:25:18</nova:creationTime>
Aug 01 14:25:18 user nova-compute[72129]:       <nova:flavor name="m1.tiny">
Aug 01 14:25:18 user nova-compute[72129]:         <nova:memory>512</nova:memory>
Aug 01 14:25:18 user nova-compute[72129]:         <nova:disk>1</nova:disk>
Aug 01 14:25:18 user nova-compute[72129]:         <nova:swap>0</nova:swap>
Aug 01 14:25:18 user nova-compute[72129]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 14:25:18 user nova-compute[72129]:         <nova:vcpus>1</nova:vcpus>
Aug 01 14:25:18 user nova-compute[72129]:       </nova:flavor>
Aug 01 14:25:18 user nova-compute[72129]:       <nova:owner>
Aug 01 14:25:18 user nova-compute[72129]:         <nova:user uuid="9bf10b1642e642658bec5d0ac60b7abe">tempest-TestStampPattern-1201126667-project-member</nova:user>
Aug 01 14:25:18 user nova-compute[72129]:         <nova:project uuid="a91b43b1394048719e2ed69f5c3ae94f">tempest-TestStampPattern-1201126667</nova:project>
Aug 01 14:25:18 user nova-compute[72129]:       </nova:owner>
Aug 01 14:25:18 user nova-compute[72129]:       <nova:root type="image" uuid="b6472c34-1b0f-4034-ba3a-7e8eb5103715"/>
Aug 01 14:25:18 user nova-compute[72129]:       <nova:ports>
Aug 01 14:25:18 user nova-compute[72129]:         <nova:port uuid="9fa9db76-1de9-4e10-962f-7d1e07b9582d">
Aug 01 14:25:18 user nova-compute[72129]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 01 14:25:18 user nova-compute[72129]:         </nova:port>
Aug 01 14:25:18 user nova-compute[72129]:       </nova:ports>
Aug 01 14:25:18 user nova-compute[72129]:     </nova:instance>
Aug 01 14:25:18 user nova-compute[72129]:   </metadata>
Aug 01 14:25:18 user nova-compute[72129]:   <sysinfo type="smbios">
Aug 01 14:25:18 user nova-compute[72129]:     <system>
Aug 01 14:25:18 user nova-compute[72129]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 14:25:18 user nova-compute[72129]:       <entry name="product">OpenStack Nova</entry>
Aug 01 14:25:18 user nova-compute[72129]:       <entry name="version">0.0.0</entry>
Aug 01 14:25:18 user nova-compute[72129]:       <entry name="serial">a3319e68-8c91-404f-800b-6798fb16aa75</entry>
Aug 01 14:25:18 user nova-compute[72129]:       <entry name="uuid">a3319e68-8c91-404f-800b-6798fb16aa75</entry>
Aug 01 14:25:18 user nova-compute[72129]:       <entry name="family">Virtual Machine</entry>
Aug 01 14:25:18 user nova-compute[72129]:     </system>
Aug 01 14:25:18 user nova-compute[72129]:   </sysinfo>
Aug 01 14:25:18 user nova-compute[72129]:   <os>
Aug 01 14:25:18 user nova-compute[72129]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 14:25:18 user nova-compute[72129]:     <boot dev="hd"/>
Aug 01 14:25:18 user nova-compute[72129]:     <smbios mode="sysinfo"/>
Aug 01 14:25:18 user nova-compute[72129]:   </os>
Aug 01 14:25:18 user nova-compute[72129]:   <features>
Aug 01 14:25:18 user nova-compute[72129]:     <acpi/>
Aug 01 14:25:18 user nova-compute[72129]:     <apic/>
Aug 01 14:25:18 user nova-compute[72129]:     <vmcoreinfo/>
Aug 01 14:25:18 user nova-compute[72129]:   </features>
Aug 01 14:25:18 user nova-compute[72129]:   <clock offset="utc">
Aug 01 14:25:18 user nova-compute[72129]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 14:25:18 user nova-compute[72129]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 14:25:18 user nova-compute[72129]:     <timer name="hpet" present="no"/>
Aug 01 14:25:18 user nova-compute[72129]:   </clock>
Aug 01 14:25:18 user nova-compute[72129]:   <cpu mode="custom" match="exact">
Aug 01 14:25:18 user nova-compute[72129]:     <model>Nehalem</model>
Aug 01 14:25:18 user nova-compute[72129]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 14:25:18 user nova-compute[72129]:   </cpu>
Aug 01 14:25:18 user nova-compute[72129]:   <devices>
Aug 01 14:25:18 user nova-compute[72129]:     <disk type="file" device="disk">
Aug 01 14:25:18 user nova-compute[72129]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 14:25:18 user nova-compute[72129]:       <source file="/opt/stack/data/nova/instances/a3319e68-8c91-404f-800b-6798fb16aa75/disk"/>
Aug 01 14:25:18 user nova-compute[72129]:       <target dev="vda" bus="virtio"/>
Aug 01 14:25:18 user nova-compute[72129]:     </disk>
Aug 01 14:25:18 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 14:25:18 user nova-compute[72129]:       <mac address="fa:16:3e:ff:ce:94"/>
Aug 01 14:25:18 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:25:18 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 14:25:18 user nova-compute[72129]:       <target dev="tap9fa9db76-1d"/>
Aug 01 14:25:18 user nova-compute[72129]:     </interface>
Aug 01 14:25:18 user nova-compute[72129]:     <serial type="pty">
Aug 01 14:25:18 user nova-compute[72129]:       <log file="/opt/stack/data/nova/instances/a3319e68-8c91-404f-800b-6798fb16aa75/console.log" append="off"/>
Aug 01 14:25:18 user nova-compute[72129]:     </serial>
Aug 01 14:25:18 user nova-compute[72129]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 14:25:18 user nova-compute[72129]:     <video>
Aug 01 14:25:18 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:25:18 user nova-compute[72129]:     </video>
Aug 01 14:25:18 user nova-compute[72129]:     <rng model="virtio">
Aug 01 14:25:18 user nova-compute[72129]:       <backend model="random">/dev/urandom</backend>
Aug 01 14:25:18 user nova-compute[72129]:     </rng>
Aug 01 14:25:18 user nova-compute[72129]:     <controller type="usb" index="0" model="none"/>
Aug 01 14:25:18 user nova-compute[72129]:     <memballoon model="virtio">
Aug 01 14:25:18 user nova-compute[72129]:       <stats period="10"/>
Aug 01 14:25:18 user nova-compute[72129]:     </memballoon>
Aug 01 14:25:18 user nova-compute[72129]:   </devices>
Aug 01 14:25:18 user nova-compute[72129]: </domain>
Aug 01 14:25:18 user nova-compute[72129]:  {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 14:25:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:25:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1390289890',display_name='tempest-TestStampPattern-server-1390289890',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1390289890',id=49,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCwUi55JC6c3jIlHojlRSa1D75mKSh1IzavmHf9G22Ze9c8CmQkw8Ybb7RlOQs1lEv+npQyyXxQntVe596OJBfHyUJy8lfQ5nyhMK2bUKD87QJNIia//pC3lm7PdMjjyDQ==',key_name='tempest-TestStampPattern-1260661357',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a91b43b1394048719e2ed69f5c3ae94f',ramdisk_id='',reservation_id='r-m0y6keih',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1201126667',owner_user_name='tempest-TestStampPattern-1201126667-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T14:25:16Z,user_data=None,user_id='9bf10b1642e642658bec5d0ac60b7abe',uuid=a3319e68-8c91-404f-800b-6798fb16aa75,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9fa9db76-1de9-4e10-962f-7d1e07b9582d", "address": "fa:16:3e:ff:ce:94", "network": {"id": "d4ba0665-71f8-48a1-b3a2-2c73c2c7db3a", "bridge": "br-int", "label": "tempest-TestStampPattern-1150922129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a91b43b1394048719e2ed69f5c3ae94f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fa9db76-1d", "ovs_interfaceid": "9fa9db76-1de9-4e10-962f-7d1e07b9582d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 14:25:18 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Converting VIF {"id": "9fa9db76-1de9-4e10-962f-7d1e07b9582d", "address": "fa:16:3e:ff:ce:94", "network": {"id": "d4ba0665-71f8-48a1-b3a2-2c73c2c7db3a", "bridge": "br-int", "label": "tempest-TestStampPattern-1150922129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a91b43b1394048719e2ed69f5c3ae94f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fa9db76-1d", "ovs_interfaceid": "9fa9db76-1de9-4e10-962f-7d1e07b9582d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:25:18 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:ce:94,bridge_name='br-int',has_traffic_filtering=True,id=9fa9db76-1de9-4e10-962f-7d1e07b9582d,network=Network(d4ba0665-71f8-48a1-b3a2-2c73c2c7db3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fa9db76-1d') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:25:18 user nova-compute[72129]: DEBUG os_vif [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:ce:94,bridge_name='br-int',has_traffic_filtering=True,id=9fa9db76-1de9-4e10-962f-7d1e07b9582d,network=Network(d4ba0665-71f8-48a1-b3a2-2c73c2c7db3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fa9db76-1d') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 14:25:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:25:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:25:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 14:25:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:25:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9fa9db76-1d, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:25:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9fa9db76-1d, col_values=(('external_ids', {'iface-id': '9fa9db76-1de9-4e10-962f-7d1e07b9582d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:ce:94', 'vm-uuid': 'a3319e68-8c91-404f-800b-6798fb16aa75'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:25:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:25:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:25:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:25:18 user nova-compute[72129]: INFO os_vif [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:ce:94,bridge_name='br-int',has_traffic_filtering=True,id=9fa9db76-1de9-4e10-962f-7d1e07b9582d,network=Network(d4ba0665-71f8-48a1-b3a2-2c73c2c7db3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fa9db76-1d')
Aug 01 14:25:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:25:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] No VIF found with MAC fa:16:3e:ff:ce:94, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 14:25:18 user nova-compute[72129]: DEBUG nova.network.neutron [req-d50297dc-7fe8-4e16-9f60-694684f227e4 req-e2f41c1b-ae8d-4e53-9829-7bd77e634ef6 service nova] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Updated VIF entry in instance network info cache for port 9fa9db76-1de9-4e10-962f-7d1e07b9582d. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 14:25:18 user nova-compute[72129]: DEBUG nova.network.neutron [req-d50297dc-7fe8-4e16-9f60-694684f227e4 req-e2f41c1b-ae8d-4e53-9829-7bd77e634ef6 service nova] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Updating instance_info_cache with network_info: [{"id": "9fa9db76-1de9-4e10-962f-7d1e07b9582d", "address": "fa:16:3e:ff:ce:94", "network": {"id": "d4ba0665-71f8-48a1-b3a2-2c73c2c7db3a", "bridge": "br-int", "label": "tempest-TestStampPattern-1150922129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a91b43b1394048719e2ed69f5c3ae94f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fa9db76-1d", "ovs_interfaceid": "9fa9db76-1de9-4e10-962f-7d1e07b9582d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:25:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-d50297dc-7fe8-4e16-9f60-694684f227e4 req-e2f41c1b-ae8d-4e53-9829-7bd77e634ef6 service nova] Releasing lock "refresh_cache-a3319e68-8c91-404f-800b-6798fb16aa75" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:25:18 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Instance destroyed successfully.
Aug 01 14:25:18 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-643c47bc-5c5c-445b-9b41-38b89be9dc1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Attempting rescue
Aug 01 14:25:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-643c47bc-5c5c-445b-9b41-38b89be9dc1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72129) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 01 14:25:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-643c47bc-5c5c-445b-9b41-38b89be9dc1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Instance directory exists: not creating {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 01 14:25:18 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-643c47bc-5c5c-445b-9b41-38b89be9dc1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Creating image(s)
Aug 01 14:25:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-643c47bc-5c5c-445b-9b41-38b89be9dc1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Acquiring lock "/opt/stack/data/nova/instances/5e602ce0-ffe8-4737-86cb-5caee367f2b4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:25:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-643c47bc-5c5c-445b-9b41-38b89be9dc1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lock "/opt/stack/data/nova/instances/5e602ce0-ffe8-4737-86cb-5caee367f2b4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:25:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-643c47bc-5c5c-445b-9b41-38b89be9dc1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lock "/opt/stack/data/nova/instances/5e602ce0-ffe8-4737-86cb-5caee367f2b4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:25:18 user nova-compute[72129]: DEBUG nova.objects.instance [None req-643c47bc-5c5c-445b-9b41-38b89be9dc1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5e602ce0-ffe8-4737-86cb-5caee367f2b4 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:25:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-643c47bc-5c5c-445b-9b41-38b89be9dc1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Acquiring lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:25:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-643c47bc-5c5c-445b-9b41-38b89be9dc1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:25:18 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-643c47bc-5c5c-445b-9b41-38b89be9dc1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:25:18 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-643c47bc-5c5c-445b-9b41-38b89be9dc1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.137s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:25:18 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-643c47bc-5c5c-445b-9b41-38b89be9dc1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/5e602ce0-ffe8-4737-86cb-5caee367f2b4/disk.rescue {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:25:18 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-643c47bc-5c5c-445b-9b41-38b89be9dc1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/5e602ce0-ffe8-4737-86cb-5caee367f2b4/disk.rescue" returned: 0 in 0.048s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:25:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-643c47bc-5c5c-445b-9b41-38b89be9dc1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.191s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:25:18 user nova-compute[72129]: DEBUG nova.objects.instance [None req-643c47bc-5c5c-445b-9b41-38b89be9dc1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lazy-loading 'migration_context' on Instance uuid 5e602ce0-ffe8-4737-86cb-5caee367f2b4 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:25:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-643c47bc-5c5c-445b-9b41-38b89be9dc1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Created local disks {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 14:25:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-643c47bc-5c5c-445b-9b41-38b89be9dc1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Start _get_guest_xml network_info=[{"id": "7cc66f81-8cb9-416d-b9c3-03451989c713", "address": "fa:16:3e:f6:cb:d3", "network": {"id": "6ffcec16-7b44-472a-b7cd-af16ebd4a653", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-901464581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-901464581-network", "vif_mac": "fa:16:3e:f6:cb:d3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cca3e17d4e4df79c94c4b94fb3fcec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc66f81-8c", "ovs_interfaceid": "7cc66f81-8cb9-416d-b9c3-03451989c713", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'b6472c34-1b0f-4034-ba3a-7e8eb5103715', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 14:25:18 user nova-compute[72129]: DEBUG nova.objects.instance [None req-643c47bc-5c5c-445b-9b41-38b89be9dc1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lazy-loading 'resources' on Instance uuid 5e602ce0-ffe8-4737-86cb-5caee367f2b4 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:25:18 user nova-compute[72129]: DEBUG nova.objects.instance [None req-643c47bc-5c5c-445b-9b41-38b89be9dc1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lazy-loading 'numa_topology' on Instance uuid 5e602ce0-ffe8-4737-86cb-5caee367f2b4 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:25:18 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-643c47bc-5c5c-445b-9b41-38b89be9dc1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:25:18 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-643c47bc-5c5c-445b-9b41-38b89be9dc1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:25:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-643c47bc-5c5c-445b-9b41-38b89be9dc1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 14:25:19 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-643c47bc-5c5c-445b-9b41-38b89be9dc1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] CPU controller missing on host. {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 14:25:19 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-643c47bc-5c5c-445b-9b41-38b89be9dc1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 14:25:19 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-643c47bc-5c5c-445b-9b41-38b89be9dc1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] CPU controller found on host. {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 14:25:19 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-643c47bc-5c5c-445b-9b41-38b89be9dc1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72129) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 14:25:19 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-643c47bc-5c5c-445b-9b41-38b89be9dc1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T13:45:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 14:25:19 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-643c47bc-5c5c-445b-9b41-38b89be9dc1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Flavor limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 14:25:19 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-643c47bc-5c5c-445b-9b41-38b89be9dc1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Image limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 14:25:19 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-643c47bc-5c5c-445b-9b41-38b89be9dc1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Flavor pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 14:25:19 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-643c47bc-5c5c-445b-9b41-38b89be9dc1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Image pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 14:25:19 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-643c47bc-5c5c-445b-9b41-38b89be9dc1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 14:25:19 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-643c47bc-5c5c-445b-9b41-38b89be9dc1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 14:25:19 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-643c47bc-5c5c-445b-9b41-38b89be9dc1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 14:25:19 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-643c47bc-5c5c-445b-9b41-38b89be9dc1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Got 1 possible topologies {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 14:25:19 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-643c47bc-5c5c-445b-9b41-38b89be9dc1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 14:25:19 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-643c47bc-5c5c-445b-9b41-38b89be9dc1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 14:25:19 user nova-compute[72129]: DEBUG nova.objects.instance [None req-643c47bc-5c5c-445b-9b41-38b89be9dc1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5e602ce0-ffe8-4737-86cb-5caee367f2b4 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:25:19 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-643c47bc-5c5c-445b-9b41-38b89be9dc1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:23:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1551117721',display_name='tempest-ServerRescueNegativeTestJSON-server-1551117721',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1551117721',id=47,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDeGC2OYrAuhdtsQ12w8hkrsQ4BStQKdcxMAGWGF9i5CEavjy55aog2hOysoEWEG4SBA9Pa0TYoxd11hOhqvXgl0N1sUSAtZyoNVLM//3QjvgWjRgJBjm0nAZ0L+/1WReA==',key_name='tempest-keypair-592319693',keypairs=<?>,launch_index=0,launched_at=2023-08-01T14:23:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='42cca3e17d4e4df79c94c4b94fb3fcec',ramdisk_id='',reservation_id='r-mfltbgi9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-481576424',owner_user_name='tempest-ServerRescueNegativeTestJSON-481576424-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T14:23:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='deb1597afdc647598ee893dd51880173',uuid=5e602ce0-ffe8-4737-86cb-5caee367f2b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7cc66f81-8cb9-416d-b9c3-03451989c713", "address": "fa:16:3e:f6:cb:d3", "network": {"id": "6ffcec16-7b44-472a-b7cd-af16ebd4a653", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-901464581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-901464581-network", "vif_mac": "fa:16:3e:f6:cb:d3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cca3e17d4e4df79c94c4b94fb3fcec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc66f81-8c", "ovs_interfaceid": "7cc66f81-8cb9-416d-b9c3-03451989c713", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 14:25:19 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-643c47bc-5c5c-445b-9b41-38b89be9dc1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Converting VIF {"id": "7cc66f81-8cb9-416d-b9c3-03451989c713", "address": "fa:16:3e:f6:cb:d3", "network": {"id": "6ffcec16-7b44-472a-b7cd-af16ebd4a653", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-901464581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-901464581-network", "vif_mac": "fa:16:3e:f6:cb:d3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cca3e17d4e4df79c94c4b94fb3fcec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc66f81-8c", "ovs_interfaceid": "7cc66f81-8cb9-416d-b9c3-03451989c713", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:25:19 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-643c47bc-5c5c-445b-9b41-38b89be9dc1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f6:cb:d3,bridge_name='br-int',has_traffic_filtering=True,id=7cc66f81-8cb9-416d-b9c3-03451989c713,network=Network(6ffcec16-7b44-472a-b7cd-af16ebd4a653),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cc66f81-8c') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:25:19 user nova-compute[72129]: DEBUG nova.objects.instance [None req-643c47bc-5c5c-445b-9b41-38b89be9dc1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lazy-loading 'pci_devices' on Instance uuid 5e602ce0-ffe8-4737-86cb-5caee367f2b4 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:25:19 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-643c47bc-5c5c-445b-9b41-38b89be9dc1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] End _get_guest_xml xml=<domain type="kvm">
Aug 01 14:25:19 user nova-compute[72129]:   <uuid>5e602ce0-ffe8-4737-86cb-5caee367f2b4</uuid>
Aug 01 14:25:19 user nova-compute[72129]:   <name>instance-0000002f</name>
Aug 01 14:25:19 user nova-compute[72129]:   <memory>524288</memory>
Aug 01 14:25:19 user nova-compute[72129]:   <vcpu>1</vcpu>
Aug 01 14:25:19 user nova-compute[72129]:   <metadata>
Aug 01 14:25:19 user nova-compute[72129]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 14:25:19 user nova-compute[72129]:       <nova:package version="0.0.0"/>
Aug 01 14:25:19 user nova-compute[72129]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1551117721</nova:name>
Aug 01 14:25:19 user nova-compute[72129]:       <nova:creationTime>2023-08-01 14:25:18</nova:creationTime>
Aug 01 14:25:19 user nova-compute[72129]:       <nova:flavor name="m1.tiny">
Aug 01 14:25:19 user nova-compute[72129]:         <nova:memory>512</nova:memory>
Aug 01 14:25:19 user nova-compute[72129]:         <nova:disk>1</nova:disk>
Aug 01 14:25:19 user nova-compute[72129]:         <nova:swap>0</nova:swap>
Aug 01 14:25:19 user nova-compute[72129]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 14:25:19 user nova-compute[72129]:         <nova:vcpus>1</nova:vcpus>
Aug 01 14:25:19 user nova-compute[72129]:       </nova:flavor>
Aug 01 14:25:19 user nova-compute[72129]:       <nova:owner>
Aug 01 14:25:19 user nova-compute[72129]:         <nova:user uuid="deb1597afdc647598ee893dd51880173">tempest-ServerRescueNegativeTestJSON-481576424-project-member</nova:user>
Aug 01 14:25:19 user nova-compute[72129]:         <nova:project uuid="42cca3e17d4e4df79c94c4b94fb3fcec">tempest-ServerRescueNegativeTestJSON-481576424</nova:project>
Aug 01 14:25:19 user nova-compute[72129]:       </nova:owner>
Aug 01 14:25:19 user nova-compute[72129]:       <nova:root type="image" uuid="b6472c34-1b0f-4034-ba3a-7e8eb5103715"/>
Aug 01 14:25:19 user nova-compute[72129]:       <nova:ports>
Aug 01 14:25:19 user nova-compute[72129]:         <nova:port uuid="7cc66f81-8cb9-416d-b9c3-03451989c713">
Aug 01 14:25:19 user nova-compute[72129]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 01 14:25:19 user nova-compute[72129]:         </nova:port>
Aug 01 14:25:19 user nova-compute[72129]:       </nova:ports>
Aug 01 14:25:19 user nova-compute[72129]:     </nova:instance>
Aug 01 14:25:19 user nova-compute[72129]:   </metadata>
Aug 01 14:25:19 user nova-compute[72129]:   <sysinfo type="smbios">
Aug 01 14:25:19 user nova-compute[72129]:     <system>
Aug 01 14:25:19 user nova-compute[72129]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 14:25:19 user nova-compute[72129]:       <entry name="product">OpenStack Nova</entry>
Aug 01 14:25:19 user nova-compute[72129]:       <entry name="version">0.0.0</entry>
Aug 01 14:25:19 user nova-compute[72129]:       <entry name="serial">5e602ce0-ffe8-4737-86cb-5caee367f2b4</entry>
Aug 01 14:25:19 user nova-compute[72129]:       <entry name="uuid">5e602ce0-ffe8-4737-86cb-5caee367f2b4</entry>
Aug 01 14:25:19 user nova-compute[72129]:       <entry name="family">Virtual Machine</entry>
Aug 01 14:25:19 user nova-compute[72129]:     </system>
Aug 01 14:25:19 user nova-compute[72129]:   </sysinfo>
Aug 01 14:25:19 user nova-compute[72129]:   <os>
Aug 01 14:25:19 user nova-compute[72129]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 14:25:19 user nova-compute[72129]:     <smbios mode="sysinfo"/>
Aug 01 14:25:19 user nova-compute[72129]:   </os>
Aug 01 14:25:19 user nova-compute[72129]:   <features>
Aug 01 14:25:19 user nova-compute[72129]:     <acpi/>
Aug 01 14:25:19 user nova-compute[72129]:     <apic/>
Aug 01 14:25:19 user nova-compute[72129]:     <vmcoreinfo/>
Aug 01 14:25:19 user nova-compute[72129]:   </features>
Aug 01 14:25:19 user nova-compute[72129]:   <clock offset="utc">
Aug 01 14:25:19 user nova-compute[72129]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 14:25:19 user nova-compute[72129]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 14:25:19 user nova-compute[72129]:     <timer name="hpet" present="no"/>
Aug 01 14:25:19 user nova-compute[72129]:   </clock>
Aug 01 14:25:19 user nova-compute[72129]:   <cpu mode="custom" match="exact">
Aug 01 14:25:19 user nova-compute[72129]:     <model>Nehalem</model>
Aug 01 14:25:19 user nova-compute[72129]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 14:25:19 user nova-compute[72129]:   </cpu>
Aug 01 14:25:19 user nova-compute[72129]:   <devices>
Aug 01 14:25:19 user nova-compute[72129]:     <disk type="file" device="disk">
Aug 01 14:25:19 user nova-compute[72129]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 14:25:19 user nova-compute[72129]:       <source file="/opt/stack/data/nova/instances/5e602ce0-ffe8-4737-86cb-5caee367f2b4/disk.rescue"/>
Aug 01 14:25:19 user nova-compute[72129]:       <target dev="vda" bus="virtio"/>
Aug 01 14:25:19 user nova-compute[72129]:     </disk>
Aug 01 14:25:19 user nova-compute[72129]:     <disk type="file" device="disk">
Aug 01 14:25:19 user nova-compute[72129]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 14:25:19 user nova-compute[72129]:       <source file="/opt/stack/data/nova/instances/5e602ce0-ffe8-4737-86cb-5caee367f2b4/disk"/>
Aug 01 14:25:19 user nova-compute[72129]:       <target dev="vdb" bus="virtio"/>
Aug 01 14:25:19 user nova-compute[72129]:     </disk>
Aug 01 14:25:19 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 14:25:19 user nova-compute[72129]:       <mac address="fa:16:3e:f6:cb:d3"/>
Aug 01 14:25:19 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:25:19 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 14:25:19 user nova-compute[72129]:       <target dev="tap7cc66f81-8c"/>
Aug 01 14:25:19 user nova-compute[72129]:     </interface>
Aug 01 14:25:19 user nova-compute[72129]:     <serial type="pty">
Aug 01 14:25:19 user nova-compute[72129]:       <log file="/opt/stack/data/nova/instances/5e602ce0-ffe8-4737-86cb-5caee367f2b4/console.log" append="off"/>
Aug 01 14:25:19 user nova-compute[72129]:     </serial>
Aug 01 14:25:19 user nova-compute[72129]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 14:25:19 user nova-compute[72129]:     <video>
Aug 01 14:25:19 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:25:19 user nova-compute[72129]:     </video>
Aug 01 14:25:19 user nova-compute[72129]:     <rng model="virtio">
Aug 01 14:25:19 user nova-compute[72129]:       <backend model="random">/dev/urandom</backend>
Aug 01 14:25:19 user nova-compute[72129]:     </rng>
Aug 01 14:25:19 user nova-compute[72129]:     <controller type="usb" index="0" model="none"/>
Aug 01 14:25:19 user nova-compute[72129]:     <memballoon model="virtio">
Aug 01 14:25:19 user nova-compute[72129]:       <stats period="10"/>
Aug 01 14:25:19 user nova-compute[72129]:     </memballoon>
Aug 01 14:25:19 user nova-compute[72129]:   </devices>
Aug 01 14:25:19 user nova-compute[72129]: </domain>
Aug 01 14:25:19 user nova-compute[72129]:  {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 14:25:19 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Instance destroyed successfully.
Aug 01 14:25:19 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-643c47bc-5c5c-445b-9b41-38b89be9dc1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:25:19 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-643c47bc-5c5c-445b-9b41-38b89be9dc1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:25:19 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-643c47bc-5c5c-445b-9b41-38b89be9dc1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] No VIF found with MAC fa:16:3e:f6:cb:d3, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 14:25:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:25:19 user nova-compute[72129]: DEBUG nova.compute.manager [req-4b357643-0729-435d-975c-c473f40f0e36 req-14a51eee-0562-42c8-be94-1a3955ef683e service nova] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Received event network-vif-plugged-7cc66f81-8cb9-416d-b9c3-03451989c713 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:25:19 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-4b357643-0729-435d-975c-c473f40f0e36 req-14a51eee-0562-42c8-be94-1a3955ef683e service nova] Acquiring lock "5e602ce0-ffe8-4737-86cb-5caee367f2b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:25:19 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-4b357643-0729-435d-975c-c473f40f0e36 req-14a51eee-0562-42c8-be94-1a3955ef683e service nova] Lock "5e602ce0-ffe8-4737-86cb-5caee367f2b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:25:19 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-4b357643-0729-435d-975c-c473f40f0e36 req-14a51eee-0562-42c8-be94-1a3955ef683e service nova] Lock "5e602ce0-ffe8-4737-86cb-5caee367f2b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:25:19 user nova-compute[72129]: DEBUG nova.compute.manager [req-4b357643-0729-435d-975c-c473f40f0e36 req-14a51eee-0562-42c8-be94-1a3955ef683e service nova] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] No waiting events found dispatching network-vif-plugged-7cc66f81-8cb9-416d-b9c3-03451989c713 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:25:19 user nova-compute[72129]: WARNING nova.compute.manager [req-4b357643-0729-435d-975c-c473f40f0e36 req-14a51eee-0562-42c8-be94-1a3955ef683e service nova] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Received unexpected event network-vif-plugged-7cc66f81-8cb9-416d-b9c3-03451989c713 for instance with vm_state active and task_state rescuing.
Aug 01 14:25:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:25:20 user nova-compute[72129]: DEBUG nova.compute.manager [req-b4c0d749-849d-43bf-96d1-0db874d35cfb req-f20a4256-886b-4adf-982a-01f4e2295d7a service nova] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Received event network-vif-plugged-9fa9db76-1de9-4e10-962f-7d1e07b9582d {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:25:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-b4c0d749-849d-43bf-96d1-0db874d35cfb req-f20a4256-886b-4adf-982a-01f4e2295d7a service nova] Acquiring lock "a3319e68-8c91-404f-800b-6798fb16aa75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:25:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-b4c0d749-849d-43bf-96d1-0db874d35cfb req-f20a4256-886b-4adf-982a-01f4e2295d7a service nova] Lock "a3319e68-8c91-404f-800b-6798fb16aa75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:25:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-b4c0d749-849d-43bf-96d1-0db874d35cfb req-f20a4256-886b-4adf-982a-01f4e2295d7a service nova] Lock "a3319e68-8c91-404f-800b-6798fb16aa75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:25:20 user nova-compute[72129]: DEBUG nova.compute.manager [req-b4c0d749-849d-43bf-96d1-0db874d35cfb req-f20a4256-886b-4adf-982a-01f4e2295d7a service nova] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] No waiting events found dispatching network-vif-plugged-9fa9db76-1de9-4e10-962f-7d1e07b9582d {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:25:20 user nova-compute[72129]: WARNING nova.compute.manager [req-b4c0d749-849d-43bf-96d1-0db874d35cfb req-f20a4256-886b-4adf-982a-01f4e2295d7a service nova] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Received unexpected event network-vif-plugged-9fa9db76-1de9-4e10-962f-7d1e07b9582d for instance with vm_state building and task_state spawning.
Aug 01 14:25:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:25:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:25:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:25:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:25:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:25:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:25:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:25:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:25:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:25:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:25:22 user nova-compute[72129]: DEBUG nova.compute.manager [req-da772cc4-50db-46fe-8692-28795df3bda6 req-336bacc9-5d54-43c8-86b7-2aabb545720f service nova] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Received event network-vif-plugged-7cc66f81-8cb9-416d-b9c3-03451989c713 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:25:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-da772cc4-50db-46fe-8692-28795df3bda6 req-336bacc9-5d54-43c8-86b7-2aabb545720f service nova] Acquiring lock "5e602ce0-ffe8-4737-86cb-5caee367f2b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:25:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-da772cc4-50db-46fe-8692-28795df3bda6 req-336bacc9-5d54-43c8-86b7-2aabb545720f service nova] Lock "5e602ce0-ffe8-4737-86cb-5caee367f2b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:25:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-da772cc4-50db-46fe-8692-28795df3bda6 req-336bacc9-5d54-43c8-86b7-2aabb545720f service nova] Lock "5e602ce0-ffe8-4737-86cb-5caee367f2b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:25:22 user nova-compute[72129]: DEBUG nova.compute.manager [req-da772cc4-50db-46fe-8692-28795df3bda6 req-336bacc9-5d54-43c8-86b7-2aabb545720f service nova] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] No waiting events found dispatching network-vif-plugged-7cc66f81-8cb9-416d-b9c3-03451989c713 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:25:22 user nova-compute[72129]: WARNING nova.compute.manager [req-da772cc4-50db-46fe-8692-28795df3bda6 req-336bacc9-5d54-43c8-86b7-2aabb545720f service nova] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Received unexpected event network-vif-plugged-7cc66f81-8cb9-416d-b9c3-03451989c713 for instance with vm_state active and task_state rescuing.
Aug 01 14:25:22 user nova-compute[72129]: DEBUG nova.compute.manager [req-da772cc4-50db-46fe-8692-28795df3bda6 req-336bacc9-5d54-43c8-86b7-2aabb545720f service nova] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Received event network-vif-plugged-7cc66f81-8cb9-416d-b9c3-03451989c713 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:25:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-da772cc4-50db-46fe-8692-28795df3bda6 req-336bacc9-5d54-43c8-86b7-2aabb545720f service nova] Acquiring lock "5e602ce0-ffe8-4737-86cb-5caee367f2b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:25:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-da772cc4-50db-46fe-8692-28795df3bda6 req-336bacc9-5d54-43c8-86b7-2aabb545720f service nova] Lock "5e602ce0-ffe8-4737-86cb-5caee367f2b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:25:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-da772cc4-50db-46fe-8692-28795df3bda6 req-336bacc9-5d54-43c8-86b7-2aabb545720f service nova] Lock "5e602ce0-ffe8-4737-86cb-5caee367f2b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:25:22 user nova-compute[72129]: DEBUG nova.compute.manager [req-da772cc4-50db-46fe-8692-28795df3bda6 req-336bacc9-5d54-43c8-86b7-2aabb545720f service nova] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] No waiting events found dispatching network-vif-plugged-7cc66f81-8cb9-416d-b9c3-03451989c713 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:25:22 user nova-compute[72129]: WARNING nova.compute.manager [req-da772cc4-50db-46fe-8692-28795df3bda6 req-336bacc9-5d54-43c8-86b7-2aabb545720f service nova] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Received unexpected event network-vif-plugged-7cc66f81-8cb9-416d-b9c3-03451989c713 for instance with vm_state active and task_state rescuing.
Aug 01 14:25:22 user nova-compute[72129]: DEBUG nova.compute.manager [req-c5e69520-a4bb-4492-89bf-4d53de17ff2d req-7d3b54ad-8cda-4646-883a-877c61c2b282 service nova] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Received event network-vif-plugged-9fa9db76-1de9-4e10-962f-7d1e07b9582d {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:25:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-c5e69520-a4bb-4492-89bf-4d53de17ff2d req-7d3b54ad-8cda-4646-883a-877c61c2b282 service nova] Acquiring lock "a3319e68-8c91-404f-800b-6798fb16aa75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:25:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-c5e69520-a4bb-4492-89bf-4d53de17ff2d req-7d3b54ad-8cda-4646-883a-877c61c2b282 service nova] Lock "a3319e68-8c91-404f-800b-6798fb16aa75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:25:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-c5e69520-a4bb-4492-89bf-4d53de17ff2d req-7d3b54ad-8cda-4646-883a-877c61c2b282 service nova] Lock "a3319e68-8c91-404f-800b-6798fb16aa75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:25:22 user nova-compute[72129]: DEBUG nova.compute.manager [req-c5e69520-a4bb-4492-89bf-4d53de17ff2d req-7d3b54ad-8cda-4646-883a-877c61c2b282 service nova] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] No waiting events found dispatching network-vif-plugged-9fa9db76-1de9-4e10-962f-7d1e07b9582d {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:25:22 user nova-compute[72129]: WARNING nova.compute.manager [req-c5e69520-a4bb-4492-89bf-4d53de17ff2d req-7d3b54ad-8cda-4646-883a-877c61c2b282 service nova] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Received unexpected event network-vif-plugged-9fa9db76-1de9-4e10-962f-7d1e07b9582d for instance with vm_state building and task_state spawning.
Aug 01 14:25:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:25:23 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690899923.2335463, a3319e68-8c91-404f-800b-6798fb16aa75 => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:25:23 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] VM Resumed (Lifecycle Event)
Aug 01 14:25:23 user nova-compute[72129]: DEBUG nova.compute.manager [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Instance event wait completed in 0 seconds for  {{(pid=72129) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 14:25:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Guest created on hypervisor {{(pid=72129) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 14:25:23 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Instance spawned successfully.
Aug 01 14:25:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 14:25:23 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:25:23 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:25:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Found default for hw_cdrom_bus of ide {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:25:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Found default for hw_disk_bus of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:25:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Found default for hw_input_bus of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:25:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Found default for hw_pointer_model of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:25:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Found default for hw_video_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:25:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Found default for hw_vif_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:25:23 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 14:25:23 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690899923.234915, a3319e68-8c91-404f-800b-6798fb16aa75 => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:25:23 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] VM Started (Lifecycle Event)
Aug 01 14:25:23 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:25:23 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:25:23 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 14:25:23 user nova-compute[72129]: DEBUG nova.compute.manager [None req-643c47bc-5c5c-445b-9b41-38b89be9dc1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:25:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Removed pending event for 5e602ce0-ffe8-4737-86cb-5caee367f2b4 due to event {{(pid=72129) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 14:25:23 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690899923.322942, 5e602ce0-ffe8-4737-86cb-5caee367f2b4 => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:25:23 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] VM Resumed (Lifecycle Event)
Aug 01 14:25:23 user nova-compute[72129]: INFO nova.compute.manager [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Took 7.09 seconds to spawn the instance on the hypervisor.
Aug 01 14:25:23 user nova-compute[72129]: DEBUG nova.compute.manager [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:25:23 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:25:23 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:25:23 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 01 14:25:23 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690899923.323548, 5e602ce0-ffe8-4737-86cb-5caee367f2b4 => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:25:23 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] VM Started (Lifecycle Event)
Aug 01 14:25:23 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:25:23 user nova-compute[72129]: INFO nova.compute.manager [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Took 7.70 seconds to build instance.
Aug 01 14:25:23 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:25:23 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-7284e9d0-f675-47fc-8f20-1a2d00041096 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Lock "a3319e68-8c91-404f-800b-6798fb16aa75" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.791s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:25:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:25:28 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:25:31 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:25:31 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:25:31 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:25:31 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:25:31 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:25:31 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:25:31 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:25:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.imagecache [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Verify base images {{(pid=72129) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 01 14:25:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.imagecache [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Image id b6472c34-1b0f-4034-ba3a-7e8eb5103715 yields fingerprint 3fd3c074fc53a830c0e0382b4996e9d134bb03d1 {{(pid=72129) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 01 14:25:31 user nova-compute[72129]: INFO nova.virt.libvirt.imagecache [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] image b6472c34-1b0f-4034-ba3a-7e8eb5103715 at (/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1): checking
Aug 01 14:25:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.imagecache [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] image b6472c34-1b0f-4034-ba3a-7e8eb5103715 at (/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1): image is in use {{(pid=72129) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 01 14:25:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.imagecache [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=72129) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 01 14:25:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.imagecache [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d is a valid instance name {{(pid=72129) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 01 14:25:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.imagecache [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d has a disk file {{(pid=72129) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 01 14:25:31 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:25:31 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:25:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.imagecache [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d is backed by 3fd3c074fc53a830c0e0382b4996e9d134bb03d1 {{(pid=72129) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 01 14:25:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.imagecache [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] 5e602ce0-ffe8-4737-86cb-5caee367f2b4 is a valid instance name {{(pid=72129) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 01 14:25:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.imagecache [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] 5e602ce0-ffe8-4737-86cb-5caee367f2b4 has a disk file {{(pid=72129) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 01 14:25:31 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e602ce0-ffe8-4737-86cb-5caee367f2b4/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:25:31 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e602ce0-ffe8-4737-86cb-5caee367f2b4/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:25:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.imagecache [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 5e602ce0-ffe8-4737-86cb-5caee367f2b4 is backed by 3fd3c074fc53a830c0e0382b4996e9d134bb03d1 {{(pid=72129) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 01 14:25:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.imagecache [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] b3f54430-8d5d-478b-8dc7-d7592ee3db36 is a valid instance name {{(pid=72129) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 01 14:25:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.imagecache [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] b3f54430-8d5d-478b-8dc7-d7592ee3db36 has a disk file {{(pid=72129) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 01 14:25:31 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:25:31 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:25:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.imagecache [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance b3f54430-8d5d-478b-8dc7-d7592ee3db36 is backed by 3fd3c074fc53a830c0e0382b4996e9d134bb03d1 {{(pid=72129) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 01 14:25:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.imagecache [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca is a valid instance name {{(pid=72129) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 01 14:25:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.imagecache [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca has a disk file {{(pid=72129) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 01 14:25:31 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:25:31 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:25:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.imagecache [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca is backed by 3fd3c074fc53a830c0e0382b4996e9d134bb03d1 {{(pid=72129) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 01 14:25:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.imagecache [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] a3319e68-8c91-404f-800b-6798fb16aa75 is a valid instance name {{(pid=72129) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 01 14:25:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.imagecache [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] a3319e68-8c91-404f-800b-6798fb16aa75 has a disk file {{(pid=72129) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 01 14:25:31 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3319e68-8c91-404f-800b-6798fb16aa75/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:25:31 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3319e68-8c91-404f-800b-6798fb16aa75/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:25:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.imagecache [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance a3319e68-8c91-404f-800b-6798fb16aa75 is backed by 3fd3c074fc53a830c0e0382b4996e9d134bb03d1 {{(pid=72129) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 01 14:25:31 user nova-compute[72129]: WARNING nova.virt.libvirt.imagecache [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Unknown base file: /opt/stack/data/nova/instances/_base/dd127d0cbe739e7bcfaadc3538e0a428185c9733
Aug 01 14:25:31 user nova-compute[72129]: WARNING nova.virt.libvirt.imagecache [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Unknown base file: /opt/stack/data/nova/instances/_base/b64ff7ed8a7a62c255dad1064c1fa18de0a7b83c
Aug 01 14:25:31 user nova-compute[72129]: WARNING nova.virt.libvirt.imagecache [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Unknown base file: /opt/stack/data/nova/instances/_base/d29a7563eb5bfa925c0d90feb1007a113b5ce7a9
Aug 01 14:25:31 user nova-compute[72129]: WARNING nova.virt.libvirt.imagecache [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Unknown base file: /opt/stack/data/nova/instances/_base/054f12cf73719c130acff9aad217367fdfac9230
Aug 01 14:25:31 user nova-compute[72129]: WARNING nova.virt.libvirt.imagecache [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Unknown base file: /opt/stack/data/nova/instances/_base/4c85195f9633235cb138a12b8940a80f69ff2671
Aug 01 14:25:31 user nova-compute[72129]: WARNING nova.virt.libvirt.imagecache [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Unknown base file: /opt/stack/data/nova/instances/_base/734c552304c5993ab26a647b4af83e454a57c1ec
Aug 01 14:25:31 user nova-compute[72129]: WARNING nova.virt.libvirt.imagecache [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Unknown base file: /opt/stack/data/nova/instances/_base/8d33c770a62ced091c43e09d4c878c9d3d0ebcd6
Aug 01 14:25:31 user nova-compute[72129]: WARNING nova.virt.libvirt.imagecache [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Unknown base file: /opt/stack/data/nova/instances/_base/e136e20e57a97cc62c58928a0768dc9d375f01f6
Aug 01 14:25:31 user nova-compute[72129]: INFO nova.virt.libvirt.imagecache [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Active base files: /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1
Aug 01 14:25:31 user nova-compute[72129]: INFO nova.virt.libvirt.imagecache [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Removable base files: /opt/stack/data/nova/instances/_base/dd127d0cbe739e7bcfaadc3538e0a428185c9733 /opt/stack/data/nova/instances/_base/b64ff7ed8a7a62c255dad1064c1fa18de0a7b83c /opt/stack/data/nova/instances/_base/d29a7563eb5bfa925c0d90feb1007a113b5ce7a9 /opt/stack/data/nova/instances/_base/054f12cf73719c130acff9aad217367fdfac9230 /opt/stack/data/nova/instances/_base/4c85195f9633235cb138a12b8940a80f69ff2671 /opt/stack/data/nova/instances/_base/734c552304c5993ab26a647b4af83e454a57c1ec /opt/stack/data/nova/instances/_base/8d33c770a62ced091c43e09d4c878c9d3d0ebcd6 /opt/stack/data/nova/instances/_base/e136e20e57a97cc62c58928a0768dc9d375f01f6
Aug 01 14:25:31 user nova-compute[72129]: INFO nova.virt.libvirt.imagecache [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/dd127d0cbe739e7bcfaadc3538e0a428185c9733
Aug 01 14:25:31 user nova-compute[72129]: INFO nova.virt.libvirt.imagecache [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b64ff7ed8a7a62c255dad1064c1fa18de0a7b83c
Aug 01 14:25:31 user nova-compute[72129]: INFO nova.virt.libvirt.imagecache [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d29a7563eb5bfa925c0d90feb1007a113b5ce7a9
Aug 01 14:25:31 user nova-compute[72129]: INFO nova.virt.libvirt.imagecache [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/054f12cf73719c130acff9aad217367fdfac9230
Aug 01 14:25:31 user nova-compute[72129]: INFO nova.virt.libvirt.imagecache [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/4c85195f9633235cb138a12b8940a80f69ff2671
Aug 01 14:25:31 user nova-compute[72129]: INFO nova.virt.libvirt.imagecache [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/734c552304c5993ab26a647b4af83e454a57c1ec
Aug 01 14:25:31 user nova-compute[72129]: INFO nova.virt.libvirt.imagecache [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/8d33c770a62ced091c43e09d4c878c9d3d0ebcd6
Aug 01 14:25:31 user nova-compute[72129]: INFO nova.virt.libvirt.imagecache [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e136e20e57a97cc62c58928a0768dc9d375f01f6
Aug 01 14:25:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.imagecache [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Verification complete {{(pid=72129) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 01 14:25:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.imagecache [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Verify swap images {{(pid=72129) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 01 14:25:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.imagecache [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Verify ephemeral images {{(pid=72129) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 01 14:25:33 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:25:36 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:25:38 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:25:41 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:25:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:25:46 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:25:48 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:25:51 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:25:53 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:25:58 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:26:03 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:26:05 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:26:05 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72129) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 14:26:07 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:26:08 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:26:08 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:26:08 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:26:08 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:26:08 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Auditing locally available compute resources for user (node: user) {{(pid=72129) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 14:26:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e602ce0-ffe8-4737-86cb-5caee367f2b4/disk.rescue --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:26:08 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:26:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e602ce0-ffe8-4737-86cb-5caee367f2b4/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:26:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e602ce0-ffe8-4737-86cb-5caee367f2b4/disk.rescue --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:26:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e602ce0-ffe8-4737-86cb-5caee367f2b4/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:26:08 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /opt/stack/data/nova/instances/5e602ce0-ffe8-4737-86cb-5caee367f2b4/disk (vdb) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 14:26:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:26:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:26:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:26:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:26:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3319e68-8c91-404f-800b-6798fb16aa75/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:26:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3319e68-8c91-404f-800b-6798fb16aa75/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:26:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3319e68-8c91-404f-800b-6798fb16aa75/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:26:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3319e68-8c91-404f-800b-6798fb16aa75/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:26:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:26:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:26:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:26:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:26:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk.rescue --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:26:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:26:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk.rescue --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:26:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk.rescue --force-share --output=json" returned: 0 in 0.151s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:26:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:26:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:26:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:26:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:26:10 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:26:10 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:26:10 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Hypervisor/Node resource view: name=user free_ram=8323MB free_disk=25.062488555908203GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72129) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 14:26:10 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:26:10 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:26:10 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance b3f54430-8d5d-478b-8dc7-d7592ee3db36 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:26:10 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:26:10 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 5e602ce0-ffe8-4737-86cb-5caee367f2b4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:26:10 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:26:10 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance a3319e68-8c91-404f-800b-6798fb16aa75 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:26:10 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 14:26:10 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 14:26:10 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Refreshing inventories for resource provider c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 14:26:10 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Updating ProviderTree inventory for provider c2f345c3-9b82-4164-b21d-1eef8e661842 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 14:26:10 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Updating inventory in ProviderTree for provider c2f345c3-9b82-4164-b21d-1eef8e661842 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 14:26:10 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Refreshing aggregate associations for resource provider c2f345c3-9b82-4164-b21d-1eef8e661842, aggregates: None {{(pid=72129) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 14:26:10 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Refreshing trait associations for resource provider c2f345c3-9b82-4164-b21d-1eef8e661842, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE {{(pid=72129) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 14:26:10 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:26:10 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:26:10 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Compute_service record updated for user:user {{(pid=72129) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 14:26:10 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.578s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:26:11 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:26:11 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Starting heal instance info cache {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 14:26:12 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "refresh_cache-3bdb8e41-8cd5-4c33-9624-d262cacd0f5d" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:26:12 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquired lock "refresh_cache-3bdb8e41-8cd5-4c33-9624-d262cacd0f5d" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:26:12 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Forcefully refreshing network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 14:26:12 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Updating instance_info_cache with network_info: [{"id": "10889d2c-ec62-4b92-b325-0f5d7d67851f", "address": "fa:16:3e:52:40:4c", "network": {"id": "6ffcec16-7b44-472a-b7cd-af16ebd4a653", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-901464581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cca3e17d4e4df79c94c4b94fb3fcec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10889d2c-ec", "ovs_interfaceid": "10889d2c-ec62-4b92-b325-0f5d7d67851f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:26:12 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Releasing lock "refresh_cache-3bdb8e41-8cd5-4c33-9624-d262cacd0f5d" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:26:12 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Updated the network info_cache for instance {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 14:26:12 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:26:12 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:26:13 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:26:13 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:26:14 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:26:14 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:26:16 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:26:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:26:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:26:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:26:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72129) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 14:26:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:26:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:26:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:26:28 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:26:28 user nova-compute[72129]: DEBUG nova.compute.manager [req-417c0958-99e7-4cee-81c2-cec80169d1f0 req-7a66a843-c587-40d2-931d-0f55f63adf22 service nova] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Received event network-changed-ed958cf2-355f-460b-be85-8e7c2b1c34ca {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:26:28 user nova-compute[72129]: DEBUG nova.compute.manager [req-417c0958-99e7-4cee-81c2-cec80169d1f0 req-7a66a843-c587-40d2-931d-0f55f63adf22 service nova] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Refreshing instance network info cache due to event network-changed-ed958cf2-355f-460b-be85-8e7c2b1c34ca. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 14:26:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-417c0958-99e7-4cee-81c2-cec80169d1f0 req-7a66a843-c587-40d2-931d-0f55f63adf22 service nova] Acquiring lock "refresh_cache-5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:26:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-417c0958-99e7-4cee-81c2-cec80169d1f0 req-7a66a843-c587-40d2-931d-0f55f63adf22 service nova] Acquired lock "refresh_cache-5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:26:28 user nova-compute[72129]: DEBUG nova.network.neutron [req-417c0958-99e7-4cee-81c2-cec80169d1f0 req-7a66a843-c587-40d2-931d-0f55f63adf22 service nova] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Refreshing network info cache for port ed958cf2-355f-460b-be85-8e7c2b1c34ca {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 14:26:29 user nova-compute[72129]: DEBUG nova.network.neutron [req-417c0958-99e7-4cee-81c2-cec80169d1f0 req-7a66a843-c587-40d2-931d-0f55f63adf22 service nova] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Updated VIF entry in instance network info cache for port ed958cf2-355f-460b-be85-8e7c2b1c34ca. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 14:26:29 user nova-compute[72129]: DEBUG nova.network.neutron [req-417c0958-99e7-4cee-81c2-cec80169d1f0 req-7a66a843-c587-40d2-931d-0f55f63adf22 service nova] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Updating instance_info_cache with network_info: [{"id": "ed958cf2-355f-460b-be85-8e7c2b1c34ca", "address": "fa:16:3e:f6:e8:d6", "network": {"id": "9d4effd9-bf5c-41a7-a8e2-18d2177ace34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333645199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5d5ede0f2e44eaab914ffc17aef8aa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped958cf2-35", "ovs_interfaceid": "ed958cf2-355f-460b-be85-8e7c2b1c34ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:26:29 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-417c0958-99e7-4cee-81c2-cec80169d1f0 req-7a66a843-c587-40d2-931d-0f55f63adf22 service nova] Releasing lock "refresh_cache-5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:26:30 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:26:31 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:26:32 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b3329190-509c-4c4d-ba59-b965adb4f146 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Acquiring lock "5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:26:32 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b3329190-509c-4c4d-ba59-b965adb4f146 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:26:32 user nova-compute[72129]: DEBUG nova.objects.instance [None req-b3329190-509c-4c4d-ba59-b965adb4f146 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lazy-loading 'flavor' on Instance uuid 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:26:32 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b3329190-509c-4c4d-ba59-b965adb4f146 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:26:32 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b3329190-509c-4c4d-ba59-b965adb4f146 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Acquiring lock "5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:26:32 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b3329190-509c-4c4d-ba59-b965adb4f146 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:26:32 user nova-compute[72129]: INFO nova.compute.manager [None req-b3329190-509c-4c4d-ba59-b965adb4f146 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Attaching volume 1e9029a9-f500-400a-8e64-a80aadbc962a to /dev/vdb
Aug 01 14:26:32 user nova-compute[72129]: DEBUG os_brick.utils [None req-b3329190-509c-4c4d-ba59-b965adb4f146 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:26:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:26:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:26:32 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a8f0a6-614b-4c32-94de-1395e737752c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f9b449c2cd3d\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:26:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:26:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:26:32 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc4710e-535d-4304-b871-08c8388bad2c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:26:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:26:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:26:32 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9ce565-1aaf-4611-80c8-c5ce5dbb86b7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:26:32 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57e9255-939d-4991-948d-e02c806d735c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:26:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-b3329190-509c-4c4d-ba59-b965adb4f146 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Running cmd (subprocess): nvme version {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:26:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-b3329190-509c-4c4d-ba59-b965adb4f146 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] 'nvme version' failed. Not Retrying. {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 14:26:32 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b3329190-509c-4c4d-ba59-b965adb4f146 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] nvme not present on system {{(pid=72129) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 14:26:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:26:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 14:26:32 user nova-compute[72129]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 14:26:32 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe873e6-7955-4902-9c15-b5005100d3ed]: (4, '') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:26:32 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-b3329190-509c-4c4d-ba59-b965adb4f146 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72129) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 14:26:32 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-b3329190-509c-4c4d-ba59-b965adb4f146 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 14:26:32 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-b3329190-509c-4c4d-ba59-b965adb4f146 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] LIGHTOS: no hostnqn found. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 14:26:32 user nova-compute[72129]: DEBUG os_brick.utils [None req-b3329190-509c-4c4d-ba59-b965adb4f146 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f9b449c2cd3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:26:32 user nova-compute[72129]: DEBUG nova.virt.block_device [None req-b3329190-509c-4c4d-ba59-b965adb4f146 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Updating existing volume attachment record: 3c9dc50e-6aed-44b5-a9c5-eb8a5cc47fb6 {{(pid=72129) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 14:26:33 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:26:33 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Cleaning up deleted instances {{(pid=72129) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 14:26:33 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] There are 0 instances to clean {{(pid=72129) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 14:26:33 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:26:34 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:26:34 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72129) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 14:26:36 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:26:38 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:26:39 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3329190-509c-4c4d-ba59-b965adb4f146 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Calling os-brick to attach iSCSI Volume {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 14:26:39 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3329190-509c-4c4d-ba59-b965adb4f146 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1e9029a9-f500-400a-8e64-a80aadbc962a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rVXlEFtT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:26:39 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-b3329190-509c-4c4d-ba59-b965adb4f146 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:26:39 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-b3329190-509c-4c4d-ba59-b965adb4f146 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:26:39 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-b3329190-509c-4c4d-ba59-b965adb4f146 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:26:39 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-b3329190-509c-4c4d-ba59-b965adb4f146 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:26:39 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-b3329190-509c-4c4d-ba59-b965adb4f146 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e9029a9-f500-400a-8e64-a80aadbc962a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:26:39 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-b3329190-509c-4c4d-ba59-b965adb4f146 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e9029a9-f500-400a-8e64-a80aadbc962a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:26:39 user nova-compute[72129]: INFO os_brick.initiator.connectors.iscsi [None req-b3329190-509c-4c4d-ba59-b965adb4f146 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 14:26:39 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e9029a9-f500-400a-8e64-a80aadbc962a -p 172.16.0.220:3260 {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:26:39 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e9029a9-f500-400a-8e64-a80aadbc962a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:26:39 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[47eefa0c-7c79-4073-a1c5-5e6e903ae93b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:26:39 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3329190-509c-4c4d-ba59-b965adb4f146 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 14:26:39 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:26:39 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e9029a9-f500-400a-8e64-a80aadbc962a -p 172.16.0.220:3260 --interface default --op new {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:26:39 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e9029a9-f500-400a-8e64-a80aadbc962a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:26:39 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[66bd8588-247b-4d32-8a73-0a4c49c45da2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1e9029a9-f500-400a-8e64-a80aadbc962a] added\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:26:39 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3329190-509c-4c4d-ba59-b965adb4f146 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1e9029a9-f500-400a-8e64-a80aadbc962a] added
Aug 01 14:26:39 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:26:39 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e9029a9-f500-400a-8e64-a80aadbc962a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:26:39 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e9029a9-f500-400a-8e64-a80aadbc962a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:26:39 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f3b62a-5090-4e34-a96a-f534bf1f5567]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:26:39 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3329190-509c-4c4d-ba59-b965adb4f146 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:26:39 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e9029a9-f500-400a-8e64-a80aadbc962a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:26:39 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e9029a9-f500-400a-8e64-a80aadbc962a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:26:39 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f6eff08-92d7-424b-aa45-59b5a3a77819]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:26:39 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3329190-509c-4c4d-ba59-b965adb4f146 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:26:39 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e9029a9-f500-400a-8e64-a80aadbc962a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rVXlEFtT {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:26:39 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e9029a9-f500-400a-8e64-a80aadbc962a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rVXlEFtT" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:26:39 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb0c66a-a5e9-4e05-a012-89284711ce49]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:26:39 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3329190-509c-4c4d-ba59-b965adb4f146 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rVXlEFtT'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:26:39 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e9029a9-f500-400a-8e64-a80aadbc962a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:26:40 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e9029a9-f500-400a-8e64-a80aadbc962a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:26:40 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea64aa0b-8305-48e6-b980-1b29a04dd528]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:26:40 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3329190-509c-4c4d-ba59-b965adb4f146 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:26:40 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:26:40 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:26:40 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[00bf4cfe-2622-4e39-a438-4432f774b366]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0a34f37-192e-4503-ae13-eb1f850bb189 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:26:40 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3329190-509c-4c4d-ba59-b965adb4f146 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0a34f37-192e-4503-ae13-eb1f850bb189 (non-flash)
Aug 01 14:26:40 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:26:40 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3329190-509c-4c4d-ba59-b965adb4f146 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0a34f37-192e-4503-ae13-eb1f850bb189 (non-flash)
Aug 01 14:26:40 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:26:40 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e9029a9-f500-400a-8e64-a80aadbc962a -p 172.16.0.220:3260 --login {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:26:40 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e9029a9-f500-400a-8e64-a80aadbc962a -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:26:40 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[7360b042-5565-4dfc-a50a-bc9caf8de2dd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1e9029a9-f500-400a-8e64-a80aadbc962a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1e9029a9-f500-400a-8e64-a80aadbc962a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:26:40 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3329190-509c-4c4d-ba59-b965adb4f146 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1e9029a9-f500-400a-8e64-a80aadbc962a, portal: 172.16.0.220,3260]
Aug 01 14:26:40 user nova-compute[72129]: Login to [iface: default, target: iqn.2010-10.org.openstack:1e9029a9-f500-400a-8e64-a80aadbc962a, portal: 172.16.0.220,3260] successful.
Aug 01 14:26:40 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:26:40 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e9029a9-f500-400a-8e64-a80aadbc962a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:26:40 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e9029a9-f500-400a-8e64-a80aadbc962a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:26:40 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e185b46-6b6c-419a-a914-9adc6933f47c]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:26:40 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3329190-509c-4c4d-ba59-b965adb4f146 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:26:40 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:26:40 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:26:40 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1e7752-78b4-4136-a162-935ed6f054ea]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0a34f37-192e-4503-ae13-eb1f850bb189 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9029a9-f500-400a-8e64-a80aadbc962a (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:26:40 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3329190-509c-4c4d-ba59-b965adb4f146 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0a34f37-192e-4503-ae13-eb1f850bb189 (non-flash)
Aug 01 14:26:40 user nova-compute[72129]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9029a9-f500-400a-8e64-a80aadbc962a (non-flash)
Aug 01 14:26:40 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:26:40 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3329190-509c-4c4d-ba59-b965adb4f146 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0a34f37-192e-4503-ae13-eb1f850bb189 (non-flash)
Aug 01 14:26:40 user nova-compute[72129]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9029a9-f500-400a-8e64-a80aadbc962a (non-flash)
Aug 01 14:26:40 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:26:40 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-b3329190-509c-4c4d-ba59-b965adb4f146 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e9029a9-f500-400a-8e64-a80aadbc962a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:26:40 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3329190-509c-4c4d-ba59-b965adb4f146 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Connected to 172.16.0.220:3260 {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 14:26:40 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-b3329190-509c-4c4d-ba59-b965adb4f146 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] HCTL ('34', '-', '-', 0) found on session 58 with lun 0 {{(pid=72129) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 14:26:40 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-b3329190-509c-4c4d-ba59-b965adb4f146 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72129) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 14:26:40 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:26:40 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:26:40 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d961e2-4487-46e5-a34f-7bdecf95d859]: (4, ('- - 0', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:26:40 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-b3329190-509c-4c4d-ba59-b965adb4f146 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: None {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 14:26:41 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-b3329190-509c-4c4d-ba59-b965adb4f146 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 14:26:41 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3329190-509c-4c4d-ba59-b965adb4f146 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rVXlEFtT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 14:26:41 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-b3329190-509c-4c4d-ba59-b965adb4f146 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:26:41 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3329190-509c-4c4d-ba59-b965adb4f146 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '23135366361306630', 'path': '/dev/sdc'} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:26:41 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3329190-509c-4c4d-ba59-b965adb4f146 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23135366361306630', 'path': '/dev/sdc'} {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 14:26:41 user nova-compute[72129]: DEBUG nova.objects.instance [None req-b3329190-509c-4c4d-ba59-b965adb4f146 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lazy-loading 'flavor' on Instance uuid 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:26:41 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-b3329190-509c-4c4d-ba59-b965adb4f146 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 14:26:41 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:26:41 user nova-compute[72129]:   <source dev="/dev/sdc"/>
Aug 01 14:26:41 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 14:26:41 user nova-compute[72129]:   <serial>1e9029a9-f500-400a-8e64-a80aadbc962a</serial>
Aug 01 14:26:41 user nova-compute[72129]: </disk>
Aug 01 14:26:41 user nova-compute[72129]:  {{(pid=72129) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 14:26:41 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-b3329190-509c-4c4d-ba59-b965adb4f146 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:26:41 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-b3329190-509c-4c4d-ba59-b965adb4f146 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:26:41 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-b3329190-509c-4c4d-ba59-b965adb4f146 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] No VIF found with MAC fa:16:3e:f6:e8:d6, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 14:26:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b3329190-509c-4c4d-ba59-b965adb4f146 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.998s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:26:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-41105cd6-fbf1-41b5-bea7-de096324d1ca tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Acquiring lock "5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:26:42 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-41105cd6-fbf1-41b5-bea7-de096324d1ca tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:26:42 user nova-compute[72129]: INFO nova.compute.manager [None req-41105cd6-fbf1-41b5-bea7-de096324d1ca tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Detaching volume 1e9029a9-f500-400a-8e64-a80aadbc962a
Aug 01 14:26:42 user nova-compute[72129]: INFO nova.virt.block_device [None req-41105cd6-fbf1-41b5-bea7-de096324d1ca tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Attempting to driver detach volume 1e9029a9-f500-400a-8e64-a80aadbc962a from mountpoint /dev/vdb
Aug 01 14:26:42 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-41105cd6-fbf1-41b5-bea7-de096324d1ca tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Attempting to detach device vdb from instance 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca from the persistent domain config. {{(pid=72129) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 14:26:42 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-41105cd6-fbf1-41b5-bea7-de096324d1ca tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 14:26:42 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:26:42 user nova-compute[72129]:   <source dev="/dev/sdc"/>
Aug 01 14:26:42 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 14:26:42 user nova-compute[72129]:   <serial>1e9029a9-f500-400a-8e64-a80aadbc962a</serial>
Aug 01 14:26:42 user nova-compute[72129]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 14:26:42 user nova-compute[72129]: </disk>
Aug 01 14:26:42 user nova-compute[72129]:  {{(pid=72129) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 14:26:42 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-41105cd6-fbf1-41b5-bea7-de096324d1ca tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Successfully detached device vdb from instance 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca from the persistent domain config.
Aug 01 14:26:42 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-41105cd6-fbf1-41b5-bea7-de096324d1ca tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca from the live domain config. {{(pid=72129) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 14:26:42 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-41105cd6-fbf1-41b5-bea7-de096324d1ca tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 14:26:42 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:26:42 user nova-compute[72129]:   <source dev="/dev/sdc"/>
Aug 01 14:26:42 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 14:26:42 user nova-compute[72129]:   <serial>1e9029a9-f500-400a-8e64-a80aadbc962a</serial>
Aug 01 14:26:42 user nova-compute[72129]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 14:26:42 user nova-compute[72129]: </disk>
Aug 01 14:26:42 user nova-compute[72129]:  {{(pid=72129) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 14:26:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:26:43 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Received event <DeviceRemovedEvent: 1690900003.263898, 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72129) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 14:26:43 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-41105cd6-fbf1-41b5-bea7-de096324d1ca tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca {{(pid=72129) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 14:26:43 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-41105cd6-fbf1-41b5-bea7-de096324d1ca tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Successfully detached device vdb from instance 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca from the live domain config.
Aug 01 14:26:43 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41105cd6-fbf1-41b5-bea7-de096324d1ca tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] calling os-brick to detach iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 14:26:43 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-41105cd6-fbf1-41b5-bea7-de096324d1ca tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, {'target_iqns': ['iqn.2010-10.org.openstack:1e9029a9-f500-400a-8e64-a80aadbc962a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rVXlEFtT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:26:43 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-41105cd6-fbf1-41b5-bea7-de096324d1ca tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:26:43 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-41105cd6-fbf1-41b5-bea7-de096324d1ca tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:26:43 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-41105cd6-fbf1-41b5-bea7-de096324d1ca tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:26:43 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-41105cd6-fbf1-41b5-bea7-de096324d1ca tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e9029a9-f500-400a-8e64-a80aadbc962a', 0)] {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 14:26:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:26:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:26:43 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[5daa0a56-6e0a-4e64-b03c-4cf2c6cbac0a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e9029a9-f500-400a-8e64-a80aadbc962a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0a34f37-192e-4503-ae13-eb1f850bb189\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:26:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:26:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:26:43 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a175fd-490d-4ca1-a2c0-9fca7c344fb7]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0a34f37-192e-4503-ae13-eb1f850bb189 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9029a9-f500-400a-8e64-a80aadbc962a (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:26:43 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-41105cd6-fbf1-41b5-bea7-de096324d1ca tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0a34f37-192e-4503-ae13-eb1f850bb189 (non-flash)
Aug 01 14:26:43 user nova-compute[72129]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9029a9-f500-400a-8e64-a80aadbc962a (non-flash)
Aug 01 14:26:43 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:26:43 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-41105cd6-fbf1-41b5-bea7-de096324d1ca tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0a34f37-192e-4503-ae13-eb1f850bb189 (non-flash)
Aug 01 14:26:43 user nova-compute[72129]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e9029a9-f500-400a-8e64-a80aadbc962a (non-flash)
Aug 01 14:26:43 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:26:43 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-41105cd6-fbf1-41b5-bea7-de096324d1ca tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f282e02bbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e9029a9-f500-400a-8e64-a80aadbc962a'): ({'sdc'}, set())}) {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 14:26:43 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-41105cd6-fbf1-41b5-bea7-de096324d1ca tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Removing single pathed devices sdc {{(pid=72129) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 14:26:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:26:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:26:43 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfbcb377-36e5-462e-b4b2-ae3f900d97bc]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:26:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:26:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:26:43 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54f874e-7b05-4aa2-80f7-baddb0aef961]: (4, ('ok\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:26:43 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-41105cd6-fbf1-41b5-bea7-de096324d1ca tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Flushing IO for device /dev/sdc {{(pid=72129) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 14:26:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:26:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:26:43 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[9890a7af-263b-4e86-8b63-ccaff62342ea]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:26:43 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-41105cd6-fbf1-41b5-bea7-de096324d1ca tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72129) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 14:26:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:26:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.029s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:26:43 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7da7219-6cab-40ca-890c-3576dae20b57]: (4, ('1', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:26:43 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-41105cd6-fbf1-41b5-bea7-de096324d1ca tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 14:26:43 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-41105cd6-fbf1-41b5-bea7-de096324d1ca tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] SCSI volumes sdc have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 14:26:43 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-41105cd6-fbf1-41b5-bea7-de096324d1ca tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e9029a9-f500-400a-8e64-a80aadbc962a')] {{(pid=72129) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 14:26:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e9029a9-f500-400a-8e64-a80aadbc962a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:26:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e9029a9-f500-400a-8e64-a80aadbc962a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:26:43 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[960c8ede-c9c8-4b2b-b3d5-2c2053b26a60]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:26:43 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-41105cd6-fbf1-41b5-bea7-de096324d1ca tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:26:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e9029a9-f500-400a-8e64-a80aadbc962a -p 172.16.0.220:3260 --logout {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:26:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e9029a9-f500-400a-8e64-a80aadbc962a -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:26:43 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ef003b-536a-4082-b3d6-e3705003e0eb]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:1e9029a9-f500-400a-8e64-a80aadbc962a, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:1e9029a9-f500-400a-8e64-a80aadbc962a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:26:43 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-41105cd6-fbf1-41b5-bea7-de096324d1ca tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:1e9029a9-f500-400a-8e64-a80aadbc962a, portal: 172.16.0.220,3260]
Aug 01 14:26:43 user nova-compute[72129]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:1e9029a9-f500-400a-8e64-a80aadbc962a, portal: 172.16.0.220,3260] successful.
Aug 01 14:26:43 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:26:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e9029a9-f500-400a-8e64-a80aadbc962a -p 172.16.0.220:3260 --op delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:26:43 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e9029a9-f500-400a-8e64-a80aadbc962a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:26:43 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a58744-5f02-4547-8b73-2177794fd10d]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:26:43 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-41105cd6-fbf1-41b5-bea7-de096324d1ca tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:26:43 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-41105cd6-fbf1-41b5-bea7-de096324d1ca tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.255s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:26:43 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-41105cd6-fbf1-41b5-bea7-de096324d1ca tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] <== disconnect_volume: return (256ms) None {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:26:43 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41105cd6-fbf1-41b5-bea7-de096324d1ca tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Disconnected iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 14:26:44 user nova-compute[72129]: DEBUG nova.objects.instance [None req-41105cd6-fbf1-41b5-bea7-de096324d1ca tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lazy-loading 'flavor' on Instance uuid 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:26:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-41105cd6-fbf1-41b5-bea7-de096324d1ca tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.586s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:26:46 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:26:48 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:26:53 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:26:58 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:26:58 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:26:58 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Triggering sync for uuid b3f54430-8d5d-478b-8dc7-d7592ee3db36 {{(pid=72129) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 14:26:58 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Triggering sync for uuid 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d {{(pid=72129) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 14:26:58 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Triggering sync for uuid 5e602ce0-ffe8-4737-86cb-5caee367f2b4 {{(pid=72129) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 14:26:58 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Triggering sync for uuid 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca {{(pid=72129) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 14:26:58 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Triggering sync for uuid a3319e68-8c91-404f-800b-6798fb16aa75 {{(pid=72129) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 14:26:58 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "b3f54430-8d5d-478b-8dc7-d7592ee3db36" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:26:58 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "b3f54430-8d5d-478b-8dc7-d7592ee3db36" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:26:58 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "3bdb8e41-8cd5-4c33-9624-d262cacd0f5d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:26:58 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "3bdb8e41-8cd5-4c33-9624-d262cacd0f5d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:26:58 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "5e602ce0-ffe8-4737-86cb-5caee367f2b4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:26:58 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "5e602ce0-ffe8-4737-86cb-5caee367f2b4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:26:58 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:26:58 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:26:58 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "a3319e68-8c91-404f-800b-6798fb16aa75" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:26:58 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "a3319e68-8c91-404f-800b-6798fb16aa75" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:26:59 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "b3f54430-8d5d-478b-8dc7-d7592ee3db36" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:26:59 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "3bdb8e41-8cd5-4c33-9624-d262cacd0f5d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:26:59 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "5e602ce0-ffe8-4737-86cb-5caee367f2b4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:26:59 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "a3319e68-8c91-404f-800b-6798fb16aa75" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:26:59 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.087s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:27:01 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:27:03 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:27:06 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:27:07 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:27:07 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72129) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 14:27:07 user nova-compute[72129]: DEBUG nova.compute.manager [req-21692bf8-d079-4b6f-a227-d0aecdf73bb9 req-453860e3-bd6c-41b7-a422-b5e97dcae6e3 service nova] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Received event network-changed-9fa9db76-1de9-4e10-962f-7d1e07b9582d {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:27:07 user nova-compute[72129]: DEBUG nova.compute.manager [req-21692bf8-d079-4b6f-a227-d0aecdf73bb9 req-453860e3-bd6c-41b7-a422-b5e97dcae6e3 service nova] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Refreshing instance network info cache due to event network-changed-9fa9db76-1de9-4e10-962f-7d1e07b9582d. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 14:27:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-21692bf8-d079-4b6f-a227-d0aecdf73bb9 req-453860e3-bd6c-41b7-a422-b5e97dcae6e3 service nova] Acquiring lock "refresh_cache-a3319e68-8c91-404f-800b-6798fb16aa75" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:27:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-21692bf8-d079-4b6f-a227-d0aecdf73bb9 req-453860e3-bd6c-41b7-a422-b5e97dcae6e3 service nova] Acquired lock "refresh_cache-a3319e68-8c91-404f-800b-6798fb16aa75" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:27:07 user nova-compute[72129]: DEBUG nova.network.neutron [req-21692bf8-d079-4b6f-a227-d0aecdf73bb9 req-453860e3-bd6c-41b7-a422-b5e97dcae6e3 service nova] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Refreshing network info cache for port 9fa9db76-1de9-4e10-962f-7d1e07b9582d {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 14:27:08 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:27:08 user nova-compute[72129]: INFO nova.compute.manager [None req-089b5c30-611b-4553-ad40-2838432132e3 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Unrescuing
Aug 01 14:27:08 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-089b5c30-611b-4553-ad40-2838432132e3 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Acquiring lock "refresh_cache-5e602ce0-ffe8-4737-86cb-5caee367f2b4" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:27:08 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-089b5c30-611b-4553-ad40-2838432132e3 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Acquired lock "refresh_cache-5e602ce0-ffe8-4737-86cb-5caee367f2b4" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:27:08 user nova-compute[72129]: DEBUG nova.network.neutron [None req-089b5c30-611b-4553-ad40-2838432132e3 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 14:27:08 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:27:08 user nova-compute[72129]: DEBUG nova.network.neutron [req-21692bf8-d079-4b6f-a227-d0aecdf73bb9 req-453860e3-bd6c-41b7-a422-b5e97dcae6e3 service nova] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Updated VIF entry in instance network info cache for port 9fa9db76-1de9-4e10-962f-7d1e07b9582d. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 14:27:08 user nova-compute[72129]: DEBUG nova.network.neutron [req-21692bf8-d079-4b6f-a227-d0aecdf73bb9 req-453860e3-bd6c-41b7-a422-b5e97dcae6e3 service nova] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Updating instance_info_cache with network_info: [{"id": "9fa9db76-1de9-4e10-962f-7d1e07b9582d", "address": "fa:16:3e:ff:ce:94", "network": {"id": "d4ba0665-71f8-48a1-b3a2-2c73c2c7db3a", "bridge": "br-int", "label": "tempest-TestStampPattern-1150922129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a91b43b1394048719e2ed69f5c3ae94f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fa9db76-1d", "ovs_interfaceid": "9fa9db76-1de9-4e10-962f-7d1e07b9582d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:27:08 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-21692bf8-d079-4b6f-a227-d0aecdf73bb9 req-453860e3-bd6c-41b7-a422-b5e97dcae6e3 service nova] Releasing lock "refresh_cache-a3319e68-8c91-404f-800b-6798fb16aa75" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:27:08 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-bfaba5e4-4ee2-476f-a04d-26dd0450b4c2 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Acquiring lock "a3319e68-8c91-404f-800b-6798fb16aa75" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:27:08 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-bfaba5e4-4ee2-476f-a04d-26dd0450b4c2 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Lock "a3319e68-8c91-404f-800b-6798fb16aa75" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:27:08 user nova-compute[72129]: DEBUG nova.objects.instance [None req-bfaba5e4-4ee2-476f-a04d-26dd0450b4c2 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Lazy-loading 'flavor' on Instance uuid a3319e68-8c91-404f-800b-6798fb16aa75 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:27:09 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:27:09 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-bfaba5e4-4ee2-476f-a04d-26dd0450b4c2 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Lock "a3319e68-8c91-404f-800b-6798fb16aa75" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:27:09 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:27:09 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:27:09 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:27:09 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Auditing locally available compute resources for user (node: user) {{(pid=72129) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 14:27:09 user nova-compute[72129]: DEBUG nova.network.neutron [None req-089b5c30-611b-4553-ad40-2838432132e3 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Updating instance_info_cache with network_info: [{"id": "7cc66f81-8cb9-416d-b9c3-03451989c713", "address": "fa:16:3e:f6:cb:d3", "network": {"id": "6ffcec16-7b44-472a-b7cd-af16ebd4a653", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-901464581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cca3e17d4e4df79c94c4b94fb3fcec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc66f81-8c", "ovs_interfaceid": "7cc66f81-8cb9-416d-b9c3-03451989c713", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:27:09 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-089b5c30-611b-4553-ad40-2838432132e3 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Releasing lock "refresh_cache-5e602ce0-ffe8-4737-86cb-5caee367f2b4" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:27:09 user nova-compute[72129]: DEBUG nova.objects.instance [None req-089b5c30-611b-4553-ad40-2838432132e3 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lazy-loading 'flavor' on Instance uuid 5e602ce0-ffe8-4737-86cb-5caee367f2b4 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:27:09 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-bfaba5e4-4ee2-476f-a04d-26dd0450b4c2 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Acquiring lock "a3319e68-8c91-404f-800b-6798fb16aa75" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:27:09 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-bfaba5e4-4ee2-476f-a04d-26dd0450b4c2 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Lock "a3319e68-8c91-404f-800b-6798fb16aa75" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:27:09 user nova-compute[72129]: INFO nova.compute.manager [None req-bfaba5e4-4ee2-476f-a04d-26dd0450b4c2 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Attaching volume f6a85161-d2da-4373-b89e-3d253dc0db91 to /dev/vdb
Aug 01 14:27:09 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:27:09 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:27:09 user nova-compute[72129]: DEBUG os_brick.utils [None req-bfaba5e4-4ee2-476f-a04d-26dd0450b4c2 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:27:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:27:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:27:09 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b963ad-0ec9-4206-959f-14622db9af24]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f9b449c2cd3d\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:27:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:27:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:27:09 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[83aacd66-02c8-4226-b6f9-4a751f0a3890]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:27:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:27:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:27:09 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef3a91f1-2e2e-47d3-9dc4-c36bf643e45d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:27:09 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd68405a-3c56-44a6-987e-742f27240d76]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:27:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-bfaba5e4-4ee2-476f-a04d-26dd0450b4c2 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Running cmd (subprocess): nvme version {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:27:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-bfaba5e4-4ee2-476f-a04d-26dd0450b4c2 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] 'nvme version' failed. Not Retrying. {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 14:27:09 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bfaba5e4-4ee2-476f-a04d-26dd0450b4c2 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] nvme not present on system {{(pid=72129) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 14:27:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:27:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e602ce0-ffe8-4737-86cb-5caee367f2b4/disk.rescue --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:27:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 14:27:09 user nova-compute[72129]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 14:27:09 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[242f1624-956b-44f0-885b-61f6e47df5a6]: (4, '') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:27:09 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-bfaba5e4-4ee2-476f-a04d-26dd0450b4c2 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72129) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 14:27:09 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-bfaba5e4-4ee2-476f-a04d-26dd0450b4c2 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 14:27:09 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-bfaba5e4-4ee2-476f-a04d-26dd0450b4c2 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] LIGHTOS: no hostnqn found. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 14:27:09 user nova-compute[72129]: DEBUG os_brick.utils [None req-bfaba5e4-4ee2-476f-a04d-26dd0450b4c2 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] <== get_connector_properties: return (175ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f9b449c2cd3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:27:09 user nova-compute[72129]: DEBUG nova.virt.block_device [None req-bfaba5e4-4ee2-476f-a04d-26dd0450b4c2 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Updating existing volume attachment record: be7f5306-8d27-4bbc-b192-1153d6e0f3fe {{(pid=72129) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 14:27:09 user nova-compute[72129]: DEBUG nova.compute.manager [req-c25eb7bd-d373-4ab6-b3f3-89dc9e26e325 req-d5a95138-ca0e-404a-ae8d-04d7040c0b96 service nova] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Received event network-vif-unplugged-7cc66f81-8cb9-416d-b9c3-03451989c713 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:27:09 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-c25eb7bd-d373-4ab6-b3f3-89dc9e26e325 req-d5a95138-ca0e-404a-ae8d-04d7040c0b96 service nova] Acquiring lock "5e602ce0-ffe8-4737-86cb-5caee367f2b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:27:09 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-c25eb7bd-d373-4ab6-b3f3-89dc9e26e325 req-d5a95138-ca0e-404a-ae8d-04d7040c0b96 service nova] Lock "5e602ce0-ffe8-4737-86cb-5caee367f2b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:27:09 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-c25eb7bd-d373-4ab6-b3f3-89dc9e26e325 req-d5a95138-ca0e-404a-ae8d-04d7040c0b96 service nova] Lock "5e602ce0-ffe8-4737-86cb-5caee367f2b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:27:09 user nova-compute[72129]: DEBUG nova.compute.manager [req-c25eb7bd-d373-4ab6-b3f3-89dc9e26e325 req-d5a95138-ca0e-404a-ae8d-04d7040c0b96 service nova] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] No waiting events found dispatching network-vif-unplugged-7cc66f81-8cb9-416d-b9c3-03451989c713 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:27:09 user nova-compute[72129]: WARNING nova.compute.manager [req-c25eb7bd-d373-4ab6-b3f3-89dc9e26e325 req-d5a95138-ca0e-404a-ae8d-04d7040c0b96 service nova] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Received unexpected event network-vif-unplugged-7cc66f81-8cb9-416d-b9c3-03451989c713 for instance with vm_state rescued and task_state unrescuing.
Aug 01 14:27:09 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:27:09 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:27:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e602ce0-ffe8-4737-86cb-5caee367f2b4/disk.rescue --force-share --output=json" returned: 0 in 0.151s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:27:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e602ce0-ffe8-4737-86cb-5caee367f2b4/disk.rescue --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:27:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e602ce0-ffe8-4737-86cb-5caee367f2b4/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:27:09 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /opt/stack/data/nova/instances/5e602ce0-ffe8-4737-86cb-5caee367f2b4/disk (vdb) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 14:27:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:27:09 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Instance destroyed successfully.
Aug 01 14:27:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:27:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:27:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:27:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3319e68-8c91-404f-800b-6798fb16aa75/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:27:10 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3319e68-8c91-404f-800b-6798fb16aa75/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:27:10 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3319e68-8c91-404f-800b-6798fb16aa75/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:27:10 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3319e68-8c91-404f-800b-6798fb16aa75/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:27:10 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:27:10 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:27:10 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:27:10 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:27:10 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk.rescue --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:27:10 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:27:10 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk.rescue --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:27:10 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:27:10 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:27:10 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:27:10 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:27:11 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:27:11 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:27:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:27:13 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:27:13 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Removed pending event for 5e602ce0-ffe8-4737-86cb-5caee367f2b4 due to event {{(pid=72129) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 14:27:13 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690900033.1851537, 5e602ce0-ffe8-4737-86cb-5caee367f2b4 => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:27:13 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] VM Resumed (Lifecycle Event)
Aug 01 14:27:13 user nova-compute[72129]: DEBUG nova.compute.manager [None req-089b5c30-611b-4553-ad40-2838432132e3 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:27:13 user nova-compute[72129]: DEBUG nova.compute.manager [req-653d0e5d-8ac7-4cfe-a7f6-1d9498a21f69 req-68fe5a3f-d1a5-41d5-8297-77e76c9a437c service nova] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Received event network-vif-plugged-7cc66f81-8cb9-416d-b9c3-03451989c713 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:27:13 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-653d0e5d-8ac7-4cfe-a7f6-1d9498a21f69 req-68fe5a3f-d1a5-41d5-8297-77e76c9a437c service nova] Acquiring lock "5e602ce0-ffe8-4737-86cb-5caee367f2b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:27:13 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-653d0e5d-8ac7-4cfe-a7f6-1d9498a21f69 req-68fe5a3f-d1a5-41d5-8297-77e76c9a437c service nova] Lock "5e602ce0-ffe8-4737-86cb-5caee367f2b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:27:13 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-653d0e5d-8ac7-4cfe-a7f6-1d9498a21f69 req-68fe5a3f-d1a5-41d5-8297-77e76c9a437c service nova] Lock "5e602ce0-ffe8-4737-86cb-5caee367f2b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:27:13 user nova-compute[72129]: DEBUG nova.compute.manager [req-653d0e5d-8ac7-4cfe-a7f6-1d9498a21f69 req-68fe5a3f-d1a5-41d5-8297-77e76c9a437c service nova] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] No waiting events found dispatching network-vif-plugged-7cc66f81-8cb9-416d-b9c3-03451989c713 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:27:13 user nova-compute[72129]: WARNING nova.compute.manager [req-653d0e5d-8ac7-4cfe-a7f6-1d9498a21f69 req-68fe5a3f-d1a5-41d5-8297-77e76c9a437c service nova] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Received unexpected event network-vif-plugged-7cc66f81-8cb9-416d-b9c3-03451989c713 for instance with vm_state rescued and task_state unrescuing.
Aug 01 14:27:13 user nova-compute[72129]: DEBUG nova.compute.manager [req-653d0e5d-8ac7-4cfe-a7f6-1d9498a21f69 req-68fe5a3f-d1a5-41d5-8297-77e76c9a437c service nova] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Received event network-vif-plugged-7cc66f81-8cb9-416d-b9c3-03451989c713 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:27:13 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-653d0e5d-8ac7-4cfe-a7f6-1d9498a21f69 req-68fe5a3f-d1a5-41d5-8297-77e76c9a437c service nova] Acquiring lock "5e602ce0-ffe8-4737-86cb-5caee367f2b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:27:13 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-653d0e5d-8ac7-4cfe-a7f6-1d9498a21f69 req-68fe5a3f-d1a5-41d5-8297-77e76c9a437c service nova] Lock "5e602ce0-ffe8-4737-86cb-5caee367f2b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:27:13 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-653d0e5d-8ac7-4cfe-a7f6-1d9498a21f69 req-68fe5a3f-d1a5-41d5-8297-77e76c9a437c service nova] Lock "5e602ce0-ffe8-4737-86cb-5caee367f2b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:27:13 user nova-compute[72129]: DEBUG nova.compute.manager [req-653d0e5d-8ac7-4cfe-a7f6-1d9498a21f69 req-68fe5a3f-d1a5-41d5-8297-77e76c9a437c service nova] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] No waiting events found dispatching network-vif-plugged-7cc66f81-8cb9-416d-b9c3-03451989c713 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:27:13 user nova-compute[72129]: WARNING nova.compute.manager [req-653d0e5d-8ac7-4cfe-a7f6-1d9498a21f69 req-68fe5a3f-d1a5-41d5-8297-77e76c9a437c service nova] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Received unexpected event network-vif-plugged-7cc66f81-8cb9-416d-b9c3-03451989c713 for instance with vm_state rescued and task_state unrescuing.
Aug 01 14:27:13 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:27:13 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:27:13 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Hypervisor/Node resource view: name=user free_ram=8445MB free_disk=25.061141967773438GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72129) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 14:27:13 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:27:13 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:27:13 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:27:13 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:27:13 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 01 14:27:13 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690900033.1860487, 5e602ce0-ffe8-4737-86cb-5caee367f2b4 => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:27:13 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] VM Started (Lifecycle Event)
Aug 01 14:27:13 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:27:13 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:27:13 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance b3f54430-8d5d-478b-8dc7-d7592ee3db36 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:27:13 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:27:13 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 5e602ce0-ffe8-4737-86cb-5caee367f2b4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:27:13 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:27:13 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance a3319e68-8c91-404f-800b-6798fb16aa75 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:27:13 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 14:27:13 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 14:27:13 user nova-compute[72129]: DEBUG nova.compute.manager [req-e2c5a729-2325-4a92-b1b5-27c00547f52e req-b63904b2-1c20-4ec6-8b93-4aef325b9145 service nova] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Received event network-vif-plugged-7cc66f81-8cb9-416d-b9c3-03451989c713 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:27:13 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-e2c5a729-2325-4a92-b1b5-27c00547f52e req-b63904b2-1c20-4ec6-8b93-4aef325b9145 service nova] Acquiring lock "5e602ce0-ffe8-4737-86cb-5caee367f2b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:27:13 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-e2c5a729-2325-4a92-b1b5-27c00547f52e req-b63904b2-1c20-4ec6-8b93-4aef325b9145 service nova] Lock "5e602ce0-ffe8-4737-86cb-5caee367f2b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:27:13 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-e2c5a729-2325-4a92-b1b5-27c00547f52e req-b63904b2-1c20-4ec6-8b93-4aef325b9145 service nova] Lock "5e602ce0-ffe8-4737-86cb-5caee367f2b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:27:13 user nova-compute[72129]: DEBUG nova.compute.manager [req-e2c5a729-2325-4a92-b1b5-27c00547f52e req-b63904b2-1c20-4ec6-8b93-4aef325b9145 service nova] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] No waiting events found dispatching network-vif-plugged-7cc66f81-8cb9-416d-b9c3-03451989c713 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:27:13 user nova-compute[72129]: WARNING nova.compute.manager [req-e2c5a729-2325-4a92-b1b5-27c00547f52e req-b63904b2-1c20-4ec6-8b93-4aef325b9145 service nova] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Received unexpected event network-vif-plugged-7cc66f81-8cb9-416d-b9c3-03451989c713 for instance with vm_state active and task_state None.
Aug 01 14:27:13 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:27:13 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:27:13 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Compute_service record updated for user:user {{(pid=72129) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 14:27:13 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.377s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:27:15 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:27:15 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:27:15 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Starting heal instance info cache {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 14:27:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "refresh_cache-5e602ce0-ffe8-4737-86cb-5caee367f2b4" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:27:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquired lock "refresh_cache-5e602ce0-ffe8-4737-86cb-5caee367f2b4" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:27:15 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Forcefully refreshing network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 14:27:16 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Updating instance_info_cache with network_info: [{"id": "7cc66f81-8cb9-416d-b9c3-03451989c713", "address": "fa:16:3e:f6:cb:d3", "network": {"id": "6ffcec16-7b44-472a-b7cd-af16ebd4a653", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-901464581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cca3e17d4e4df79c94c4b94fb3fcec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc66f81-8c", "ovs_interfaceid": "7cc66f81-8cb9-416d-b9c3-03451989c713", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:27:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Releasing lock "refresh_cache-5e602ce0-ffe8-4737-86cb-5caee367f2b4" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:27:16 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Updated the network info_cache for instance {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 14:27:16 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:27:16 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:27:16 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:27:16 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:27:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:27:17 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfaba5e4-4ee2-476f-a04d-26dd0450b4c2 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Calling os-brick to attach iSCSI Volume {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 14:27:17 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfaba5e4-4ee2-476f-a04d-26dd0450b4c2 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f6a85161-d2da-4373-b89e-3d253dc0db91'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vWGoPjdS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:27:17 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-bfaba5e4-4ee2-476f-a04d-26dd0450b4c2 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:27:17 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-bfaba5e4-4ee2-476f-a04d-26dd0450b4c2 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:27:17 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-bfaba5e4-4ee2-476f-a04d-26dd0450b4c2 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:27:17 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-bfaba5e4-4ee2-476f-a04d-26dd0450b4c2 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:27:17 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-bfaba5e4-4ee2-476f-a04d-26dd0450b4c2 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6a85161-d2da-4373-b89e-3d253dc0db91" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:27:17 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-bfaba5e4-4ee2-476f-a04d-26dd0450b4c2 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6a85161-d2da-4373-b89e-3d253dc0db91" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:27:17 user nova-compute[72129]: INFO os_brick.initiator.connectors.iscsi [None req-bfaba5e4-4ee2-476f-a04d-26dd0450b4c2 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 14:27:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6a85161-d2da-4373-b89e-3d253dc0db91 -p 172.16.0.220:3260 {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:27:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6a85161-d2da-4373-b89e-3d253dc0db91 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:27:17 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ebc564b-027e-435d-95a3-c7248b70534a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:27:17 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfaba5e4-4ee2-476f-a04d-26dd0450b4c2 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 14:27:17 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:27:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6a85161-d2da-4373-b89e-3d253dc0db91 -p 172.16.0.220:3260 --interface default --op new {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:27:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6a85161-d2da-4373-b89e-3d253dc0db91 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:27:17 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11db711-9193-47ef-803c-c617e8419664]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f6a85161-d2da-4373-b89e-3d253dc0db91] added\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:27:17 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfaba5e4-4ee2-476f-a04d-26dd0450b4c2 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f6a85161-d2da-4373-b89e-3d253dc0db91] added
Aug 01 14:27:17 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:27:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6a85161-d2da-4373-b89e-3d253dc0db91 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:27:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6a85161-d2da-4373-b89e-3d253dc0db91 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:27:17 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[75fb8ca2-2e9a-4a3b-8293-bf84d3c2dac7]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:27:17 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfaba5e4-4ee2-476f-a04d-26dd0450b4c2 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:27:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6a85161-d2da-4373-b89e-3d253dc0db91 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:27:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6a85161-d2da-4373-b89e-3d253dc0db91 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:27:17 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf96fcc-4a1a-4496-8c27-1b6dacc62ed4]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:27:17 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfaba5e4-4ee2-476f-a04d-26dd0450b4c2 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:27:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6a85161-d2da-4373-b89e-3d253dc0db91 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vWGoPjdS {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:27:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6a85161-d2da-4373-b89e-3d253dc0db91 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vWGoPjdS" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:27:17 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ebd51a7-b715-42f7-99bb-003fa35ee494]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:27:17 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfaba5e4-4ee2-476f-a04d-26dd0450b4c2 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vWGoPjdS'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:27:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6a85161-d2da-4373-b89e-3d253dc0db91 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:27:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6a85161-d2da-4373-b89e-3d253dc0db91 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:27:17 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed20a82c-a399-4a6b-863e-fbcfce65a078]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:27:17 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfaba5e4-4ee2-476f-a04d-26dd0450b4c2 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:27:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:27:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:27:17 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[87cd36fe-1dd9-4bcc-8601-1cae5a3d0f7c]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0a34f37-192e-4503-ae13-eb1f850bb189 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:27:17 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfaba5e4-4ee2-476f-a04d-26dd0450b4c2 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0a34f37-192e-4503-ae13-eb1f850bb189 (non-flash)
Aug 01 14:27:17 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:27:17 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfaba5e4-4ee2-476f-a04d-26dd0450b4c2 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0a34f37-192e-4503-ae13-eb1f850bb189 (non-flash)
Aug 01 14:27:17 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:27:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6a85161-d2da-4373-b89e-3d253dc0db91 -p 172.16.0.220:3260 --login {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:27:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6a85161-d2da-4373-b89e-3d253dc0db91 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:27:17 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3c90f7-d8d2-4f65-b9b3-e8e0522d11e4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f6a85161-d2da-4373-b89e-3d253dc0db91, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f6a85161-d2da-4373-b89e-3d253dc0db91, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:27:17 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfaba5e4-4ee2-476f-a04d-26dd0450b4c2 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f6a85161-d2da-4373-b89e-3d253dc0db91, portal: 172.16.0.220,3260]
Aug 01 14:27:17 user nova-compute[72129]: Login to [iface: default, target: iqn.2010-10.org.openstack:f6a85161-d2da-4373-b89e-3d253dc0db91, portal: 172.16.0.220,3260] successful.
Aug 01 14:27:17 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:27:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6a85161-d2da-4373-b89e-3d253dc0db91 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:27:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6a85161-d2da-4373-b89e-3d253dc0db91 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:27:17 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d769eef-4a12-4a91-84d2-465fdc1425fe]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:27:17 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfaba5e4-4ee2-476f-a04d-26dd0450b4c2 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:27:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:27:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:27:17 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[f723a3cd-d06d-4ac7-aaa9-9cf9c48647ba]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0a34f37-192e-4503-ae13-eb1f850bb189 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a85161-d2da-4373-b89e-3d253dc0db91 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:27:17 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfaba5e4-4ee2-476f-a04d-26dd0450b4c2 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0a34f37-192e-4503-ae13-eb1f850bb189 (non-flash)
Aug 01 14:27:17 user nova-compute[72129]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a85161-d2da-4373-b89e-3d253dc0db91 (non-flash)
Aug 01 14:27:17 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:27:17 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfaba5e4-4ee2-476f-a04d-26dd0450b4c2 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0a34f37-192e-4503-ae13-eb1f850bb189 (non-flash)
Aug 01 14:27:17 user nova-compute[72129]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a85161-d2da-4373-b89e-3d253dc0db91 (non-flash)
Aug 01 14:27:17 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:27:17 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-bfaba5e4-4ee2-476f-a04d-26dd0450b4c2 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6a85161-d2da-4373-b89e-3d253dc0db91" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:27:17 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfaba5e4-4ee2-476f-a04d-26dd0450b4c2 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Connected to 172.16.0.220:3260 {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 14:27:17 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-bfaba5e4-4ee2-476f-a04d-26dd0450b4c2 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] HCTL ('34', '-', '-', 0) found on session 59 with lun 0 {{(pid=72129) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 14:27:17 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-bfaba5e4-4ee2-476f-a04d-26dd0450b4c2 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72129) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 14:27:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:27:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:27:17 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3a1e25-d48d-423f-bb01-7ab695be9e2e]: (4, ('- - 0', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:27:17 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-bfaba5e4-4ee2-476f-a04d-26dd0450b4c2 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Searching for a device in session 59 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 14:27:17 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfaba5e4-4ee2-476f-a04d-26dd0450b4c2 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vWGoPjdS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 14:27:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:27:18 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-bfaba5e4-4ee2-476f-a04d-26dd0450b4c2 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:27:18 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfaba5e4-4ee2-476f-a04d-26dd0450b4c2 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '26163613263303239', 'path': '/dev/sdc'} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:27:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfaba5e4-4ee2-476f-a04d-26dd0450b4c2 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26163613263303239', 'path': '/dev/sdc'} {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 14:27:18 user nova-compute[72129]: DEBUG nova.objects.instance [None req-bfaba5e4-4ee2-476f-a04d-26dd0450b4c2 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Lazy-loading 'flavor' on Instance uuid a3319e68-8c91-404f-800b-6798fb16aa75 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:27:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-bfaba5e4-4ee2-476f-a04d-26dd0450b4c2 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 14:27:18 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:27:18 user nova-compute[72129]:   <source dev="/dev/sdc"/>
Aug 01 14:27:18 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 14:27:18 user nova-compute[72129]:   <serial>f6a85161-d2da-4373-b89e-3d253dc0db91</serial>
Aug 01 14:27:18 user nova-compute[72129]: </disk>
Aug 01 14:27:18 user nova-compute[72129]:  {{(pid=72129) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 14:27:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-bfaba5e4-4ee2-476f-a04d-26dd0450b4c2 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:27:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-bfaba5e4-4ee2-476f-a04d-26dd0450b4c2 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:27:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-bfaba5e4-4ee2-476f-a04d-26dd0450b4c2 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] No VIF found with MAC fa:16:3e:ff:ce:94, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 14:27:19 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-bfaba5e4-4ee2-476f-a04d-26dd0450b4c2 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Lock "a3319e68-8c91-404f-800b-6798fb16aa75" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.909s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:27:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-1010b423-91d3-41c0-b3cd-b7a711bb8a10 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Acquiring lock "a3319e68-8c91-404f-800b-6798fb16aa75" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:27:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-1010b423-91d3-41c0-b3cd-b7a711bb8a10 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Lock "a3319e68-8c91-404f-800b-6798fb16aa75" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:27:21 user nova-compute[72129]: INFO nova.compute.manager [None req-1010b423-91d3-41c0-b3cd-b7a711bb8a10 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Detaching volume f6a85161-d2da-4373-b89e-3d253dc0db91
Aug 01 14:27:21 user nova-compute[72129]: INFO nova.virt.block_device [None req-1010b423-91d3-41c0-b3cd-b7a711bb8a10 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Attempting to driver detach volume f6a85161-d2da-4373-b89e-3d253dc0db91 from mountpoint /dev/vdb
Aug 01 14:27:21 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-1010b423-91d3-41c0-b3cd-b7a711bb8a10 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Attempting to detach device vdb from instance a3319e68-8c91-404f-800b-6798fb16aa75 from the persistent domain config. {{(pid=72129) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 14:27:21 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-1010b423-91d3-41c0-b3cd-b7a711bb8a10 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 14:27:21 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:27:21 user nova-compute[72129]:   <source dev="/dev/sdc"/>
Aug 01 14:27:21 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 14:27:21 user nova-compute[72129]:   <serial>f6a85161-d2da-4373-b89e-3d253dc0db91</serial>
Aug 01 14:27:21 user nova-compute[72129]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 14:27:21 user nova-compute[72129]: </disk>
Aug 01 14:27:21 user nova-compute[72129]:  {{(pid=72129) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 14:27:21 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-1010b423-91d3-41c0-b3cd-b7a711bb8a10 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Successfully detached device vdb from instance a3319e68-8c91-404f-800b-6798fb16aa75 from the persistent domain config.
Aug 01 14:27:21 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-1010b423-91d3-41c0-b3cd-b7a711bb8a10 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a3319e68-8c91-404f-800b-6798fb16aa75 from the live domain config. {{(pid=72129) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 14:27:21 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-1010b423-91d3-41c0-b3cd-b7a711bb8a10 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 14:27:21 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:27:21 user nova-compute[72129]:   <source dev="/dev/sdc"/>
Aug 01 14:27:21 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 14:27:21 user nova-compute[72129]:   <serial>f6a85161-d2da-4373-b89e-3d253dc0db91</serial>
Aug 01 14:27:21 user nova-compute[72129]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 14:27:21 user nova-compute[72129]: </disk>
Aug 01 14:27:21 user nova-compute[72129]:  {{(pid=72129) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 14:27:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:27:21 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Received event <DeviceRemovedEvent: 1690900041.8064961, a3319e68-8c91-404f-800b-6798fb16aa75 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72129) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 14:27:21 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-1010b423-91d3-41c0-b3cd-b7a711bb8a10 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a3319e68-8c91-404f-800b-6798fb16aa75 {{(pid=72129) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 14:27:21 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-1010b423-91d3-41c0-b3cd-b7a711bb8a10 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Successfully detached device vdb from instance a3319e68-8c91-404f-800b-6798fb16aa75 from the live domain config.
Aug 01 14:27:21 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1010b423-91d3-41c0-b3cd-b7a711bb8a10 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] calling os-brick to detach iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 14:27:21 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-1010b423-91d3-41c0-b3cd-b7a711bb8a10 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, {'target_iqns': ['iqn.2010-10.org.openstack:f6a85161-d2da-4373-b89e-3d253dc0db91'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vWGoPjdS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:27:21 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-1010b423-91d3-41c0-b3cd-b7a711bb8a10 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:27:21 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-1010b423-91d3-41c0-b3cd-b7a711bb8a10 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:27:21 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-1010b423-91d3-41c0-b3cd-b7a711bb8a10 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:27:21 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-1010b423-91d3-41c0-b3cd-b7a711bb8a10 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f6a85161-d2da-4373-b89e-3d253dc0db91', 0)] {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 14:27:21 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:27:21 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:27:21 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[649ab3a2-669d-49cd-9d9d-b9a4145a9c91]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0a34f37-192e-4503-ae13-eb1f850bb189\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6a85161-d2da-4373-b89e-3d253dc0db91\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:27:21 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:27:21 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:27:21 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[1138c902-0c1b-478a-890f-bc72bacc3910]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0a34f37-192e-4503-ae13-eb1f850bb189 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a85161-d2da-4373-b89e-3d253dc0db91 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:27:21 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-1010b423-91d3-41c0-b3cd-b7a711bb8a10 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0a34f37-192e-4503-ae13-eb1f850bb189 (non-flash)
Aug 01 14:27:21 user nova-compute[72129]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a85161-d2da-4373-b89e-3d253dc0db91 (non-flash)
Aug 01 14:27:21 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:27:21 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-1010b423-91d3-41c0-b3cd-b7a711bb8a10 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0a34f37-192e-4503-ae13-eb1f850bb189 (non-flash)
Aug 01 14:27:21 user nova-compute[72129]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a85161-d2da-4373-b89e-3d253dc0db91 (non-flash)
Aug 01 14:27:21 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:27:21 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-1010b423-91d3-41c0-b3cd-b7a711bb8a10 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f28202d3f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f6a85161-d2da-4373-b89e-3d253dc0db91'): ({'sdc'}, set())}) {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 14:27:21 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-1010b423-91d3-41c0-b3cd-b7a711bb8a10 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Removing single pathed devices sdc {{(pid=72129) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 14:27:21 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:27:21 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:27:21 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[8344cb6b-118f-4e14-be5b-2a942459afae]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:27:21 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:27:21 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:27:21 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a172f697-e2de-46e0-8b20-8b74da95e8b8]: (4, ('ok\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:27:21 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-1010b423-91d3-41c0-b3cd-b7a711bb8a10 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Flushing IO for device /dev/sdc {{(pid=72129) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 14:27:21 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:27:21 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:27:21 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[4005fad4-f93d-43eb-92ba-f0a0c9273d02]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:27:21 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-1010b423-91d3-41c0-b3cd-b7a711bb8a10 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72129) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 14:27:21 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:27:21 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:27:21 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[34529cb9-40fb-4b3e-87dd-d9f908175533]: (4, ('1', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:27:22 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-1010b423-91d3-41c0-b3cd-b7a711bb8a10 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 14:27:22 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-1010b423-91d3-41c0-b3cd-b7a711bb8a10 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] SCSI volumes sdc have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 14:27:22 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-1010b423-91d3-41c0-b3cd-b7a711bb8a10 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f6a85161-d2da-4373-b89e-3d253dc0db91')] {{(pid=72129) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 14:27:22 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6a85161-d2da-4373-b89e-3d253dc0db91 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:27:22 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6a85161-d2da-4373-b89e-3d253dc0db91 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:27:22 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc9f0aa-5249-4ad6-aa78-a67c68d837bd]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:27:22 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-1010b423-91d3-41c0-b3cd-b7a711bb8a10 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:27:22 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6a85161-d2da-4373-b89e-3d253dc0db91 -p 172.16.0.220:3260 --logout {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:27:22 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6a85161-d2da-4373-b89e-3d253dc0db91 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:27:22 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4cd547-c455-44ce-a3be-5a9fc912045b]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:f6a85161-d2da-4373-b89e-3d253dc0db91, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:f6a85161-d2da-4373-b89e-3d253dc0db91, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:27:22 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-1010b423-91d3-41c0-b3cd-b7a711bb8a10 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:f6a85161-d2da-4373-b89e-3d253dc0db91, portal: 172.16.0.220,3260]
Aug 01 14:27:22 user nova-compute[72129]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:f6a85161-d2da-4373-b89e-3d253dc0db91, portal: 172.16.0.220,3260] successful.
Aug 01 14:27:22 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:27:22 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6a85161-d2da-4373-b89e-3d253dc0db91 -p 172.16.0.220:3260 --op delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:27:22 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6a85161-d2da-4373-b89e-3d253dc0db91 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:27:22 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b74de64-676f-42ea-9676-166357762ae8]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:27:22 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-1010b423-91d3-41c0-b3cd-b7a711bb8a10 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:27:22 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-1010b423-91d3-41c0-b3cd-b7a711bb8a10 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:27:22 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-1010b423-91d3-41c0-b3cd-b7a711bb8a10 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] <== disconnect_volume: return (280ms) None {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:27:22 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1010b423-91d3-41c0-b3cd-b7a711bb8a10 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Disconnected iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 14:27:22 user nova-compute[72129]: DEBUG nova.objects.instance [None req-1010b423-91d3-41c0-b3cd-b7a711bb8a10 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Lazy-loading 'flavor' on Instance uuid a3319e68-8c91-404f-800b-6798fb16aa75 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:27:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-1010b423-91d3-41c0-b3cd-b7a711bb8a10 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Lock "a3319e68-8c91-404f-800b-6798fb16aa75" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.605s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:27:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:27:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:27:28 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:27:31 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:27:33 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-bf274805-5c83-448d-aa50-c96bcf04f823 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Acquiring lock "5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:27:33 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-bf274805-5c83-448d-aa50-c96bcf04f823 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:27:33 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-bf274805-5c83-448d-aa50-c96bcf04f823 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Acquiring lock "5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:27:33 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-bf274805-5c83-448d-aa50-c96bcf04f823 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:27:33 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-bf274805-5c83-448d-aa50-c96bcf04f823 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:27:33 user nova-compute[72129]: INFO nova.compute.manager [None req-bf274805-5c83-448d-aa50-c96bcf04f823 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Terminating instance
Aug 01 14:27:33 user nova-compute[72129]: DEBUG nova.compute.manager [None req-bf274805-5c83-448d-aa50-c96bcf04f823 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Start destroying the instance on the hypervisor. {{(pid=72129) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 14:27:33 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:27:33 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:27:33 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:27:33 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:27:33 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:27:33 user nova-compute[72129]: DEBUG nova.compute.manager [req-3755d354-e4e7-48d4-9fca-1a6dcff797ae req-ebde2ba1-6645-41f8-a216-f6ba801285fc service nova] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Received event network-vif-unplugged-ed958cf2-355f-460b-be85-8e7c2b1c34ca {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:27:33 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-3755d354-e4e7-48d4-9fca-1a6dcff797ae req-ebde2ba1-6645-41f8-a216-f6ba801285fc service nova] Acquiring lock "5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:27:33 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-3755d354-e4e7-48d4-9fca-1a6dcff797ae req-ebde2ba1-6645-41f8-a216-f6ba801285fc service nova] Lock "5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:27:33 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-3755d354-e4e7-48d4-9fca-1a6dcff797ae req-ebde2ba1-6645-41f8-a216-f6ba801285fc service nova] Lock "5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:27:33 user nova-compute[72129]: DEBUG nova.compute.manager [req-3755d354-e4e7-48d4-9fca-1a6dcff797ae req-ebde2ba1-6645-41f8-a216-f6ba801285fc service nova] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] No waiting events found dispatching network-vif-unplugged-ed958cf2-355f-460b-be85-8e7c2b1c34ca {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:27:33 user nova-compute[72129]: DEBUG nova.compute.manager [req-3755d354-e4e7-48d4-9fca-1a6dcff797ae req-ebde2ba1-6645-41f8-a216-f6ba801285fc service nova] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Received event network-vif-unplugged-ed958cf2-355f-460b-be85-8e7c2b1c34ca for instance with task_state deleting. {{(pid=72129) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 14:27:33 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:27:33 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:27:33 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:27:33 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:27:33 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Instance destroyed successfully.
Aug 01 14:27:33 user nova-compute[72129]: DEBUG nova.objects.instance [None req-bf274805-5c83-448d-aa50-c96bcf04f823 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lazy-loading 'resources' on Instance uuid 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:27:33 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-bf274805-5c83-448d-aa50-c96bcf04f823 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:24:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-138240537',display_name='tempest-AttachVolumeNegativeTest-server-138240537',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-138240537',id=48,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBqUjH2kno+mFYLbnS02dMeF3/rIpcKCnsXOX9li40nZYX1kfTsrWlLnGtYLSI/asPjtPMvU5s9lTM9olLagz6JqbqYPuGxg2Sy1oG8ihwZ877disRwgSx4nHcZzXtV7Ng==',key_name='tempest-keypair-1556347356',keypairs=<?>,launch_index=0,launched_at=2023-08-01T14:24:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f5d5ede0f2e44eaab914ffc17aef8aa8',ramdisk_id='',reservation_id='r-vm15gwel',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2079788087',owner_user_name='tempest-AttachVolumeNegativeTest-2079788087-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T14:24:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85308332b4084e9f8c1bf605f540434b',uuid=5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ed958cf2-355f-460b-be85-8e7c2b1c34ca", "address": "fa:16:3e:f6:e8:d6", "network": {"id": "9d4effd9-bf5c-41a7-a8e2-18d2177ace34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333645199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5d5ede0f2e44eaab914ffc17aef8aa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped958cf2-35", "ovs_interfaceid": "ed958cf2-355f-460b-be85-8e7c2b1c34ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 14:27:33 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-bf274805-5c83-448d-aa50-c96bcf04f823 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Converting VIF {"id": "ed958cf2-355f-460b-be85-8e7c2b1c34ca", "address": "fa:16:3e:f6:e8:d6", "network": {"id": "9d4effd9-bf5c-41a7-a8e2-18d2177ace34", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-333645199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5d5ede0f2e44eaab914ffc17aef8aa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped958cf2-35", "ovs_interfaceid": "ed958cf2-355f-460b-be85-8e7c2b1c34ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:27:33 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-bf274805-5c83-448d-aa50-c96bcf04f823 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f6:e8:d6,bridge_name='br-int',has_traffic_filtering=True,id=ed958cf2-355f-460b-be85-8e7c2b1c34ca,network=Network(9d4effd9-bf5c-41a7-a8e2-18d2177ace34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped958cf2-35') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:27:33 user nova-compute[72129]: DEBUG os_vif [None req-bf274805-5c83-448d-aa50-c96bcf04f823 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:e8:d6,bridge_name='br-int',has_traffic_filtering=True,id=ed958cf2-355f-460b-be85-8e7c2b1c34ca,network=Network(9d4effd9-bf5c-41a7-a8e2-18d2177ace34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped958cf2-35') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 14:27:33 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:27:33 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=taped958cf2-35, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:27:33 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:27:33 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:27:33 user nova-compute[72129]: INFO os_vif [None req-bf274805-5c83-448d-aa50-c96bcf04f823 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:e8:d6,bridge_name='br-int',has_traffic_filtering=True,id=ed958cf2-355f-460b-be85-8e7c2b1c34ca,network=Network(9d4effd9-bf5c-41a7-a8e2-18d2177ace34),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped958cf2-35')
Aug 01 14:27:33 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-bf274805-5c83-448d-aa50-c96bcf04f823 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Deleting instance files /opt/stack/data/nova/instances/5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca_del
Aug 01 14:27:33 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-bf274805-5c83-448d-aa50-c96bcf04f823 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Deletion of /opt/stack/data/nova/instances/5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca_del complete
Aug 01 14:27:33 user nova-compute[72129]: INFO nova.compute.manager [None req-bf274805-5c83-448d-aa50-c96bcf04f823 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 01 14:27:33 user nova-compute[72129]: DEBUG oslo.service.loopingcall [None req-bf274805-5c83-448d-aa50-c96bcf04f823 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72129) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 14:27:33 user nova-compute[72129]: DEBUG nova.compute.manager [-] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Deallocating network for instance {{(pid=72129) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 14:27:33 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] deallocate_for_instance() {{(pid=72129) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 14:27:34 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:27:34 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:27:34 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:27:34 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:27:34 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:27:34 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:27:35 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:27:35 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Took 1.36 seconds to deallocate network for instance.
Aug 01 14:27:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-bf274805-5c83-448d-aa50-c96bcf04f823 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:27:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-bf274805-5c83-448d-aa50-c96bcf04f823 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:27:35 user nova-compute[72129]: DEBUG nova.compute.manager [req-4edc8693-fbb9-43ba-849f-1a8b5577fc37 req-eeecef0c-ab8a-423a-9e48-b06689eec586 service nova] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Received event network-vif-plugged-ed958cf2-355f-460b-be85-8e7c2b1c34ca {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:27:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-4edc8693-fbb9-43ba-849f-1a8b5577fc37 req-eeecef0c-ab8a-423a-9e48-b06689eec586 service nova] Acquiring lock "5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:27:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-4edc8693-fbb9-43ba-849f-1a8b5577fc37 req-eeecef0c-ab8a-423a-9e48-b06689eec586 service nova] Lock "5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:27:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-4edc8693-fbb9-43ba-849f-1a8b5577fc37 req-eeecef0c-ab8a-423a-9e48-b06689eec586 service nova] Lock "5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:27:35 user nova-compute[72129]: DEBUG nova.compute.manager [req-4edc8693-fbb9-43ba-849f-1a8b5577fc37 req-eeecef0c-ab8a-423a-9e48-b06689eec586 service nova] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] No waiting events found dispatching network-vif-plugged-ed958cf2-355f-460b-be85-8e7c2b1c34ca {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:27:35 user nova-compute[72129]: WARNING nova.compute.manager [req-4edc8693-fbb9-43ba-849f-1a8b5577fc37 req-eeecef0c-ab8a-423a-9e48-b06689eec586 service nova] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Received unexpected event network-vif-plugged-ed958cf2-355f-460b-be85-8e7c2b1c34ca for instance with vm_state deleted and task_state None.
Aug 01 14:27:35 user nova-compute[72129]: DEBUG nova.compute.manager [req-4edc8693-fbb9-43ba-849f-1a8b5577fc37 req-eeecef0c-ab8a-423a-9e48-b06689eec586 service nova] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Received event network-vif-plugged-ed958cf2-355f-460b-be85-8e7c2b1c34ca {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:27:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-4edc8693-fbb9-43ba-849f-1a8b5577fc37 req-eeecef0c-ab8a-423a-9e48-b06689eec586 service nova] Acquiring lock "5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:27:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-4edc8693-fbb9-43ba-849f-1a8b5577fc37 req-eeecef0c-ab8a-423a-9e48-b06689eec586 service nova] Lock "5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:27:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-4edc8693-fbb9-43ba-849f-1a8b5577fc37 req-eeecef0c-ab8a-423a-9e48-b06689eec586 service nova] Lock "5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:27:35 user nova-compute[72129]: DEBUG nova.compute.manager [req-4edc8693-fbb9-43ba-849f-1a8b5577fc37 req-eeecef0c-ab8a-423a-9e48-b06689eec586 service nova] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] No waiting events found dispatching network-vif-plugged-ed958cf2-355f-460b-be85-8e7c2b1c34ca {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:27:35 user nova-compute[72129]: WARNING nova.compute.manager [req-4edc8693-fbb9-43ba-849f-1a8b5577fc37 req-eeecef0c-ab8a-423a-9e48-b06689eec586 service nova] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Received unexpected event network-vif-plugged-ed958cf2-355f-460b-be85-8e7c2b1c34ca for instance with vm_state deleted and task_state None.
Aug 01 14:27:35 user nova-compute[72129]: DEBUG nova.compute.manager [req-4edc8693-fbb9-43ba-849f-1a8b5577fc37 req-eeecef0c-ab8a-423a-9e48-b06689eec586 service nova] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Received event network-vif-plugged-ed958cf2-355f-460b-be85-8e7c2b1c34ca {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:27:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-4edc8693-fbb9-43ba-849f-1a8b5577fc37 req-eeecef0c-ab8a-423a-9e48-b06689eec586 service nova] Acquiring lock "5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:27:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-4edc8693-fbb9-43ba-849f-1a8b5577fc37 req-eeecef0c-ab8a-423a-9e48-b06689eec586 service nova] Lock "5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:27:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-4edc8693-fbb9-43ba-849f-1a8b5577fc37 req-eeecef0c-ab8a-423a-9e48-b06689eec586 service nova] Lock "5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:27:35 user nova-compute[72129]: DEBUG nova.compute.manager [req-4edc8693-fbb9-43ba-849f-1a8b5577fc37 req-eeecef0c-ab8a-423a-9e48-b06689eec586 service nova] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] No waiting events found dispatching network-vif-plugged-ed958cf2-355f-460b-be85-8e7c2b1c34ca {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:27:35 user nova-compute[72129]: WARNING nova.compute.manager [req-4edc8693-fbb9-43ba-849f-1a8b5577fc37 req-eeecef0c-ab8a-423a-9e48-b06689eec586 service nova] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Received unexpected event network-vif-plugged-ed958cf2-355f-460b-be85-8e7c2b1c34ca for instance with vm_state deleted and task_state None.
Aug 01 14:27:35 user nova-compute[72129]: DEBUG nova.compute.manager [req-4edc8693-fbb9-43ba-849f-1a8b5577fc37 req-eeecef0c-ab8a-423a-9e48-b06689eec586 service nova] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Received event network-vif-unplugged-ed958cf2-355f-460b-be85-8e7c2b1c34ca {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:27:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-4edc8693-fbb9-43ba-849f-1a8b5577fc37 req-eeecef0c-ab8a-423a-9e48-b06689eec586 service nova] Acquiring lock "5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:27:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-4edc8693-fbb9-43ba-849f-1a8b5577fc37 req-eeecef0c-ab8a-423a-9e48-b06689eec586 service nova] Lock "5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:27:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-4edc8693-fbb9-43ba-849f-1a8b5577fc37 req-eeecef0c-ab8a-423a-9e48-b06689eec586 service nova] Lock "5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:27:35 user nova-compute[72129]: DEBUG nova.compute.manager [req-4edc8693-fbb9-43ba-849f-1a8b5577fc37 req-eeecef0c-ab8a-423a-9e48-b06689eec586 service nova] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] No waiting events found dispatching network-vif-unplugged-ed958cf2-355f-460b-be85-8e7c2b1c34ca {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:27:35 user nova-compute[72129]: WARNING nova.compute.manager [req-4edc8693-fbb9-43ba-849f-1a8b5577fc37 req-eeecef0c-ab8a-423a-9e48-b06689eec586 service nova] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Received unexpected event network-vif-unplugged-ed958cf2-355f-460b-be85-8e7c2b1c34ca for instance with vm_state deleted and task_state None.
Aug 01 14:27:35 user nova-compute[72129]: DEBUG nova.compute.manager [req-4edc8693-fbb9-43ba-849f-1a8b5577fc37 req-eeecef0c-ab8a-423a-9e48-b06689eec586 service nova] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Received event network-vif-plugged-ed958cf2-355f-460b-be85-8e7c2b1c34ca {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:27:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-4edc8693-fbb9-43ba-849f-1a8b5577fc37 req-eeecef0c-ab8a-423a-9e48-b06689eec586 service nova] Acquiring lock "5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:27:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-4edc8693-fbb9-43ba-849f-1a8b5577fc37 req-eeecef0c-ab8a-423a-9e48-b06689eec586 service nova] Lock "5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:27:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-4edc8693-fbb9-43ba-849f-1a8b5577fc37 req-eeecef0c-ab8a-423a-9e48-b06689eec586 service nova] Lock "5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:27:35 user nova-compute[72129]: DEBUG nova.compute.manager [req-4edc8693-fbb9-43ba-849f-1a8b5577fc37 req-eeecef0c-ab8a-423a-9e48-b06689eec586 service nova] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] No waiting events found dispatching network-vif-plugged-ed958cf2-355f-460b-be85-8e7c2b1c34ca {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:27:35 user nova-compute[72129]: WARNING nova.compute.manager [req-4edc8693-fbb9-43ba-849f-1a8b5577fc37 req-eeecef0c-ab8a-423a-9e48-b06689eec586 service nova] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Received unexpected event network-vif-plugged-ed958cf2-355f-460b-be85-8e7c2b1c34ca for instance with vm_state deleted and task_state None.
Aug 01 14:27:35 user nova-compute[72129]: DEBUG nova.compute.manager [req-4edc8693-fbb9-43ba-849f-1a8b5577fc37 req-eeecef0c-ab8a-423a-9e48-b06689eec586 service nova] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Received event network-vif-deleted-ed958cf2-355f-460b-be85-8e7c2b1c34ca {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:27:35 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-bf274805-5c83-448d-aa50-c96bcf04f823 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:27:35 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-bf274805-5c83-448d-aa50-c96bcf04f823 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:27:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-bf274805-5c83-448d-aa50-c96bcf04f823 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.191s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:27:35 user nova-compute[72129]: INFO nova.scheduler.client.report [None req-bf274805-5c83-448d-aa50-c96bcf04f823 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Deleted allocations for instance 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca
Aug 01 14:27:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-bf274805-5c83-448d-aa50-c96bcf04f823 tempest-AttachVolumeNegativeTest-2079788087 tempest-AttachVolumeNegativeTest-2079788087-project-member] Lock "5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.620s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:27:36 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:27:38 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:27:41 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:27:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:27:48 user nova-compute[72129]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690900053.7926352, 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca => Stopped> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:27:48 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] VM Stopped (Lifecycle Event)
Aug 01 14:27:48 user nova-compute[72129]: DEBUG nova.compute.manager [None req-10a146f7-66a0-4968-a018-594487dd2bb9 None None] [instance: 5baf2a4a-2e92-484e-b3f7-bf7c32bdb3ca] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:27:48 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:27:48 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:27:48 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72129) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 14:27:48 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:27:48 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:27:48 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:27:53 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:27:58 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:28:03 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:28:03 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:28:03 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72129) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 14:28:03 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:28:03 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:28:03 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:28:07 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:28:07 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72129) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 14:28:08 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:28:08 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:28:09 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:28:09 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:28:09 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:28:09 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:28:09 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Auditing locally available compute resources for user (node: user) {{(pid=72129) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 14:28:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e602ce0-ffe8-4737-86cb-5caee367f2b4/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:28:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e602ce0-ffe8-4737-86cb-5caee367f2b4/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:28:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e602ce0-ffe8-4737-86cb-5caee367f2b4/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:28:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e602ce0-ffe8-4737-86cb-5caee367f2b4/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:28:09 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 14:28:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3319e68-8c91-404f-800b-6798fb16aa75/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:28:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3319e68-8c91-404f-800b-6798fb16aa75/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:28:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3319e68-8c91-404f-800b-6798fb16aa75/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:28:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3319e68-8c91-404f-800b-6798fb16aa75/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:28:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:28:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:28:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:28:10 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:28:10 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk.rescue --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:28:10 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:28:10 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk.rescue --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:28:10 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:28:10 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:28:10 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:28:10 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:28:10 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:28:11 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:28:11 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:28:11 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Hypervisor/Node resource view: name=user free_ram=8481MB free_disk=25.08719253540039GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72129) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 14:28:11 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:28:11 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:28:11 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance b3f54430-8d5d-478b-8dc7-d7592ee3db36 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:28:11 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:28:11 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 5e602ce0-ffe8-4737-86cb-5caee367f2b4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:28:11 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance a3319e68-8c91-404f-800b-6798fb16aa75 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:28:11 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 14:28:11 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 14:28:11 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:28:11 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:28:11 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Compute_service record updated for user:user {{(pid=72129) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 14:28:11 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.321s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:28:13 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:28:14 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:28:14 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:28:14 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Starting heal instance info cache {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 14:28:14 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Didn't find any instances for network info cache update. {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 14:28:14 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:28:14 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:28:15 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:28:16 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:28:16 user nova-compute[72129]: DEBUG nova.compute.manager [None req-3fb5f71e-5167-4aaa-b9a8-f2777397e2f0 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:28:16 user nova-compute[72129]: INFO nova.compute.manager [None req-3fb5f71e-5167-4aaa-b9a8-f2777397e2f0 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] instance snapshotting
Aug 01 14:28:16 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-3fb5f71e-5167-4aaa-b9a8-f2777397e2f0 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Beginning live snapshot process
Aug 01 14:28:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-3fb5f71e-5167-4aaa-b9a8-f2777397e2f0 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3319e68-8c91-404f-800b-6798fb16aa75/disk --force-share --output=json -f qcow2 {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:28:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-3fb5f71e-5167-4aaa-b9a8-f2777397e2f0 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3319e68-8c91-404f-800b-6798fb16aa75/disk --force-share --output=json -f qcow2" returned: 0 in 0.137s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:28:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-3fb5f71e-5167-4aaa-b9a8-f2777397e2f0 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3319e68-8c91-404f-800b-6798fb16aa75/disk --force-share --output=json -f qcow2 {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:28:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-3fb5f71e-5167-4aaa-b9a8-f2777397e2f0 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3319e68-8c91-404f-800b-6798fb16aa75/disk --force-share --output=json -f qcow2" returned: 0 in 0.142s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:28:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-3fb5f71e-5167-4aaa-b9a8-f2777397e2f0 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:28:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-3fb5f71e-5167-4aaa-b9a8-f2777397e2f0 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.145s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:28:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-3fb5f71e-5167-4aaa-b9a8-f2777397e2f0 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpsudopkuy/997742ce7b4c48d490e46d98f2344693.delta 1073741824 {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:28:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-3fb5f71e-5167-4aaa-b9a8-f2777397e2f0 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpsudopkuy/997742ce7b4c48d490e46d98f2344693.delta 1073741824" returned: 0 in 0.050s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:28:17 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-3fb5f71e-5167-4aaa-b9a8-f2777397e2f0 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 01 14:28:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-3fb5f71e-5167-4aaa-b9a8-f2777397e2f0 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=72129) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 14:28:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-3fb5f71e-5167-4aaa-b9a8-f2777397e2f0 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=72129) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 14:28:18 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-3fb5f71e-5167-4aaa-b9a8-f2777397e2f0 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 01 14:28:18 user nova-compute[72129]: DEBUG nova.privsep.utils [None req-3fb5f71e-5167-4aaa-b9a8-f2777397e2f0 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72129) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 14:28:18 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-3fb5f71e-5167-4aaa-b9a8-f2777397e2f0 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpsudopkuy/997742ce7b4c48d490e46d98f2344693.delta /opt/stack/data/nova/instances/snapshots/tmpsudopkuy/997742ce7b4c48d490e46d98f2344693 {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:28:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:28:19 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-3fb5f71e-5167-4aaa-b9a8-f2777397e2f0 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpsudopkuy/997742ce7b4c48d490e46d98f2344693.delta /opt/stack/data/nova/instances/snapshots/tmpsudopkuy/997742ce7b4c48d490e46d98f2344693" returned: 0 in 0.571s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:28:19 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-3fb5f71e-5167-4aaa-b9a8-f2777397e2f0 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Snapshot extracted, beginning image upload
Aug 01 14:28:20 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:28:21 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-3fb5f71e-5167-4aaa-b9a8-f2777397e2f0 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Snapshot image upload complete
Aug 01 14:28:21 user nova-compute[72129]: INFO nova.compute.manager [None req-3fb5f71e-5167-4aaa-b9a8-f2777397e2f0 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Took 4.77 seconds to snapshot the instance on the hypervisor.
Aug 01 14:28:23 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Acquiring lock "7e31e6ee-1bd8-423a-96ed-3940a87ee789" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:28:23 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Lock "7e31e6ee-1bd8-423a-96ed-3940a87ee789" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:28:23 user nova-compute[72129]: DEBUG nova.compute.manager [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] Starting instance... {{(pid=72129) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 14:28:23 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:28:23 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:28:23 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72129) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 14:28:23 user nova-compute[72129]: INFO nova.compute.claims [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] Claim successful on node user
Aug 01 14:28:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:28:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:28:24 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:28:24 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:28:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.618s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:28:24 user nova-compute[72129]: DEBUG nova.compute.manager [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] Start building networks asynchronously for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 14:28:24 user nova-compute[72129]: DEBUG nova.compute.manager [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] Allocating IP information in the background. {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 14:28:24 user nova-compute[72129]: DEBUG nova.network.neutron [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] allocate_for_instance() {{(pid=72129) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 14:28:24 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 14:28:24 user nova-compute[72129]: DEBUG nova.compute.manager [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] Start building block device mappings for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 14:28:24 user nova-compute[72129]: DEBUG nova.compute.manager [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] Start spawning the instance on the hypervisor. {{(pid=72129) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 14:28:24 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] Creating instance directory {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 14:28:24 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] Creating image(s)
Aug 01 14:28:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Acquiring lock "/opt/stack/data/nova/instances/7e31e6ee-1bd8-423a-96ed-3940a87ee789/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:28:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Lock "/opt/stack/data/nova/instances/7e31e6ee-1bd8-423a-96ed-3940a87ee789/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:28:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Lock "/opt/stack/data/nova/instances/7e31e6ee-1bd8-423a-96ed-3940a87ee789/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:28:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Acquiring lock "aab2430b9303bf15127700a89334e7a469d4b039" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:28:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Lock "aab2430b9303bf15127700a89334e7a469d4b039" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:28:25 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2430b9303bf15127700a89334e7a469d4b039.part --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:28:25 user nova-compute[72129]: DEBUG nova.policy [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9bf10b1642e642658bec5d0ac60b7abe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a91b43b1394048719e2ed69f5c3ae94f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72129) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 14:28:25 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2430b9303bf15127700a89334e7a469d4b039.part --force-share --output=json" returned: 0 in 0.142s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:28:25 user nova-compute[72129]: DEBUG nova.virt.images [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] dc80883f-f1dd-4ab8-a2cb-3591be595955 was qcow2, converting to raw {{(pid=72129) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 14:28:25 user nova-compute[72129]: DEBUG nova.privsep.utils [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72129) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 14:28:25 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/aab2430b9303bf15127700a89334e7a469d4b039.part /opt/stack/data/nova/instances/_base/aab2430b9303bf15127700a89334e7a469d4b039.converted {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:28:26 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/aab2430b9303bf15127700a89334e7a469d4b039.part /opt/stack/data/nova/instances/_base/aab2430b9303bf15127700a89334e7a469d4b039.converted" returned: 0 in 1.173s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:28:26 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2430b9303bf15127700a89334e7a469d4b039.converted --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:28:26 user nova-compute[72129]: DEBUG nova.network.neutron [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] Successfully created port: 6cb74238-92d8-4629-9631-b869d1775929 {{(pid=72129) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 14:28:26 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2430b9303bf15127700a89334e7a469d4b039.converted --force-share --output=json" returned: 0 in 0.140s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:28:26 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Lock "aab2430b9303bf15127700a89334e7a469d4b039" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.285s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:28:26 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2430b9303bf15127700a89334e7a469d4b039 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:28:26 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2430b9303bf15127700a89334e7a469d4b039 --force-share --output=json" returned: 0 in 0.135s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:28:26 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Acquiring lock "aab2430b9303bf15127700a89334e7a469d4b039" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:28:26 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Lock "aab2430b9303bf15127700a89334e7a469d4b039" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:28:26 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2430b9303bf15127700a89334e7a469d4b039 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:28:27 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2430b9303bf15127700a89334e7a469d4b039 --force-share --output=json" returned: 0 in 0.143s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:28:27 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aab2430b9303bf15127700a89334e7a469d4b039,backing_fmt=raw /opt/stack/data/nova/instances/7e31e6ee-1bd8-423a-96ed-3940a87ee789/disk 1073741824 {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:28:27 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/aab2430b9303bf15127700a89334e7a469d4b039,backing_fmt=raw /opt/stack/data/nova/instances/7e31e6ee-1bd8-423a-96ed-3940a87ee789/disk 1073741824" returned: 0 in 0.053s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:28:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Lock "aab2430b9303bf15127700a89334e7a469d4b039" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.203s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:28:27 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2430b9303bf15127700a89334e7a469d4b039 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:28:27 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/aab2430b9303bf15127700a89334e7a469d4b039 --force-share --output=json" returned: 0 in 0.146s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:28:27 user nova-compute[72129]: DEBUG nova.objects.instance [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Lazy-loading 'migration_context' on Instance uuid 7e31e6ee-1bd8-423a-96ed-3940a87ee789 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:28:27 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] Created local disks {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 14:28:27 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] Ensure instance console log exists: /opt/stack/data/nova/instances/7e31e6ee-1bd8-423a-96ed-3940a87ee789/console.log {{(pid=72129) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 14:28:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:28:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:28:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:28:27 user nova-compute[72129]: DEBUG nova.network.neutron [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] Successfully updated port: 6cb74238-92d8-4629-9631-b869d1775929 {{(pid=72129) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 14:28:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Acquiring lock "refresh_cache-7e31e6ee-1bd8-423a-96ed-3940a87ee789" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:28:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Acquired lock "refresh_cache-7e31e6ee-1bd8-423a-96ed-3940a87ee789" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:28:27 user nova-compute[72129]: DEBUG nova.network.neutron [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 14:28:27 user nova-compute[72129]: DEBUG nova.compute.manager [req-c951f250-a6ef-40a3-aee0-d755de7616e6 req-ed8f6be1-2f0a-47f2-a332-81e15a66b0c9 service nova] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] Received event network-changed-6cb74238-92d8-4629-9631-b869d1775929 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:28:27 user nova-compute[72129]: DEBUG nova.compute.manager [req-c951f250-a6ef-40a3-aee0-d755de7616e6 req-ed8f6be1-2f0a-47f2-a332-81e15a66b0c9 service nova] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] Refreshing instance network info cache due to event network-changed-6cb74238-92d8-4629-9631-b869d1775929. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 14:28:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-c951f250-a6ef-40a3-aee0-d755de7616e6 req-ed8f6be1-2f0a-47f2-a332-81e15a66b0c9 service nova] Acquiring lock "refresh_cache-7e31e6ee-1bd8-423a-96ed-3940a87ee789" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:28:27 user nova-compute[72129]: DEBUG nova.network.neutron [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] Instance cache missing network info. {{(pid=72129) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 14:28:27 user nova-compute[72129]: DEBUG nova.network.neutron [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] Updating instance_info_cache with network_info: [{"id": "6cb74238-92d8-4629-9631-b869d1775929", "address": "fa:16:3e:0b:05:26", "network": {"id": "d4ba0665-71f8-48a1-b3a2-2c73c2c7db3a", "bridge": "br-int", "label": "tempest-TestStampPattern-1150922129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a91b43b1394048719e2ed69f5c3ae94f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cb74238-92", "ovs_interfaceid": "6cb74238-92d8-4629-9631-b869d1775929", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:28:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Releasing lock "refresh_cache-7e31e6ee-1bd8-423a-96ed-3940a87ee789" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:28:27 user nova-compute[72129]: DEBUG nova.compute.manager [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] Instance network_info: |[{"id": "6cb74238-92d8-4629-9631-b869d1775929", "address": "fa:16:3e:0b:05:26", "network": {"id": "d4ba0665-71f8-48a1-b3a2-2c73c2c7db3a", "bridge": "br-int", "label": "tempest-TestStampPattern-1150922129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a91b43b1394048719e2ed69f5c3ae94f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cb74238-92", "ovs_interfaceid": "6cb74238-92d8-4629-9631-b869d1775929", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 14:28:27 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-c951f250-a6ef-40a3-aee0-d755de7616e6 req-ed8f6be1-2f0a-47f2-a332-81e15a66b0c9 service nova] Acquired lock "refresh_cache-7e31e6ee-1bd8-423a-96ed-3940a87ee789" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:28:27 user nova-compute[72129]: DEBUG nova.network.neutron [req-c951f250-a6ef-40a3-aee0-d755de7616e6 req-ed8f6be1-2f0a-47f2-a332-81e15a66b0c9 service nova] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] Refreshing network info cache for port 6cb74238-92d8-4629-9631-b869d1775929 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 14:28:27 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] Start _get_guest_xml network_info=[{"id": "6cb74238-92d8-4629-9631-b869d1775929", "address": "fa:16:3e:0b:05:26", "network": {"id": "d4ba0665-71f8-48a1-b3a2-2c73c2c7db3a", "bridge": "br-int", "label": "tempest-TestStampPattern-1150922129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a91b43b1394048719e2ed69f5c3ae94f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cb74238-92", "ovs_interfaceid": "6cb74238-92d8-4629-9631-b869d1775929", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='e9cae15caaa3d3c401a770b113181519',container_format='bare',created_at=2023-08-01T14:28:16Z,direct_url=<?>,disk_format='qcow2',id=dc80883f-f1dd-4ab8-a2cb-3591be595955,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1621774959',owner='a91b43b1394048719e2ed69f5c3ae94f',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-01T14:28:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'image_id': 'dc80883f-f1dd-4ab8-a2cb-3591be595955'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 14:28:27 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:28:27 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:28:27 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 14:28:27 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] CPU controller missing on host. {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 14:28:27 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 14:28:27 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] CPU controller found on host. {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 14:28:27 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72129) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 14:28:27 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T13:45:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='e9cae15caaa3d3c401a770b113181519',container_format='bare',created_at=2023-08-01T14:28:16Z,direct_url=<?>,disk_format='qcow2',id=dc80883f-f1dd-4ab8-a2cb-3591be595955,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1621774959',owner='a91b43b1394048719e2ed69f5c3ae94f',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-01T14:28:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 14:28:27 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Flavor limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 14:28:27 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Image limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 14:28:27 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Flavor pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 14:28:27 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Image pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 14:28:27 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 14:28:27 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 14:28:27 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 14:28:27 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Got 1 possible topologies {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 14:28:27 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 14:28:27 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 14:28:27 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:28:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-98663805',display_name='tempest-TestStampPattern-server-98663805',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-98663805',id=50,image_ref='dc80883f-f1dd-4ab8-a2cb-3591be595955',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCwUi55JC6c3jIlHojlRSa1D75mKSh1IzavmHf9G22Ze9c8CmQkw8Ybb7RlOQs1lEv+npQyyXxQntVe596OJBfHyUJy8lfQ5nyhMK2bUKD87QJNIia//pC3lm7PdMjjyDQ==',key_name='tempest-TestStampPattern-1260661357',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a91b43b1394048719e2ed69f5c3ae94f',ramdisk_id='',reservation_id='r-0vkvuh0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='a3319e68-8c91-404f-800b-6798fb16aa75',image_min_disk='1',image_min_ram='0',image_owner_id='a91b43b1394048719e2ed69f5c3ae94f',image_owner_project_name='tempest-TestStampPattern-1201126667',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1201126667-project-member',image_user_id='9bf10b1642e642658bec5d0ac60b7abe',network_allocated='True',owner_project_name='tempest-TestStampPattern-1201126667',owner_user_name='tempest-TestStampPattern-1201126667-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T14:28:24Z,user_data=None,user_id='9bf10b1642e642658bec5d0ac60b7abe',uuid=7e31e6ee-1bd8-423a-96ed-3940a87ee789,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6cb74238-92d8-4629-9631-b869d1775929", "address": "fa:16:3e:0b:05:26", "network": {"id": "d4ba0665-71f8-48a1-b3a2-2c73c2c7db3a", "bridge": "br-int", "label": "tempest-TestStampPattern-1150922129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a91b43b1394048719e2ed69f5c3ae94f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cb74238-92", "ovs_interfaceid": "6cb74238-92d8-4629-9631-b869d1775929", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 14:28:27 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Converting VIF {"id": "6cb74238-92d8-4629-9631-b869d1775929", "address": "fa:16:3e:0b:05:26", "network": {"id": "d4ba0665-71f8-48a1-b3a2-2c73c2c7db3a", "bridge": "br-int", "label": "tempest-TestStampPattern-1150922129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a91b43b1394048719e2ed69f5c3ae94f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cb74238-92", "ovs_interfaceid": "6cb74238-92d8-4629-9631-b869d1775929", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:28:27 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:05:26,bridge_name='br-int',has_traffic_filtering=True,id=6cb74238-92d8-4629-9631-b869d1775929,network=Network(d4ba0665-71f8-48a1-b3a2-2c73c2c7db3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cb74238-92') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:28:27 user nova-compute[72129]: DEBUG nova.objects.instance [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Lazy-loading 'pci_devices' on Instance uuid 7e31e6ee-1bd8-423a-96ed-3940a87ee789 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:28:27 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] End _get_guest_xml xml=<domain type="kvm">
Aug 01 14:28:27 user nova-compute[72129]:   <uuid>7e31e6ee-1bd8-423a-96ed-3940a87ee789</uuid>
Aug 01 14:28:27 user nova-compute[72129]:   <name>instance-00000032</name>
Aug 01 14:28:27 user nova-compute[72129]:   <memory>524288</memory>
Aug 01 14:28:27 user nova-compute[72129]:   <vcpu>1</vcpu>
Aug 01 14:28:27 user nova-compute[72129]:   <metadata>
Aug 01 14:28:27 user nova-compute[72129]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 14:28:27 user nova-compute[72129]:       <nova:package version="0.0.0"/>
Aug 01 14:28:27 user nova-compute[72129]:       <nova:name>tempest-TestStampPattern-server-98663805</nova:name>
Aug 01 14:28:27 user nova-compute[72129]:       <nova:creationTime>2023-08-01 14:28:27</nova:creationTime>
Aug 01 14:28:27 user nova-compute[72129]:       <nova:flavor name="m1.tiny">
Aug 01 14:28:27 user nova-compute[72129]:         <nova:memory>512</nova:memory>
Aug 01 14:28:27 user nova-compute[72129]:         <nova:disk>1</nova:disk>
Aug 01 14:28:27 user nova-compute[72129]:         <nova:swap>0</nova:swap>
Aug 01 14:28:27 user nova-compute[72129]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 14:28:27 user nova-compute[72129]:         <nova:vcpus>1</nova:vcpus>
Aug 01 14:28:27 user nova-compute[72129]:       </nova:flavor>
Aug 01 14:28:27 user nova-compute[72129]:       <nova:owner>
Aug 01 14:28:27 user nova-compute[72129]:         <nova:user uuid="9bf10b1642e642658bec5d0ac60b7abe">tempest-TestStampPattern-1201126667-project-member</nova:user>
Aug 01 14:28:27 user nova-compute[72129]:         <nova:project uuid="a91b43b1394048719e2ed69f5c3ae94f">tempest-TestStampPattern-1201126667</nova:project>
Aug 01 14:28:27 user nova-compute[72129]:       </nova:owner>
Aug 01 14:28:27 user nova-compute[72129]:       <nova:root type="image" uuid="dc80883f-f1dd-4ab8-a2cb-3591be595955"/>
Aug 01 14:28:27 user nova-compute[72129]:       <nova:ports>
Aug 01 14:28:27 user nova-compute[72129]:         <nova:port uuid="6cb74238-92d8-4629-9631-b869d1775929">
Aug 01 14:28:27 user nova-compute[72129]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 01 14:28:27 user nova-compute[72129]:         </nova:port>
Aug 01 14:28:27 user nova-compute[72129]:       </nova:ports>
Aug 01 14:28:27 user nova-compute[72129]:     </nova:instance>
Aug 01 14:28:27 user nova-compute[72129]:   </metadata>
Aug 01 14:28:27 user nova-compute[72129]:   <sysinfo type="smbios">
Aug 01 14:28:27 user nova-compute[72129]:     <system>
Aug 01 14:28:27 user nova-compute[72129]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 14:28:27 user nova-compute[72129]:       <entry name="product">OpenStack Nova</entry>
Aug 01 14:28:27 user nova-compute[72129]:       <entry name="version">0.0.0</entry>
Aug 01 14:28:27 user nova-compute[72129]:       <entry name="serial">7e31e6ee-1bd8-423a-96ed-3940a87ee789</entry>
Aug 01 14:28:27 user nova-compute[72129]:       <entry name="uuid">7e31e6ee-1bd8-423a-96ed-3940a87ee789</entry>
Aug 01 14:28:27 user nova-compute[72129]:       <entry name="family">Virtual Machine</entry>
Aug 01 14:28:27 user nova-compute[72129]:     </system>
Aug 01 14:28:27 user nova-compute[72129]:   </sysinfo>
Aug 01 14:28:27 user nova-compute[72129]:   <os>
Aug 01 14:28:27 user nova-compute[72129]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 14:28:27 user nova-compute[72129]:     <boot dev="hd"/>
Aug 01 14:28:27 user nova-compute[72129]:     <smbios mode="sysinfo"/>
Aug 01 14:28:27 user nova-compute[72129]:   </os>
Aug 01 14:28:27 user nova-compute[72129]:   <features>
Aug 01 14:28:27 user nova-compute[72129]:     <acpi/>
Aug 01 14:28:27 user nova-compute[72129]:     <apic/>
Aug 01 14:28:27 user nova-compute[72129]:     <vmcoreinfo/>
Aug 01 14:28:27 user nova-compute[72129]:   </features>
Aug 01 14:28:27 user nova-compute[72129]:   <clock offset="utc">
Aug 01 14:28:27 user nova-compute[72129]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 14:28:27 user nova-compute[72129]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 14:28:27 user nova-compute[72129]:     <timer name="hpet" present="no"/>
Aug 01 14:28:27 user nova-compute[72129]:   </clock>
Aug 01 14:28:27 user nova-compute[72129]:   <cpu mode="custom" match="exact">
Aug 01 14:28:27 user nova-compute[72129]:     <model>Nehalem</model>
Aug 01 14:28:27 user nova-compute[72129]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 14:28:27 user nova-compute[72129]:   </cpu>
Aug 01 14:28:27 user nova-compute[72129]:   <devices>
Aug 01 14:28:27 user nova-compute[72129]:     <disk type="file" device="disk">
Aug 01 14:28:27 user nova-compute[72129]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 14:28:27 user nova-compute[72129]:       <source file="/opt/stack/data/nova/instances/7e31e6ee-1bd8-423a-96ed-3940a87ee789/disk"/>
Aug 01 14:28:27 user nova-compute[72129]:       <target dev="vda" bus="virtio"/>
Aug 01 14:28:27 user nova-compute[72129]:     </disk>
Aug 01 14:28:27 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 14:28:27 user nova-compute[72129]:       <mac address="fa:16:3e:0b:05:26"/>
Aug 01 14:28:27 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:28:27 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 14:28:27 user nova-compute[72129]:       <target dev="tap6cb74238-92"/>
Aug 01 14:28:27 user nova-compute[72129]:     </interface>
Aug 01 14:28:27 user nova-compute[72129]:     <serial type="pty">
Aug 01 14:28:27 user nova-compute[72129]:       <log file="/opt/stack/data/nova/instances/7e31e6ee-1bd8-423a-96ed-3940a87ee789/console.log" append="off"/>
Aug 01 14:28:27 user nova-compute[72129]:     </serial>
Aug 01 14:28:27 user nova-compute[72129]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 14:28:27 user nova-compute[72129]:     <video>
Aug 01 14:28:27 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:28:27 user nova-compute[72129]:     </video>
Aug 01 14:28:27 user nova-compute[72129]:     <rng model="virtio">
Aug 01 14:28:27 user nova-compute[72129]:       <backend model="random">/dev/urandom</backend>
Aug 01 14:28:27 user nova-compute[72129]:     </rng>
Aug 01 14:28:27 user nova-compute[72129]:     <controller type="usb" index="0" model="none"/>
Aug 01 14:28:27 user nova-compute[72129]:     <memballoon model="virtio">
Aug 01 14:28:27 user nova-compute[72129]:       <stats period="10"/>
Aug 01 14:28:27 user nova-compute[72129]:     </memballoon>
Aug 01 14:28:27 user nova-compute[72129]:   </devices>
Aug 01 14:28:27 user nova-compute[72129]: </domain>
Aug 01 14:28:27 user nova-compute[72129]:  {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 14:28:27 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:28:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-98663805',display_name='tempest-TestStampPattern-server-98663805',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-98663805',id=50,image_ref='dc80883f-f1dd-4ab8-a2cb-3591be595955',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCwUi55JC6c3jIlHojlRSa1D75mKSh1IzavmHf9G22Ze9c8CmQkw8Ybb7RlOQs1lEv+npQyyXxQntVe596OJBfHyUJy8lfQ5nyhMK2bUKD87QJNIia//pC3lm7PdMjjyDQ==',key_name='tempest-TestStampPattern-1260661357',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a91b43b1394048719e2ed69f5c3ae94f',ramdisk_id='',reservation_id='r-0vkvuh0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='a3319e68-8c91-404f-800b-6798fb16aa75',image_min_disk='1',image_min_ram='0',image_owner_id='a91b43b1394048719e2ed69f5c3ae94f',image_owner_project_name='tempest-TestStampPattern-1201126667',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1201126667-project-member',image_user_id='9bf10b1642e642658bec5d0ac60b7abe',network_allocated='True',owner_project_name='tempest-TestStampPattern-1201126667',owner_user_name='tempest-TestStampPattern-1201126667-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T14:28:24Z,user_data=None,user_id='9bf10b1642e642658bec5d0ac60b7abe',uuid=7e31e6ee-1bd8-423a-96ed-3940a87ee789,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6cb74238-92d8-4629-9631-b869d1775929", "address": "fa:16:3e:0b:05:26", "network": {"id": "d4ba0665-71f8-48a1-b3a2-2c73c2c7db3a", "bridge": "br-int", "label": "tempest-TestStampPattern-1150922129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a91b43b1394048719e2ed69f5c3ae94f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cb74238-92", "ovs_interfaceid": "6cb74238-92d8-4629-9631-b869d1775929", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 14:28:27 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Converting VIF {"id": "6cb74238-92d8-4629-9631-b869d1775929", "address": "fa:16:3e:0b:05:26", "network": {"id": "d4ba0665-71f8-48a1-b3a2-2c73c2c7db3a", "bridge": "br-int", "label": "tempest-TestStampPattern-1150922129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a91b43b1394048719e2ed69f5c3ae94f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cb74238-92", "ovs_interfaceid": "6cb74238-92d8-4629-9631-b869d1775929", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:28:27 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:05:26,bridge_name='br-int',has_traffic_filtering=True,id=6cb74238-92d8-4629-9631-b869d1775929,network=Network(d4ba0665-71f8-48a1-b3a2-2c73c2c7db3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cb74238-92') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:28:27 user nova-compute[72129]: DEBUG os_vif [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:05:26,bridge_name='br-int',has_traffic_filtering=True,id=6cb74238-92d8-4629-9631-b869d1775929,network=Network(d4ba0665-71f8-48a1-b3a2-2c73c2c7db3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cb74238-92') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 14:28:27 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:28:27 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:28:27 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 14:28:27 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:28:27 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6cb74238-92, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:28:27 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6cb74238-92, col_values=(('external_ids', {'iface-id': '6cb74238-92d8-4629-9631-b869d1775929', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:05:26', 'vm-uuid': '7e31e6ee-1bd8-423a-96ed-3940a87ee789'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:28:27 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:28:27 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:28:27 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:28:27 user nova-compute[72129]: INFO os_vif [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:05:26,bridge_name='br-int',has_traffic_filtering=True,id=6cb74238-92d8-4629-9631-b869d1775929,network=Network(d4ba0665-71f8-48a1-b3a2-2c73c2c7db3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cb74238-92')
Aug 01 14:28:28 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:28:28 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] No VIF found with MAC fa:16:3e:0b:05:26, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 14:28:28 user nova-compute[72129]: DEBUG nova.network.neutron [req-c951f250-a6ef-40a3-aee0-d755de7616e6 req-ed8f6be1-2f0a-47f2-a332-81e15a66b0c9 service nova] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] Updated VIF entry in instance network info cache for port 6cb74238-92d8-4629-9631-b869d1775929. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 14:28:28 user nova-compute[72129]: DEBUG nova.network.neutron [req-c951f250-a6ef-40a3-aee0-d755de7616e6 req-ed8f6be1-2f0a-47f2-a332-81e15a66b0c9 service nova] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] Updating instance_info_cache with network_info: [{"id": "6cb74238-92d8-4629-9631-b869d1775929", "address": "fa:16:3e:0b:05:26", "network": {"id": "d4ba0665-71f8-48a1-b3a2-2c73c2c7db3a", "bridge": "br-int", "label": "tempest-TestStampPattern-1150922129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a91b43b1394048719e2ed69f5c3ae94f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cb74238-92", "ovs_interfaceid": "6cb74238-92d8-4629-9631-b869d1775929", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:28:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-c951f250-a6ef-40a3-aee0-d755de7616e6 req-ed8f6be1-2f0a-47f2-a332-81e15a66b0c9 service nova] Releasing lock "refresh_cache-7e31e6ee-1bd8-423a-96ed-3940a87ee789" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:28:29 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:28:29 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:28:29 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:28:29 user nova-compute[72129]: DEBUG nova.compute.manager [req-a1f7ac8b-2783-4117-8e1a-5c81df803b66 req-ea173fb2-a536-4da2-85ba-d77dd2237416 service nova] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] Received event network-vif-plugged-6cb74238-92d8-4629-9631-b869d1775929 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:28:29 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-a1f7ac8b-2783-4117-8e1a-5c81df803b66 req-ea173fb2-a536-4da2-85ba-d77dd2237416 service nova] Acquiring lock "7e31e6ee-1bd8-423a-96ed-3940a87ee789-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:28:29 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-a1f7ac8b-2783-4117-8e1a-5c81df803b66 req-ea173fb2-a536-4da2-85ba-d77dd2237416 service nova] Lock "7e31e6ee-1bd8-423a-96ed-3940a87ee789-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:28:29 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-a1f7ac8b-2783-4117-8e1a-5c81df803b66 req-ea173fb2-a536-4da2-85ba-d77dd2237416 service nova] Lock "7e31e6ee-1bd8-423a-96ed-3940a87ee789-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:28:29 user nova-compute[72129]: DEBUG nova.compute.manager [req-a1f7ac8b-2783-4117-8e1a-5c81df803b66 req-ea173fb2-a536-4da2-85ba-d77dd2237416 service nova] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] No waiting events found dispatching network-vif-plugged-6cb74238-92d8-4629-9631-b869d1775929 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:28:29 user nova-compute[72129]: WARNING nova.compute.manager [req-a1f7ac8b-2783-4117-8e1a-5c81df803b66 req-ea173fb2-a536-4da2-85ba-d77dd2237416 service nova] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] Received unexpected event network-vif-plugged-6cb74238-92d8-4629-9631-b869d1775929 for instance with vm_state building and task_state spawning.
Aug 01 14:28:29 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:28:29 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:28:31 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690900111.3900642, 7e31e6ee-1bd8-423a-96ed-3940a87ee789 => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:28:31 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] VM Resumed (Lifecycle Event)
Aug 01 14:28:31 user nova-compute[72129]: DEBUG nova.compute.manager [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] Instance event wait completed in 0 seconds for  {{(pid=72129) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 14:28:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] Guest created on hypervisor {{(pid=72129) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 14:28:31 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] Instance spawned successfully.
Aug 01 14:28:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 14:28:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] Found default for hw_input_bus of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:28:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] Found default for hw_pointer_model of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:28:31 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:28:31 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:28:31 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 14:28:31 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690900111.392451, 7e31e6ee-1bd8-423a-96ed-3940a87ee789 => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:28:31 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] VM Started (Lifecycle Event)
Aug 01 14:28:31 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:28:31 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:28:31 user nova-compute[72129]: INFO nova.compute.manager [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] Took 7.02 seconds to spawn the instance on the hypervisor.
Aug 01 14:28:31 user nova-compute[72129]: DEBUG nova.compute.manager [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:28:31 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 14:28:31 user nova-compute[72129]: DEBUG nova.compute.manager [req-e35e4f8b-c75d-4222-b36f-a901a18e3a1a req-1c98c609-e423-4f09-a9f7-7a269b4d31ac service nova] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] Received event network-vif-plugged-6cb74238-92d8-4629-9631-b869d1775929 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:28:31 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-e35e4f8b-c75d-4222-b36f-a901a18e3a1a req-1c98c609-e423-4f09-a9f7-7a269b4d31ac service nova] Acquiring lock "7e31e6ee-1bd8-423a-96ed-3940a87ee789-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:28:31 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-e35e4f8b-c75d-4222-b36f-a901a18e3a1a req-1c98c609-e423-4f09-a9f7-7a269b4d31ac service nova] Lock "7e31e6ee-1bd8-423a-96ed-3940a87ee789-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:28:31 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-e35e4f8b-c75d-4222-b36f-a901a18e3a1a req-1c98c609-e423-4f09-a9f7-7a269b4d31ac service nova] Lock "7e31e6ee-1bd8-423a-96ed-3940a87ee789-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:28:31 user nova-compute[72129]: DEBUG nova.compute.manager [req-e35e4f8b-c75d-4222-b36f-a901a18e3a1a req-1c98c609-e423-4f09-a9f7-7a269b4d31ac service nova] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] No waiting events found dispatching network-vif-plugged-6cb74238-92d8-4629-9631-b869d1775929 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:28:31 user nova-compute[72129]: WARNING nova.compute.manager [req-e35e4f8b-c75d-4222-b36f-a901a18e3a1a req-1c98c609-e423-4f09-a9f7-7a269b4d31ac service nova] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] Received unexpected event network-vif-plugged-6cb74238-92d8-4629-9631-b869d1775929 for instance with vm_state building and task_state spawning.
Aug 01 14:28:31 user nova-compute[72129]: INFO nova.compute.manager [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] Took 7.99 seconds to build instance.
Aug 01 14:28:31 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-b52d97d4-a72b-402c-8b5f-20b1eccb04d4 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Lock "7e31e6ee-1bd8-423a-96ed-3940a87ee789" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.125s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:28:31 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:28:32 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:28:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:28:42 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:28:42 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:28:46 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:28:47 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:28:51 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:28:52 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:28:56 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:28:57 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:29:00 user nova-compute[72129]: DEBUG nova.compute.manager [req-a7d9ddd0-622a-4713-bf33-3bae98dda160 req-856977dd-2d90-4a76-b41f-eda8483ac662 service nova] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Received event network-changed-7cc66f81-8cb9-416d-b9c3-03451989c713 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:29:00 user nova-compute[72129]: DEBUG nova.compute.manager [req-a7d9ddd0-622a-4713-bf33-3bae98dda160 req-856977dd-2d90-4a76-b41f-eda8483ac662 service nova] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Refreshing instance network info cache due to event network-changed-7cc66f81-8cb9-416d-b9c3-03451989c713. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 14:29:00 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-a7d9ddd0-622a-4713-bf33-3bae98dda160 req-856977dd-2d90-4a76-b41f-eda8483ac662 service nova] Acquiring lock "refresh_cache-5e602ce0-ffe8-4737-86cb-5caee367f2b4" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:29:00 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-a7d9ddd0-622a-4713-bf33-3bae98dda160 req-856977dd-2d90-4a76-b41f-eda8483ac662 service nova] Acquired lock "refresh_cache-5e602ce0-ffe8-4737-86cb-5caee367f2b4" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:29:00 user nova-compute[72129]: DEBUG nova.network.neutron [req-a7d9ddd0-622a-4713-bf33-3bae98dda160 req-856977dd-2d90-4a76-b41f-eda8483ac662 service nova] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Refreshing network info cache for port 7cc66f81-8cb9-416d-b9c3-03451989c713 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 14:29:01 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-210f1efd-adf7-4874-a0df-c6c15d93f246 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Acquiring lock "5e602ce0-ffe8-4737-86cb-5caee367f2b4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:29:01 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-210f1efd-adf7-4874-a0df-c6c15d93f246 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lock "5e602ce0-ffe8-4737-86cb-5caee367f2b4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:29:01 user nova-compute[72129]: INFO nova.compute.manager [None req-210f1efd-adf7-4874-a0df-c6c15d93f246 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Detaching volume d0a34f37-192e-4503-ae13-eb1f850bb189
Aug 01 14:29:01 user nova-compute[72129]: INFO nova.virt.block_device [None req-210f1efd-adf7-4874-a0df-c6c15d93f246 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Attempting to driver detach volume d0a34f37-192e-4503-ae13-eb1f850bb189 from mountpoint /dev/vdb
Aug 01 14:29:01 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-210f1efd-adf7-4874-a0df-c6c15d93f246 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Attempting to detach device vdb from instance 5e602ce0-ffe8-4737-86cb-5caee367f2b4 from the persistent domain config. {{(pid=72129) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 14:29:01 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-210f1efd-adf7-4874-a0df-c6c15d93f246 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 14:29:01 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:29:01 user nova-compute[72129]:   <source dev="/dev/sdb"/>
Aug 01 14:29:01 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 14:29:01 user nova-compute[72129]:   <serial>d0a34f37-192e-4503-ae13-eb1f850bb189</serial>
Aug 01 14:29:01 user nova-compute[72129]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 14:29:01 user nova-compute[72129]: </disk>
Aug 01 14:29:01 user nova-compute[72129]:  {{(pid=72129) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 14:29:01 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-210f1efd-adf7-4874-a0df-c6c15d93f246 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Successfully detached device vdb from instance 5e602ce0-ffe8-4737-86cb-5caee367f2b4 from the persistent domain config.
Aug 01 14:29:01 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-210f1efd-adf7-4874-a0df-c6c15d93f246 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5e602ce0-ffe8-4737-86cb-5caee367f2b4 from the live domain config. {{(pid=72129) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 14:29:01 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-210f1efd-adf7-4874-a0df-c6c15d93f246 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 14:29:01 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:29:01 user nova-compute[72129]:   <source dev="/dev/sdb"/>
Aug 01 14:29:01 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 14:29:01 user nova-compute[72129]:   <serial>d0a34f37-192e-4503-ae13-eb1f850bb189</serial>
Aug 01 14:29:01 user nova-compute[72129]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 14:29:01 user nova-compute[72129]: </disk>
Aug 01 14:29:01 user nova-compute[72129]:  {{(pid=72129) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 14:29:01 user nova-compute[72129]: DEBUG nova.network.neutron [req-a7d9ddd0-622a-4713-bf33-3bae98dda160 req-856977dd-2d90-4a76-b41f-eda8483ac662 service nova] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Updated VIF entry in instance network info cache for port 7cc66f81-8cb9-416d-b9c3-03451989c713. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 14:29:01 user nova-compute[72129]: DEBUG nova.network.neutron [req-a7d9ddd0-622a-4713-bf33-3bae98dda160 req-856977dd-2d90-4a76-b41f-eda8483ac662 service nova] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Updating instance_info_cache with network_info: [{"id": "7cc66f81-8cb9-416d-b9c3-03451989c713", "address": "fa:16:3e:f6:cb:d3", "network": {"id": "6ffcec16-7b44-472a-b7cd-af16ebd4a653", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-901464581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cca3e17d4e4df79c94c4b94fb3fcec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc66f81-8c", "ovs_interfaceid": "7cc66f81-8cb9-416d-b9c3-03451989c713", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:29:01 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-a7d9ddd0-622a-4713-bf33-3bae98dda160 req-856977dd-2d90-4a76-b41f-eda8483ac662 service nova] Releasing lock "refresh_cache-5e602ce0-ffe8-4737-86cb-5caee367f2b4" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:29:01 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:29:02 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Received event <DeviceRemovedEvent: 1690900142.002458, 5e602ce0-ffe8-4737-86cb-5caee367f2b4 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72129) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 14:29:02 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-210f1efd-adf7-4874-a0df-c6c15d93f246 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5e602ce0-ffe8-4737-86cb-5caee367f2b4 {{(pid=72129) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 14:29:02 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-210f1efd-adf7-4874-a0df-c6c15d93f246 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Successfully detached device vdb from instance 5e602ce0-ffe8-4737-86cb-5caee367f2b4 from the live domain config.
Aug 01 14:29:02 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-210f1efd-adf7-4874-a0df-c6c15d93f246 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] calling os-brick to detach iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 14:29:02 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-210f1efd-adf7-4874-a0df-c6c15d93f246 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, {'target_iqns': ['iqn.2010-10.org.openstack:d0a34f37-192e-4503-ae13-eb1f850bb189'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ASEtQeXv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:29:02 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-210f1efd-adf7-4874-a0df-c6c15d93f246 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:29:02 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-210f1efd-adf7-4874-a0df-c6c15d93f246 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:29:02 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-210f1efd-adf7-4874-a0df-c6c15d93f246 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:29:02 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-210f1efd-adf7-4874-a0df-c6c15d93f246 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0a34f37-192e-4503-ae13-eb1f850bb189', 0)] {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 14:29:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:29:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:29:02 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9a1141-c508-4586-9c70-4faa5f3701cd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0a34f37-192e-4503-ae13-eb1f850bb189\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:29:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:29:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:29:02 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[426d5dc9-ef48-4866-8a87-6f38926f6f4b]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0a34f37-192e-4503-ae13-eb1f850bb189 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:29:02 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-210f1efd-adf7-4874-a0df-c6c15d93f246 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0a34f37-192e-4503-ae13-eb1f850bb189 (non-flash)
Aug 01 14:29:02 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:29:02 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-210f1efd-adf7-4874-a0df-c6c15d93f246 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0a34f37-192e-4503-ae13-eb1f850bb189 (non-flash)
Aug 01 14:29:02 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:29:02 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-210f1efd-adf7-4874-a0df-c6c15d93f246 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f28102a6290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0a34f37-192e-4503-ae13-eb1f850bb189'): ({'sdb'}, set())}) {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 14:29:02 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-210f1efd-adf7-4874-a0df-c6c15d93f246 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Removing single pathed devices sdb {{(pid=72129) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 14:29:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:29:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:29:02 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a8a8c6-4077-4bb2-a722-f890a54b0da2]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:29:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:29:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:29:02 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[972a0aed-fed1-4f11-a8a2-600e63711cf0]: (4, ('ok\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:29:02 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-210f1efd-adf7-4874-a0df-c6c15d93f246 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Flushing IO for device /dev/sdb {{(pid=72129) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 14:29:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:29:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:29:02 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[72889137-a213-4f57-8510-03fe506ccf27]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:29:02 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-210f1efd-adf7-4874-a0df-c6c15d93f246 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72129) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 14:29:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:29:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:29:02 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c4267e-4b0a-4c99-ad37-bc654d49ee11]: (4, ('1', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:29:02 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-210f1efd-adf7-4874-a0df-c6c15d93f246 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 14:29:02 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-210f1efd-adf7-4874-a0df-c6c15d93f246 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] SCSI volumes sdb have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 14:29:02 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-210f1efd-adf7-4874-a0df-c6c15d93f246 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0a34f37-192e-4503-ae13-eb1f850bb189')] {{(pid=72129) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 14:29:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0a34f37-192e-4503-ae13-eb1f850bb189 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:29:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0a34f37-192e-4503-ae13-eb1f850bb189 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:29:02 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a34fa3-cb90-4a09-a808-ae2783cda34e]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:29:02 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-210f1efd-adf7-4874-a0df-c6c15d93f246 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:29:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0a34f37-192e-4503-ae13-eb1f850bb189 -p 172.16.0.220:3260 --logout {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:29:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0a34f37-192e-4503-ae13-eb1f850bb189 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:29:02 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e55669e-3020-4963-8b1e-5a5bdfd0c032]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:d0a34f37-192e-4503-ae13-eb1f850bb189, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:d0a34f37-192e-4503-ae13-eb1f850bb189, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:29:02 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-210f1efd-adf7-4874-a0df-c6c15d93f246 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:d0a34f37-192e-4503-ae13-eb1f850bb189, portal: 172.16.0.220,3260]
Aug 01 14:29:02 user nova-compute[72129]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:d0a34f37-192e-4503-ae13-eb1f850bb189, portal: 172.16.0.220,3260] successful.
Aug 01 14:29:02 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:29:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0a34f37-192e-4503-ae13-eb1f850bb189 -p 172.16.0.220:3260 --op delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:29:02 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0a34f37-192e-4503-ae13-eb1f850bb189 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:29:02 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[56fd11d7-c364-4010-b12c-7e469efdb862]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:29:02 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-210f1efd-adf7-4874-a0df-c6c15d93f246 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:29:02 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-210f1efd-adf7-4874-a0df-c6c15d93f246 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:29:02 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-210f1efd-adf7-4874-a0df-c6c15d93f246 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] <== disconnect_volume: return (283ms) None {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:29:02 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-210f1efd-adf7-4874-a0df-c6c15d93f246 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Disconnected iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 14:29:02 user nova-compute[72129]: DEBUG nova.compute.manager [req-971d10a2-693f-4109-a974-785ecc09f9fc req-3c126e0e-4926-4c54-a961-311952194050 service nova] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Received event network-changed-7cc66f81-8cb9-416d-b9c3-03451989c713 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:29:02 user nova-compute[72129]: DEBUG nova.compute.manager [req-971d10a2-693f-4109-a974-785ecc09f9fc req-3c126e0e-4926-4c54-a961-311952194050 service nova] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Refreshing instance network info cache due to event network-changed-7cc66f81-8cb9-416d-b9c3-03451989c713. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 14:29:02 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-971d10a2-693f-4109-a974-785ecc09f9fc req-3c126e0e-4926-4c54-a961-311952194050 service nova] Acquiring lock "refresh_cache-5e602ce0-ffe8-4737-86cb-5caee367f2b4" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:29:02 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-971d10a2-693f-4109-a974-785ecc09f9fc req-3c126e0e-4926-4c54-a961-311952194050 service nova] Acquired lock "refresh_cache-5e602ce0-ffe8-4737-86cb-5caee367f2b4" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:29:02 user nova-compute[72129]: DEBUG nova.network.neutron [req-971d10a2-693f-4109-a974-785ecc09f9fc req-3c126e0e-4926-4c54-a961-311952194050 service nova] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Refreshing network info cache for port 7cc66f81-8cb9-416d-b9c3-03451989c713 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 14:29:02 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:29:03 user nova-compute[72129]: DEBUG nova.objects.instance [None req-210f1efd-adf7-4874-a0df-c6c15d93f246 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lazy-loading 'flavor' on Instance uuid 5e602ce0-ffe8-4737-86cb-5caee367f2b4 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:29:03 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-210f1efd-adf7-4874-a0df-c6c15d93f246 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lock "5e602ce0-ffe8-4737-86cb-5caee367f2b4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.703s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:29:03 user nova-compute[72129]: DEBUG nova.network.neutron [req-971d10a2-693f-4109-a974-785ecc09f9fc req-3c126e0e-4926-4c54-a961-311952194050 service nova] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Updated VIF entry in instance network info cache for port 7cc66f81-8cb9-416d-b9c3-03451989c713. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 14:29:03 user nova-compute[72129]: DEBUG nova.network.neutron [req-971d10a2-693f-4109-a974-785ecc09f9fc req-3c126e0e-4926-4c54-a961-311952194050 service nova] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Updating instance_info_cache with network_info: [{"id": "7cc66f81-8cb9-416d-b9c3-03451989c713", "address": "fa:16:3e:f6:cb:d3", "network": {"id": "6ffcec16-7b44-472a-b7cd-af16ebd4a653", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-901464581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cca3e17d4e4df79c94c4b94fb3fcec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc66f81-8c", "ovs_interfaceid": "7cc66f81-8cb9-416d-b9c3-03451989c713", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:29:03 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-971d10a2-693f-4109-a974-785ecc09f9fc req-3c126e0e-4926-4c54-a961-311952194050 service nova] Releasing lock "refresh_cache-5e602ce0-ffe8-4737-86cb-5caee367f2b4" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:29:07 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:29:07 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72129) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 14:29:07 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:29:07 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:29:07 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72129) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 14:29:07 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:29:07 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:29:07 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:29:09 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:29:11 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:29:11 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:29:11 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:29:11 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:29:11 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Auditing locally available compute resources for user (node: user) {{(pid=72129) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 14:29:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e602ce0-ffe8-4737-86cb-5caee367f2b4/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:29:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e602ce0-ffe8-4737-86cb-5caee367f2b4/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:29:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e602ce0-ffe8-4737-86cb-5caee367f2b4/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:29:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e602ce0-ffe8-4737-86cb-5caee367f2b4/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:29:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3319e68-8c91-404f-800b-6798fb16aa75/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:29:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3319e68-8c91-404f-800b-6798fb16aa75/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:29:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3319e68-8c91-404f-800b-6798fb16aa75/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:29:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3319e68-8c91-404f-800b-6798fb16aa75/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:29:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:29:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:29:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:29:12 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:29:12 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk.rescue --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:29:12 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:29:12 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk.rescue --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:29:12 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:29:12 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:29:12 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:29:12 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:29:12 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:29:12 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e31e6ee-1bd8-423a-96ed-3940a87ee789/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:29:12 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e31e6ee-1bd8-423a-96ed-3940a87ee789/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:29:12 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e31e6ee-1bd8-423a-96ed-3940a87ee789/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:29:12 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:29:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e31e6ee-1bd8-423a-96ed-3940a87ee789/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:29:13 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:29:13 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:29:13 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Hypervisor/Node resource view: name=user free_ram=8364MB free_disk=24.931800842285156GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72129) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 14:29:13 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:29:13 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:29:13 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance b3f54430-8d5d-478b-8dc7-d7592ee3db36 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:29:13 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:29:13 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 5e602ce0-ffe8-4737-86cb-5caee367f2b4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:29:13 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance a3319e68-8c91-404f-800b-6798fb16aa75 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:29:13 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 7e31e6ee-1bd8-423a-96ed-3940a87ee789 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:29:13 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 14:29:13 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 14:29:13 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:29:13 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:29:13 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Compute_service record updated for user:user {{(pid=72129) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 14:29:13 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.324s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:29:16 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:29:16 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:29:16 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Starting heal instance info cache {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 14:29:16 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Rebuilding the list of instances to heal {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 14:29:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "refresh_cache-b3f54430-8d5d-478b-8dc7-d7592ee3db36" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:29:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquired lock "refresh_cache-b3f54430-8d5d-478b-8dc7-d7592ee3db36" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:29:16 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Forcefully refreshing network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 14:29:16 user nova-compute[72129]: DEBUG nova.objects.instance [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lazy-loading 'info_cache' on Instance uuid b3f54430-8d5d-478b-8dc7-d7592ee3db36 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:29:17 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Updating instance_info_cache with network_info: [{"id": "77cb18a9-2c41-4aa6-8784-ffcbafeb1341", "address": "fa:16:3e:d2:d6:8b", "network": {"id": "6ffcec16-7b44-472a-b7cd-af16ebd4a653", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-901464581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cca3e17d4e4df79c94c4b94fb3fcec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77cb18a9-2c", "ovs_interfaceid": "77cb18a9-2c41-4aa6-8784-ffcbafeb1341", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:29:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Releasing lock "refresh_cache-b3f54430-8d5d-478b-8dc7-d7592ee3db36" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:29:17 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Updated the network info_cache for instance {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 14:29:17 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:29:17 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:29:17 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:29:17 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:29:18 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:29:22 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:29:27 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:29:27 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:29:27 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72129) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 14:29:27 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:29:27 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:29:27 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:29:32 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:29:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:29:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:29:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72129) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 14:29:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:29:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:29:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:29:42 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:29:47 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:29:47 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:29:47 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72129) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 14:29:47 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:29:47 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:29:47 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:29:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c8e126af-5058-462e-a63d-4edbe6fd9286 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Acquiring lock "5e602ce0-ffe8-4737-86cb-5caee367f2b4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:29:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c8e126af-5058-462e-a63d-4edbe6fd9286 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lock "5e602ce0-ffe8-4737-86cb-5caee367f2b4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:29:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c8e126af-5058-462e-a63d-4edbe6fd9286 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Acquiring lock "5e602ce0-ffe8-4737-86cb-5caee367f2b4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:29:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c8e126af-5058-462e-a63d-4edbe6fd9286 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lock "5e602ce0-ffe8-4737-86cb-5caee367f2b4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:29:51 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c8e126af-5058-462e-a63d-4edbe6fd9286 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lock "5e602ce0-ffe8-4737-86cb-5caee367f2b4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:29:51 user nova-compute[72129]: INFO nova.compute.manager [None req-c8e126af-5058-462e-a63d-4edbe6fd9286 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Terminating instance
Aug 01 14:29:51 user nova-compute[72129]: DEBUG nova.compute.manager [None req-c8e126af-5058-462e-a63d-4edbe6fd9286 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Start destroying the instance on the hypervisor. {{(pid=72129) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 14:29:52 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:29:52 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:29:52 user nova-compute[72129]: DEBUG nova.compute.manager [req-bd502cae-ab3b-4242-aa1f-47c28fd77d13 req-44eb7008-ff5a-4c58-a411-c14625fe3339 service nova] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Received event network-vif-unplugged-7cc66f81-8cb9-416d-b9c3-03451989c713 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:29:52 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-bd502cae-ab3b-4242-aa1f-47c28fd77d13 req-44eb7008-ff5a-4c58-a411-c14625fe3339 service nova] Acquiring lock "5e602ce0-ffe8-4737-86cb-5caee367f2b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:29:52 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-bd502cae-ab3b-4242-aa1f-47c28fd77d13 req-44eb7008-ff5a-4c58-a411-c14625fe3339 service nova] Lock "5e602ce0-ffe8-4737-86cb-5caee367f2b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:29:52 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-bd502cae-ab3b-4242-aa1f-47c28fd77d13 req-44eb7008-ff5a-4c58-a411-c14625fe3339 service nova] Lock "5e602ce0-ffe8-4737-86cb-5caee367f2b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:29:52 user nova-compute[72129]: DEBUG nova.compute.manager [req-bd502cae-ab3b-4242-aa1f-47c28fd77d13 req-44eb7008-ff5a-4c58-a411-c14625fe3339 service nova] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] No waiting events found dispatching network-vif-unplugged-7cc66f81-8cb9-416d-b9c3-03451989c713 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:29:52 user nova-compute[72129]: DEBUG nova.compute.manager [req-bd502cae-ab3b-4242-aa1f-47c28fd77d13 req-44eb7008-ff5a-4c58-a411-c14625fe3339 service nova] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Received event network-vif-unplugged-7cc66f81-8cb9-416d-b9c3-03451989c713 for instance with task_state deleting. {{(pid=72129) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 14:29:52 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:29:52 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:29:52 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:29:52 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:29:52 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:29:52 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:29:52 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:29:52 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Instance destroyed successfully.
Aug 01 14:29:52 user nova-compute[72129]: DEBUG nova.objects.instance [None req-c8e126af-5058-462e-a63d-4edbe6fd9286 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lazy-loading 'resources' on Instance uuid 5e602ce0-ffe8-4737-86cb-5caee367f2b4 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:29:52 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:29:52 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-c8e126af-5058-462e-a63d-4edbe6fd9286 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:23:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1551117721',display_name='tempest-ServerRescueNegativeTestJSON-server-1551117721',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1551117721',id=47,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDeGC2OYrAuhdtsQ12w8hkrsQ4BStQKdcxMAGWGF9i5CEavjy55aog2hOysoEWEG4SBA9Pa0TYoxd11hOhqvXgl0N1sUSAtZyoNVLM//3QjvgWjRgJBjm0nAZ0L+/1WReA==',key_name='tempest-keypair-592319693',keypairs=<?>,launch_index=0,launched_at=2023-08-01T14:25:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='42cca3e17d4e4df79c94c4b94fb3fcec',ramdisk_id='',reservation_id='r-mfltbgi9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-481576424',owner_user_name='tempest-ServerRescueNegativeTestJSON-481576424-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T14:27:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='deb1597afdc647598ee893dd51880173',uuid=5e602ce0-ffe8-4737-86cb-5caee367f2b4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7cc66f81-8cb9-416d-b9c3-03451989c713", "address": "fa:16:3e:f6:cb:d3", "network": {"id": "6ffcec16-7b44-472a-b7cd-af16ebd4a653", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-901464581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cca3e17d4e4df79c94c4b94fb3fcec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc66f81-8c", "ovs_interfaceid": "7cc66f81-8cb9-416d-b9c3-03451989c713", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 14:29:52 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-c8e126af-5058-462e-a63d-4edbe6fd9286 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Converting VIF {"id": "7cc66f81-8cb9-416d-b9c3-03451989c713", "address": "fa:16:3e:f6:cb:d3", "network": {"id": "6ffcec16-7b44-472a-b7cd-af16ebd4a653", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-901464581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cca3e17d4e4df79c94c4b94fb3fcec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cc66f81-8c", "ovs_interfaceid": "7cc66f81-8cb9-416d-b9c3-03451989c713", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:29:52 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-c8e126af-5058-462e-a63d-4edbe6fd9286 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f6:cb:d3,bridge_name='br-int',has_traffic_filtering=True,id=7cc66f81-8cb9-416d-b9c3-03451989c713,network=Network(6ffcec16-7b44-472a-b7cd-af16ebd4a653),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cc66f81-8c') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:29:52 user nova-compute[72129]: DEBUG os_vif [None req-c8e126af-5058-462e-a63d-4edbe6fd9286 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:cb:d3,bridge_name='br-int',has_traffic_filtering=True,id=7cc66f81-8cb9-416d-b9c3-03451989c713,network=Network(6ffcec16-7b44-472a-b7cd-af16ebd4a653),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cc66f81-8c') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 14:29:52 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:29:52 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7cc66f81-8c, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:29:52 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:29:52 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:29:52 user nova-compute[72129]: INFO os_vif [None req-c8e126af-5058-462e-a63d-4edbe6fd9286 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:cb:d3,bridge_name='br-int',has_traffic_filtering=True,id=7cc66f81-8cb9-416d-b9c3-03451989c713,network=Network(6ffcec16-7b44-472a-b7cd-af16ebd4a653),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cc66f81-8c')
Aug 01 14:29:52 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-c8e126af-5058-462e-a63d-4edbe6fd9286 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Deleting instance files /opt/stack/data/nova/instances/5e602ce0-ffe8-4737-86cb-5caee367f2b4_del
Aug 01 14:29:52 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-c8e126af-5058-462e-a63d-4edbe6fd9286 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Deletion of /opt/stack/data/nova/instances/5e602ce0-ffe8-4737-86cb-5caee367f2b4_del complete
Aug 01 14:29:52 user nova-compute[72129]: INFO nova.compute.manager [None req-c8e126af-5058-462e-a63d-4edbe6fd9286 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 01 14:29:52 user nova-compute[72129]: DEBUG oslo.service.loopingcall [None req-c8e126af-5058-462e-a63d-4edbe6fd9286 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72129) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 14:29:52 user nova-compute[72129]: DEBUG nova.compute.manager [-] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Deallocating network for instance {{(pid=72129) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 14:29:52 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] deallocate_for_instance() {{(pid=72129) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 14:29:53 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:29:53 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:29:54 user nova-compute[72129]: DEBUG nova.compute.manager [req-05c5352a-0777-4083-99b3-5c28c626bb2e req-33126245-9e27-4269-82ec-5a89e5215db6 service nova] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Received event network-vif-plugged-7cc66f81-8cb9-416d-b9c3-03451989c713 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:29:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-05c5352a-0777-4083-99b3-5c28c626bb2e req-33126245-9e27-4269-82ec-5a89e5215db6 service nova] Acquiring lock "5e602ce0-ffe8-4737-86cb-5caee367f2b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:29:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-05c5352a-0777-4083-99b3-5c28c626bb2e req-33126245-9e27-4269-82ec-5a89e5215db6 service nova] Lock "5e602ce0-ffe8-4737-86cb-5caee367f2b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:29:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-05c5352a-0777-4083-99b3-5c28c626bb2e req-33126245-9e27-4269-82ec-5a89e5215db6 service nova] Lock "5e602ce0-ffe8-4737-86cb-5caee367f2b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:29:54 user nova-compute[72129]: DEBUG nova.compute.manager [req-05c5352a-0777-4083-99b3-5c28c626bb2e req-33126245-9e27-4269-82ec-5a89e5215db6 service nova] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] No waiting events found dispatching network-vif-plugged-7cc66f81-8cb9-416d-b9c3-03451989c713 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:29:54 user nova-compute[72129]: WARNING nova.compute.manager [req-05c5352a-0777-4083-99b3-5c28c626bb2e req-33126245-9e27-4269-82ec-5a89e5215db6 service nova] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Received unexpected event network-vif-plugged-7cc66f81-8cb9-416d-b9c3-03451989c713 for instance with vm_state active and task_state deleting.
Aug 01 14:29:54 user nova-compute[72129]: DEBUG nova.compute.manager [req-05c5352a-0777-4083-99b3-5c28c626bb2e req-33126245-9e27-4269-82ec-5a89e5215db6 service nova] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Received event network-vif-plugged-7cc66f81-8cb9-416d-b9c3-03451989c713 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:29:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-05c5352a-0777-4083-99b3-5c28c626bb2e req-33126245-9e27-4269-82ec-5a89e5215db6 service nova] Acquiring lock "5e602ce0-ffe8-4737-86cb-5caee367f2b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:29:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-05c5352a-0777-4083-99b3-5c28c626bb2e req-33126245-9e27-4269-82ec-5a89e5215db6 service nova] Lock "5e602ce0-ffe8-4737-86cb-5caee367f2b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:29:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-05c5352a-0777-4083-99b3-5c28c626bb2e req-33126245-9e27-4269-82ec-5a89e5215db6 service nova] Lock "5e602ce0-ffe8-4737-86cb-5caee367f2b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:29:54 user nova-compute[72129]: DEBUG nova.compute.manager [req-05c5352a-0777-4083-99b3-5c28c626bb2e req-33126245-9e27-4269-82ec-5a89e5215db6 service nova] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] No waiting events found dispatching network-vif-plugged-7cc66f81-8cb9-416d-b9c3-03451989c713 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:29:54 user nova-compute[72129]: WARNING nova.compute.manager [req-05c5352a-0777-4083-99b3-5c28c626bb2e req-33126245-9e27-4269-82ec-5a89e5215db6 service nova] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Received unexpected event network-vif-plugged-7cc66f81-8cb9-416d-b9c3-03451989c713 for instance with vm_state active and task_state deleting.
Aug 01 14:29:54 user nova-compute[72129]: DEBUG nova.compute.manager [req-05c5352a-0777-4083-99b3-5c28c626bb2e req-33126245-9e27-4269-82ec-5a89e5215db6 service nova] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Received event network-vif-plugged-7cc66f81-8cb9-416d-b9c3-03451989c713 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:29:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-05c5352a-0777-4083-99b3-5c28c626bb2e req-33126245-9e27-4269-82ec-5a89e5215db6 service nova] Acquiring lock "5e602ce0-ffe8-4737-86cb-5caee367f2b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:29:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-05c5352a-0777-4083-99b3-5c28c626bb2e req-33126245-9e27-4269-82ec-5a89e5215db6 service nova] Lock "5e602ce0-ffe8-4737-86cb-5caee367f2b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:29:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-05c5352a-0777-4083-99b3-5c28c626bb2e req-33126245-9e27-4269-82ec-5a89e5215db6 service nova] Lock "5e602ce0-ffe8-4737-86cb-5caee367f2b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:29:54 user nova-compute[72129]: DEBUG nova.compute.manager [req-05c5352a-0777-4083-99b3-5c28c626bb2e req-33126245-9e27-4269-82ec-5a89e5215db6 service nova] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] No waiting events found dispatching network-vif-plugged-7cc66f81-8cb9-416d-b9c3-03451989c713 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:29:54 user nova-compute[72129]: WARNING nova.compute.manager [req-05c5352a-0777-4083-99b3-5c28c626bb2e req-33126245-9e27-4269-82ec-5a89e5215db6 service nova] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Received unexpected event network-vif-plugged-7cc66f81-8cb9-416d-b9c3-03451989c713 for instance with vm_state active and task_state deleting.
Aug 01 14:29:54 user nova-compute[72129]: DEBUG nova.compute.manager [req-05c5352a-0777-4083-99b3-5c28c626bb2e req-33126245-9e27-4269-82ec-5a89e5215db6 service nova] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Received event network-vif-unplugged-7cc66f81-8cb9-416d-b9c3-03451989c713 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:29:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-05c5352a-0777-4083-99b3-5c28c626bb2e req-33126245-9e27-4269-82ec-5a89e5215db6 service nova] Acquiring lock "5e602ce0-ffe8-4737-86cb-5caee367f2b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:29:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-05c5352a-0777-4083-99b3-5c28c626bb2e req-33126245-9e27-4269-82ec-5a89e5215db6 service nova] Lock "5e602ce0-ffe8-4737-86cb-5caee367f2b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:29:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-05c5352a-0777-4083-99b3-5c28c626bb2e req-33126245-9e27-4269-82ec-5a89e5215db6 service nova] Lock "5e602ce0-ffe8-4737-86cb-5caee367f2b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:29:54 user nova-compute[72129]: DEBUG nova.compute.manager [req-05c5352a-0777-4083-99b3-5c28c626bb2e req-33126245-9e27-4269-82ec-5a89e5215db6 service nova] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] No waiting events found dispatching network-vif-unplugged-7cc66f81-8cb9-416d-b9c3-03451989c713 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:29:54 user nova-compute[72129]: DEBUG nova.compute.manager [req-05c5352a-0777-4083-99b3-5c28c626bb2e req-33126245-9e27-4269-82ec-5a89e5215db6 service nova] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Received event network-vif-unplugged-7cc66f81-8cb9-416d-b9c3-03451989c713 for instance with task_state deleting. {{(pid=72129) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 14:29:54 user nova-compute[72129]: DEBUG nova.compute.manager [req-05c5352a-0777-4083-99b3-5c28c626bb2e req-33126245-9e27-4269-82ec-5a89e5215db6 service nova] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Received event network-vif-plugged-7cc66f81-8cb9-416d-b9c3-03451989c713 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:29:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-05c5352a-0777-4083-99b3-5c28c626bb2e req-33126245-9e27-4269-82ec-5a89e5215db6 service nova] Acquiring lock "5e602ce0-ffe8-4737-86cb-5caee367f2b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:29:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-05c5352a-0777-4083-99b3-5c28c626bb2e req-33126245-9e27-4269-82ec-5a89e5215db6 service nova] Lock "5e602ce0-ffe8-4737-86cb-5caee367f2b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:29:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-05c5352a-0777-4083-99b3-5c28c626bb2e req-33126245-9e27-4269-82ec-5a89e5215db6 service nova] Lock "5e602ce0-ffe8-4737-86cb-5caee367f2b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:29:54 user nova-compute[72129]: DEBUG nova.compute.manager [req-05c5352a-0777-4083-99b3-5c28c626bb2e req-33126245-9e27-4269-82ec-5a89e5215db6 service nova] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] No waiting events found dispatching network-vif-plugged-7cc66f81-8cb9-416d-b9c3-03451989c713 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:29:54 user nova-compute[72129]: WARNING nova.compute.manager [req-05c5352a-0777-4083-99b3-5c28c626bb2e req-33126245-9e27-4269-82ec-5a89e5215db6 service nova] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Received unexpected event network-vif-plugged-7cc66f81-8cb9-416d-b9c3-03451989c713 for instance with vm_state active and task_state deleting.
Aug 01 14:29:54 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:29:54 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Took 1.46 seconds to deallocate network for instance.
Aug 01 14:29:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c8e126af-5058-462e-a63d-4edbe6fd9286 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:29:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c8e126af-5058-462e-a63d-4edbe6fd9286 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:29:54 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-c8e126af-5058-462e-a63d-4edbe6fd9286 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:29:54 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-c8e126af-5058-462e-a63d-4edbe6fd9286 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:29:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c8e126af-5058-462e-a63d-4edbe6fd9286 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.211s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:29:54 user nova-compute[72129]: INFO nova.scheduler.client.report [None req-c8e126af-5058-462e-a63d-4edbe6fd9286 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Deleted allocations for instance 5e602ce0-ffe8-4737-86cb-5caee367f2b4
Aug 01 14:29:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-c8e126af-5058-462e-a63d-4edbe6fd9286 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lock "5e602ce0-ffe8-4737-86cb-5caee367f2b4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.849s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:29:56 user nova-compute[72129]: DEBUG nova.compute.manager [req-91c4e48a-04cd-42c2-8a97-891724fe303d req-a3e89da0-4f14-4d11-9cd3-d7be14d02dfd service nova] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Received event network-vif-deleted-7cc66f81-8cb9-416d-b9c3-03451989c713 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:29:57 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:30:02 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:30:07 user nova-compute[72129]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690900192.800051, 5e602ce0-ffe8-4737-86cb-5caee367f2b4 => Stopped> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:30:07 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] VM Stopped (Lifecycle Event)
Aug 01 14:30:07 user nova-compute[72129]: DEBUG nova.compute.manager [None req-7c8839cf-7a31-4c01-af28-cdb858014601 None None] [instance: 5e602ce0-ffe8-4737-86cb-5caee367f2b4] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:30:07 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:30:07 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:30:07 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72129) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 14:30:07 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:30:07 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:30:07 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:30:08 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:30:08 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72129) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 14:30:09 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:30:12 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:30:12 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:30:12 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72129) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 14:30:12 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:30:12 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:30:12 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:30:13 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:30:13 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:30:13 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:30:13 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:30:13 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Auditing locally available compute resources for user (node: user) {{(pid=72129) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 14:30:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3319e68-8c91-404f-800b-6798fb16aa75/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:30:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3319e68-8c91-404f-800b-6798fb16aa75/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:30:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3319e68-8c91-404f-800b-6798fb16aa75/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:30:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3319e68-8c91-404f-800b-6798fb16aa75/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:30:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:30:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:30:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:30:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:30:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk.rescue --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:30:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk.rescue --force-share --output=json" returned: 0 in 0.152s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:30:13 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk.rescue --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:30:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:30:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:30:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:30:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:30:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:30:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e31e6ee-1bd8-423a-96ed-3940a87ee789/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:30:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e31e6ee-1bd8-423a-96ed-3940a87ee789/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:30:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e31e6ee-1bd8-423a-96ed-3940a87ee789/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:30:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e31e6ee-1bd8-423a-96ed-3940a87ee789/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:30:15 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:30:15 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:30:15 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Hypervisor/Node resource view: name=user free_ram=8513MB free_disk=24.95740509033203GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72129) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 14:30:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:30:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:30:15 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance b3f54430-8d5d-478b-8dc7-d7592ee3db36 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:30:15 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:30:15 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance a3319e68-8c91-404f-800b-6798fb16aa75 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:30:15 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 7e31e6ee-1bd8-423a-96ed-3940a87ee789 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:30:15 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 14:30:15 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 14:30:15 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:30:15 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:30:15 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Compute_service record updated for user:user {{(pid=72129) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 14:30:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.290s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:30:15 user nova-compute[72129]: DEBUG nova.compute.manager [req-c2077f39-4d52-496d-8345-0cab781727cb req-6d92f61c-6b98-41b2-a732-7cf2b36f63c4 service nova] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] Received event network-changed-6cb74238-92d8-4629-9631-b869d1775929 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:30:15 user nova-compute[72129]: DEBUG nova.compute.manager [req-c2077f39-4d52-496d-8345-0cab781727cb req-6d92f61c-6b98-41b2-a732-7cf2b36f63c4 service nova] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] Refreshing instance network info cache due to event network-changed-6cb74238-92d8-4629-9631-b869d1775929. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 14:30:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-c2077f39-4d52-496d-8345-0cab781727cb req-6d92f61c-6b98-41b2-a732-7cf2b36f63c4 service nova] Acquiring lock "refresh_cache-7e31e6ee-1bd8-423a-96ed-3940a87ee789" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:30:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-c2077f39-4d52-496d-8345-0cab781727cb req-6d92f61c-6b98-41b2-a732-7cf2b36f63c4 service nova] Acquired lock "refresh_cache-7e31e6ee-1bd8-423a-96ed-3940a87ee789" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:30:15 user nova-compute[72129]: DEBUG nova.network.neutron [req-c2077f39-4d52-496d-8345-0cab781727cb req-6d92f61c-6b98-41b2-a732-7cf2b36f63c4 service nova] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] Refreshing network info cache for port 6cb74238-92d8-4629-9631-b869d1775929 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 14:30:16 user nova-compute[72129]: DEBUG nova.network.neutron [req-c2077f39-4d52-496d-8345-0cab781727cb req-6d92f61c-6b98-41b2-a732-7cf2b36f63c4 service nova] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] Updated VIF entry in instance network info cache for port 6cb74238-92d8-4629-9631-b869d1775929. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 14:30:16 user nova-compute[72129]: DEBUG nova.network.neutron [req-c2077f39-4d52-496d-8345-0cab781727cb req-6d92f61c-6b98-41b2-a732-7cf2b36f63c4 service nova] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] Updating instance_info_cache with network_info: [{"id": "6cb74238-92d8-4629-9631-b869d1775929", "address": "fa:16:3e:0b:05:26", "network": {"id": "d4ba0665-71f8-48a1-b3a2-2c73c2c7db3a", "bridge": "br-int", "label": "tempest-TestStampPattern-1150922129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a91b43b1394048719e2ed69f5c3ae94f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cb74238-92", "ovs_interfaceid": "6cb74238-92d8-4629-9631-b869d1775929", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:30:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-c2077f39-4d52-496d-8345-0cab781727cb req-6d92f61c-6b98-41b2-a732-7cf2b36f63c4 service nova] Releasing lock "refresh_cache-7e31e6ee-1bd8-423a-96ed-3940a87ee789" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:30:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:30:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e0b3b8d0-f2bc-4b3b-bdd3-0cd7e92483a1 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Acquiring lock "7e31e6ee-1bd8-423a-96ed-3940a87ee789" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:30:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e0b3b8d0-f2bc-4b3b-bdd3-0cd7e92483a1 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Lock "7e31e6ee-1bd8-423a-96ed-3940a87ee789" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:30:17 user nova-compute[72129]: DEBUG nova.objects.instance [None req-e0b3b8d0-f2bc-4b3b-bdd3-0cd7e92483a1 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Lazy-loading 'flavor' on Instance uuid 7e31e6ee-1bd8-423a-96ed-3940a87ee789 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:30:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e0b3b8d0-f2bc-4b3b-bdd3-0cd7e92483a1 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Lock "7e31e6ee-1bd8-423a-96ed-3940a87ee789" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:30:17 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:30:17 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:30:17 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Starting heal instance info cache {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 14:30:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e0b3b8d0-f2bc-4b3b-bdd3-0cd7e92483a1 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Acquiring lock "7e31e6ee-1bd8-423a-96ed-3940a87ee789" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:30:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e0b3b8d0-f2bc-4b3b-bdd3-0cd7e92483a1 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Lock "7e31e6ee-1bd8-423a-96ed-3940a87ee789" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:30:17 user nova-compute[72129]: INFO nova.compute.manager [None req-e0b3b8d0-f2bc-4b3b-bdd3-0cd7e92483a1 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] Attaching volume a69cf56c-f349-4bb2-9e42-05c9e9dbda10 to /dev/vdb
Aug 01 14:30:17 user nova-compute[72129]: DEBUG os_brick.utils [None req-e0b3b8d0-f2bc-4b3b-bdd3-0cd7e92483a1 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:30:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "refresh_cache-3bdb8e41-8cd5-4c33-9624-d262cacd0f5d" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:30:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquired lock "refresh_cache-3bdb8e41-8cd5-4c33-9624-d262cacd0f5d" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:30:17 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Forcefully refreshing network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 14:30:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:30:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:30:17 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3a4620-e5e2-4a8d-b59a-e077413ca5e5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f9b449c2cd3d\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:30:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:30:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:30:17 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c64f06b-0195-4351-aeed-e048c9745b9e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:30:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:30:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:30:17 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[22926849-1d0a-4397-b3f6-d1847115e66e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:30:17 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[96510f6c-0f92-4954-888c-b43e1a914437]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:30:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-e0b3b8d0-f2bc-4b3b-bdd3-0cd7e92483a1 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Running cmd (subprocess): nvme version {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:30:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-e0b3b8d0-f2bc-4b3b-bdd3-0cd7e92483a1 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] 'nvme version' failed. Not Retrying. {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 14:30:17 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e0b3b8d0-f2bc-4b3b-bdd3-0cd7e92483a1 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] nvme not present on system {{(pid=72129) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 14:30:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:30:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 14:30:17 user nova-compute[72129]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 14:30:17 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[296d97b1-fc92-4614-8130-02b514def4d5]: (4, '') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:30:17 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-e0b3b8d0-f2bc-4b3b-bdd3-0cd7e92483a1 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72129) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 14:30:17 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-e0b3b8d0-f2bc-4b3b-bdd3-0cd7e92483a1 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 14:30:17 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-e0b3b8d0-f2bc-4b3b-bdd3-0cd7e92483a1 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] LIGHTOS: no hostnqn found. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 14:30:17 user nova-compute[72129]: DEBUG os_brick.utils [None req-e0b3b8d0-f2bc-4b3b-bdd3-0cd7e92483a1 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f9b449c2cd3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:30:17 user nova-compute[72129]: DEBUG nova.virt.block_device [None req-e0b3b8d0-f2bc-4b3b-bdd3-0cd7e92483a1 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] Updating existing volume attachment record: 188059ab-ccfb-4ecc-b1db-fb3499b4e250 {{(pid=72129) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 14:30:17 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:30:17 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Updating instance_info_cache with network_info: [{"id": "10889d2c-ec62-4b92-b325-0f5d7d67851f", "address": "fa:16:3e:52:40:4c", "network": {"id": "6ffcec16-7b44-472a-b7cd-af16ebd4a653", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-901464581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cca3e17d4e4df79c94c4b94fb3fcec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10889d2c-ec", "ovs_interfaceid": "10889d2c-ec62-4b92-b325-0f5d7d67851f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:30:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Releasing lock "refresh_cache-3bdb8e41-8cd5-4c33-9624-d262cacd0f5d" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:30:17 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Updated the network info_cache for instance {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 14:30:17 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:30:17 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:30:17 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:30:19 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:30:20 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:30:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:30:22 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:30:24 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0b3b8d0-f2bc-4b3b-bdd3-0cd7e92483a1 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] Calling os-brick to attach iSCSI Volume {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 14:30:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b3b8d0-f2bc-4b3b-bdd3-0cd7e92483a1 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a69cf56c-f349-4bb2-9e42-05c9e9dbda10'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WheZqVTX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:30:24 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-e0b3b8d0-f2bc-4b3b-bdd3-0cd7e92483a1 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:30:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-e0b3b8d0-f2bc-4b3b-bdd3-0cd7e92483a1 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:30:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-e0b3b8d0-f2bc-4b3b-bdd3-0cd7e92483a1 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:30:24 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-e0b3b8d0-f2bc-4b3b-bdd3-0cd7e92483a1 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:30:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-e0b3b8d0-f2bc-4b3b-bdd3-0cd7e92483a1 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a69cf56c-f349-4bb2-9e42-05c9e9dbda10" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:30:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-e0b3b8d0-f2bc-4b3b-bdd3-0cd7e92483a1 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a69cf56c-f349-4bb2-9e42-05c9e9dbda10" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:30:24 user nova-compute[72129]: INFO os_brick.initiator.connectors.iscsi [None req-e0b3b8d0-f2bc-4b3b-bdd3-0cd7e92483a1 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 14:30:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a69cf56c-f349-4bb2-9e42-05c9e9dbda10 -p 172.16.0.220:3260 {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:30:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a69cf56c-f349-4bb2-9e42-05c9e9dbda10 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:30:24 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[fccae1dc-efeb-46bd-b189-f81b0f72733e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:30:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b3b8d0-f2bc-4b3b-bdd3-0cd7e92483a1 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 14:30:24 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:30:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a69cf56c-f349-4bb2-9e42-05c9e9dbda10 -p 172.16.0.220:3260 --interface default --op new {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:30:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a69cf56c-f349-4bb2-9e42-05c9e9dbda10 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:30:24 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd184c68-13f1-4e39-acf4-682f5775ac44]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a69cf56c-f349-4bb2-9e42-05c9e9dbda10] added\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:30:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b3b8d0-f2bc-4b3b-bdd3-0cd7e92483a1 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a69cf56c-f349-4bb2-9e42-05c9e9dbda10] added
Aug 01 14:30:24 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:30:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a69cf56c-f349-4bb2-9e42-05c9e9dbda10 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:30:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a69cf56c-f349-4bb2-9e42-05c9e9dbda10 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:30:24 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f0cc567-2aa4-43b9-8ce9-595b1dbd2c1c]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:30:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b3b8d0-f2bc-4b3b-bdd3-0cd7e92483a1 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:30:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a69cf56c-f349-4bb2-9e42-05c9e9dbda10 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:30:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a69cf56c-f349-4bb2-9e42-05c9e9dbda10 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:30:24 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[960e8d02-5405-4f95-b29e-02f597e87ee7]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:30:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b3b8d0-f2bc-4b3b-bdd3-0cd7e92483a1 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:30:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a69cf56c-f349-4bb2-9e42-05c9e9dbda10 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WheZqVTX {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:30:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a69cf56c-f349-4bb2-9e42-05c9e9dbda10 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WheZqVTX" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:30:24 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7500c1-194b-4430-ad1d-f5321132f7b6]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:30:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b3b8d0-f2bc-4b3b-bdd3-0cd7e92483a1 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WheZqVTX'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:30:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a69cf56c-f349-4bb2-9e42-05c9e9dbda10 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:30:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a69cf56c-f349-4bb2-9e42-05c9e9dbda10 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:30:24 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc32f8eb-5b65-455c-b46b-39430605fc80]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:30:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b3b8d0-f2bc-4b3b-bdd3-0cd7e92483a1 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:30:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:30:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:30:24 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c60aeb97-8cb2-49ae-8617-c8d7f8c63e67]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:30:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b3b8d0-f2bc-4b3b-bdd3-0cd7e92483a1 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 14:30:24 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:30:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b3b8d0-f2bc-4b3b-bdd3-0cd7e92483a1 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 14:30:24 user nova-compute[72129]:  {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:30:24 user nova-compute[72129]: WARNING os_brick.initiator.connectors.iscsi [None req-e0b3b8d0-f2bc-4b3b-bdd3-0cd7e92483a1 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 14:30:24 user nova-compute[72129]: 
Aug 01 14:30:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a69cf56c-f349-4bb2-9e42-05c9e9dbda10 -p 172.16.0.220:3260 --login {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:30:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a69cf56c-f349-4bb2-9e42-05c9e9dbda10 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:30:24 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cdbe8d8-2fc5-4af9-a20c-b6d1459cb555]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a69cf56c-f349-4bb2-9e42-05c9e9dbda10, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a69cf56c-f349-4bb2-9e42-05c9e9dbda10, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:30:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b3b8d0-f2bc-4b3b-bdd3-0cd7e92483a1 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a69cf56c-f349-4bb2-9e42-05c9e9dbda10, portal: 172.16.0.220,3260]
Aug 01 14:30:24 user nova-compute[72129]: Login to [iface: default, target: iqn.2010-10.org.openstack:a69cf56c-f349-4bb2-9e42-05c9e9dbda10, portal: 172.16.0.220,3260] successful.
Aug 01 14:30:24 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:30:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a69cf56c-f349-4bb2-9e42-05c9e9dbda10 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:30:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a69cf56c-f349-4bb2-9e42-05c9e9dbda10 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:30:24 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e7f584-24ba-4190-a0a1-d7f2885945e3]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:30:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b3b8d0-f2bc-4b3b-bdd3-0cd7e92483a1 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:30:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:30:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:30:24 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de8e5a7-9c48-4968-8cd8-9a44fafc56a6]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69cf56c-f349-4bb2-9e42-05c9e9dbda10 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:30:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b3b8d0-f2bc-4b3b-bdd3-0cd7e92483a1 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69cf56c-f349-4bb2-9e42-05c9e9dbda10 (non-flash)
Aug 01 14:30:24 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:30:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b3b8d0-f2bc-4b3b-bdd3-0cd7e92483a1 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69cf56c-f349-4bb2-9e42-05c9e9dbda10 (non-flash)
Aug 01 14:30:24 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:30:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-e0b3b8d0-f2bc-4b3b-bdd3-0cd7e92483a1 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a69cf56c-f349-4bb2-9e42-05c9e9dbda10" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:30:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b3b8d0-f2bc-4b3b-bdd3-0cd7e92483a1 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Connected to 172.16.0.220:3260 {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 14:30:24 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-e0b3b8d0-f2bc-4b3b-bdd3-0cd7e92483a1 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=72129) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 14:30:24 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-e0b3b8d0-f2bc-4b3b-bdd3-0cd7e92483a1 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72129) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 14:30:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:30:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:30:24 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b735055c-7673-477e-8e6f-1371704780b0]: (4, ('- - 0', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:30:24 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-e0b3b8d0-f2bc-4b3b-bdd3-0cd7e92483a1 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 14:30:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b3b8d0-f2bc-4b3b-bdd3-0cd7e92483a1 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WheZqVTX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 14:30:25 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-e0b3b8d0-f2bc-4b3b-bdd3-0cd7e92483a1 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:30:25 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b3b8d0-f2bc-4b3b-bdd3-0cd7e92483a1 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '26662383964353236', 'path': '/dev/sdb'} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:30:25 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0b3b8d0-f2bc-4b3b-bdd3-0cd7e92483a1 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26662383964353236', 'path': '/dev/sdb'} {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 14:30:25 user nova-compute[72129]: DEBUG nova.objects.instance [None req-e0b3b8d0-f2bc-4b3b-bdd3-0cd7e92483a1 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Lazy-loading 'flavor' on Instance uuid 7e31e6ee-1bd8-423a-96ed-3940a87ee789 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:30:25 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-e0b3b8d0-f2bc-4b3b-bdd3-0cd7e92483a1 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 14:30:25 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:30:25 user nova-compute[72129]:   <source dev="/dev/sdb"/>
Aug 01 14:30:25 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 14:30:25 user nova-compute[72129]:   <serial>a69cf56c-f349-4bb2-9e42-05c9e9dbda10</serial>
Aug 01 14:30:25 user nova-compute[72129]: </disk>
Aug 01 14:30:25 user nova-compute[72129]:  {{(pid=72129) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 14:30:26 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-e0b3b8d0-f2bc-4b3b-bdd3-0cd7e92483a1 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:30:26 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-e0b3b8d0-f2bc-4b3b-bdd3-0cd7e92483a1 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:30:26 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-e0b3b8d0-f2bc-4b3b-bdd3-0cd7e92483a1 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] No VIF found with MAC fa:16:3e:0b:05:26, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 14:30:26 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e0b3b8d0-f2bc-4b3b-bdd3-0cd7e92483a1 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Lock "7e31e6ee-1bd8-423a-96ed-3940a87ee789" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.185s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:30:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:30:27 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:30:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e7d0d866-000a-4bac-a815-0e56655bba7f tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Acquiring lock "7e31e6ee-1bd8-423a-96ed-3940a87ee789" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:30:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e7d0d866-000a-4bac-a815-0e56655bba7f tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Lock "7e31e6ee-1bd8-423a-96ed-3940a87ee789" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:30:28 user nova-compute[72129]: INFO nova.compute.manager [None req-e7d0d866-000a-4bac-a815-0e56655bba7f tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] Detaching volume a69cf56c-f349-4bb2-9e42-05c9e9dbda10
Aug 01 14:30:28 user nova-compute[72129]: INFO nova.virt.block_device [None req-e7d0d866-000a-4bac-a815-0e56655bba7f tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] Attempting to driver detach volume a69cf56c-f349-4bb2-9e42-05c9e9dbda10 from mountpoint /dev/vdb
Aug 01 14:30:28 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-e7d0d866-000a-4bac-a815-0e56655bba7f tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Attempting to detach device vdb from instance 7e31e6ee-1bd8-423a-96ed-3940a87ee789 from the persistent domain config. {{(pid=72129) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 14:30:28 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-e7d0d866-000a-4bac-a815-0e56655bba7f tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 14:30:28 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:30:28 user nova-compute[72129]:   <source dev="/dev/sdb"/>
Aug 01 14:30:28 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 14:30:28 user nova-compute[72129]:   <serial>a69cf56c-f349-4bb2-9e42-05c9e9dbda10</serial>
Aug 01 14:30:28 user nova-compute[72129]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 14:30:28 user nova-compute[72129]: </disk>
Aug 01 14:30:28 user nova-compute[72129]:  {{(pid=72129) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 14:30:28 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-e7d0d866-000a-4bac-a815-0e56655bba7f tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Successfully detached device vdb from instance 7e31e6ee-1bd8-423a-96ed-3940a87ee789 from the persistent domain config.
Aug 01 14:30:28 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-e7d0d866-000a-4bac-a815-0e56655bba7f tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7e31e6ee-1bd8-423a-96ed-3940a87ee789 from the live domain config. {{(pid=72129) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 14:30:28 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-e7d0d866-000a-4bac-a815-0e56655bba7f tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 14:30:28 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:30:28 user nova-compute[72129]:   <source dev="/dev/sdb"/>
Aug 01 14:30:28 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 14:30:28 user nova-compute[72129]:   <serial>a69cf56c-f349-4bb2-9e42-05c9e9dbda10</serial>
Aug 01 14:30:28 user nova-compute[72129]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 14:30:28 user nova-compute[72129]: </disk>
Aug 01 14:30:28 user nova-compute[72129]:  {{(pid=72129) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 14:30:28 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Received event <DeviceRemovedEvent: 1690900228.7634816, 7e31e6ee-1bd8-423a-96ed-3940a87ee789 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72129) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 14:30:28 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-e7d0d866-000a-4bac-a815-0e56655bba7f tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7e31e6ee-1bd8-423a-96ed-3940a87ee789 {{(pid=72129) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 14:30:28 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-e7d0d866-000a-4bac-a815-0e56655bba7f tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Successfully detached device vdb from instance 7e31e6ee-1bd8-423a-96ed-3940a87ee789 from the live domain config.
Aug 01 14:30:28 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7d0d866-000a-4bac-a815-0e56655bba7f tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] calling os-brick to detach iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 14:30:28 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d0d866-000a-4bac-a815-0e56655bba7f tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, {'target_iqns': ['iqn.2010-10.org.openstack:a69cf56c-f349-4bb2-9e42-05c9e9dbda10'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WheZqVTX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:30:28 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-e7d0d866-000a-4bac-a815-0e56655bba7f tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:30:28 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-e7d0d866-000a-4bac-a815-0e56655bba7f tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:30:28 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-e7d0d866-000a-4bac-a815-0e56655bba7f tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:30:28 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d0d866-000a-4bac-a815-0e56655bba7f tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a69cf56c-f349-4bb2-9e42-05c9e9dbda10', 0)] {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 14:30:28 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:30:28 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:30:28 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d7e034-113c-407e-9126-caf69fe78019]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a69cf56c-f349-4bb2-9e42-05c9e9dbda10\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:30:28 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:30:28 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:30:28 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4802785-7b7f-4940-b11f-77d325ab1108]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69cf56c-f349-4bb2-9e42-05c9e9dbda10 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:30:28 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d0d866-000a-4bac-a815-0e56655bba7f tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69cf56c-f349-4bb2-9e42-05c9e9dbda10 (non-flash)
Aug 01 14:30:28 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:30:28 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d0d866-000a-4bac-a815-0e56655bba7f tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a69cf56c-f349-4bb2-9e42-05c9e9dbda10 (non-flash)
Aug 01 14:30:28 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:30:28 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d0d866-000a-4bac-a815-0e56655bba7f tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f28102a70a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a69cf56c-f349-4bb2-9e42-05c9e9dbda10'): ({'sdb'}, set())}) {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 14:30:28 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-e7d0d866-000a-4bac-a815-0e56655bba7f tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Removing single pathed devices sdb {{(pid=72129) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 14:30:28 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:30:28 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:30:28 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e9b9cf6-c3b0-4afd-97c1-861a0894fd5b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:30:28 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:30:28 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:30:28 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[42111e6b-f4c8-490e-aff5-9d0098b5e8cb]: (4, ('ok\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:30:28 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-e7d0d866-000a-4bac-a815-0e56655bba7f tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Flushing IO for device /dev/sdb {{(pid=72129) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 14:30:28 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:30:28 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:30:28 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f7a89e-ce43-4cd3-9800-febd7b52a256]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:30:28 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-e7d0d866-000a-4bac-a815-0e56655bba7f tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72129) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 14:30:28 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:30:28 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:30:28 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7788937-957d-49fe-98ca-7969eba0bd5a]: (4, ('1', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:30:28 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-e7d0d866-000a-4bac-a815-0e56655bba7f tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 14:30:28 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-e7d0d866-000a-4bac-a815-0e56655bba7f tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] SCSI volumes sdb have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 14:30:28 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d0d866-000a-4bac-a815-0e56655bba7f tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a69cf56c-f349-4bb2-9e42-05c9e9dbda10')] {{(pid=72129) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 14:30:28 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a69cf56c-f349-4bb2-9e42-05c9e9dbda10 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:30:28 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a69cf56c-f349-4bb2-9e42-05c9e9dbda10 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:30:28 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce35a695-5abd-46d8-93a5-19848be4a14d]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:30:28 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d0d866-000a-4bac-a815-0e56655bba7f tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:30:28 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a69cf56c-f349-4bb2-9e42-05c9e9dbda10 -p 172.16.0.220:3260 --logout {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:30:28 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a69cf56c-f349-4bb2-9e42-05c9e9dbda10 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:30:28 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d659bc9c-76c3-447c-924b-6dbf25be44ff]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:a69cf56c-f349-4bb2-9e42-05c9e9dbda10, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:a69cf56c-f349-4bb2-9e42-05c9e9dbda10, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:30:28 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d0d866-000a-4bac-a815-0e56655bba7f tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:a69cf56c-f349-4bb2-9e42-05c9e9dbda10, portal: 172.16.0.220,3260]
Aug 01 14:30:28 user nova-compute[72129]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:a69cf56c-f349-4bb2-9e42-05c9e9dbda10, portal: 172.16.0.220,3260] successful.
Aug 01 14:30:28 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:30:28 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a69cf56c-f349-4bb2-9e42-05c9e9dbda10 -p 172.16.0.220:3260 --op delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:30:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a69cf56c-f349-4bb2-9e42-05c9e9dbda10 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:30:29 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[e84774f3-12d6-4ed2-b32a-4ffc8477e901]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:30:29 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d0d866-000a-4bac-a815-0e56655bba7f tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:30:29 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-e7d0d866-000a-4bac-a815-0e56655bba7f tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.241s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:30:29 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d0d866-000a-4bac-a815-0e56655bba7f tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] <== disconnect_volume: return (242ms) None {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:30:29 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7d0d866-000a-4bac-a815-0e56655bba7f tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] Disconnected iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 14:30:29 user nova-compute[72129]: DEBUG nova.objects.instance [None req-e7d0d866-000a-4bac-a815-0e56655bba7f tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Lazy-loading 'flavor' on Instance uuid 7e31e6ee-1bd8-423a-96ed-3940a87ee789 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:30:29 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-e7d0d866-000a-4bac-a815-0e56655bba7f tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Lock "7e31e6ee-1bd8-423a-96ed-3940a87ee789" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.582s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:30:31 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:30:32 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:30:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:30:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:30:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72129) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 14:30:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:30:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:30:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:30:42 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:30:46 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:30:47 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:30:52 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d34ed63e-ca5a-460d-aa8f-a697977efd1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Acquiring lock "3bdb8e41-8cd5-4c33-9624-d262cacd0f5d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:30:52 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d34ed63e-ca5a-460d-aa8f-a697977efd1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lock "3bdb8e41-8cd5-4c33-9624-d262cacd0f5d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:30:52 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d34ed63e-ca5a-460d-aa8f-a697977efd1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Acquiring lock "3bdb8e41-8cd5-4c33-9624-d262cacd0f5d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:30:52 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d34ed63e-ca5a-460d-aa8f-a697977efd1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lock "3bdb8e41-8cd5-4c33-9624-d262cacd0f5d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:30:52 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d34ed63e-ca5a-460d-aa8f-a697977efd1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lock "3bdb8e41-8cd5-4c33-9624-d262cacd0f5d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:30:52 user nova-compute[72129]: INFO nova.compute.manager [None req-d34ed63e-ca5a-460d-aa8f-a697977efd1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Terminating instance
Aug 01 14:30:52 user nova-compute[72129]: DEBUG nova.compute.manager [None req-d34ed63e-ca5a-460d-aa8f-a697977efd1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Start destroying the instance on the hypervisor. {{(pid=72129) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 14:30:52 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:30:52 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:30:52 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72129) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 14:30:52 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:30:52 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:30:52 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:30:52 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:30:53 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:30:53 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:30:53 user nova-compute[72129]: DEBUG nova.compute.manager [req-762817c8-d7da-4c27-8dca-8a3f52957848 req-839b1f03-a7af-42d9-b825-b11db1e08388 service nova] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Received event network-vif-unplugged-10889d2c-ec62-4b92-b325-0f5d7d67851f {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:30:53 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-762817c8-d7da-4c27-8dca-8a3f52957848 req-839b1f03-a7af-42d9-b825-b11db1e08388 service nova] Acquiring lock "3bdb8e41-8cd5-4c33-9624-d262cacd0f5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:30:53 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-762817c8-d7da-4c27-8dca-8a3f52957848 req-839b1f03-a7af-42d9-b825-b11db1e08388 service nova] Lock "3bdb8e41-8cd5-4c33-9624-d262cacd0f5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:30:53 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-762817c8-d7da-4c27-8dca-8a3f52957848 req-839b1f03-a7af-42d9-b825-b11db1e08388 service nova] Lock "3bdb8e41-8cd5-4c33-9624-d262cacd0f5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:30:53 user nova-compute[72129]: DEBUG nova.compute.manager [req-762817c8-d7da-4c27-8dca-8a3f52957848 req-839b1f03-a7af-42d9-b825-b11db1e08388 service nova] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] No waiting events found dispatching network-vif-unplugged-10889d2c-ec62-4b92-b325-0f5d7d67851f {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:30:53 user nova-compute[72129]: DEBUG nova.compute.manager [req-762817c8-d7da-4c27-8dca-8a3f52957848 req-839b1f03-a7af-42d9-b825-b11db1e08388 service nova] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Received event network-vif-unplugged-10889d2c-ec62-4b92-b325-0f5d7d67851f for instance with task_state deleting. {{(pid=72129) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 14:30:53 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:30:53 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:30:53 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Instance destroyed successfully.
Aug 01 14:30:53 user nova-compute[72129]: DEBUG nova.objects.instance [None req-d34ed63e-ca5a-460d-aa8f-a697977efd1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lazy-loading 'resources' on Instance uuid 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:30:53 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-d34ed63e-ca5a-460d-aa8f-a697977efd1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:14:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1844594790',display_name='tempest-ServerRescueNegativeTestJSON-server-1844594790',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1844594790',id=42,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T14:16:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='42cca3e17d4e4df79c94c4b94fb3fcec',ramdisk_id='',reservation_id='r-qb9lk1yt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-481576424',owner_user_name='tempest-ServerRescueNegativeTestJSON-481576424-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T14:16:39Z,user_data=None,user_id='deb1597afdc647598ee893dd51880173',uuid=3bdb8e41-8cd5-4c33-9624-d262cacd0f5d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "10889d2c-ec62-4b92-b325-0f5d7d67851f", "address": "fa:16:3e:52:40:4c", "network": {"id": "6ffcec16-7b44-472a-b7cd-af16ebd4a653", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-901464581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cca3e17d4e4df79c94c4b94fb3fcec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10889d2c-ec", "ovs_interfaceid": "10889d2c-ec62-4b92-b325-0f5d7d67851f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 14:30:53 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-d34ed63e-ca5a-460d-aa8f-a697977efd1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Converting VIF {"id": "10889d2c-ec62-4b92-b325-0f5d7d67851f", "address": "fa:16:3e:52:40:4c", "network": {"id": "6ffcec16-7b44-472a-b7cd-af16ebd4a653", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-901464581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cca3e17d4e4df79c94c4b94fb3fcec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10889d2c-ec", "ovs_interfaceid": "10889d2c-ec62-4b92-b325-0f5d7d67851f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:30:53 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-d34ed63e-ca5a-460d-aa8f-a697977efd1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:52:40:4c,bridge_name='br-int',has_traffic_filtering=True,id=10889d2c-ec62-4b92-b325-0f5d7d67851f,network=Network(6ffcec16-7b44-472a-b7cd-af16ebd4a653),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10889d2c-ec') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:30:53 user nova-compute[72129]: DEBUG os_vif [None req-d34ed63e-ca5a-460d-aa8f-a697977efd1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:40:4c,bridge_name='br-int',has_traffic_filtering=True,id=10889d2c-ec62-4b92-b325-0f5d7d67851f,network=Network(6ffcec16-7b44-472a-b7cd-af16ebd4a653),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10889d2c-ec') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 14:30:53 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:30:53 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap10889d2c-ec, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:30:53 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:30:53 user nova-compute[72129]: INFO os_vif [None req-d34ed63e-ca5a-460d-aa8f-a697977efd1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:40:4c,bridge_name='br-int',has_traffic_filtering=True,id=10889d2c-ec62-4b92-b325-0f5d7d67851f,network=Network(6ffcec16-7b44-472a-b7cd-af16ebd4a653),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10889d2c-ec')
Aug 01 14:30:53 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-d34ed63e-ca5a-460d-aa8f-a697977efd1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Deleting instance files /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d_del
Aug 01 14:30:53 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-d34ed63e-ca5a-460d-aa8f-a697977efd1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Deletion of /opt/stack/data/nova/instances/3bdb8e41-8cd5-4c33-9624-d262cacd0f5d_del complete
Aug 01 14:30:53 user nova-compute[72129]: INFO nova.compute.manager [None req-d34ed63e-ca5a-460d-aa8f-a697977efd1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 01 14:30:53 user nova-compute[72129]: DEBUG oslo.service.loopingcall [None req-d34ed63e-ca5a-460d-aa8f-a697977efd1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72129) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 14:30:53 user nova-compute[72129]: DEBUG nova.compute.manager [-] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Deallocating network for instance {{(pid=72129) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 14:30:53 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] deallocate_for_instance() {{(pid=72129) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 14:30:54 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:30:54 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Took 0.80 seconds to deallocate network for instance.
Aug 01 14:30:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d34ed63e-ca5a-460d-aa8f-a697977efd1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:30:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d34ed63e-ca5a-460d-aa8f-a697977efd1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:30:54 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-d34ed63e-ca5a-460d-aa8f-a697977efd1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:30:54 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-d34ed63e-ca5a-460d-aa8f-a697977efd1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:30:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d34ed63e-ca5a-460d-aa8f-a697977efd1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.186s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:30:54 user nova-compute[72129]: INFO nova.scheduler.client.report [None req-d34ed63e-ca5a-460d-aa8f-a697977efd1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Deleted allocations for instance 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d
Aug 01 14:30:54 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-d34ed63e-ca5a-460d-aa8f-a697977efd1e tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lock "3bdb8e41-8cd5-4c33-9624-d262cacd0f5d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.111s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:30:55 user nova-compute[72129]: DEBUG nova.compute.manager [req-a52f9b56-6676-41b5-a142-914cd4b6c556 req-e817a7a2-faa7-4ef7-b717-7138dc44aec9 service nova] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Received event network-vif-plugged-10889d2c-ec62-4b92-b325-0f5d7d67851f {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:30:55 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-a52f9b56-6676-41b5-a142-914cd4b6c556 req-e817a7a2-faa7-4ef7-b717-7138dc44aec9 service nova] Acquiring lock "3bdb8e41-8cd5-4c33-9624-d262cacd0f5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:30:55 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-a52f9b56-6676-41b5-a142-914cd4b6c556 req-e817a7a2-faa7-4ef7-b717-7138dc44aec9 service nova] Lock "3bdb8e41-8cd5-4c33-9624-d262cacd0f5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:30:55 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-a52f9b56-6676-41b5-a142-914cd4b6c556 req-e817a7a2-faa7-4ef7-b717-7138dc44aec9 service nova] Lock "3bdb8e41-8cd5-4c33-9624-d262cacd0f5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:30:55 user nova-compute[72129]: DEBUG nova.compute.manager [req-a52f9b56-6676-41b5-a142-914cd4b6c556 req-e817a7a2-faa7-4ef7-b717-7138dc44aec9 service nova] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] No waiting events found dispatching network-vif-plugged-10889d2c-ec62-4b92-b325-0f5d7d67851f {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:30:55 user nova-compute[72129]: WARNING nova.compute.manager [req-a52f9b56-6676-41b5-a142-914cd4b6c556 req-e817a7a2-faa7-4ef7-b717-7138dc44aec9 service nova] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Received unexpected event network-vif-plugged-10889d2c-ec62-4b92-b325-0f5d7d67851f for instance with vm_state deleted and task_state None.
Aug 01 14:30:55 user nova-compute[72129]: DEBUG nova.compute.manager [req-a52f9b56-6676-41b5-a142-914cd4b6c556 req-e817a7a2-faa7-4ef7-b717-7138dc44aec9 service nova] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Received event network-vif-deleted-10889d2c-ec62-4b92-b325-0f5d7d67851f {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:30:58 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:31:02 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:31:03 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:31:05 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:31:06 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:31:08 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:31:08 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72129) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 14:31:08 user nova-compute[72129]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690900253.6365125, 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d => Stopped> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:31:08 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] VM Stopped (Lifecycle Event)
Aug 01 14:31:08 user nova-compute[72129]: DEBUG nova.compute.manager [None req-8a4fda13-199f-4e57-8828-05dbc99026e8 None None] [instance: 3bdb8e41-8cd5-4c33-9624-d262cacd0f5d] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:31:08 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:31:08 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:31:09 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:31:11 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:31:12 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:31:13 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:31:14 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:31:14 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:31:14 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:31:14 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:31:14 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Auditing locally available compute resources for user (node: user) {{(pid=72129) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 14:31:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3319e68-8c91-404f-800b-6798fb16aa75/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:31:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3319e68-8c91-404f-800b-6798fb16aa75/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:31:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3319e68-8c91-404f-800b-6798fb16aa75/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:31:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3319e68-8c91-404f-800b-6798fb16aa75/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:31:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:31:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:31:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:31:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:31:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e31e6ee-1bd8-423a-96ed-3940a87ee789/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:31:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e31e6ee-1bd8-423a-96ed-3940a87ee789/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:31:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e31e6ee-1bd8-423a-96ed-3940a87ee789/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:31:15 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e31e6ee-1bd8-423a-96ed-3940a87ee789/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:31:15 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:31:15 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:31:15 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Hypervisor/Node resource view: name=user free_ram=8606MB free_disk=24.982418060302734GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72129) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 14:31:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:31:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.004s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:31:15 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance b3f54430-8d5d-478b-8dc7-d7592ee3db36 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:31:15 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance a3319e68-8c91-404f-800b-6798fb16aa75 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:31:15 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 7e31e6ee-1bd8-423a-96ed-3940a87ee789 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:31:15 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 14:31:15 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 14:31:15 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Refreshing inventories for resource provider c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 14:31:15 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Updating ProviderTree inventory for provider c2f345c3-9b82-4164-b21d-1eef8e661842 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 14:31:15 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Updating inventory in ProviderTree for provider c2f345c3-9b82-4164-b21d-1eef8e661842 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 14:31:15 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Refreshing aggregate associations for resource provider c2f345c3-9b82-4164-b21d-1eef8e661842, aggregates: None {{(pid=72129) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 14:31:15 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Refreshing trait associations for resource provider c2f345c3-9b82-4164-b21d-1eef8e661842, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE {{(pid=72129) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 14:31:15 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:31:15 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:31:15 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Compute_service record updated for user:user {{(pid=72129) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 14:31:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.528s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:31:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Acquiring lock "c4bc2711-d958-41e4-a596-f7a6260c3e25" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:31:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Lock "c4bc2711-d958-41e4-a596-f7a6260c3e25" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:31:16 user nova-compute[72129]: DEBUG nova.compute.manager [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Starting instance... {{(pid=72129) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 14:31:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:31:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:31:16 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72129) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 14:31:16 user nova-compute[72129]: INFO nova.compute.claims [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Claim successful on node user
Aug 01 14:31:16 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:31:16 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:31:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.237s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:31:16 user nova-compute[72129]: DEBUG nova.compute.manager [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Start building networks asynchronously for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 14:31:16 user nova-compute[72129]: DEBUG nova.compute.manager [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Allocating IP information in the background. {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 14:31:16 user nova-compute[72129]: DEBUG nova.network.neutron [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] allocate_for_instance() {{(pid=72129) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 14:31:16 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 14:31:16 user nova-compute[72129]: DEBUG nova.compute.manager [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Start building block device mappings for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 14:31:16 user nova-compute[72129]: DEBUG nova.compute.manager [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Start spawning the instance on the hypervisor. {{(pid=72129) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 14:31:16 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Creating instance directory {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 14:31:16 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Creating image(s)
Aug 01 14:31:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Acquiring lock "/opt/stack/data/nova/instances/c4bc2711-d958-41e4-a596-f7a6260c3e25/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:31:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Lock "/opt/stack/data/nova/instances/c4bc2711-d958-41e4-a596-f7a6260c3e25/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:31:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Lock "/opt/stack/data/nova/instances/c4bc2711-d958-41e4-a596-f7a6260c3e25/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:31:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:31:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:31:16 user nova-compute[72129]: DEBUG nova.policy [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fb400f977eb64fa7bbf4493103649386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2d02f947a94977aba1e77775ef5ffe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72129) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 14:31:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.132s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:31:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Acquiring lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:31:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:31:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:31:16 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:31:16 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:31:16 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Starting heal instance info cache {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 14:31:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.167s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:31:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/c4bc2711-d958-41e4-a596-f7a6260c3e25/disk 1073741824 {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:31:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/c4bc2711-d958-41e4-a596-f7a6260c3e25/disk 1073741824" returned: 0 in 0.054s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:31:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:31:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:31:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "refresh_cache-a3319e68-8c91-404f-800b-6798fb16aa75" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:31:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquired lock "refresh_cache-a3319e68-8c91-404f-800b-6798fb16aa75" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:31:17 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Forcefully refreshing network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 14:31:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.145s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:31:17 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c4bc2711-d958-41e4-a596-f7a6260c3e25/disk. size=1073741824 {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 14:31:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4bc2711-d958-41e4-a596-f7a6260c3e25/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:31:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4bc2711-d958-41e4-a596-f7a6260c3e25/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:31:17 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Cannot resize image /opt/stack/data/nova/instances/c4bc2711-d958-41e4-a596-f7a6260c3e25/disk to a smaller size. {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 14:31:17 user nova-compute[72129]: DEBUG nova.objects.instance [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Lazy-loading 'migration_context' on Instance uuid c4bc2711-d958-41e4-a596-f7a6260c3e25 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:31:17 user nova-compute[72129]: DEBUG nova.network.neutron [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Successfully created port: 3e61efad-17e6-4ac4-b178-f806c8140bf3 {{(pid=72129) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 14:31:17 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Created local disks {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 14:31:17 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Ensure instance console log exists: /opt/stack/data/nova/instances/c4bc2711-d958-41e4-a596-f7a6260c3e25/console.log {{(pid=72129) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 14:31:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:31:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:31:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:31:17 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Updating instance_info_cache with network_info: [{"id": "9fa9db76-1de9-4e10-962f-7d1e07b9582d", "address": "fa:16:3e:ff:ce:94", "network": {"id": "d4ba0665-71f8-48a1-b3a2-2c73c2c7db3a", "bridge": "br-int", "label": "tempest-TestStampPattern-1150922129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a91b43b1394048719e2ed69f5c3ae94f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fa9db76-1d", "ovs_interfaceid": "9fa9db76-1de9-4e10-962f-7d1e07b9582d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:31:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Releasing lock "refresh_cache-a3319e68-8c91-404f-800b-6798fb16aa75" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:31:17 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Updated the network info_cache for instance {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 14:31:17 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:31:17 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:31:18 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:31:18 user nova-compute[72129]: DEBUG nova.network.neutron [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Successfully updated port: 3e61efad-17e6-4ac4-b178-f806c8140bf3 {{(pid=72129) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 14:31:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Acquiring lock "refresh_cache-c4bc2711-d958-41e4-a596-f7a6260c3e25" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:31:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Acquired lock "refresh_cache-c4bc2711-d958-41e4-a596-f7a6260c3e25" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:31:18 user nova-compute[72129]: DEBUG nova.network.neutron [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 14:31:18 user nova-compute[72129]: DEBUG nova.compute.manager [req-ff5179d8-cdb1-4d3e-a681-537b1933c8a8 req-6a166156-107c-429d-86e8-b89064e7b545 service nova] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Received event network-changed-3e61efad-17e6-4ac4-b178-f806c8140bf3 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:31:18 user nova-compute[72129]: DEBUG nova.compute.manager [req-ff5179d8-cdb1-4d3e-a681-537b1933c8a8 req-6a166156-107c-429d-86e8-b89064e7b545 service nova] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Refreshing instance network info cache due to event network-changed-3e61efad-17e6-4ac4-b178-f806c8140bf3. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 14:31:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ff5179d8-cdb1-4d3e-a681-537b1933c8a8 req-6a166156-107c-429d-86e8-b89064e7b545 service nova] Acquiring lock "refresh_cache-c4bc2711-d958-41e4-a596-f7a6260c3e25" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:31:18 user nova-compute[72129]: DEBUG nova.network.neutron [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Instance cache missing network info. {{(pid=72129) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 14:31:18 user nova-compute[72129]: DEBUG nova.network.neutron [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Updating instance_info_cache with network_info: [{"id": "3e61efad-17e6-4ac4-b178-f806c8140bf3", "address": "fa:16:3e:ec:fb:bd", "network": {"id": "0dcde27b-5262-470e-affe-12b66f49084a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-937126397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f2d02f947a94977aba1e77775ef5ffe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e61efad-17", "ovs_interfaceid": "3e61efad-17e6-4ac4-b178-f806c8140bf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:31:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Releasing lock "refresh_cache-c4bc2711-d958-41e4-a596-f7a6260c3e25" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:31:18 user nova-compute[72129]: DEBUG nova.compute.manager [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Instance network_info: |[{"id": "3e61efad-17e6-4ac4-b178-f806c8140bf3", "address": "fa:16:3e:ec:fb:bd", "network": {"id": "0dcde27b-5262-470e-affe-12b66f49084a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-937126397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f2d02f947a94977aba1e77775ef5ffe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e61efad-17", "ovs_interfaceid": "3e61efad-17e6-4ac4-b178-f806c8140bf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 14:31:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ff5179d8-cdb1-4d3e-a681-537b1933c8a8 req-6a166156-107c-429d-86e8-b89064e7b545 service nova] Acquired lock "refresh_cache-c4bc2711-d958-41e4-a596-f7a6260c3e25" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:31:18 user nova-compute[72129]: DEBUG nova.network.neutron [req-ff5179d8-cdb1-4d3e-a681-537b1933c8a8 req-6a166156-107c-429d-86e8-b89064e7b545 service nova] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Refreshing network info cache for port 3e61efad-17e6-4ac4-b178-f806c8140bf3 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 14:31:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Start _get_guest_xml network_info=[{"id": "3e61efad-17e6-4ac4-b178-f806c8140bf3", "address": "fa:16:3e:ec:fb:bd", "network": {"id": "0dcde27b-5262-470e-affe-12b66f49084a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-937126397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f2d02f947a94977aba1e77775ef5ffe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e61efad-17", "ovs_interfaceid": "3e61efad-17e6-4ac4-b178-f806c8140bf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'image_id': 'b6472c34-1b0f-4034-ba3a-7e8eb5103715'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 14:31:18 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:31:18 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:31:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 14:31:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] CPU controller missing on host. {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 14:31:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 14:31:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] CPU controller found on host. {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 14:31:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72129) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 14:31:18 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T13:45:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 14:31:18 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Flavor limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 14:31:18 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Image limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 14:31:18 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Flavor pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 14:31:18 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Image pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 14:31:18 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 14:31:18 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 14:31:18 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 14:31:18 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Got 1 possible topologies {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 14:31:18 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 14:31:18 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 14:31:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:31:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-710368898',display_name='tempest-TestServerVolumeAttachmentScenario-server-710368898',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-710368898',id=51,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA0acstFhS8UNcYpcaJEQ9OEAiWpOL8opPzw0hn0rePKQYlQIjScO1cFWlQwDpXdSwKjYmkhn39XqpQICyB5VZ5rJsPPWTSvYoedvU9DPO2vgFcGWc5OGn+Nk0717VpWsw==',key_name='tempest-keypair-1272737235',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3f2d02f947a94977aba1e77775ef5ffe',ramdisk_id='',reservation_id='r-tu5ibal8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1472719378',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1472719378-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T14:31:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb400f977eb64fa7bbf4493103649386',uuid=c4bc2711-d958-41e4-a596-f7a6260c3e25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e61efad-17e6-4ac4-b178-f806c8140bf3", "address": "fa:16:3e:ec:fb:bd", "network": {"id": "0dcde27b-5262-470e-affe-12b66f49084a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-937126397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f2d02f947a94977aba1e77775ef5ffe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e61efad-17", "ovs_interfaceid": "3e61efad-17e6-4ac4-b178-f806c8140bf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 14:31:18 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Converting VIF {"id": "3e61efad-17e6-4ac4-b178-f806c8140bf3", "address": "fa:16:3e:ec:fb:bd", "network": {"id": "0dcde27b-5262-470e-affe-12b66f49084a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-937126397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f2d02f947a94977aba1e77775ef5ffe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e61efad-17", "ovs_interfaceid": "3e61efad-17e6-4ac4-b178-f806c8140bf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:31:18 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:fb:bd,bridge_name='br-int',has_traffic_filtering=True,id=3e61efad-17e6-4ac4-b178-f806c8140bf3,network=Network(0dcde27b-5262-470e-affe-12b66f49084a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e61efad-17') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:31:18 user nova-compute[72129]: DEBUG nova.objects.instance [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Lazy-loading 'pci_devices' on Instance uuid c4bc2711-d958-41e4-a596-f7a6260c3e25 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:31:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] End _get_guest_xml xml=<domain type="kvm">
Aug 01 14:31:18 user nova-compute[72129]:   <uuid>c4bc2711-d958-41e4-a596-f7a6260c3e25</uuid>
Aug 01 14:31:18 user nova-compute[72129]:   <name>instance-00000033</name>
Aug 01 14:31:18 user nova-compute[72129]:   <memory>524288</memory>
Aug 01 14:31:18 user nova-compute[72129]:   <vcpu>1</vcpu>
Aug 01 14:31:18 user nova-compute[72129]:   <metadata>
Aug 01 14:31:18 user nova-compute[72129]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 14:31:18 user nova-compute[72129]:       <nova:package version="0.0.0"/>
Aug 01 14:31:18 user nova-compute[72129]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-710368898</nova:name>
Aug 01 14:31:18 user nova-compute[72129]:       <nova:creationTime>2023-08-01 14:31:18</nova:creationTime>
Aug 01 14:31:18 user nova-compute[72129]:       <nova:flavor name="m1.tiny">
Aug 01 14:31:18 user nova-compute[72129]:         <nova:memory>512</nova:memory>
Aug 01 14:31:18 user nova-compute[72129]:         <nova:disk>1</nova:disk>
Aug 01 14:31:18 user nova-compute[72129]:         <nova:swap>0</nova:swap>
Aug 01 14:31:18 user nova-compute[72129]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 14:31:18 user nova-compute[72129]:         <nova:vcpus>1</nova:vcpus>
Aug 01 14:31:18 user nova-compute[72129]:       </nova:flavor>
Aug 01 14:31:18 user nova-compute[72129]:       <nova:owner>
Aug 01 14:31:18 user nova-compute[72129]:         <nova:user uuid="fb400f977eb64fa7bbf4493103649386">tempest-TestServerVolumeAttachmentScenario-1472719378-project-member</nova:user>
Aug 01 14:31:18 user nova-compute[72129]:         <nova:project uuid="3f2d02f947a94977aba1e77775ef5ffe">tempest-TestServerVolumeAttachmentScenario-1472719378</nova:project>
Aug 01 14:31:18 user nova-compute[72129]:       </nova:owner>
Aug 01 14:31:18 user nova-compute[72129]:       <nova:root type="image" uuid="b6472c34-1b0f-4034-ba3a-7e8eb5103715"/>
Aug 01 14:31:18 user nova-compute[72129]:       <nova:ports>
Aug 01 14:31:18 user nova-compute[72129]:         <nova:port uuid="3e61efad-17e6-4ac4-b178-f806c8140bf3">
Aug 01 14:31:18 user nova-compute[72129]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 01 14:31:18 user nova-compute[72129]:         </nova:port>
Aug 01 14:31:18 user nova-compute[72129]:       </nova:ports>
Aug 01 14:31:18 user nova-compute[72129]:     </nova:instance>
Aug 01 14:31:18 user nova-compute[72129]:   </metadata>
Aug 01 14:31:18 user nova-compute[72129]:   <sysinfo type="smbios">
Aug 01 14:31:18 user nova-compute[72129]:     <system>
Aug 01 14:31:18 user nova-compute[72129]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 14:31:18 user nova-compute[72129]:       <entry name="product">OpenStack Nova</entry>
Aug 01 14:31:18 user nova-compute[72129]:       <entry name="version">0.0.0</entry>
Aug 01 14:31:18 user nova-compute[72129]:       <entry name="serial">c4bc2711-d958-41e4-a596-f7a6260c3e25</entry>
Aug 01 14:31:18 user nova-compute[72129]:       <entry name="uuid">c4bc2711-d958-41e4-a596-f7a6260c3e25</entry>
Aug 01 14:31:18 user nova-compute[72129]:       <entry name="family">Virtual Machine</entry>
Aug 01 14:31:18 user nova-compute[72129]:     </system>
Aug 01 14:31:18 user nova-compute[72129]:   </sysinfo>
Aug 01 14:31:18 user nova-compute[72129]:   <os>
Aug 01 14:31:18 user nova-compute[72129]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 14:31:18 user nova-compute[72129]:     <boot dev="hd"/>
Aug 01 14:31:18 user nova-compute[72129]:     <smbios mode="sysinfo"/>
Aug 01 14:31:18 user nova-compute[72129]:   </os>
Aug 01 14:31:18 user nova-compute[72129]:   <features>
Aug 01 14:31:18 user nova-compute[72129]:     <acpi/>
Aug 01 14:31:18 user nova-compute[72129]:     <apic/>
Aug 01 14:31:18 user nova-compute[72129]:     <vmcoreinfo/>
Aug 01 14:31:18 user nova-compute[72129]:   </features>
Aug 01 14:31:18 user nova-compute[72129]:   <clock offset="utc">
Aug 01 14:31:18 user nova-compute[72129]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 14:31:18 user nova-compute[72129]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 14:31:18 user nova-compute[72129]:     <timer name="hpet" present="no"/>
Aug 01 14:31:18 user nova-compute[72129]:   </clock>
Aug 01 14:31:18 user nova-compute[72129]:   <cpu mode="custom" match="exact">
Aug 01 14:31:18 user nova-compute[72129]:     <model>Nehalem</model>
Aug 01 14:31:18 user nova-compute[72129]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 14:31:18 user nova-compute[72129]:   </cpu>
Aug 01 14:31:18 user nova-compute[72129]:   <devices>
Aug 01 14:31:18 user nova-compute[72129]:     <disk type="file" device="disk">
Aug 01 14:31:18 user nova-compute[72129]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 14:31:18 user nova-compute[72129]:       <source file="/opt/stack/data/nova/instances/c4bc2711-d958-41e4-a596-f7a6260c3e25/disk"/>
Aug 01 14:31:18 user nova-compute[72129]:       <target dev="vda" bus="virtio"/>
Aug 01 14:31:18 user nova-compute[72129]:     </disk>
Aug 01 14:31:18 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 14:31:18 user nova-compute[72129]:       <mac address="fa:16:3e:ec:fb:bd"/>
Aug 01 14:31:18 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:31:18 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 14:31:18 user nova-compute[72129]:       <target dev="tap3e61efad-17"/>
Aug 01 14:31:18 user nova-compute[72129]:     </interface>
Aug 01 14:31:18 user nova-compute[72129]:     <serial type="pty">
Aug 01 14:31:18 user nova-compute[72129]:       <log file="/opt/stack/data/nova/instances/c4bc2711-d958-41e4-a596-f7a6260c3e25/console.log" append="off"/>
Aug 01 14:31:18 user nova-compute[72129]:     </serial>
Aug 01 14:31:18 user nova-compute[72129]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 14:31:18 user nova-compute[72129]:     <video>
Aug 01 14:31:18 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:31:18 user nova-compute[72129]:     </video>
Aug 01 14:31:18 user nova-compute[72129]:     <rng model="virtio">
Aug 01 14:31:18 user nova-compute[72129]:       <backend model="random">/dev/urandom</backend>
Aug 01 14:31:18 user nova-compute[72129]:     </rng>
Aug 01 14:31:18 user nova-compute[72129]:     <controller type="usb" index="0" model="none"/>
Aug 01 14:31:18 user nova-compute[72129]:     <memballoon model="virtio">
Aug 01 14:31:18 user nova-compute[72129]:       <stats period="10"/>
Aug 01 14:31:18 user nova-compute[72129]:     </memballoon>
Aug 01 14:31:18 user nova-compute[72129]:   </devices>
Aug 01 14:31:18 user nova-compute[72129]: </domain>
Aug 01 14:31:18 user nova-compute[72129]:  {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 14:31:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:31:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-710368898',display_name='tempest-TestServerVolumeAttachmentScenario-server-710368898',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-710368898',id=51,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA0acstFhS8UNcYpcaJEQ9OEAiWpOL8opPzw0hn0rePKQYlQIjScO1cFWlQwDpXdSwKjYmkhn39XqpQICyB5VZ5rJsPPWTSvYoedvU9DPO2vgFcGWc5OGn+Nk0717VpWsw==',key_name='tempest-keypair-1272737235',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3f2d02f947a94977aba1e77775ef5ffe',ramdisk_id='',reservation_id='r-tu5ibal8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1472719378',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1472719378-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T14:31:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb400f977eb64fa7bbf4493103649386',uuid=c4bc2711-d958-41e4-a596-f7a6260c3e25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e61efad-17e6-4ac4-b178-f806c8140bf3", "address": "fa:16:3e:ec:fb:bd", "network": {"id": "0dcde27b-5262-470e-affe-12b66f49084a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-937126397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f2d02f947a94977aba1e77775ef5ffe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e61efad-17", "ovs_interfaceid": "3e61efad-17e6-4ac4-b178-f806c8140bf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 14:31:18 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Converting VIF {"id": "3e61efad-17e6-4ac4-b178-f806c8140bf3", "address": "fa:16:3e:ec:fb:bd", "network": {"id": "0dcde27b-5262-470e-affe-12b66f49084a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-937126397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f2d02f947a94977aba1e77775ef5ffe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e61efad-17", "ovs_interfaceid": "3e61efad-17e6-4ac4-b178-f806c8140bf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:31:18 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:fb:bd,bridge_name='br-int',has_traffic_filtering=True,id=3e61efad-17e6-4ac4-b178-f806c8140bf3,network=Network(0dcde27b-5262-470e-affe-12b66f49084a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e61efad-17') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:31:18 user nova-compute[72129]: DEBUG os_vif [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:fb:bd,bridge_name='br-int',has_traffic_filtering=True,id=3e61efad-17e6-4ac4-b178-f806c8140bf3,network=Network(0dcde27b-5262-470e-affe-12b66f49084a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e61efad-17') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 14:31:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:31:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:31:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 14:31:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:31:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3e61efad-17, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:31:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3e61efad-17, col_values=(('external_ids', {'iface-id': '3e61efad-17e6-4ac4-b178-f806c8140bf3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:fb:bd', 'vm-uuid': 'c4bc2711-d958-41e4-a596-f7a6260c3e25'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:31:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:31:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:31:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:31:18 user nova-compute[72129]: INFO os_vif [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:fb:bd,bridge_name='br-int',has_traffic_filtering=True,id=3e61efad-17e6-4ac4-b178-f806c8140bf3,network=Network(0dcde27b-5262-470e-affe-12b66f49084a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e61efad-17')
Aug 01 14:31:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:31:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] No VIF found with MAC fa:16:3e:ec:fb:bd, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 14:31:18 user nova-compute[72129]: DEBUG nova.network.neutron [req-ff5179d8-cdb1-4d3e-a681-537b1933c8a8 req-6a166156-107c-429d-86e8-b89064e7b545 service nova] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Updated VIF entry in instance network info cache for port 3e61efad-17e6-4ac4-b178-f806c8140bf3. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 14:31:18 user nova-compute[72129]: DEBUG nova.network.neutron [req-ff5179d8-cdb1-4d3e-a681-537b1933c8a8 req-6a166156-107c-429d-86e8-b89064e7b545 service nova] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Updating instance_info_cache with network_info: [{"id": "3e61efad-17e6-4ac4-b178-f806c8140bf3", "address": "fa:16:3e:ec:fb:bd", "network": {"id": "0dcde27b-5262-470e-affe-12b66f49084a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-937126397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f2d02f947a94977aba1e77775ef5ffe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e61efad-17", "ovs_interfaceid": "3e61efad-17e6-4ac4-b178-f806c8140bf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:31:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-ff5179d8-cdb1-4d3e-a681-537b1933c8a8 req-6a166156-107c-429d-86e8-b89064e7b545 service nova] Releasing lock "refresh_cache-c4bc2711-d958-41e4-a596-f7a6260c3e25" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:31:19 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:31:19 user nova-compute[72129]: DEBUG nova.compute.manager [req-0b7c9058-0410-4ca5-a44b-019203c348a5 req-4a0ef1bc-2437-419f-9cfe-e89e8ee9f2dc service nova] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] Received event network-changed-6cb74238-92d8-4629-9631-b869d1775929 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:31:19 user nova-compute[72129]: DEBUG nova.compute.manager [req-0b7c9058-0410-4ca5-a44b-019203c348a5 req-4a0ef1bc-2437-419f-9cfe-e89e8ee9f2dc service nova] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] Refreshing instance network info cache due to event network-changed-6cb74238-92d8-4629-9631-b869d1775929. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 14:31:19 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-0b7c9058-0410-4ca5-a44b-019203c348a5 req-4a0ef1bc-2437-419f-9cfe-e89e8ee9f2dc service nova] Acquiring lock "refresh_cache-7e31e6ee-1bd8-423a-96ed-3940a87ee789" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:31:19 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-0b7c9058-0410-4ca5-a44b-019203c348a5 req-4a0ef1bc-2437-419f-9cfe-e89e8ee9f2dc service nova] Acquired lock "refresh_cache-7e31e6ee-1bd8-423a-96ed-3940a87ee789" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:31:19 user nova-compute[72129]: DEBUG nova.network.neutron [req-0b7c9058-0410-4ca5-a44b-019203c348a5 req-4a0ef1bc-2437-419f-9cfe-e89e8ee9f2dc service nova] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] Refreshing network info cache for port 6cb74238-92d8-4629-9631-b869d1775929 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 14:31:19 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-da399a1b-b83a-4aad-a7df-b419a884e164 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Acquiring lock "7e31e6ee-1bd8-423a-96ed-3940a87ee789" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:31:19 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-da399a1b-b83a-4aad-a7df-b419a884e164 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Lock "7e31e6ee-1bd8-423a-96ed-3940a87ee789" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:31:19 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-da399a1b-b83a-4aad-a7df-b419a884e164 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Acquiring lock "7e31e6ee-1bd8-423a-96ed-3940a87ee789-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:31:19 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-da399a1b-b83a-4aad-a7df-b419a884e164 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Lock "7e31e6ee-1bd8-423a-96ed-3940a87ee789-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:31:19 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-da399a1b-b83a-4aad-a7df-b419a884e164 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Lock "7e31e6ee-1bd8-423a-96ed-3940a87ee789-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:31:19 user nova-compute[72129]: INFO nova.compute.manager [None req-da399a1b-b83a-4aad-a7df-b419a884e164 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] Terminating instance
Aug 01 14:31:19 user nova-compute[72129]: DEBUG nova.compute.manager [None req-da399a1b-b83a-4aad-a7df-b419a884e164 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] Start destroying the instance on the hypervisor. {{(pid=72129) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 14:31:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:31:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:31:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:31:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:31:19 user nova-compute[72129]: DEBUG nova.network.neutron [req-0b7c9058-0410-4ca5-a44b-019203c348a5 req-4a0ef1bc-2437-419f-9cfe-e89e8ee9f2dc service nova] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] Updated VIF entry in instance network info cache for port 6cb74238-92d8-4629-9631-b869d1775929. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 14:31:19 user nova-compute[72129]: DEBUG nova.network.neutron [req-0b7c9058-0410-4ca5-a44b-019203c348a5 req-4a0ef1bc-2437-419f-9cfe-e89e8ee9f2dc service nova] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] Updating instance_info_cache with network_info: [{"id": "6cb74238-92d8-4629-9631-b869d1775929", "address": "fa:16:3e:0b:05:26", "network": {"id": "d4ba0665-71f8-48a1-b3a2-2c73c2c7db3a", "bridge": "br-int", "label": "tempest-TestStampPattern-1150922129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a91b43b1394048719e2ed69f5c3ae94f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cb74238-92", "ovs_interfaceid": "6cb74238-92d8-4629-9631-b869d1775929", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:31:19 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-0b7c9058-0410-4ca5-a44b-019203c348a5 req-4a0ef1bc-2437-419f-9cfe-e89e8ee9f2dc service nova] Releasing lock "refresh_cache-7e31e6ee-1bd8-423a-96ed-3940a87ee789" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:31:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:31:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:31:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:31:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:31:20 user nova-compute[72129]: DEBUG nova.compute.manager [req-f467b15e-57d9-40ef-8cf3-6338268d6d78 req-bfb74483-edf6-4bc4-805f-59052bfb3e11 service nova] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Received event network-vif-plugged-3e61efad-17e6-4ac4-b178-f806c8140bf3 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:31:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f467b15e-57d9-40ef-8cf3-6338268d6d78 req-bfb74483-edf6-4bc4-805f-59052bfb3e11 service nova] Acquiring lock "c4bc2711-d958-41e4-a596-f7a6260c3e25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:31:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f467b15e-57d9-40ef-8cf3-6338268d6d78 req-bfb74483-edf6-4bc4-805f-59052bfb3e11 service nova] Lock "c4bc2711-d958-41e4-a596-f7a6260c3e25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:31:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-f467b15e-57d9-40ef-8cf3-6338268d6d78 req-bfb74483-edf6-4bc4-805f-59052bfb3e11 service nova] Lock "c4bc2711-d958-41e4-a596-f7a6260c3e25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:31:20 user nova-compute[72129]: DEBUG nova.compute.manager [req-f467b15e-57d9-40ef-8cf3-6338268d6d78 req-bfb74483-edf6-4bc4-805f-59052bfb3e11 service nova] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] No waiting events found dispatching network-vif-plugged-3e61efad-17e6-4ac4-b178-f806c8140bf3 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:31:20 user nova-compute[72129]: WARNING nova.compute.manager [req-f467b15e-57d9-40ef-8cf3-6338268d6d78 req-bfb74483-edf6-4bc4-805f-59052bfb3e11 service nova] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Received unexpected event network-vif-plugged-3e61efad-17e6-4ac4-b178-f806c8140bf3 for instance with vm_state building and task_state spawning.
Aug 01 14:31:20 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] Instance destroyed successfully.
Aug 01 14:31:20 user nova-compute[72129]: DEBUG nova.objects.instance [None req-da399a1b-b83a-4aad-a7df-b419a884e164 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Lazy-loading 'resources' on Instance uuid 7e31e6ee-1bd8-423a-96ed-3940a87ee789 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:31:20 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-da399a1b-b83a-4aad-a7df-b419a884e164 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:28:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-98663805',display_name='tempest-TestStampPattern-server-98663805',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-98663805',id=50,image_ref='dc80883f-f1dd-4ab8-a2cb-3591be595955',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCwUi55JC6c3jIlHojlRSa1D75mKSh1IzavmHf9G22Ze9c8CmQkw8Ybb7RlOQs1lEv+npQyyXxQntVe596OJBfHyUJy8lfQ5nyhMK2bUKD87QJNIia//pC3lm7PdMjjyDQ==',key_name='tempest-TestStampPattern-1260661357',keypairs=<?>,launch_index=0,launched_at=2023-08-01T14:28:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a91b43b1394048719e2ed69f5c3ae94f',ramdisk_id='',reservation_id='r-0vkvuh0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='a3319e68-8c91-404f-800b-6798fb16aa75',image_min_disk='1',image_min_ram='0',image_owner_id='a91b43b1394048719e2ed69f5c3ae94f',image_owner_project_name='tempest-TestStampPattern-1201126667',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1201126667-project-member',image_user_id='9bf10b1642e642658bec5d0ac60b7abe',owner_project_name='tempest-TestStampPattern-1201126667',owner_user_name='tempest-TestStampPattern-1201126667-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T14:28:32Z,user_data=None,user_id='9bf10b1642e642658bec5d0ac60b7abe',uuid=7e31e6ee-1bd8-423a-96ed-3940a87ee789,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6cb74238-92d8-4629-9631-b869d1775929", "address": "fa:16:3e:0b:05:26", "network": {"id": "d4ba0665-71f8-48a1-b3a2-2c73c2c7db3a", "bridge": "br-int", "label": "tempest-TestStampPattern-1150922129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a91b43b1394048719e2ed69f5c3ae94f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cb74238-92", "ovs_interfaceid": "6cb74238-92d8-4629-9631-b869d1775929", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 14:31:20 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-da399a1b-b83a-4aad-a7df-b419a884e164 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Converting VIF {"id": "6cb74238-92d8-4629-9631-b869d1775929", "address": "fa:16:3e:0b:05:26", "network": {"id": "d4ba0665-71f8-48a1-b3a2-2c73c2c7db3a", "bridge": "br-int", "label": "tempest-TestStampPattern-1150922129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a91b43b1394048719e2ed69f5c3ae94f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cb74238-92", "ovs_interfaceid": "6cb74238-92d8-4629-9631-b869d1775929", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:31:20 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-da399a1b-b83a-4aad-a7df-b419a884e164 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0b:05:26,bridge_name='br-int',has_traffic_filtering=True,id=6cb74238-92d8-4629-9631-b869d1775929,network=Network(d4ba0665-71f8-48a1-b3a2-2c73c2c7db3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cb74238-92') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:31:20 user nova-compute[72129]: DEBUG os_vif [None req-da399a1b-b83a-4aad-a7df-b419a884e164 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:05:26,bridge_name='br-int',has_traffic_filtering=True,id=6cb74238-92d8-4629-9631-b869d1775929,network=Network(d4ba0665-71f8-48a1-b3a2-2c73c2c7db3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cb74238-92') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 14:31:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:31:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6cb74238-92, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:31:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:31:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:31:20 user nova-compute[72129]: INFO os_vif [None req-da399a1b-b83a-4aad-a7df-b419a884e164 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:05:26,bridge_name='br-int',has_traffic_filtering=True,id=6cb74238-92d8-4629-9631-b869d1775929,network=Network(d4ba0665-71f8-48a1-b3a2-2c73c2c7db3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cb74238-92')
Aug 01 14:31:20 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-da399a1b-b83a-4aad-a7df-b419a884e164 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] Deleting instance files /opt/stack/data/nova/instances/7e31e6ee-1bd8-423a-96ed-3940a87ee789_del
Aug 01 14:31:20 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-da399a1b-b83a-4aad-a7df-b419a884e164 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] Deletion of /opt/stack/data/nova/instances/7e31e6ee-1bd8-423a-96ed-3940a87ee789_del complete
Aug 01 14:31:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:31:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:31:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:31:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:31:20 user nova-compute[72129]: INFO nova.compute.manager [None req-da399a1b-b83a-4aad-a7df-b419a884e164 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] Took 1.38 seconds to destroy the instance on the hypervisor.
Aug 01 14:31:20 user nova-compute[72129]: DEBUG oslo.service.loopingcall [None req-da399a1b-b83a-4aad-a7df-b419a884e164 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72129) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 14:31:20 user nova-compute[72129]: DEBUG nova.compute.manager [-] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] Deallocating network for instance {{(pid=72129) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 14:31:20 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] deallocate_for_instance() {{(pid=72129) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 14:31:21 user nova-compute[72129]: DEBUG nova.compute.manager [req-9fa90aca-5d5f-412f-ba4a-e24c92757ea0 req-565f52db-5d07-417f-b4df-a2e191c1a1c3 service nova] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] Received event network-vif-unplugged-6cb74238-92d8-4629-9631-b869d1775929 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:31:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-9fa90aca-5d5f-412f-ba4a-e24c92757ea0 req-565f52db-5d07-417f-b4df-a2e191c1a1c3 service nova] Acquiring lock "7e31e6ee-1bd8-423a-96ed-3940a87ee789-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:31:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-9fa90aca-5d5f-412f-ba4a-e24c92757ea0 req-565f52db-5d07-417f-b4df-a2e191c1a1c3 service nova] Lock "7e31e6ee-1bd8-423a-96ed-3940a87ee789-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:31:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-9fa90aca-5d5f-412f-ba4a-e24c92757ea0 req-565f52db-5d07-417f-b4df-a2e191c1a1c3 service nova] Lock "7e31e6ee-1bd8-423a-96ed-3940a87ee789-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:31:21 user nova-compute[72129]: DEBUG nova.compute.manager [req-9fa90aca-5d5f-412f-ba4a-e24c92757ea0 req-565f52db-5d07-417f-b4df-a2e191c1a1c3 service nova] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] No waiting events found dispatching network-vif-unplugged-6cb74238-92d8-4629-9631-b869d1775929 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:31:21 user nova-compute[72129]: DEBUG nova.compute.manager [req-9fa90aca-5d5f-412f-ba4a-e24c92757ea0 req-565f52db-5d07-417f-b4df-a2e191c1a1c3 service nova] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] Received event network-vif-unplugged-6cb74238-92d8-4629-9631-b869d1775929 for instance with task_state deleting. {{(pid=72129) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 14:31:21 user nova-compute[72129]: DEBUG nova.compute.manager [req-9fa90aca-5d5f-412f-ba4a-e24c92757ea0 req-565f52db-5d07-417f-b4df-a2e191c1a1c3 service nova] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] Received event network-vif-plugged-6cb74238-92d8-4629-9631-b869d1775929 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:31:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-9fa90aca-5d5f-412f-ba4a-e24c92757ea0 req-565f52db-5d07-417f-b4df-a2e191c1a1c3 service nova] Acquiring lock "7e31e6ee-1bd8-423a-96ed-3940a87ee789-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:31:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-9fa90aca-5d5f-412f-ba4a-e24c92757ea0 req-565f52db-5d07-417f-b4df-a2e191c1a1c3 service nova] Lock "7e31e6ee-1bd8-423a-96ed-3940a87ee789-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:31:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-9fa90aca-5d5f-412f-ba4a-e24c92757ea0 req-565f52db-5d07-417f-b4df-a2e191c1a1c3 service nova] Lock "7e31e6ee-1bd8-423a-96ed-3940a87ee789-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:31:21 user nova-compute[72129]: DEBUG nova.compute.manager [req-9fa90aca-5d5f-412f-ba4a-e24c92757ea0 req-565f52db-5d07-417f-b4df-a2e191c1a1c3 service nova] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] No waiting events found dispatching network-vif-plugged-6cb74238-92d8-4629-9631-b869d1775929 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:31:21 user nova-compute[72129]: WARNING nova.compute.manager [req-9fa90aca-5d5f-412f-ba4a-e24c92757ea0 req-565f52db-5d07-417f-b4df-a2e191c1a1c3 service nova] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] Received unexpected event network-vif-plugged-6cb74238-92d8-4629-9631-b869d1775929 for instance with vm_state active and task_state deleting.
Aug 01 14:31:21 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:31:21 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] Took 0.88 seconds to deallocate network for instance.
Aug 01 14:31:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-da399a1b-b83a-4aad-a7df-b419a884e164 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:31:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-da399a1b-b83a-4aad-a7df-b419a884e164 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:31:21 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-da399a1b-b83a-4aad-a7df-b419a884e164 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:31:21 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-da399a1b-b83a-4aad-a7df-b419a884e164 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:31:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-da399a1b-b83a-4aad-a7df-b419a884e164 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.164s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:31:21 user nova-compute[72129]: INFO nova.scheduler.client.report [None req-da399a1b-b83a-4aad-a7df-b419a884e164 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Deleted allocations for instance 7e31e6ee-1bd8-423a-96ed-3940a87ee789
Aug 01 14:31:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-da399a1b-b83a-4aad-a7df-b419a884e164 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Lock "7e31e6ee-1bd8-423a-96ed-3940a87ee789" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.599s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:31:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:31:22 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690900282.1770458, c4bc2711-d958-41e4-a596-f7a6260c3e25 => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:31:22 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] VM Resumed (Lifecycle Event)
Aug 01 14:31:22 user nova-compute[72129]: DEBUG nova.compute.manager [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Instance event wait completed in 0 seconds for  {{(pid=72129) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 14:31:22 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Guest created on hypervisor {{(pid=72129) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 14:31:22 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Instance spawned successfully.
Aug 01 14:31:22 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 14:31:22 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:31:22 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:31:22 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Found default for hw_cdrom_bus of ide {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:31:22 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Found default for hw_disk_bus of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:31:22 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Found default for hw_input_bus of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:31:22 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Found default for hw_pointer_model of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:31:22 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Found default for hw_video_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:31:22 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Found default for hw_vif_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:31:22 user nova-compute[72129]: DEBUG nova.compute.manager [req-15443f17-f4c5-484f-978f-2406eb522115 req-997566f9-0636-4e00-a639-de7f343c52a4 service nova] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Received event network-vif-plugged-3e61efad-17e6-4ac4-b178-f806c8140bf3 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:31:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-15443f17-f4c5-484f-978f-2406eb522115 req-997566f9-0636-4e00-a639-de7f343c52a4 service nova] Acquiring lock "c4bc2711-d958-41e4-a596-f7a6260c3e25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:31:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-15443f17-f4c5-484f-978f-2406eb522115 req-997566f9-0636-4e00-a639-de7f343c52a4 service nova] Lock "c4bc2711-d958-41e4-a596-f7a6260c3e25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:31:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-15443f17-f4c5-484f-978f-2406eb522115 req-997566f9-0636-4e00-a639-de7f343c52a4 service nova] Lock "c4bc2711-d958-41e4-a596-f7a6260c3e25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:31:22 user nova-compute[72129]: DEBUG nova.compute.manager [req-15443f17-f4c5-484f-978f-2406eb522115 req-997566f9-0636-4e00-a639-de7f343c52a4 service nova] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] No waiting events found dispatching network-vif-plugged-3e61efad-17e6-4ac4-b178-f806c8140bf3 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:31:22 user nova-compute[72129]: WARNING nova.compute.manager [req-15443f17-f4c5-484f-978f-2406eb522115 req-997566f9-0636-4e00-a639-de7f343c52a4 service nova] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Received unexpected event network-vif-plugged-3e61efad-17e6-4ac4-b178-f806c8140bf3 for instance with vm_state building and task_state spawning.
Aug 01 14:31:22 user nova-compute[72129]: DEBUG nova.compute.manager [req-15443f17-f4c5-484f-978f-2406eb522115 req-997566f9-0636-4e00-a639-de7f343c52a4 service nova] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] Received event network-vif-deleted-6cb74238-92d8-4629-9631-b869d1775929 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:31:22 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 14:31:22 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690900282.1780076, c4bc2711-d958-41e4-a596-f7a6260c3e25 => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:31:22 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] VM Started (Lifecycle Event)
Aug 01 14:31:22 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:31:22 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:31:22 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 14:31:22 user nova-compute[72129]: INFO nova.compute.manager [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Took 5.61 seconds to spawn the instance on the hypervisor.
Aug 01 14:31:22 user nova-compute[72129]: DEBUG nova.compute.manager [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:31:22 user nova-compute[72129]: INFO nova.compute.manager [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Took 6.16 seconds to build instance.
Aug 01 14:31:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-43a40c64-10f3-4b0e-9777-c116e9fb8bd4 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Lock "c4bc2711-d958-41e4-a596-f7a6260c3e25" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.257s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:31:25 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:31:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:31:30 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:31:30 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:31:35 user nova-compute[72129]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690900280.3779917, 7e31e6ee-1bd8-423a-96ed-3940a87ee789 => Stopped> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:31:35 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] VM Stopped (Lifecycle Event)
Aug 01 14:31:35 user nova-compute[72129]: DEBUG nova.compute.manager [None req-f7faa535-5b01-4927-9d48-3175b5af1741 None None] [instance: 7e31e6ee-1bd8-423a-96ed-3940a87ee789] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:31:35 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:31:35 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:31:35 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72129) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 14:31:35 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:31:35 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:31:35 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:31:36 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:31:38 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:31:38 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72129) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 14:31:40 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:31:40 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Cleaning up deleted instances {{(pid=72129) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 14:31:40 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] There are 0 instances to clean {{(pid=72129) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 14:31:40 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:31:41 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:31:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-21701d58-7c48-4e7b-8f87-71eb1e23f0a9 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Acquiring lock "b3f54430-8d5d-478b-8dc7-d7592ee3db36" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:31:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-21701d58-7c48-4e7b-8f87-71eb1e23f0a9 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lock "b3f54430-8d5d-478b-8dc7-d7592ee3db36" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:31:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-21701d58-7c48-4e7b-8f87-71eb1e23f0a9 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Acquiring lock "b3f54430-8d5d-478b-8dc7-d7592ee3db36-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:31:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-21701d58-7c48-4e7b-8f87-71eb1e23f0a9 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lock "b3f54430-8d5d-478b-8dc7-d7592ee3db36-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:31:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-21701d58-7c48-4e7b-8f87-71eb1e23f0a9 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lock "b3f54430-8d5d-478b-8dc7-d7592ee3db36-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:31:43 user nova-compute[72129]: INFO nova.compute.manager [None req-21701d58-7c48-4e7b-8f87-71eb1e23f0a9 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Terminating instance
Aug 01 14:31:43 user nova-compute[72129]: DEBUG nova.compute.manager [None req-21701d58-7c48-4e7b-8f87-71eb1e23f0a9 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Start destroying the instance on the hypervisor. {{(pid=72129) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 14:31:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:31:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:31:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:31:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:31:43 user nova-compute[72129]: DEBUG nova.compute.manager [req-77683da2-776e-4c91-ba81-fe2537f29bcd req-47b1861b-d756-43c2-8be0-6c822d9e7942 service nova] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Received event network-vif-unplugged-77cb18a9-2c41-4aa6-8784-ffcbafeb1341 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:31:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-77683da2-776e-4c91-ba81-fe2537f29bcd req-47b1861b-d756-43c2-8be0-6c822d9e7942 service nova] Acquiring lock "b3f54430-8d5d-478b-8dc7-d7592ee3db36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:31:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-77683da2-776e-4c91-ba81-fe2537f29bcd req-47b1861b-d756-43c2-8be0-6c822d9e7942 service nova] Lock "b3f54430-8d5d-478b-8dc7-d7592ee3db36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:31:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-77683da2-776e-4c91-ba81-fe2537f29bcd req-47b1861b-d756-43c2-8be0-6c822d9e7942 service nova] Lock "b3f54430-8d5d-478b-8dc7-d7592ee3db36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:31:43 user nova-compute[72129]: DEBUG nova.compute.manager [req-77683da2-776e-4c91-ba81-fe2537f29bcd req-47b1861b-d756-43c2-8be0-6c822d9e7942 service nova] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] No waiting events found dispatching network-vif-unplugged-77cb18a9-2c41-4aa6-8784-ffcbafeb1341 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:31:43 user nova-compute[72129]: DEBUG nova.compute.manager [req-77683da2-776e-4c91-ba81-fe2537f29bcd req-47b1861b-d756-43c2-8be0-6c822d9e7942 service nova] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Received event network-vif-unplugged-77cb18a9-2c41-4aa6-8784-ffcbafeb1341 for instance with task_state deleting. {{(pid=72129) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 14:31:44 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Instance destroyed successfully.
Aug 01 14:31:44 user nova-compute[72129]: DEBUG nova.objects.instance [None req-21701d58-7c48-4e7b-8f87-71eb1e23f0a9 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lazy-loading 'resources' on Instance uuid b3f54430-8d5d-478b-8dc7-d7592ee3db36 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:31:44 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-21701d58-7c48-4e7b-8f87-71eb1e23f0a9 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:14:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-998646471',display_name='tempest-ServerRescueNegativeTestJSON-server-998646471',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-998646471',id=41,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T14:19:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='42cca3e17d4e4df79c94c4b94fb3fcec',ramdisk_id='',reservation_id='r-3w5r0zro',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-481576424',owner_user_name='tempest-ServerRescueNegativeTestJSON-481576424-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T14:21:24Z,user_data=None,user_id='deb1597afdc647598ee893dd51880173',uuid=b3f54430-8d5d-478b-8dc7-d7592ee3db36,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "77cb18a9-2c41-4aa6-8784-ffcbafeb1341", "address": "fa:16:3e:d2:d6:8b", "network": {"id": "6ffcec16-7b44-472a-b7cd-af16ebd4a653", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-901464581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cca3e17d4e4df79c94c4b94fb3fcec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77cb18a9-2c", "ovs_interfaceid": "77cb18a9-2c41-4aa6-8784-ffcbafeb1341", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 14:31:44 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-21701d58-7c48-4e7b-8f87-71eb1e23f0a9 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Converting VIF {"id": "77cb18a9-2c41-4aa6-8784-ffcbafeb1341", "address": "fa:16:3e:d2:d6:8b", "network": {"id": "6ffcec16-7b44-472a-b7cd-af16ebd4a653", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-901464581-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42cca3e17d4e4df79c94c4b94fb3fcec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77cb18a9-2c", "ovs_interfaceid": "77cb18a9-2c41-4aa6-8784-ffcbafeb1341", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:31:44 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-21701d58-7c48-4e7b-8f87-71eb1e23f0a9 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d2:d6:8b,bridge_name='br-int',has_traffic_filtering=True,id=77cb18a9-2c41-4aa6-8784-ffcbafeb1341,network=Network(6ffcec16-7b44-472a-b7cd-af16ebd4a653),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77cb18a9-2c') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:31:44 user nova-compute[72129]: DEBUG os_vif [None req-21701d58-7c48-4e7b-8f87-71eb1e23f0a9 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:d6:8b,bridge_name='br-int',has_traffic_filtering=True,id=77cb18a9-2c41-4aa6-8784-ffcbafeb1341,network=Network(6ffcec16-7b44-472a-b7cd-af16ebd4a653),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77cb18a9-2c') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 14:31:44 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:31:44 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap77cb18a9-2c, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:31:44 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:31:44 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:31:44 user nova-compute[72129]: INFO os_vif [None req-21701d58-7c48-4e7b-8f87-71eb1e23f0a9 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:d6:8b,bridge_name='br-int',has_traffic_filtering=True,id=77cb18a9-2c41-4aa6-8784-ffcbafeb1341,network=Network(6ffcec16-7b44-472a-b7cd-af16ebd4a653),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77cb18a9-2c')
Aug 01 14:31:44 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-21701d58-7c48-4e7b-8f87-71eb1e23f0a9 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Deleting instance files /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36_del
Aug 01 14:31:44 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-21701d58-7c48-4e7b-8f87-71eb1e23f0a9 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Deletion of /opt/stack/data/nova/instances/b3f54430-8d5d-478b-8dc7-d7592ee3db36_del complete
Aug 01 14:31:44 user nova-compute[72129]: INFO nova.compute.manager [None req-21701d58-7c48-4e7b-8f87-71eb1e23f0a9 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Took 0.65 seconds to destroy the instance on the hypervisor.
Aug 01 14:31:44 user nova-compute[72129]: DEBUG oslo.service.loopingcall [None req-21701d58-7c48-4e7b-8f87-71eb1e23f0a9 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72129) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 14:31:44 user nova-compute[72129]: DEBUG nova.compute.manager [-] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Deallocating network for instance {{(pid=72129) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 14:31:44 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] deallocate_for_instance() {{(pid=72129) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 14:31:44 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:31:44 user nova-compute[72129]: DEBUG nova.compute.manager [req-e2d24fbe-3754-4401-aa19-bcb1ec10a326 req-7ef7461b-0f66-4030-9a44-f78c93ccea25 service nova] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Received event network-vif-deleted-77cb18a9-2c41-4aa6-8784-ffcbafeb1341 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:31:44 user nova-compute[72129]: INFO nova.compute.manager [req-e2d24fbe-3754-4401-aa19-bcb1ec10a326 req-7ef7461b-0f66-4030-9a44-f78c93ccea25 service nova] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Neutron deleted interface 77cb18a9-2c41-4aa6-8784-ffcbafeb1341; detaching it from the instance and deleting it from the info cache
Aug 01 14:31:44 user nova-compute[72129]: DEBUG nova.network.neutron [req-e2d24fbe-3754-4401-aa19-bcb1ec10a326 req-7ef7461b-0f66-4030-9a44-f78c93ccea25 service nova] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:31:44 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Took 0.56 seconds to deallocate network for instance.
Aug 01 14:31:44 user nova-compute[72129]: DEBUG nova.compute.manager [req-e2d24fbe-3754-4401-aa19-bcb1ec10a326 req-7ef7461b-0f66-4030-9a44-f78c93ccea25 service nova] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Detach interface failed, port_id=77cb18a9-2c41-4aa6-8784-ffcbafeb1341, reason: Instance b3f54430-8d5d-478b-8dc7-d7592ee3db36 could not be found. {{(pid=72129) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 14:31:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-21701d58-7c48-4e7b-8f87-71eb1e23f0a9 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:31:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-21701d58-7c48-4e7b-8f87-71eb1e23f0a9 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:31:44 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-21701d58-7c48-4e7b-8f87-71eb1e23f0a9 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:31:44 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-21701d58-7c48-4e7b-8f87-71eb1e23f0a9 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:31:44 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-21701d58-7c48-4e7b-8f87-71eb1e23f0a9 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.180s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:31:44 user nova-compute[72129]: INFO nova.scheduler.client.report [None req-21701d58-7c48-4e7b-8f87-71eb1e23f0a9 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Deleted allocations for instance b3f54430-8d5d-478b-8dc7-d7592ee3db36
Aug 01 14:31:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-21701d58-7c48-4e7b-8f87-71eb1e23f0a9 tempest-ServerRescueNegativeTestJSON-481576424 tempest-ServerRescueNegativeTestJSON-481576424-project-member] Lock "b3f54430-8d5d-478b-8dc7-d7592ee3db36" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.552s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:31:45 user nova-compute[72129]: DEBUG nova.compute.manager [req-3269f022-ad88-41fa-be83-8bbb9a0532f5 req-fffd0244-2142-4f0c-93a9-ef525396e8ec service nova] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Received event network-vif-plugged-77cb18a9-2c41-4aa6-8784-ffcbafeb1341 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:31:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-3269f022-ad88-41fa-be83-8bbb9a0532f5 req-fffd0244-2142-4f0c-93a9-ef525396e8ec service nova] Acquiring lock "b3f54430-8d5d-478b-8dc7-d7592ee3db36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:31:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-3269f022-ad88-41fa-be83-8bbb9a0532f5 req-fffd0244-2142-4f0c-93a9-ef525396e8ec service nova] Lock "b3f54430-8d5d-478b-8dc7-d7592ee3db36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:31:45 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-3269f022-ad88-41fa-be83-8bbb9a0532f5 req-fffd0244-2142-4f0c-93a9-ef525396e8ec service nova] Lock "b3f54430-8d5d-478b-8dc7-d7592ee3db36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:31:45 user nova-compute[72129]: DEBUG nova.compute.manager [req-3269f022-ad88-41fa-be83-8bbb9a0532f5 req-fffd0244-2142-4f0c-93a9-ef525396e8ec service nova] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] No waiting events found dispatching network-vif-plugged-77cb18a9-2c41-4aa6-8784-ffcbafeb1341 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:31:45 user nova-compute[72129]: WARNING nova.compute.manager [req-3269f022-ad88-41fa-be83-8bbb9a0532f5 req-fffd0244-2142-4f0c-93a9-ef525396e8ec service nova] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Received unexpected event network-vif-plugged-77cb18a9-2c41-4aa6-8784-ffcbafeb1341 for instance with vm_state deleted and task_state None.
Aug 01 14:31:46 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:31:49 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:31:51 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:31:54 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:31:59 user nova-compute[72129]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690900304.0489693, b3f54430-8d5d-478b-8dc7-d7592ee3db36 => Stopped> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:31:59 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] VM Stopped (Lifecycle Event)
Aug 01 14:31:59 user nova-compute[72129]: DEBUG nova.compute.manager [None req-070c0b03-a6e9-445c-8bf7-6661d4c67e56 None None] [instance: b3f54430-8d5d-478b-8dc7-d7592ee3db36] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:31:59 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:31:59 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:31:59 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72129) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 14:31:59 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:31:59 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:31:59 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:32:04 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:32:08 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:32:08 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72129) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 14:32:09 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:32:09 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:32:14 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:32:14 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:32:14 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:32:14 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:32:14 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Auditing locally available compute resources for user (node: user) {{(pid=72129) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 14:32:14 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:32:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3319e68-8c91-404f-800b-6798fb16aa75/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:32:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3319e68-8c91-404f-800b-6798fb16aa75/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:32:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3319e68-8c91-404f-800b-6798fb16aa75/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:32:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3319e68-8c91-404f-800b-6798fb16aa75/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:32:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4bc2711-d958-41e4-a596-f7a6260c3e25/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:32:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4bc2711-d958-41e4-a596-f7a6260c3e25/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:32:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4bc2711-d958-41e4-a596-f7a6260c3e25/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:32:14 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4bc2711-d958-41e4-a596-f7a6260c3e25/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:32:15 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:32:15 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:32:15 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Hypervisor/Node resource view: name=user free_ram=8670MB free_disk=25.07156753540039GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72129) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 14:32:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:32:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:32:15 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance a3319e68-8c91-404f-800b-6798fb16aa75 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:32:15 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance c4bc2711-d958-41e4-a596-f7a6260c3e25 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:32:15 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 14:32:15 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 14:32:15 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:32:15 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:32:15 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Compute_service record updated for user:user {{(pid=72129) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 14:32:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.239s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:32:17 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:32:17 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:32:17 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:32:18 user nova-compute[72129]: DEBUG nova.compute.manager [req-0cd2ef26-4f17-439e-a94f-1292d9f56505 req-c73b18e1-ba21-4828-b217-21c91b5fd5a8 service nova] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Received event network-changed-9fa9db76-1de9-4e10-962f-7d1e07b9582d {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:32:18 user nova-compute[72129]: DEBUG nova.compute.manager [req-0cd2ef26-4f17-439e-a94f-1292d9f56505 req-c73b18e1-ba21-4828-b217-21c91b5fd5a8 service nova] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Refreshing instance network info cache due to event network-changed-9fa9db76-1de9-4e10-962f-7d1e07b9582d. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 14:32:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-0cd2ef26-4f17-439e-a94f-1292d9f56505 req-c73b18e1-ba21-4828-b217-21c91b5fd5a8 service nova] Acquiring lock "refresh_cache-a3319e68-8c91-404f-800b-6798fb16aa75" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:32:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-0cd2ef26-4f17-439e-a94f-1292d9f56505 req-c73b18e1-ba21-4828-b217-21c91b5fd5a8 service nova] Acquired lock "refresh_cache-a3319e68-8c91-404f-800b-6798fb16aa75" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:32:18 user nova-compute[72129]: DEBUG nova.network.neutron [req-0cd2ef26-4f17-439e-a94f-1292d9f56505 req-c73b18e1-ba21-4828-b217-21c91b5fd5a8 service nova] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Refreshing network info cache for port 9fa9db76-1de9-4e10-962f-7d1e07b9582d {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 14:32:18 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:32:18 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Starting heal instance info cache {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 14:32:18 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Didn't find any instances for network info cache update. {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 14:32:18 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:32:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-0c6ba7ea-a275-4267-b7de-cb3ae887e681 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Acquiring lock "a3319e68-8c91-404f-800b-6798fb16aa75" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:32:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-0c6ba7ea-a275-4267-b7de-cb3ae887e681 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Lock "a3319e68-8c91-404f-800b-6798fb16aa75" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:32:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-0c6ba7ea-a275-4267-b7de-cb3ae887e681 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Acquiring lock "a3319e68-8c91-404f-800b-6798fb16aa75-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:32:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-0c6ba7ea-a275-4267-b7de-cb3ae887e681 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Lock "a3319e68-8c91-404f-800b-6798fb16aa75-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:32:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-0c6ba7ea-a275-4267-b7de-cb3ae887e681 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Lock "a3319e68-8c91-404f-800b-6798fb16aa75-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:32:18 user nova-compute[72129]: INFO nova.compute.manager [None req-0c6ba7ea-a275-4267-b7de-cb3ae887e681 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Terminating instance
Aug 01 14:32:18 user nova-compute[72129]: DEBUG nova.compute.manager [None req-0c6ba7ea-a275-4267-b7de-cb3ae887e681 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Start destroying the instance on the hypervisor. {{(pid=72129) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 14:32:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:32:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:32:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:32:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:32:18 user nova-compute[72129]: DEBUG nova.compute.manager [req-5e3bb951-fe7f-47a8-ba98-463400b37ffd req-a4dfbbab-5a7f-42ac-aa4f-7cc1df95379e service nova] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Received event network-vif-unplugged-9fa9db76-1de9-4e10-962f-7d1e07b9582d {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:32:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-5e3bb951-fe7f-47a8-ba98-463400b37ffd req-a4dfbbab-5a7f-42ac-aa4f-7cc1df95379e service nova] Acquiring lock "a3319e68-8c91-404f-800b-6798fb16aa75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:32:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-5e3bb951-fe7f-47a8-ba98-463400b37ffd req-a4dfbbab-5a7f-42ac-aa4f-7cc1df95379e service nova] Lock "a3319e68-8c91-404f-800b-6798fb16aa75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:32:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-5e3bb951-fe7f-47a8-ba98-463400b37ffd req-a4dfbbab-5a7f-42ac-aa4f-7cc1df95379e service nova] Lock "a3319e68-8c91-404f-800b-6798fb16aa75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:32:18 user nova-compute[72129]: DEBUG nova.compute.manager [req-5e3bb951-fe7f-47a8-ba98-463400b37ffd req-a4dfbbab-5a7f-42ac-aa4f-7cc1df95379e service nova] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] No waiting events found dispatching network-vif-unplugged-9fa9db76-1de9-4e10-962f-7d1e07b9582d {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:32:18 user nova-compute[72129]: DEBUG nova.compute.manager [req-5e3bb951-fe7f-47a8-ba98-463400b37ffd req-a4dfbbab-5a7f-42ac-aa4f-7cc1df95379e service nova] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Received event network-vif-unplugged-9fa9db76-1de9-4e10-962f-7d1e07b9582d for instance with task_state deleting. {{(pid=72129) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 14:32:18 user nova-compute[72129]: DEBUG nova.network.neutron [req-0cd2ef26-4f17-439e-a94f-1292d9f56505 req-c73b18e1-ba21-4828-b217-21c91b5fd5a8 service nova] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Updated VIF entry in instance network info cache for port 9fa9db76-1de9-4e10-962f-7d1e07b9582d. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 14:32:18 user nova-compute[72129]: DEBUG nova.network.neutron [req-0cd2ef26-4f17-439e-a94f-1292d9f56505 req-c73b18e1-ba21-4828-b217-21c91b5fd5a8 service nova] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Updating instance_info_cache with network_info: [{"id": "9fa9db76-1de9-4e10-962f-7d1e07b9582d", "address": "fa:16:3e:ff:ce:94", "network": {"id": "d4ba0665-71f8-48a1-b3a2-2c73c2c7db3a", "bridge": "br-int", "label": "tempest-TestStampPattern-1150922129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a91b43b1394048719e2ed69f5c3ae94f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fa9db76-1d", "ovs_interfaceid": "9fa9db76-1de9-4e10-962f-7d1e07b9582d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:32:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-0cd2ef26-4f17-439e-a94f-1292d9f56505 req-c73b18e1-ba21-4828-b217-21c91b5fd5a8 service nova] Releasing lock "refresh_cache-a3319e68-8c91-404f-800b-6798fb16aa75" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:32:18 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Instance destroyed successfully.
Aug 01 14:32:18 user nova-compute[72129]: DEBUG nova.objects.instance [None req-0c6ba7ea-a275-4267-b7de-cb3ae887e681 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Lazy-loading 'resources' on Instance uuid a3319e68-8c91-404f-800b-6798fb16aa75 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:32:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-0c6ba7ea-a275-4267-b7de-cb3ae887e681 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:25:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1390289890',display_name='tempest-TestStampPattern-server-1390289890',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1390289890',id=49,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCwUi55JC6c3jIlHojlRSa1D75mKSh1IzavmHf9G22Ze9c8CmQkw8Ybb7RlOQs1lEv+npQyyXxQntVe596OJBfHyUJy8lfQ5nyhMK2bUKD87QJNIia//pC3lm7PdMjjyDQ==',key_name='tempest-TestStampPattern-1260661357',keypairs=<?>,launch_index=0,launched_at=2023-08-01T14:25:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a91b43b1394048719e2ed69f5c3ae94f',ramdisk_id='',reservation_id='r-m0y6keih',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1201126667',owner_user_name='tempest-TestStampPattern-1201126667-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T14:28:22Z,user_data=None,user_id='9bf10b1642e642658bec5d0ac60b7abe',uuid=a3319e68-8c91-404f-800b-6798fb16aa75,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9fa9db76-1de9-4e10-962f-7d1e07b9582d", "address": "fa:16:3e:ff:ce:94", "network": {"id": "d4ba0665-71f8-48a1-b3a2-2c73c2c7db3a", "bridge": "br-int", "label": "tempest-TestStampPattern-1150922129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a91b43b1394048719e2ed69f5c3ae94f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fa9db76-1d", "ovs_interfaceid": "9fa9db76-1de9-4e10-962f-7d1e07b9582d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 14:32:18 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-0c6ba7ea-a275-4267-b7de-cb3ae887e681 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Converting VIF {"id": "9fa9db76-1de9-4e10-962f-7d1e07b9582d", "address": "fa:16:3e:ff:ce:94", "network": {"id": "d4ba0665-71f8-48a1-b3a2-2c73c2c7db3a", "bridge": "br-int", "label": "tempest-TestStampPattern-1150922129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a91b43b1394048719e2ed69f5c3ae94f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fa9db76-1d", "ovs_interfaceid": "9fa9db76-1de9-4e10-962f-7d1e07b9582d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:32:18 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-0c6ba7ea-a275-4267-b7de-cb3ae887e681 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ff:ce:94,bridge_name='br-int',has_traffic_filtering=True,id=9fa9db76-1de9-4e10-962f-7d1e07b9582d,network=Network(d4ba0665-71f8-48a1-b3a2-2c73c2c7db3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fa9db76-1d') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:32:18 user nova-compute[72129]: DEBUG os_vif [None req-0c6ba7ea-a275-4267-b7de-cb3ae887e681 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:ce:94,bridge_name='br-int',has_traffic_filtering=True,id=9fa9db76-1de9-4e10-962f-7d1e07b9582d,network=Network(d4ba0665-71f8-48a1-b3a2-2c73c2c7db3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fa9db76-1d') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 14:32:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:32:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9fa9db76-1d, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:32:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:32:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:32:18 user nova-compute[72129]: INFO os_vif [None req-0c6ba7ea-a275-4267-b7de-cb3ae887e681 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:ce:94,bridge_name='br-int',has_traffic_filtering=True,id=9fa9db76-1de9-4e10-962f-7d1e07b9582d,network=Network(d4ba0665-71f8-48a1-b3a2-2c73c2c7db3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fa9db76-1d')
Aug 01 14:32:18 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-0c6ba7ea-a275-4267-b7de-cb3ae887e681 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Deleting instance files /opt/stack/data/nova/instances/a3319e68-8c91-404f-800b-6798fb16aa75_del
Aug 01 14:32:18 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-0c6ba7ea-a275-4267-b7de-cb3ae887e681 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Deletion of /opt/stack/data/nova/instances/a3319e68-8c91-404f-800b-6798fb16aa75_del complete
Aug 01 14:32:19 user nova-compute[72129]: INFO nova.compute.manager [None req-0c6ba7ea-a275-4267-b7de-cb3ae887e681 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 01 14:32:19 user nova-compute[72129]: DEBUG oslo.service.loopingcall [None req-0c6ba7ea-a275-4267-b7de-cb3ae887e681 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72129) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 14:32:19 user nova-compute[72129]: DEBUG nova.compute.manager [-] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Deallocating network for instance {{(pid=72129) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 14:32:19 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] deallocate_for_instance() {{(pid=72129) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 14:32:19 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:32:19 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Took 0.53 seconds to deallocate network for instance.
Aug 01 14:32:19 user nova-compute[72129]: DEBUG nova.compute.manager [req-6a2059d6-6498-4d55-9492-f57c234b2357 req-37b9e505-ff32-4a3f-a447-691c4d1ccb33 service nova] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Received event network-vif-deleted-9fa9db76-1de9-4e10-962f-7d1e07b9582d {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:32:19 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-0c6ba7ea-a275-4267-b7de-cb3ae887e681 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:32:19 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-0c6ba7ea-a275-4267-b7de-cb3ae887e681 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:32:19 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-0c6ba7ea-a275-4267-b7de-cb3ae887e681 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:32:19 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-0c6ba7ea-a275-4267-b7de-cb3ae887e681 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:32:19 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-0c6ba7ea-a275-4267-b7de-cb3ae887e681 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.124s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:32:19 user nova-compute[72129]: INFO nova.scheduler.client.report [None req-0c6ba7ea-a275-4267-b7de-cb3ae887e681 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Deleted allocations for instance a3319e68-8c91-404f-800b-6798fb16aa75
Aug 01 14:32:19 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-0c6ba7ea-a275-4267-b7de-cb3ae887e681 tempest-TestStampPattern-1201126667 tempest-TestStampPattern-1201126667-project-member] Lock "a3319e68-8c91-404f-800b-6798fb16aa75" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.735s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:32:20 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:32:20 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:32:20 user nova-compute[72129]: DEBUG nova.compute.manager [req-db68c47c-cbcb-49a6-abdd-2cecfe0b899d req-07a2bc2d-f32e-4f9a-9145-f2ed7f9fdded service nova] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Received event network-vif-plugged-9fa9db76-1de9-4e10-962f-7d1e07b9582d {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:32:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-db68c47c-cbcb-49a6-abdd-2cecfe0b899d req-07a2bc2d-f32e-4f9a-9145-f2ed7f9fdded service nova] Acquiring lock "a3319e68-8c91-404f-800b-6798fb16aa75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:32:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-db68c47c-cbcb-49a6-abdd-2cecfe0b899d req-07a2bc2d-f32e-4f9a-9145-f2ed7f9fdded service nova] Lock "a3319e68-8c91-404f-800b-6798fb16aa75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:32:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-db68c47c-cbcb-49a6-abdd-2cecfe0b899d req-07a2bc2d-f32e-4f9a-9145-f2ed7f9fdded service nova] Lock "a3319e68-8c91-404f-800b-6798fb16aa75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:32:20 user nova-compute[72129]: DEBUG nova.compute.manager [req-db68c47c-cbcb-49a6-abdd-2cecfe0b899d req-07a2bc2d-f32e-4f9a-9145-f2ed7f9fdded service nova] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] No waiting events found dispatching network-vif-plugged-9fa9db76-1de9-4e10-962f-7d1e07b9582d {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:32:20 user nova-compute[72129]: WARNING nova.compute.manager [req-db68c47c-cbcb-49a6-abdd-2cecfe0b899d req-07a2bc2d-f32e-4f9a-9145-f2ed7f9fdded service nova] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Received unexpected event network-vif-plugged-9fa9db76-1de9-4e10-962f-7d1e07b9582d for instance with vm_state deleted and task_state None.
Aug 01 14:32:23 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:32:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:32:28 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:32:33 user nova-compute[72129]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690900338.9367514, a3319e68-8c91-404f-800b-6798fb16aa75 => Stopped> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:32:33 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] VM Stopped (Lifecycle Event)
Aug 01 14:32:33 user nova-compute[72129]: DEBUG nova.compute.manager [None req-82242734-be81-4765-a1a4-53a68f1f1f23 None None] [instance: a3319e68-8c91-404f-800b-6798fb16aa75] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:32:33 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:32:33 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:32:33 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72129) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 14:32:33 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:32:33 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:32:33 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:32:37 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:32:38 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:32:43 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:32:48 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:32:48 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:32:48 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72129) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 14:32:48 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:32:48 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:32:48 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:32:53 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:32:58 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:33:03 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:33:03 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:33:03 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72129) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 14:33:03 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:33:03 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:33:03 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:33:07 user nova-compute[72129]: DEBUG nova.compute.manager [req-7eb06122-bba0-422f-b46f-8f816f7346da req-2d2b438b-32f6-4aeb-94c8-62cb2d7c55b8 service nova] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Received event network-changed-3e61efad-17e6-4ac4-b178-f806c8140bf3 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:33:07 user nova-compute[72129]: DEBUG nova.compute.manager [req-7eb06122-bba0-422f-b46f-8f816f7346da req-2d2b438b-32f6-4aeb-94c8-62cb2d7c55b8 service nova] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Refreshing instance network info cache due to event network-changed-3e61efad-17e6-4ac4-b178-f806c8140bf3. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 14:33:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-7eb06122-bba0-422f-b46f-8f816f7346da req-2d2b438b-32f6-4aeb-94c8-62cb2d7c55b8 service nova] Acquiring lock "refresh_cache-c4bc2711-d958-41e4-a596-f7a6260c3e25" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:33:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-7eb06122-bba0-422f-b46f-8f816f7346da req-2d2b438b-32f6-4aeb-94c8-62cb2d7c55b8 service nova] Acquired lock "refresh_cache-c4bc2711-d958-41e4-a596-f7a6260c3e25" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:33:07 user nova-compute[72129]: DEBUG nova.network.neutron [req-7eb06122-bba0-422f-b46f-8f816f7346da req-2d2b438b-32f6-4aeb-94c8-62cb2d7c55b8 service nova] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Refreshing network info cache for port 3e61efad-17e6-4ac4-b178-f806c8140bf3 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 14:33:07 user nova-compute[72129]: DEBUG nova.network.neutron [req-7eb06122-bba0-422f-b46f-8f816f7346da req-2d2b438b-32f6-4aeb-94c8-62cb2d7c55b8 service nova] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Updated VIF entry in instance network info cache for port 3e61efad-17e6-4ac4-b178-f806c8140bf3. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 14:33:07 user nova-compute[72129]: DEBUG nova.network.neutron [req-7eb06122-bba0-422f-b46f-8f816f7346da req-2d2b438b-32f6-4aeb-94c8-62cb2d7c55b8 service nova] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Updating instance_info_cache with network_info: [{"id": "3e61efad-17e6-4ac4-b178-f806c8140bf3", "address": "fa:16:3e:ec:fb:bd", "network": {"id": "0dcde27b-5262-470e-affe-12b66f49084a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-937126397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f2d02f947a94977aba1e77775ef5ffe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e61efad-17", "ovs_interfaceid": "3e61efad-17e6-4ac4-b178-f806c8140bf3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:33:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-7eb06122-bba0-422f-b46f-8f816f7346da req-2d2b438b-32f6-4aeb-94c8-62cb2d7c55b8 service nova] Releasing lock "refresh_cache-c4bc2711-d958-41e4-a596-f7a6260c3e25" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:33:08 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-415912a2-e2bf-4ebc-bbca-abe2d2455d99 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Acquiring lock "c4bc2711-d958-41e4-a596-f7a6260c3e25" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:33:08 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-415912a2-e2bf-4ebc-bbca-abe2d2455d99 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Lock "c4bc2711-d958-41e4-a596-f7a6260c3e25" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:33:08 user nova-compute[72129]: DEBUG nova.objects.instance [None req-415912a2-e2bf-4ebc-bbca-abe2d2455d99 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Lazy-loading 'flavor' on Instance uuid c4bc2711-d958-41e4-a596-f7a6260c3e25 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:33:08 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-415912a2-e2bf-4ebc-bbca-abe2d2455d99 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Lock "c4bc2711-d958-41e4-a596-f7a6260c3e25" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:33:08 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-415912a2-e2bf-4ebc-bbca-abe2d2455d99 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Acquiring lock "c4bc2711-d958-41e4-a596-f7a6260c3e25" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:33:08 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-415912a2-e2bf-4ebc-bbca-abe2d2455d99 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Lock "c4bc2711-d958-41e4-a596-f7a6260c3e25" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:33:08 user nova-compute[72129]: INFO nova.compute.manager [None req-415912a2-e2bf-4ebc-bbca-abe2d2455d99 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Attaching volume af8fbb62-77db-4563-9020-ad8d4f81484e to /dev/vdb
Aug 01 14:33:08 user nova-compute[72129]: DEBUG os_brick.utils [None req-415912a2-e2bf-4ebc-bbca-abe2d2455d99 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:33:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:33:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:33:08 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[118e53ad-7d74-432f-a498-3091024c21ef]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f9b449c2cd3d\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:33:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:33:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:33:08 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe06584-2187-4e02-81cc-349d0ea8642d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:33:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:33:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:33:08 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[0789c922-9354-4b11-9334-ad7c24cce768]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:33:08 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3c1b40-de16-4ad2-abba-3c14fa2d3801]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:33:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-415912a2-e2bf-4ebc-bbca-abe2d2455d99 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Running cmd (subprocess): nvme version {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:33:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-415912a2-e2bf-4ebc-bbca-abe2d2455d99 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] 'nvme version' failed. Not Retrying. {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 14:33:08 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.nvmeof [None req-415912a2-e2bf-4ebc-bbca-abe2d2455d99 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] nvme not present on system {{(pid=72129) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 14:33:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:33:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 14:33:08 user nova-compute[72129]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 14:33:08 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5d5863-d88e-4d83-aec3-7093c4e296e7]: (4, '') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:33:08 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-415912a2-e2bf-4ebc-bbca-abe2d2455d99 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72129) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 14:33:08 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-415912a2-e2bf-4ebc-bbca-abe2d2455d99 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 14:33:08 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-415912a2-e2bf-4ebc-bbca-abe2d2455d99 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] LIGHTOS: no hostnqn found. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 14:33:08 user nova-compute[72129]: DEBUG os_brick.utils [None req-415912a2-e2bf-4ebc-bbca-abe2d2455d99 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f9b449c2cd3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:33:08 user nova-compute[72129]: DEBUG nova.virt.block_device [None req-415912a2-e2bf-4ebc-bbca-abe2d2455d99 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Updating existing volume attachment record: fdb735fe-0ad6-4341-b600-b8489acfb309 {{(pid=72129) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 14:33:08 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:33:09 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:33:09 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72129) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 14:33:10 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:33:11 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:33:13 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:33:16 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:33:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:33:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:33:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:33:16 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Auditing locally available compute resources for user (node: user) {{(pid=72129) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 14:33:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4bc2711-d958-41e4-a596-f7a6260c3e25/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:33:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4bc2711-d958-41e4-a596-f7a6260c3e25/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:33:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4bc2711-d958-41e4-a596-f7a6260c3e25/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:33:16 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-415912a2-e2bf-4ebc-bbca-abe2d2455d99 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Calling os-brick to attach iSCSI Volume {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 14:33:16 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-415912a2-e2bf-4ebc-bbca-abe2d2455d99 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:af8fbb62-77db-4563-9020-ad8d4f81484e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TmSDNAhf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:33:16 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-415912a2-e2bf-4ebc-bbca-abe2d2455d99 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:33:16 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-415912a2-e2bf-4ebc-bbca-abe2d2455d99 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:33:16 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-415912a2-e2bf-4ebc-bbca-abe2d2455d99 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:33:16 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-415912a2-e2bf-4ebc-bbca-abe2d2455d99 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:33:16 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-415912a2-e2bf-4ebc-bbca-abe2d2455d99 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af8fbb62-77db-4563-9020-ad8d4f81484e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:33:16 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-415912a2-e2bf-4ebc-bbca-abe2d2455d99 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af8fbb62-77db-4563-9020-ad8d4f81484e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:33:16 user nova-compute[72129]: INFO os_brick.initiator.connectors.iscsi [None req-415912a2-e2bf-4ebc-bbca-abe2d2455d99 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 14:33:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af8fbb62-77db-4563-9020-ad8d4f81484e -p 172.16.0.220:3260 {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:33:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af8fbb62-77db-4563-9020-ad8d4f81484e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:33:16 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[61fc1eb6-0bcb-4c78-8e0c-68df8b7eef1d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:33:16 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-415912a2-e2bf-4ebc-bbca-abe2d2455d99 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 14:33:16 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:33:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af8fbb62-77db-4563-9020-ad8d4f81484e -p 172.16.0.220:3260 --interface default --op new {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:33:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af8fbb62-77db-4563-9020-ad8d4f81484e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.031s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:33:16 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[4483bc85-7359-4461-b4ac-0bcfdea1647d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af8fbb62-77db-4563-9020-ad8d4f81484e] added\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:33:16 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-415912a2-e2bf-4ebc-bbca-abe2d2455d99 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af8fbb62-77db-4563-9020-ad8d4f81484e] added
Aug 01 14:33:16 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:33:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af8fbb62-77db-4563-9020-ad8d4f81484e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:33:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af8fbb62-77db-4563-9020-ad8d4f81484e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:33:16 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93b587d-64a5-4765-8c3c-17c5cb32c6d9]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:33:16 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-415912a2-e2bf-4ebc-bbca-abe2d2455d99 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:33:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af8fbb62-77db-4563-9020-ad8d4f81484e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:33:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4bc2711-d958-41e4-a596-f7a6260c3e25/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:33:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af8fbb62-77db-4563-9020-ad8d4f81484e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:33:16 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[417cc9c0-722f-4fce-9403-e5438a9ed165]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:33:16 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-415912a2-e2bf-4ebc-bbca-abe2d2455d99 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:33:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af8fbb62-77db-4563-9020-ad8d4f81484e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TmSDNAhf {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:33:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af8fbb62-77db-4563-9020-ad8d4f81484e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TmSDNAhf" returned: 0 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:33:16 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ad604d-8858-4e2c-9948-027767bc1718]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:33:16 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-415912a2-e2bf-4ebc-bbca-abe2d2455d99 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TmSDNAhf'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:33:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af8fbb62-77db-4563-9020-ad8d4f81484e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:33:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:33:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:33:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af8fbb62-77db-4563-9020-ad8d4f81484e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:33:16 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c254d89b-cebf-40b3-bba9-93dbf0bc0c1d]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:33:16 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-415912a2-e2bf-4ebc-bbca-abe2d2455d99 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:33:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:33:16 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:33:16 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:33:16 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Hypervisor/Node resource view: name=user free_ram=8795MB free_disk=25.096092224121094GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72129) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 14:33:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:33:16 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:33:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:33:16 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[93dee600-8177-41a3-b73e-72937a68738b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:33:16 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-415912a2-e2bf-4ebc-bbca-abe2d2455d99 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 14:33:16 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:33:16 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-415912a2-e2bf-4ebc-bbca-abe2d2455d99 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 14:33:16 user nova-compute[72129]:  {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:33:16 user nova-compute[72129]: WARNING os_brick.initiator.connectors.iscsi [None req-415912a2-e2bf-4ebc-bbca-abe2d2455d99 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 14:33:16 user nova-compute[72129]: 
Aug 01 14:33:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af8fbb62-77db-4563-9020-ad8d4f81484e -p 172.16.0.220:3260 --login {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:33:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af8fbb62-77db-4563-9020-ad8d4f81484e -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:33:16 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[122180e8-19e0-45e6-9c40-212dc2026549]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:af8fbb62-77db-4563-9020-ad8d4f81484e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:af8fbb62-77db-4563-9020-ad8d4f81484e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:33:16 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-415912a2-e2bf-4ebc-bbca-abe2d2455d99 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:af8fbb62-77db-4563-9020-ad8d4f81484e, portal: 172.16.0.220,3260]
Aug 01 14:33:16 user nova-compute[72129]: Login to [iface: default, target: iqn.2010-10.org.openstack:af8fbb62-77db-4563-9020-ad8d4f81484e, portal: 172.16.0.220,3260] successful.
Aug 01 14:33:16 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:33:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af8fbb62-77db-4563-9020-ad8d4f81484e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:33:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af8fbb62-77db-4563-9020-ad8d4f81484e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:33:16 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e58db1-c608-496b-97ea-28d18b99cda5]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:33:16 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-415912a2-e2bf-4ebc-bbca-abe2d2455d99 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:33:16 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance c4bc2711-d958-41e4-a596-f7a6260c3e25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:33:16 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 14:33:16 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 14:33:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:33:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:33:16 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d42eab90-7eb6-42f5-a5e3-7ac3972e541f]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af8fbb62-77db-4563-9020-ad8d4f81484e (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:33:16 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-415912a2-e2bf-4ebc-bbca-abe2d2455d99 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af8fbb62-77db-4563-9020-ad8d4f81484e (non-flash)
Aug 01 14:33:16 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:33:16 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-415912a2-e2bf-4ebc-bbca-abe2d2455d99 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af8fbb62-77db-4563-9020-ad8d4f81484e (non-flash)
Aug 01 14:33:16 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:33:16 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-415912a2-e2bf-4ebc-bbca-abe2d2455d99 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af8fbb62-77db-4563-9020-ad8d4f81484e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.633s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:33:16 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-415912a2-e2bf-4ebc-bbca-abe2d2455d99 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Connected to 172.16.0.220:3260 {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 14:33:16 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-415912a2-e2bf-4ebc-bbca-abe2d2455d99 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=72129) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 14:33:16 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-415912a2-e2bf-4ebc-bbca-abe2d2455d99 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72129) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 14:33:16 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:33:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:33:17 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[869f473c-a5e7-488c-8450-edd20ddf0d00]: (4, ('- - 0', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:33:17 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-415912a2-e2bf-4ebc-bbca-abe2d2455d99 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 14:33:17 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-415912a2-e2bf-4ebc-bbca-abe2d2455d99 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TmSDNAhf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 14:33:17 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:33:17 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:33:17 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Compute_service record updated for user:user {{(pid=72129) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 14:33:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.239s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:33:18 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-415912a2-e2bf-4ebc-bbca-abe2d2455d99 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.669s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:33:18 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-415912a2-e2bf-4ebc-bbca-abe2d2455d99 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] <== connect_volume: return (1672ms) {'type': 'block', 'scsi_wwn': '23665376562393432', 'path': '/dev/sdb'} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:33:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-415912a2-e2bf-4ebc-bbca-abe2d2455d99 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23665376562393432', 'path': '/dev/sdb'} {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 14:33:18 user nova-compute[72129]: DEBUG nova.objects.instance [None req-415912a2-e2bf-4ebc-bbca-abe2d2455d99 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Lazy-loading 'flavor' on Instance uuid c4bc2711-d958-41e4-a596-f7a6260c3e25 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:33:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-415912a2-e2bf-4ebc-bbca-abe2d2455d99 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 14:33:18 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:33:18 user nova-compute[72129]:   <source dev="/dev/sdb"/>
Aug 01 14:33:18 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 14:33:18 user nova-compute[72129]:   <serial>af8fbb62-77db-4563-9020-ad8d4f81484e</serial>
Aug 01 14:33:18 user nova-compute[72129]: </disk>
Aug 01 14:33:18 user nova-compute[72129]:  {{(pid=72129) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 14:33:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-415912a2-e2bf-4ebc-bbca-abe2d2455d99 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:33:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-415912a2-e2bf-4ebc-bbca-abe2d2455d99 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:33:18 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-415912a2-e2bf-4ebc-bbca-abe2d2455d99 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] No VIF found with MAC fa:16:3e:ec:fb:bd, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 14:33:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-415912a2-e2bf-4ebc-bbca-abe2d2455d99 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Lock "c4bc2711-d958-41e4-a596-f7a6260c3e25" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.967s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:33:18 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:33:19 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:33:19 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:33:19 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Starting heal instance info cache {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 14:33:19 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Rebuilding the list of instances to heal {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 14:33:19 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "refresh_cache-c4bc2711-d958-41e4-a596-f7a6260c3e25" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:33:19 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquired lock "refresh_cache-c4bc2711-d958-41e4-a596-f7a6260c3e25" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:33:19 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Forcefully refreshing network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 14:33:19 user nova-compute[72129]: DEBUG nova.objects.instance [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lazy-loading 'info_cache' on Instance uuid c4bc2711-d958-41e4-a596-f7a6260c3e25 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:33:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:33:20 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Updating instance_info_cache with network_info: [{"id": "3e61efad-17e6-4ac4-b178-f806c8140bf3", "address": "fa:16:3e:ec:fb:bd", "network": {"id": "0dcde27b-5262-470e-affe-12b66f49084a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-937126397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f2d02f947a94977aba1e77775ef5ffe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e61efad-17", "ovs_interfaceid": "3e61efad-17e6-4ac4-b178-f806c8140bf3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:33:20 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Releasing lock "refresh_cache-c4bc2711-d958-41e4-a596-f7a6260c3e25" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:33:20 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Updated the network info_cache for instance {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 14:33:20 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:33:20 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:33:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:33:21 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:33:21 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:33:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-2a4bed8e-4df2-49fe-9dc2-bdc0d2068c54 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Acquiring lock "c4bc2711-d958-41e4-a596-f7a6260c3e25" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:33:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-2a4bed8e-4df2-49fe-9dc2-bdc0d2068c54 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Lock "c4bc2711-d958-41e4-a596-f7a6260c3e25" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:33:22 user nova-compute[72129]: DEBUG nova.objects.instance [None req-2a4bed8e-4df2-49fe-9dc2-bdc0d2068c54 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Lazy-loading 'flavor' on Instance uuid c4bc2711-d958-41e4-a596-f7a6260c3e25 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:33:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-2a4bed8e-4df2-49fe-9dc2-bdc0d2068c54 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Lock "c4bc2711-d958-41e4-a596-f7a6260c3e25" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:33:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-2a4bed8e-4df2-49fe-9dc2-bdc0d2068c54 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Acquiring lock "c4bc2711-d958-41e4-a596-f7a6260c3e25" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:33:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-2a4bed8e-4df2-49fe-9dc2-bdc0d2068c54 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Lock "c4bc2711-d958-41e4-a596-f7a6260c3e25" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:33:22 user nova-compute[72129]: INFO nova.compute.manager [None req-2a4bed8e-4df2-49fe-9dc2-bdc0d2068c54 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Attaching volume 3528e67b-2e6a-42a9-9e19-8c00c499eb2d to /dev/vdc
Aug 01 14:33:22 user nova-compute[72129]: DEBUG os_brick.utils [None req-2a4bed8e-4df2-49fe-9dc2-bdc0d2068c54 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:33:22 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:33:22 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:33:22 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d36b780-9f9d-4d31-81ee-8ce06a95e89f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f9b449c2cd3d\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:33:22 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:33:22 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:33:22 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea6f229-9503-42c6-bd4b-a218e48be54c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:33:22 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:33:22 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:33:22 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[94fa715e-8d92-4fdc-9c94-95a6dda92e7d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:33:22 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d19681-a879-4d48-8798-ca3e596764e2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:33:22 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-2a4bed8e-4df2-49fe-9dc2-bdc0d2068c54 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Running cmd (subprocess): nvme version {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:33:22 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-2a4bed8e-4df2-49fe-9dc2-bdc0d2068c54 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] 'nvme version' failed. Not Retrying. {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 14:33:22 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2a4bed8e-4df2-49fe-9dc2-bdc0d2068c54 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] nvme not present on system {{(pid=72129) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 14:33:22 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:33:22 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 14:33:22 user nova-compute[72129]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 14:33:22 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b8e079-81c8-4afc-891b-f6819db70711]: (4, '') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:33:22 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-2a4bed8e-4df2-49fe-9dc2-bdc0d2068c54 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72129) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 14:33:22 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-2a4bed8e-4df2-49fe-9dc2-bdc0d2068c54 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 14:33:22 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-2a4bed8e-4df2-49fe-9dc2-bdc0d2068c54 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] LIGHTOS: no hostnqn found. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 14:33:22 user nova-compute[72129]: DEBUG os_brick.utils [None req-2a4bed8e-4df2-49fe-9dc2-bdc0d2068c54 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f9b449c2cd3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:33:22 user nova-compute[72129]: DEBUG nova.virt.block_device [None req-2a4bed8e-4df2-49fe-9dc2-bdc0d2068c54 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Updating existing volume attachment record: 87900de2-475c-4923-8197-4b8c457aa05a {{(pid=72129) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 14:33:23 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:33:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:33:28 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:33:29 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a4bed8e-4df2-49fe-9dc2-bdc0d2068c54 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Calling os-brick to attach iSCSI Volume {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 14:33:29 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4bed8e-4df2-49fe-9dc2-bdc0d2068c54 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3528e67b-2e6a-42a9-9e19-8c00c499eb2d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UglDTIGw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:33:29 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-2a4bed8e-4df2-49fe-9dc2-bdc0d2068c54 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:33:29 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-2a4bed8e-4df2-49fe-9dc2-bdc0d2068c54 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:33:29 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-2a4bed8e-4df2-49fe-9dc2-bdc0d2068c54 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:33:29 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-2a4bed8e-4df2-49fe-9dc2-bdc0d2068c54 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:33:29 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-2a4bed8e-4df2-49fe-9dc2-bdc0d2068c54 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3528e67b-2e6a-42a9-9e19-8c00c499eb2d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:33:29 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-2a4bed8e-4df2-49fe-9dc2-bdc0d2068c54 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3528e67b-2e6a-42a9-9e19-8c00c499eb2d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:33:29 user nova-compute[72129]: INFO os_brick.initiator.connectors.iscsi [None req-2a4bed8e-4df2-49fe-9dc2-bdc0d2068c54 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 14:33:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3528e67b-2e6a-42a9-9e19-8c00c499eb2d -p 172.16.0.220:3260 {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:33:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3528e67b-2e6a-42a9-9e19-8c00c499eb2d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:33:29 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ee4ce1-9983-4208-97db-e05c61cba117]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:33:29 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4bed8e-4df2-49fe-9dc2-bdc0d2068c54 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 14:33:29 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:33:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3528e67b-2e6a-42a9-9e19-8c00c499eb2d -p 172.16.0.220:3260 --interface default --op new {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:33:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3528e67b-2e6a-42a9-9e19-8c00c499eb2d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:33:29 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf8acb0-c50b-4ced-9f65-592369bcc9f1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3528e67b-2e6a-42a9-9e19-8c00c499eb2d] added\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:33:29 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4bed8e-4df2-49fe-9dc2-bdc0d2068c54 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3528e67b-2e6a-42a9-9e19-8c00c499eb2d] added
Aug 01 14:33:29 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:33:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3528e67b-2e6a-42a9-9e19-8c00c499eb2d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:33:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3528e67b-2e6a-42a9-9e19-8c00c499eb2d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:33:29 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2dbfd4e-c648-496a-9a5e-fe70b765dbde]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:33:29 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4bed8e-4df2-49fe-9dc2-bdc0d2068c54 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:33:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3528e67b-2e6a-42a9-9e19-8c00c499eb2d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:33:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3528e67b-2e6a-42a9-9e19-8c00c499eb2d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:33:29 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[6328190f-c817-4bec-bdaf-cca481a25578]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:33:29 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4bed8e-4df2-49fe-9dc2-bdc0d2068c54 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:33:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3528e67b-2e6a-42a9-9e19-8c00c499eb2d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UglDTIGw {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:33:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3528e67b-2e6a-42a9-9e19-8c00c499eb2d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UglDTIGw" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:33:29 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[643943b6-caec-4999-96cd-9816d5ef7deb]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:33:29 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4bed8e-4df2-49fe-9dc2-bdc0d2068c54 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UglDTIGw'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:33:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3528e67b-2e6a-42a9-9e19-8c00c499eb2d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:33:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3528e67b-2e6a-42a9-9e19-8c00c499eb2d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:33:29 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[50bc7d70-8fe8-4aa9-93c6-7af96d333d7e]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:33:29 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4bed8e-4df2-49fe-9dc2-bdc0d2068c54 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:33:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:33:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:33:29 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac3e563-7849-4e04-9efe-48f662238f21]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af8fbb62-77db-4563-9020-ad8d4f81484e (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:33:29 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4bed8e-4df2-49fe-9dc2-bdc0d2068c54 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af8fbb62-77db-4563-9020-ad8d4f81484e (non-flash)
Aug 01 14:33:29 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:33:29 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4bed8e-4df2-49fe-9dc2-bdc0d2068c54 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af8fbb62-77db-4563-9020-ad8d4f81484e (non-flash)
Aug 01 14:33:29 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:33:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3528e67b-2e6a-42a9-9e19-8c00c499eb2d -p 172.16.0.220:3260 --login {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:33:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3528e67b-2e6a-42a9-9e19-8c00c499eb2d -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:33:29 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[e986b0fc-0376-4b7a-84f2-1d934f59841c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3528e67b-2e6a-42a9-9e19-8c00c499eb2d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3528e67b-2e6a-42a9-9e19-8c00c499eb2d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:33:29 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4bed8e-4df2-49fe-9dc2-bdc0d2068c54 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3528e67b-2e6a-42a9-9e19-8c00c499eb2d, portal: 172.16.0.220,3260]
Aug 01 14:33:29 user nova-compute[72129]: Login to [iface: default, target: iqn.2010-10.org.openstack:3528e67b-2e6a-42a9-9e19-8c00c499eb2d, portal: 172.16.0.220,3260] successful.
Aug 01 14:33:29 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:33:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3528e67b-2e6a-42a9-9e19-8c00c499eb2d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:33:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3528e67b-2e6a-42a9-9e19-8c00c499eb2d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:33:29 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c85715b0-1941-46e2-8eba-7b4a220b902c]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:33:29 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4bed8e-4df2-49fe-9dc2-bdc0d2068c54 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:33:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:33:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:33:29 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd051272-7fc0-4751-afcc-719917648411]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af8fbb62-77db-4563-9020-ad8d4f81484e (non-flash)\ntcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3528e67b-2e6a-42a9-9e19-8c00c499eb2d (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:33:29 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4bed8e-4df2-49fe-9dc2-bdc0d2068c54 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af8fbb62-77db-4563-9020-ad8d4f81484e (non-flash)
Aug 01 14:33:29 user nova-compute[72129]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3528e67b-2e6a-42a9-9e19-8c00c499eb2d (non-flash)
Aug 01 14:33:29 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:33:29 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4bed8e-4df2-49fe-9dc2-bdc0d2068c54 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af8fbb62-77db-4563-9020-ad8d4f81484e (non-flash)
Aug 01 14:33:29 user nova-compute[72129]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3528e67b-2e6a-42a9-9e19-8c00c499eb2d (non-flash)
Aug 01 14:33:29 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:33:29 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-2a4bed8e-4df2-49fe-9dc2-bdc0d2068c54 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3528e67b-2e6a-42a9-9e19-8c00c499eb2d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:33:29 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4bed8e-4df2-49fe-9dc2-bdc0d2068c54 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Connected to 172.16.0.220:3260 {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 14:33:29 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-2a4bed8e-4df2-49fe-9dc2-bdc0d2068c54 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] HCTL ('34', '-', '-', 0) found on session 62 with lun 0 {{(pid=72129) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 14:33:29 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-2a4bed8e-4df2-49fe-9dc2-bdc0d2068c54 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72129) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 14:33:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:33:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:33:29 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[186382ea-70ba-4a81-a8b0-6717e8326017]: (4, ('- - 0', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:33:29 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-2a4bed8e-4df2-49fe-9dc2-bdc0d2068c54 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Searching for a device in session 62 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 14:33:29 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4bed8e-4df2-49fe-9dc2-bdc0d2068c54 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UglDTIGw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 14:33:30 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-2a4bed8e-4df2-49fe-9dc2-bdc0d2068c54 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:33:30 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4bed8e-4df2-49fe-9dc2-bdc0d2068c54 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '23065356437306431', 'path': '/dev/sdc'} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:33:30 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a4bed8e-4df2-49fe-9dc2-bdc0d2068c54 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23065356437306431', 'path': '/dev/sdc'} {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 14:33:30 user nova-compute[72129]: DEBUG nova.objects.instance [None req-2a4bed8e-4df2-49fe-9dc2-bdc0d2068c54 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Lazy-loading 'flavor' on Instance uuid c4bc2711-d958-41e4-a596-f7a6260c3e25 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:33:30 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-2a4bed8e-4df2-49fe-9dc2-bdc0d2068c54 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 14:33:30 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:33:30 user nova-compute[72129]:   <source dev="/dev/sdc"/>
Aug 01 14:33:30 user nova-compute[72129]:   <target dev="vdc" bus="virtio"/>
Aug 01 14:33:30 user nova-compute[72129]:   <serial>3528e67b-2e6a-42a9-9e19-8c00c499eb2d</serial>
Aug 01 14:33:30 user nova-compute[72129]: </disk>
Aug 01 14:33:30 user nova-compute[72129]:  {{(pid=72129) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 14:33:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-2a4bed8e-4df2-49fe-9dc2-bdc0d2068c54 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:33:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-2a4bed8e-4df2-49fe-9dc2-bdc0d2068c54 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:33:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-2a4bed8e-4df2-49fe-9dc2-bdc0d2068c54 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:33:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-2a4bed8e-4df2-49fe-9dc2-bdc0d2068c54 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] No VIF found with MAC fa:16:3e:ec:fb:bd, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 14:33:31 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-2a4bed8e-4df2-49fe-9dc2-bdc0d2068c54 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Lock "c4bc2711-d958-41e4-a596-f7a6260c3e25" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.102s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:33:32 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-69ac578f-d1e8-4dda-8019-34fb65ab26c0 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Acquiring lock "c4bc2711-d958-41e4-a596-f7a6260c3e25" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:33:32 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-69ac578f-d1e8-4dda-8019-34fb65ab26c0 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Lock "c4bc2711-d958-41e4-a596-f7a6260c3e25" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:33:32 user nova-compute[72129]: INFO nova.compute.manager [None req-69ac578f-d1e8-4dda-8019-34fb65ab26c0 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Detaching volume 3528e67b-2e6a-42a9-9e19-8c00c499eb2d
Aug 01 14:33:32 user nova-compute[72129]: INFO nova.virt.block_device [None req-69ac578f-d1e8-4dda-8019-34fb65ab26c0 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Attempting to driver detach volume 3528e67b-2e6a-42a9-9e19-8c00c499eb2d from mountpoint /dev/vdc
Aug 01 14:33:32 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-69ac578f-d1e8-4dda-8019-34fb65ab26c0 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Attempting to detach device vdc from instance c4bc2711-d958-41e4-a596-f7a6260c3e25 from the persistent domain config. {{(pid=72129) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 14:33:32 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-69ac578f-d1e8-4dda-8019-34fb65ab26c0 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 14:33:32 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:33:32 user nova-compute[72129]:   <source dev="/dev/sdc"/>
Aug 01 14:33:32 user nova-compute[72129]:   <target dev="vdc" bus="virtio"/>
Aug 01 14:33:32 user nova-compute[72129]:   <serial>3528e67b-2e6a-42a9-9e19-8c00c499eb2d</serial>
Aug 01 14:33:32 user nova-compute[72129]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 01 14:33:32 user nova-compute[72129]: </disk>
Aug 01 14:33:32 user nova-compute[72129]:  {{(pid=72129) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 14:33:32 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-69ac578f-d1e8-4dda-8019-34fb65ab26c0 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Successfully detached device vdc from instance c4bc2711-d958-41e4-a596-f7a6260c3e25 from the persistent domain config.
Aug 01 14:33:32 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-69ac578f-d1e8-4dda-8019-34fb65ab26c0 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance c4bc2711-d958-41e4-a596-f7a6260c3e25 from the live domain config. {{(pid=72129) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 14:33:32 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-69ac578f-d1e8-4dda-8019-34fb65ab26c0 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 14:33:32 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:33:32 user nova-compute[72129]:   <source dev="/dev/sdc"/>
Aug 01 14:33:32 user nova-compute[72129]:   <target dev="vdc" bus="virtio"/>
Aug 01 14:33:32 user nova-compute[72129]:   <serial>3528e67b-2e6a-42a9-9e19-8c00c499eb2d</serial>
Aug 01 14:33:32 user nova-compute[72129]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 01 14:33:32 user nova-compute[72129]: </disk>
Aug 01 14:33:32 user nova-compute[72129]:  {{(pid=72129) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 14:33:32 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Received event <DeviceRemovedEvent: 1690900412.883742, c4bc2711-d958-41e4-a596-f7a6260c3e25 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72129) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 14:33:32 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-69ac578f-d1e8-4dda-8019-34fb65ab26c0 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance c4bc2711-d958-41e4-a596-f7a6260c3e25 {{(pid=72129) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 14:33:32 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-69ac578f-d1e8-4dda-8019-34fb65ab26c0 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Successfully detached device vdc from instance c4bc2711-d958-41e4-a596-f7a6260c3e25 from the live domain config.
Aug 01 14:33:32 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69ac578f-d1e8-4dda-8019-34fb65ab26c0 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] calling os-brick to detach iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 14:33:32 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-69ac578f-d1e8-4dda-8019-34fb65ab26c0 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, {'target_iqns': ['iqn.2010-10.org.openstack:3528e67b-2e6a-42a9-9e19-8c00c499eb2d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UglDTIGw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:33:32 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-69ac578f-d1e8-4dda-8019-34fb65ab26c0 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:33:32 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-69ac578f-d1e8-4dda-8019-34fb65ab26c0 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:33:32 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-69ac578f-d1e8-4dda-8019-34fb65ab26c0 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:33:32 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-69ac578f-d1e8-4dda-8019-34fb65ab26c0 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3528e67b-2e6a-42a9-9e19-8c00c499eb2d', 0)] {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 14:33:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:33:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:33:32 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ab594c-b575-49f1-92bf-4d8a72f3d833]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3528e67b-2e6a-42a9-9e19-8c00c499eb2d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af8fbb62-77db-4563-9020-ad8d4f81484e\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:33:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:33:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:33:32 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[45482be7-ba86-4459-a6b4-5f873b38fa21]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af8fbb62-77db-4563-9020-ad8d4f81484e (non-flash)\ntcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3528e67b-2e6a-42a9-9e19-8c00c499eb2d (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:33:32 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-69ac578f-d1e8-4dda-8019-34fb65ab26c0 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af8fbb62-77db-4563-9020-ad8d4f81484e (non-flash)
Aug 01 14:33:32 user nova-compute[72129]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3528e67b-2e6a-42a9-9e19-8c00c499eb2d (non-flash)
Aug 01 14:33:32 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:33:32 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-69ac578f-d1e8-4dda-8019-34fb65ab26c0 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af8fbb62-77db-4563-9020-ad8d4f81484e (non-flash)
Aug 01 14:33:32 user nova-compute[72129]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3528e67b-2e6a-42a9-9e19-8c00c499eb2d (non-flash)
Aug 01 14:33:32 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:33:32 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-69ac578f-d1e8-4dda-8019-34fb65ab26c0 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f28200f6440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3528e67b-2e6a-42a9-9e19-8c00c499eb2d'): ({'sdc'}, set())}) {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 14:33:32 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-69ac578f-d1e8-4dda-8019-34fb65ab26c0 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Removing single pathed devices sdc {{(pid=72129) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 14:33:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:33:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:33:32 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[71aaed43-ca75-4546-b060-12f80f267187]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:33:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:33:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:33:32 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a7fdb6-adbe-4f6b-a7a2-2d27d4cf042b]: (4, ('ok\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:33:32 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-69ac578f-d1e8-4dda-8019-34fb65ab26c0 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Flushing IO for device /dev/sdc {{(pid=72129) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 14:33:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:33:33 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:33:33 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd4dcafe-f866-460b-bd4d-e00f0735754b]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:33:33 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-69ac578f-d1e8-4dda-8019-34fb65ab26c0 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72129) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 14:33:33 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:33:33 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:33:33 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e8ce308-1224-4d5d-bbc8-ad7a7e38fb69]: (4, ('1', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:33:33 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-69ac578f-d1e8-4dda-8019-34fb65ab26c0 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 14:33:33 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-69ac578f-d1e8-4dda-8019-34fb65ab26c0 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] SCSI volumes sdc have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 14:33:33 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-69ac578f-d1e8-4dda-8019-34fb65ab26c0 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3528e67b-2e6a-42a9-9e19-8c00c499eb2d')] {{(pid=72129) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 14:33:33 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3528e67b-2e6a-42a9-9e19-8c00c499eb2d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:33:33 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3528e67b-2e6a-42a9-9e19-8c00c499eb2d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:33:33 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4109d19-33b0-4918-adb8-2ec3edae260f]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:33:33 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-69ac578f-d1e8-4dda-8019-34fb65ab26c0 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:33:33 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3528e67b-2e6a-42a9-9e19-8c00c499eb2d -p 172.16.0.220:3260 --logout {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:33:33 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3528e67b-2e6a-42a9-9e19-8c00c499eb2d -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:33:33 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[919695c2-e9ed-4498-b322-6a73105d8b8e]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:3528e67b-2e6a-42a9-9e19-8c00c499eb2d, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:3528e67b-2e6a-42a9-9e19-8c00c499eb2d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:33:33 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-69ac578f-d1e8-4dda-8019-34fb65ab26c0 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:3528e67b-2e6a-42a9-9e19-8c00c499eb2d, portal: 172.16.0.220,3260]
Aug 01 14:33:33 user nova-compute[72129]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:3528e67b-2e6a-42a9-9e19-8c00c499eb2d, portal: 172.16.0.220,3260] successful.
Aug 01 14:33:33 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:33:33 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3528e67b-2e6a-42a9-9e19-8c00c499eb2d -p 172.16.0.220:3260 --op delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:33:33 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3528e67b-2e6a-42a9-9e19-8c00c499eb2d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:33:33 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ba6744-6b89-4886-8256-3e78840c56b5]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:33:33 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-69ac578f-d1e8-4dda-8019-34fb65ab26c0 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:33:33 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-69ac578f-d1e8-4dda-8019-34fb65ab26c0 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:33:33 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-69ac578f-d1e8-4dda-8019-34fb65ab26c0 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] <== disconnect_volume: return (285ms) None {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:33:33 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69ac578f-d1e8-4dda-8019-34fb65ab26c0 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Disconnected iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 14:33:33 user nova-compute[72129]: DEBUG nova.objects.instance [None req-69ac578f-d1e8-4dda-8019-34fb65ab26c0 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Lazy-loading 'flavor' on Instance uuid c4bc2711-d958-41e4-a596-f7a6260c3e25 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:33:33 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-69ac578f-d1e8-4dda-8019-34fb65ab26c0 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Lock "c4bc2711-d958-41e4-a596-f7a6260c3e25" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.625s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:33:34 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:33:34 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:33:34 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72129) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 14:33:34 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:33:34 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:33:34 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:33:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:33:41 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:33:44 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:33:49 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:33:54 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:33:59 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:34:04 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:34:09 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:34:09 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72129) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 14:34:09 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:34:11 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:34:14 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:34:17 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:34:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:34:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:34:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:34:17 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Auditing locally available compute resources for user (node: user) {{(pid=72129) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 14:34:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4bc2711-d958-41e4-a596-f7a6260c3e25/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:34:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4bc2711-d958-41e4-a596-f7a6260c3e25/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:34:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4bc2711-d958-41e4-a596-f7a6260c3e25/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:34:17 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4bc2711-d958-41e4-a596-f7a6260c3e25/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:34:17 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 14:34:17 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:34:17 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:34:17 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Hypervisor/Node resource view: name=user free_ram=8877MB free_disk=25.094398498535156GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72129) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 14:34:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:34:17 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:34:17 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance c4bc2711-d958-41e4-a596-f7a6260c3e25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:34:17 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 14:34:17 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 14:34:18 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:34:18 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:34:18 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Compute_service record updated for user:user {{(pid=72129) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 14:34:18 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.173s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:34:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:34:20 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:34:20 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:34:21 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:34:21 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:34:21 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Starting heal instance info cache {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 14:34:21 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Rebuilding the list of instances to heal {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 14:34:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "refresh_cache-c4bc2711-d958-41e4-a596-f7a6260c3e25" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:34:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquired lock "refresh_cache-c4bc2711-d958-41e4-a596-f7a6260c3e25" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:34:21 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Forcefully refreshing network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 14:34:21 user nova-compute[72129]: DEBUG nova.objects.instance [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lazy-loading 'info_cache' on Instance uuid c4bc2711-d958-41e4-a596-f7a6260c3e25 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:34:21 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Updating instance_info_cache with network_info: [{"id": "3e61efad-17e6-4ac4-b178-f806c8140bf3", "address": "fa:16:3e:ec:fb:bd", "network": {"id": "0dcde27b-5262-470e-affe-12b66f49084a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-937126397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f2d02f947a94977aba1e77775ef5ffe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e61efad-17", "ovs_interfaceid": "3e61efad-17e6-4ac4-b178-f806c8140bf3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:34:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Releasing lock "refresh_cache-c4bc2711-d958-41e4-a596-f7a6260c3e25" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:34:21 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Updated the network info_cache for instance {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 14:34:21 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:34:21 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:34:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-f0ee9e22-4041-4042-bf25-a00811795f9f tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Acquiring lock "c4bc2711-d958-41e4-a596-f7a6260c3e25" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:34:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-f0ee9e22-4041-4042-bf25-a00811795f9f tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Lock "c4bc2711-d958-41e4-a596-f7a6260c3e25" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:34:22 user nova-compute[72129]: INFO nova.compute.manager [None req-f0ee9e22-4041-4042-bf25-a00811795f9f tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Detaching volume af8fbb62-77db-4563-9020-ad8d4f81484e
Aug 01 14:34:22 user nova-compute[72129]: INFO nova.virt.block_device [None req-f0ee9e22-4041-4042-bf25-a00811795f9f tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Attempting to driver detach volume af8fbb62-77db-4563-9020-ad8d4f81484e from mountpoint /dev/vdb
Aug 01 14:34:22 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-f0ee9e22-4041-4042-bf25-a00811795f9f tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Attempting to detach device vdb from instance c4bc2711-d958-41e4-a596-f7a6260c3e25 from the persistent domain config. {{(pid=72129) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 14:34:22 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-f0ee9e22-4041-4042-bf25-a00811795f9f tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 14:34:22 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:34:22 user nova-compute[72129]:   <source dev="/dev/sdb"/>
Aug 01 14:34:22 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 14:34:22 user nova-compute[72129]:   <serial>af8fbb62-77db-4563-9020-ad8d4f81484e</serial>
Aug 01 14:34:22 user nova-compute[72129]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 14:34:22 user nova-compute[72129]: </disk>
Aug 01 14:34:22 user nova-compute[72129]:  {{(pid=72129) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 14:34:22 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-f0ee9e22-4041-4042-bf25-a00811795f9f tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Successfully detached device vdb from instance c4bc2711-d958-41e4-a596-f7a6260c3e25 from the persistent domain config.
Aug 01 14:34:22 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-f0ee9e22-4041-4042-bf25-a00811795f9f tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c4bc2711-d958-41e4-a596-f7a6260c3e25 from the live domain config. {{(pid=72129) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 14:34:22 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-f0ee9e22-4041-4042-bf25-a00811795f9f tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 14:34:22 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:34:22 user nova-compute[72129]:   <source dev="/dev/sdb"/>
Aug 01 14:34:22 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 14:34:22 user nova-compute[72129]:   <serial>af8fbb62-77db-4563-9020-ad8d4f81484e</serial>
Aug 01 14:34:22 user nova-compute[72129]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 14:34:22 user nova-compute[72129]: </disk>
Aug 01 14:34:22 user nova-compute[72129]:  {{(pid=72129) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 14:34:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Received event <DeviceRemovedEvent: 1690900463.410924, c4bc2711-d958-41e4-a596-f7a6260c3e25 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72129) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 14:34:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-f0ee9e22-4041-4042-bf25-a00811795f9f tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c4bc2711-d958-41e4-a596-f7a6260c3e25 {{(pid=72129) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 14:34:23 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-f0ee9e22-4041-4042-bf25-a00811795f9f tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Successfully detached device vdb from instance c4bc2711-d958-41e4-a596-f7a6260c3e25 from the live domain config.
Aug 01 14:34:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0ee9e22-4041-4042-bf25-a00811795f9f tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] calling os-brick to detach iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 14:34:23 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ee9e22-4041-4042-bf25-a00811795f9f tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, {'target_iqns': ['iqn.2010-10.org.openstack:af8fbb62-77db-4563-9020-ad8d4f81484e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TmSDNAhf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:34:23 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-f0ee9e22-4041-4042-bf25-a00811795f9f tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:34:23 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-f0ee9e22-4041-4042-bf25-a00811795f9f tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:34:23 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-f0ee9e22-4041-4042-bf25-a00811795f9f tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:34:23 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ee9e22-4041-4042-bf25-a00811795f9f tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af8fbb62-77db-4563-9020-ad8d4f81484e', 0)] {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 14:34:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:34:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:34:23 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d91a4fd-5a91-4a8e-b04a-210f23649a7b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af8fbb62-77db-4563-9020-ad8d4f81484e\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:34:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:34:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:34:23 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8ea63e-ab61-48be-a450-a5a88d0cb54b]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af8fbb62-77db-4563-9020-ad8d4f81484e (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:34:23 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ee9e22-4041-4042-bf25-a00811795f9f tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af8fbb62-77db-4563-9020-ad8d4f81484e (non-flash)
Aug 01 14:34:23 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:34:23 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ee9e22-4041-4042-bf25-a00811795f9f tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af8fbb62-77db-4563-9020-ad8d4f81484e (non-flash)
Aug 01 14:34:23 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:34:23 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ee9e22-4041-4042-bf25-a00811795f9f tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f282833b5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af8fbb62-77db-4563-9020-ad8d4f81484e'): ({'sdb'}, set())}) {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 14:34:23 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-f0ee9e22-4041-4042-bf25-a00811795f9f tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Removing single pathed devices sdb {{(pid=72129) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 14:34:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:34:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:34:23 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[4600d5cb-b691-49f7-b6cc-ee88629abf27]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:34:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:34:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:34:23 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3c54ea-d420-4bc6-b862-0c6b4ab63a2e]: (4, ('ok\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:34:23 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-f0ee9e22-4041-4042-bf25-a00811795f9f tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Flushing IO for device /dev/sdb {{(pid=72129) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 14:34:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:34:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:34:23 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d3c47c5-0bad-4efb-af5b-36739f058e21]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:34:23 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-f0ee9e22-4041-4042-bf25-a00811795f9f tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72129) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 14:34:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:34:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:34:23 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3dbb9f-b834-4670-9228-06de707d6ea4]: (4, ('1', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:34:23 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-f0ee9e22-4041-4042-bf25-a00811795f9f tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 14:34:23 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-f0ee9e22-4041-4042-bf25-a00811795f9f tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] SCSI volumes sdb have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 14:34:23 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ee9e22-4041-4042-bf25-a00811795f9f tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af8fbb62-77db-4563-9020-ad8d4f81484e')] {{(pid=72129) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 14:34:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af8fbb62-77db-4563-9020-ad8d4f81484e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:34:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af8fbb62-77db-4563-9020-ad8d4f81484e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:34:23 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bcd504f-6b55-4ce6-8eab-b5664750f5c4]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:34:23 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ee9e22-4041-4042-bf25-a00811795f9f tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:34:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af8fbb62-77db-4563-9020-ad8d4f81484e -p 172.16.0.220:3260 --logout {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:34:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af8fbb62-77db-4563-9020-ad8d4f81484e -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:34:23 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b834b372-2ce2-4332-97d6-403f99893506]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:af8fbb62-77db-4563-9020-ad8d4f81484e, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:af8fbb62-77db-4563-9020-ad8d4f81484e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:34:23 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ee9e22-4041-4042-bf25-a00811795f9f tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:af8fbb62-77db-4563-9020-ad8d4f81484e, portal: 172.16.0.220,3260]
Aug 01 14:34:23 user nova-compute[72129]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:af8fbb62-77db-4563-9020-ad8d4f81484e, portal: 172.16.0.220,3260] successful.
Aug 01 14:34:23 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:34:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af8fbb62-77db-4563-9020-ad8d4f81484e -p 172.16.0.220:3260 --op delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:34:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af8fbb62-77db-4563-9020-ad8d4f81484e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:34:23 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb030f62-ff00-4adf-9b68-a016270dd539]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:34:23 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ee9e22-4041-4042-bf25-a00811795f9f tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:34:23 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-f0ee9e22-4041-4042-bf25-a00811795f9f tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.266s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:34:23 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ee9e22-4041-4042-bf25-a00811795f9f tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] <== disconnect_volume: return (267ms) None {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:34:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0ee9e22-4041-4042-bf25-a00811795f9f tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Disconnected iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 14:34:24 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:34:24 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:34:24 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72129) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 14:34:24 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:34:24 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:34:24 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:34:24 user nova-compute[72129]: DEBUG nova.objects.instance [None req-f0ee9e22-4041-4042-bf25-a00811795f9f tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Lazy-loading 'flavor' on Instance uuid c4bc2711-d958-41e4-a596-f7a6260c3e25 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:34:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-f0ee9e22-4041-4042-bf25-a00811795f9f tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Lock "c4bc2711-d958-41e4-a596-f7a6260c3e25" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.573s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:34:27 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:34:29 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:34:34 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:34:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:34:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:34:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72129) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 14:34:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:34:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:34:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:34:44 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:34:49 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:34:54 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:34:59 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:35:04 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:35:09 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:35:09 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:35:09 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72129) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 14:35:09 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:35:09 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:35:09 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:35:11 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:35:11 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:35:11 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72129) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 14:35:13 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-dc58d74d-23e7-4956-a012-5fe8e4d598b7 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Acquiring lock "c4bc2711-d958-41e4-a596-f7a6260c3e25" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:35:13 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-dc58d74d-23e7-4956-a012-5fe8e4d598b7 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Lock "c4bc2711-d958-41e4-a596-f7a6260c3e25" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:35:13 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-dc58d74d-23e7-4956-a012-5fe8e4d598b7 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Acquiring lock "c4bc2711-d958-41e4-a596-f7a6260c3e25-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:35:13 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-dc58d74d-23e7-4956-a012-5fe8e4d598b7 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Lock "c4bc2711-d958-41e4-a596-f7a6260c3e25-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:35:13 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-dc58d74d-23e7-4956-a012-5fe8e4d598b7 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Lock "c4bc2711-d958-41e4-a596-f7a6260c3e25-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:35:13 user nova-compute[72129]: INFO nova.compute.manager [None req-dc58d74d-23e7-4956-a012-5fe8e4d598b7 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Terminating instance
Aug 01 14:35:13 user nova-compute[72129]: DEBUG nova.compute.manager [None req-dc58d74d-23e7-4956-a012-5fe8e4d598b7 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Start destroying the instance on the hypervisor. {{(pid=72129) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 14:35:13 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:35:13 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:35:13 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:35:13 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:35:13 user nova-compute[72129]: DEBUG nova.compute.manager [req-392116dc-c6ff-4fb7-89e0-9cb017230684 req-504aa143-f266-4ad7-ba0f-0455f10cbeeb service nova] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Received event network-vif-unplugged-3e61efad-17e6-4ac4-b178-f806c8140bf3 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:35:13 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-392116dc-c6ff-4fb7-89e0-9cb017230684 req-504aa143-f266-4ad7-ba0f-0455f10cbeeb service nova] Acquiring lock "c4bc2711-d958-41e4-a596-f7a6260c3e25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:35:13 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-392116dc-c6ff-4fb7-89e0-9cb017230684 req-504aa143-f266-4ad7-ba0f-0455f10cbeeb service nova] Lock "c4bc2711-d958-41e4-a596-f7a6260c3e25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:35:13 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-392116dc-c6ff-4fb7-89e0-9cb017230684 req-504aa143-f266-4ad7-ba0f-0455f10cbeeb service nova] Lock "c4bc2711-d958-41e4-a596-f7a6260c3e25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:35:13 user nova-compute[72129]: DEBUG nova.compute.manager [req-392116dc-c6ff-4fb7-89e0-9cb017230684 req-504aa143-f266-4ad7-ba0f-0455f10cbeeb service nova] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] No waiting events found dispatching network-vif-unplugged-3e61efad-17e6-4ac4-b178-f806c8140bf3 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:35:13 user nova-compute[72129]: DEBUG nova.compute.manager [req-392116dc-c6ff-4fb7-89e0-9cb017230684 req-504aa143-f266-4ad7-ba0f-0455f10cbeeb service nova] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Received event network-vif-unplugged-3e61efad-17e6-4ac4-b178-f806c8140bf3 for instance with task_state deleting. {{(pid=72129) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 14:35:13 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:35:14 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Instance destroyed successfully.
Aug 01 14:35:14 user nova-compute[72129]: DEBUG nova.objects.instance [None req-dc58d74d-23e7-4956-a012-5fe8e4d598b7 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Lazy-loading 'resources' on Instance uuid c4bc2711-d958-41e4-a596-f7a6260c3e25 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:35:14 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-dc58d74d-23e7-4956-a012-5fe8e4d598b7 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:31:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-710368898',display_name='tempest-TestServerVolumeAttachmentScenario-server-710368898',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-710368898',id=51,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA0acstFhS8UNcYpcaJEQ9OEAiWpOL8opPzw0hn0rePKQYlQIjScO1cFWlQwDpXdSwKjYmkhn39XqpQICyB5VZ5rJsPPWTSvYoedvU9DPO2vgFcGWc5OGn+Nk0717VpWsw==',key_name='tempest-keypair-1272737235',keypairs=<?>,launch_index=0,launched_at=2023-08-01T14:31:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3f2d02f947a94977aba1e77775ef5ffe',ramdisk_id='',reservation_id='r-tu5ibal8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1472719378',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1472719378-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T14:31:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb400f977eb64fa7bbf4493103649386',uuid=c4bc2711-d958-41e4-a596-f7a6260c3e25,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3e61efad-17e6-4ac4-b178-f806c8140bf3", "address": "fa:16:3e:ec:fb:bd", "network": {"id": "0dcde27b-5262-470e-affe-12b66f49084a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-937126397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f2d02f947a94977aba1e77775ef5ffe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e61efad-17", "ovs_interfaceid": "3e61efad-17e6-4ac4-b178-f806c8140bf3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 14:35:14 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-dc58d74d-23e7-4956-a012-5fe8e4d598b7 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Converting VIF {"id": "3e61efad-17e6-4ac4-b178-f806c8140bf3", "address": "fa:16:3e:ec:fb:bd", "network": {"id": "0dcde27b-5262-470e-affe-12b66f49084a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-937126397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f2d02f947a94977aba1e77775ef5ffe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e61efad-17", "ovs_interfaceid": "3e61efad-17e6-4ac4-b178-f806c8140bf3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:35:14 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-dc58d74d-23e7-4956-a012-5fe8e4d598b7 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:fb:bd,bridge_name='br-int',has_traffic_filtering=True,id=3e61efad-17e6-4ac4-b178-f806c8140bf3,network=Network(0dcde27b-5262-470e-affe-12b66f49084a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e61efad-17') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:35:14 user nova-compute[72129]: DEBUG os_vif [None req-dc58d74d-23e7-4956-a012-5fe8e4d598b7 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:fb:bd,bridge_name='br-int',has_traffic_filtering=True,id=3e61efad-17e6-4ac4-b178-f806c8140bf3,network=Network(0dcde27b-5262-470e-affe-12b66f49084a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e61efad-17') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 14:35:14 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:35:14 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3e61efad-17, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:35:14 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:35:14 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:35:14 user nova-compute[72129]: INFO os_vif [None req-dc58d74d-23e7-4956-a012-5fe8e4d598b7 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:fb:bd,bridge_name='br-int',has_traffic_filtering=True,id=3e61efad-17e6-4ac4-b178-f806c8140bf3,network=Network(0dcde27b-5262-470e-affe-12b66f49084a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e61efad-17')
Aug 01 14:35:14 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-dc58d74d-23e7-4956-a012-5fe8e4d598b7 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Deleting instance files /opt/stack/data/nova/instances/c4bc2711-d958-41e4-a596-f7a6260c3e25_del
Aug 01 14:35:14 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-dc58d74d-23e7-4956-a012-5fe8e4d598b7 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Deletion of /opt/stack/data/nova/instances/c4bc2711-d958-41e4-a596-f7a6260c3e25_del complete
Aug 01 14:35:14 user nova-compute[72129]: INFO nova.compute.manager [None req-dc58d74d-23e7-4956-a012-5fe8e4d598b7 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 01 14:35:14 user nova-compute[72129]: DEBUG oslo.service.loopingcall [None req-dc58d74d-23e7-4956-a012-5fe8e4d598b7 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72129) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 14:35:14 user nova-compute[72129]: DEBUG nova.compute.manager [-] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Deallocating network for instance {{(pid=72129) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 14:35:14 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] deallocate_for_instance() {{(pid=72129) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 14:35:15 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:35:15 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Took 0.98 seconds to deallocate network for instance.
Aug 01 14:35:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-dc58d74d-23e7-4956-a012-5fe8e4d598b7 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:35:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-dc58d74d-23e7-4956-a012-5fe8e4d598b7 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:35:15 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-dc58d74d-23e7-4956-a012-5fe8e4d598b7 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:35:15 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-dc58d74d-23e7-4956-a012-5fe8e4d598b7 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:35:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-dc58d74d-23e7-4956-a012-5fe8e4d598b7 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.121s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:35:15 user nova-compute[72129]: INFO nova.scheduler.client.report [None req-dc58d74d-23e7-4956-a012-5fe8e4d598b7 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Deleted allocations for instance c4bc2711-d958-41e4-a596-f7a6260c3e25
Aug 01 14:35:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-dc58d74d-23e7-4956-a012-5fe8e4d598b7 tempest-TestServerVolumeAttachmentScenario-1472719378 tempest-TestServerVolumeAttachmentScenario-1472719378-project-member] Lock "c4bc2711-d958-41e4-a596-f7a6260c3e25" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.190s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:35:15 user nova-compute[72129]: DEBUG nova.compute.manager [req-d15dd3e6-d10a-4768-8717-f292175e8796 req-06470ed3-8d95-4546-a9ee-f90e56ab84b8 service nova] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Received event network-vif-plugged-3e61efad-17e6-4ac4-b178-f806c8140bf3 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:35:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-d15dd3e6-d10a-4768-8717-f292175e8796 req-06470ed3-8d95-4546-a9ee-f90e56ab84b8 service nova] Acquiring lock "c4bc2711-d958-41e4-a596-f7a6260c3e25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:35:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-d15dd3e6-d10a-4768-8717-f292175e8796 req-06470ed3-8d95-4546-a9ee-f90e56ab84b8 service nova] Lock "c4bc2711-d958-41e4-a596-f7a6260c3e25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:35:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-d15dd3e6-d10a-4768-8717-f292175e8796 req-06470ed3-8d95-4546-a9ee-f90e56ab84b8 service nova] Lock "c4bc2711-d958-41e4-a596-f7a6260c3e25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:35:15 user nova-compute[72129]: DEBUG nova.compute.manager [req-d15dd3e6-d10a-4768-8717-f292175e8796 req-06470ed3-8d95-4546-a9ee-f90e56ab84b8 service nova] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] No waiting events found dispatching network-vif-plugged-3e61efad-17e6-4ac4-b178-f806c8140bf3 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:35:15 user nova-compute[72129]: WARNING nova.compute.manager [req-d15dd3e6-d10a-4768-8717-f292175e8796 req-06470ed3-8d95-4546-a9ee-f90e56ab84b8 service nova] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Received unexpected event network-vif-plugged-3e61efad-17e6-4ac4-b178-f806c8140bf3 for instance with vm_state deleted and task_state None.
Aug 01 14:35:15 user nova-compute[72129]: DEBUG nova.compute.manager [req-d15dd3e6-d10a-4768-8717-f292175e8796 req-06470ed3-8d95-4546-a9ee-f90e56ab84b8 service nova] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Received event network-vif-deleted-3e61efad-17e6-4ac4-b178-f806c8140bf3 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:35:19 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:35:19 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:35:19 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:35:19 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:35:19 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Auditing locally available compute resources for user (node: user) {{(pid=72129) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 14:35:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:35:19 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:35:19 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:35:19 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Hypervisor/Node resource view: name=user free_ram=9001MB free_disk=25.12145233154297GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72129) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 14:35:19 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:35:19 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:35:19 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 14:35:19 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 14:35:19 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:35:19 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:35:19 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Compute_service record updated for user:user {{(pid=72129) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 14:35:19 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.131s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:35:20 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:35:21 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:35:21 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:35:21 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Starting heal instance info cache {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 14:35:21 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Rebuilding the list of instances to heal {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 14:35:21 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Didn't find any instances for network info cache update. {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 14:35:21 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:35:22 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:35:23 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:35:24 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:35:24 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:35:24 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72129) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 14:35:24 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:35:24 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:35:24 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:35:29 user nova-compute[72129]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690900514.0040956, c4bc2711-d958-41e4-a596-f7a6260c3e25 => Stopped> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:35:29 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] VM Stopped (Lifecycle Event)
Aug 01 14:35:29 user nova-compute[72129]: DEBUG nova.compute.manager [None req-64bd7277-4fc3-41ee-aaba-ec09a91053a3 None None] [instance: c4bc2711-d958-41e4-a596-f7a6260c3e25] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:35:29 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:35:34 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:35:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:35:44 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:35:49 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:35:54 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:35:59 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:35:59 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:35:59 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72129) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 14:35:59 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:35:59 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:35:59 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:36:04 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:36:04 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:36:09 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:36:11 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:36:11 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72129) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 14:36:12 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:36:14 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:36:14 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:36:14 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72129) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 14:36:14 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:36:14 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:36:14 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:36:17 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:36:19 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:36:19 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:36:19 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:36:19 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:36:19 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Auditing locally available compute resources for user (node: user) {{(pid=72129) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 14:36:19 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:36:19 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:36:19 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:36:19 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Hypervisor/Node resource view: name=user free_ram=9026MB free_disk=25.12038803100586GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72129) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 14:36:19 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:36:19 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:36:19 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 14:36:19 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 14:36:19 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Refreshing inventories for resource provider c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 14:36:19 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Updating ProviderTree inventory for provider c2f345c3-9b82-4164-b21d-1eef8e661842 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 14:36:19 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Updating inventory in ProviderTree for provider c2f345c3-9b82-4164-b21d-1eef8e661842 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 14:36:19 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Refreshing aggregate associations for resource provider c2f345c3-9b82-4164-b21d-1eef8e661842, aggregates: None {{(pid=72129) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 14:36:19 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Refreshing trait associations for resource provider c2f345c3-9b82-4164-b21d-1eef8e661842, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE {{(pid=72129) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 14:36:19 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:36:19 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:36:19 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Compute_service record updated for user:user {{(pid=72129) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 14:36:19 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.328s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:36:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:36:21 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:36:22 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:36:22 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Starting heal instance info cache {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 14:36:22 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Rebuilding the list of instances to heal {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 14:36:22 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Didn't find any instances for network info cache update. {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 14:36:22 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:36:23 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:36:23 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:36:24 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:36:25 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:36:29 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:36:29 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:36:29 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72129) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 14:36:29 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:36:29 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:36:29 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:36:31 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:36:33 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:36:34 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:36:39 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:36:44 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:36:44 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72129) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 14:36:44 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:36:49 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:36:49 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:36:51 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:36:52 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:36:53 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:36:53 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Cleaning up deleted instances {{(pid=72129) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 14:36:53 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] There are 0 instances to clean {{(pid=72129) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 14:36:54 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:36:56 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:36:58 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:36:58 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:36:59 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:37:01 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:37:02 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:37:04 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:37:06 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:37:08 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Acquiring lock "7b5266f7-4c4e-47c6-ae9f-de91882367d8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:37:08 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lock "7b5266f7-4c4e-47c6-ae9f-de91882367d8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:37:08 user nova-compute[72129]: DEBUG nova.compute.manager [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Starting instance... {{(pid=72129) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 14:37:08 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:37:08 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:37:08 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72129) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 14:37:08 user nova-compute[72129]: INFO nova.compute.claims [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Claim successful on node user
Aug 01 14:37:08 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:37:08 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:37:08 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.209s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:37:08 user nova-compute[72129]: DEBUG nova.compute.manager [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Start building networks asynchronously for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 14:37:08 user nova-compute[72129]: DEBUG nova.compute.manager [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Allocating IP information in the background. {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 14:37:08 user nova-compute[72129]: DEBUG nova.network.neutron [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] allocate_for_instance() {{(pid=72129) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 14:37:08 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 14:37:08 user nova-compute[72129]: DEBUG nova.compute.manager [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Start building block device mappings for instance. {{(pid=72129) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 14:37:08 user nova-compute[72129]: DEBUG nova.compute.manager [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Start spawning the instance on the hypervisor. {{(pid=72129) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 14:37:08 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Creating instance directory {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 14:37:08 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Creating image(s)
Aug 01 14:37:08 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Acquiring lock "/opt/stack/data/nova/instances/7b5266f7-4c4e-47c6-ae9f-de91882367d8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:37:08 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lock "/opt/stack/data/nova/instances/7b5266f7-4c4e-47c6-ae9f-de91882367d8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:37:08 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lock "/opt/stack/data/nova/instances/7b5266f7-4c4e-47c6-ae9f-de91882367d8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:37:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:37:08 user nova-compute[72129]: DEBUG nova.policy [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '46ae3bdbb1a9473fa0f5b875c8d6ed40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d4bd37adfe64390a8923850d99aa534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72129) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 14:37:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.148s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:37:08 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Acquiring lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:37:08 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:37:08 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:37:09 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:37:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.243s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:37:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/7b5266f7-4c4e-47c6-ae9f-de91882367d8/disk 1073741824 {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:37:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1,backing_fmt=raw /opt/stack/data/nova/instances/7b5266f7-4c4e-47c6-ae9f-de91882367d8/disk 1073741824" returned: 0 in 0.069s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:37:09 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lock "3fd3c074fc53a830c0e0382b4996e9d134bb03d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.317s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:37:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:37:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3fd3c074fc53a830c0e0382b4996e9d134bb03d1 --force-share --output=json" returned: 0 in 0.149s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:37:09 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7b5266f7-4c4e-47c6-ae9f-de91882367d8/disk. size=1073741824 {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 14:37:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b5266f7-4c4e-47c6-ae9f-de91882367d8/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:37:09 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b5266f7-4c4e-47c6-ae9f-de91882367d8/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:37:09 user nova-compute[72129]: DEBUG nova.virt.disk.api [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Cannot resize image /opt/stack/data/nova/instances/7b5266f7-4c4e-47c6-ae9f-de91882367d8/disk to a smaller size. {{(pid=72129) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 14:37:09 user nova-compute[72129]: DEBUG nova.objects.instance [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lazy-loading 'migration_context' on Instance uuid 7b5266f7-4c4e-47c6-ae9f-de91882367d8 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:37:09 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Created local disks {{(pid=72129) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 14:37:09 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Ensure instance console log exists: /opt/stack/data/nova/instances/7b5266f7-4c4e-47c6-ae9f-de91882367d8/console.log {{(pid=72129) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 14:37:09 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:37:09 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:37:09 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:37:09 user nova-compute[72129]: DEBUG nova.network.neutron [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Successfully created port: b32c7e0b-2091-4c3d-bb68-05ea41b0b054 {{(pid=72129) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 14:37:10 user nova-compute[72129]: DEBUG nova.network.neutron [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Successfully updated port: b32c7e0b-2091-4c3d-bb68-05ea41b0b054 {{(pid=72129) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 14:37:10 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Acquiring lock "refresh_cache-7b5266f7-4c4e-47c6-ae9f-de91882367d8" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:37:10 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Acquired lock "refresh_cache-7b5266f7-4c4e-47c6-ae9f-de91882367d8" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:37:10 user nova-compute[72129]: DEBUG nova.network.neutron [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Building network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 14:37:10 user nova-compute[72129]: DEBUG nova.compute.manager [req-6ce5422d-eeed-493e-ba38-dacd91af5647 req-ba9856d2-067c-490b-b47f-8bf5e2367ec6 service nova] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Received event network-changed-b32c7e0b-2091-4c3d-bb68-05ea41b0b054 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:37:10 user nova-compute[72129]: DEBUG nova.compute.manager [req-6ce5422d-eeed-493e-ba38-dacd91af5647 req-ba9856d2-067c-490b-b47f-8bf5e2367ec6 service nova] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Refreshing instance network info cache due to event network-changed-b32c7e0b-2091-4c3d-bb68-05ea41b0b054. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 14:37:10 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-6ce5422d-eeed-493e-ba38-dacd91af5647 req-ba9856d2-067c-490b-b47f-8bf5e2367ec6 service nova] Acquiring lock "refresh_cache-7b5266f7-4c4e-47c6-ae9f-de91882367d8" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:37:10 user nova-compute[72129]: DEBUG nova.network.neutron [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Instance cache missing network info. {{(pid=72129) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 14:37:11 user nova-compute[72129]: DEBUG nova.network.neutron [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Updating instance_info_cache with network_info: [{"id": "b32c7e0b-2091-4c3d-bb68-05ea41b0b054", "address": "fa:16:3e:5a:79:44", "network": {"id": "ab6c1e03-f49f-473e-800f-75b628d68520", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1630528208-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d4bd37adfe64390a8923850d99aa534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32c7e0b-20", "ovs_interfaceid": "b32c7e0b-2091-4c3d-bb68-05ea41b0b054", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:37:11 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Releasing lock "refresh_cache-7b5266f7-4c4e-47c6-ae9f-de91882367d8" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:37:11 user nova-compute[72129]: DEBUG nova.compute.manager [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Instance network_info: |[{"id": "b32c7e0b-2091-4c3d-bb68-05ea41b0b054", "address": "fa:16:3e:5a:79:44", "network": {"id": "ab6c1e03-f49f-473e-800f-75b628d68520", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1630528208-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d4bd37adfe64390a8923850d99aa534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32c7e0b-20", "ovs_interfaceid": "b32c7e0b-2091-4c3d-bb68-05ea41b0b054", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72129) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 14:37:11 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-6ce5422d-eeed-493e-ba38-dacd91af5647 req-ba9856d2-067c-490b-b47f-8bf5e2367ec6 service nova] Acquired lock "refresh_cache-7b5266f7-4c4e-47c6-ae9f-de91882367d8" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:37:11 user nova-compute[72129]: DEBUG nova.network.neutron [req-6ce5422d-eeed-493e-ba38-dacd91af5647 req-ba9856d2-067c-490b-b47f-8bf5e2367ec6 service nova] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Refreshing network info cache for port b32c7e0b-2091-4c3d-bb68-05ea41b0b054 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 14:37:11 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Start _get_guest_xml network_info=[{"id": "b32c7e0b-2091-4c3d-bb68-05ea41b0b054", "address": "fa:16:3e:5a:79:44", "network": {"id": "ab6c1e03-f49f-473e-800f-75b628d68520", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1630528208-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d4bd37adfe64390a8923850d99aa534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32c7e0b-20", "ovs_interfaceid": "b32c7e0b-2091-4c3d-bb68-05ea41b0b054", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'disk_bus': 'virtio', 'size': 0, 'image_id': 'b6472c34-1b0f-4034-ba3a-7e8eb5103715'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 14:37:11 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:37:11 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:37:11 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 14:37:11 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] CPU controller missing on host. {{(pid=72129) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 14:37:11 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 14:37:11 user nova-compute[72129]: DEBUG nova.virt.libvirt.host [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] CPU controller found on host. {{(pid=72129) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 14:37:11 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72129) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 14:37:11 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T13:45:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T13:45:59Z,direct_url=<?>,disk_format='qcow2',id=b6472c34-1b0f-4034-ba3a-7e8eb5103715,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c51a048b091340dab769abbab323121d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T13:46:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 14:37:11 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Flavor limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 14:37:11 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Image limits 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 14:37:11 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Flavor pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 14:37:11 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Image pref 0:0:0 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 14:37:11 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 14:37:11 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 14:37:11 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 14:37:11 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Got 1 possible topologies {{(pid=72129) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 14:37:11 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 14:37:11 user nova-compute[72129]: DEBUG nova.virt.hardware [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72129) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 14:37:11 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:37:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1333244913',display_name='tempest-SnapshotDataIntegrityTests-server-1333244913',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1333244913',id=52,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4qfhRfUAgGTJD4U5bIAuThWZrdvTM5El2Fh53H3141MBL5DCvI7o1K+Kxugag8SwQtuHtvDqyx18oh4mX5IroBlLLbn4l7AQIUrCFEcqaOg3XAcEEi+Q5Qr3Zv4bNv1A==',key_name='tempest-keypair-634626118',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7d4bd37adfe64390a8923850d99aa534',ramdisk_id='',reservation_id='r-1fiw344i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-365166466',owner_user_name='tempest-SnapshotDataIntegrityTests-365166466-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T14:37:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='46ae3bdbb1a9473fa0f5b875c8d6ed40',uuid=7b5266f7-4c4e-47c6-ae9f-de91882367d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b32c7e0b-2091-4c3d-bb68-05ea41b0b054", "address": "fa:16:3e:5a:79:44", "network": {"id": "ab6c1e03-f49f-473e-800f-75b628d68520", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1630528208-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d4bd37adfe64390a8923850d99aa534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32c7e0b-20", "ovs_interfaceid": "b32c7e0b-2091-4c3d-bb68-05ea41b0b054", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72129) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 14:37:11 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Converting VIF {"id": "b32c7e0b-2091-4c3d-bb68-05ea41b0b054", "address": "fa:16:3e:5a:79:44", "network": {"id": "ab6c1e03-f49f-473e-800f-75b628d68520", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1630528208-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d4bd37adfe64390a8923850d99aa534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32c7e0b-20", "ovs_interfaceid": "b32c7e0b-2091-4c3d-bb68-05ea41b0b054", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:37:11 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:79:44,bridge_name='br-int',has_traffic_filtering=True,id=b32c7e0b-2091-4c3d-bb68-05ea41b0b054,network=Network(ab6c1e03-f49f-473e-800f-75b628d68520),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb32c7e0b-20') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:37:11 user nova-compute[72129]: DEBUG nova.objects.instance [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lazy-loading 'pci_devices' on Instance uuid 7b5266f7-4c4e-47c6-ae9f-de91882367d8 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:37:11 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] End _get_guest_xml xml=<domain type="kvm">
Aug 01 14:37:11 user nova-compute[72129]:   <uuid>7b5266f7-4c4e-47c6-ae9f-de91882367d8</uuid>
Aug 01 14:37:11 user nova-compute[72129]:   <name>instance-00000034</name>
Aug 01 14:37:11 user nova-compute[72129]:   <memory>524288</memory>
Aug 01 14:37:11 user nova-compute[72129]:   <vcpu>1</vcpu>
Aug 01 14:37:11 user nova-compute[72129]:   <metadata>
Aug 01 14:37:11 user nova-compute[72129]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 14:37:11 user nova-compute[72129]:       <nova:package version="0.0.0"/>
Aug 01 14:37:11 user nova-compute[72129]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1333244913</nova:name>
Aug 01 14:37:11 user nova-compute[72129]:       <nova:creationTime>2023-08-01 14:37:11</nova:creationTime>
Aug 01 14:37:11 user nova-compute[72129]:       <nova:flavor name="m1.tiny">
Aug 01 14:37:11 user nova-compute[72129]:         <nova:memory>512</nova:memory>
Aug 01 14:37:11 user nova-compute[72129]:         <nova:disk>1</nova:disk>
Aug 01 14:37:11 user nova-compute[72129]:         <nova:swap>0</nova:swap>
Aug 01 14:37:11 user nova-compute[72129]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 14:37:11 user nova-compute[72129]:         <nova:vcpus>1</nova:vcpus>
Aug 01 14:37:11 user nova-compute[72129]:       </nova:flavor>
Aug 01 14:37:11 user nova-compute[72129]:       <nova:owner>
Aug 01 14:37:11 user nova-compute[72129]:         <nova:user uuid="46ae3bdbb1a9473fa0f5b875c8d6ed40">tempest-SnapshotDataIntegrityTests-365166466-project-member</nova:user>
Aug 01 14:37:11 user nova-compute[72129]:         <nova:project uuid="7d4bd37adfe64390a8923850d99aa534">tempest-SnapshotDataIntegrityTests-365166466</nova:project>
Aug 01 14:37:11 user nova-compute[72129]:       </nova:owner>
Aug 01 14:37:11 user nova-compute[72129]:       <nova:root type="image" uuid="b6472c34-1b0f-4034-ba3a-7e8eb5103715"/>
Aug 01 14:37:11 user nova-compute[72129]:       <nova:ports>
Aug 01 14:37:11 user nova-compute[72129]:         <nova:port uuid="b32c7e0b-2091-4c3d-bb68-05ea41b0b054">
Aug 01 14:37:11 user nova-compute[72129]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 01 14:37:11 user nova-compute[72129]:         </nova:port>
Aug 01 14:37:11 user nova-compute[72129]:       </nova:ports>
Aug 01 14:37:11 user nova-compute[72129]:     </nova:instance>
Aug 01 14:37:11 user nova-compute[72129]:   </metadata>
Aug 01 14:37:11 user nova-compute[72129]:   <sysinfo type="smbios">
Aug 01 14:37:11 user nova-compute[72129]:     <system>
Aug 01 14:37:11 user nova-compute[72129]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 14:37:11 user nova-compute[72129]:       <entry name="product">OpenStack Nova</entry>
Aug 01 14:37:11 user nova-compute[72129]:       <entry name="version">0.0.0</entry>
Aug 01 14:37:11 user nova-compute[72129]:       <entry name="serial">7b5266f7-4c4e-47c6-ae9f-de91882367d8</entry>
Aug 01 14:37:11 user nova-compute[72129]:       <entry name="uuid">7b5266f7-4c4e-47c6-ae9f-de91882367d8</entry>
Aug 01 14:37:11 user nova-compute[72129]:       <entry name="family">Virtual Machine</entry>
Aug 01 14:37:11 user nova-compute[72129]:     </system>
Aug 01 14:37:11 user nova-compute[72129]:   </sysinfo>
Aug 01 14:37:11 user nova-compute[72129]:   <os>
Aug 01 14:37:11 user nova-compute[72129]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 14:37:11 user nova-compute[72129]:     <boot dev="hd"/>
Aug 01 14:37:11 user nova-compute[72129]:     <smbios mode="sysinfo"/>
Aug 01 14:37:11 user nova-compute[72129]:   </os>
Aug 01 14:37:11 user nova-compute[72129]:   <features>
Aug 01 14:37:11 user nova-compute[72129]:     <acpi/>
Aug 01 14:37:11 user nova-compute[72129]:     <apic/>
Aug 01 14:37:11 user nova-compute[72129]:     <vmcoreinfo/>
Aug 01 14:37:11 user nova-compute[72129]:   </features>
Aug 01 14:37:11 user nova-compute[72129]:   <clock offset="utc">
Aug 01 14:37:11 user nova-compute[72129]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 14:37:11 user nova-compute[72129]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 14:37:11 user nova-compute[72129]:     <timer name="hpet" present="no"/>
Aug 01 14:37:11 user nova-compute[72129]:   </clock>
Aug 01 14:37:11 user nova-compute[72129]:   <cpu mode="custom" match="exact">
Aug 01 14:37:11 user nova-compute[72129]:     <model>Nehalem</model>
Aug 01 14:37:11 user nova-compute[72129]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 14:37:11 user nova-compute[72129]:   </cpu>
Aug 01 14:37:11 user nova-compute[72129]:   <devices>
Aug 01 14:37:11 user nova-compute[72129]:     <disk type="file" device="disk">
Aug 01 14:37:11 user nova-compute[72129]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 14:37:11 user nova-compute[72129]:       <source file="/opt/stack/data/nova/instances/7b5266f7-4c4e-47c6-ae9f-de91882367d8/disk"/>
Aug 01 14:37:11 user nova-compute[72129]:       <target dev="vda" bus="virtio"/>
Aug 01 14:37:11 user nova-compute[72129]:     </disk>
Aug 01 14:37:11 user nova-compute[72129]:     <interface type="ethernet">
Aug 01 14:37:11 user nova-compute[72129]:       <mac address="fa:16:3e:5a:79:44"/>
Aug 01 14:37:11 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:37:11 user nova-compute[72129]:       <mtu size="1442"/>
Aug 01 14:37:11 user nova-compute[72129]:       <target dev="tapb32c7e0b-20"/>
Aug 01 14:37:11 user nova-compute[72129]:     </interface>
Aug 01 14:37:11 user nova-compute[72129]:     <serial type="pty">
Aug 01 14:37:11 user nova-compute[72129]:       <log file="/opt/stack/data/nova/instances/7b5266f7-4c4e-47c6-ae9f-de91882367d8/console.log" append="off"/>
Aug 01 14:37:11 user nova-compute[72129]:     </serial>
Aug 01 14:37:11 user nova-compute[72129]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 14:37:11 user nova-compute[72129]:     <video>
Aug 01 14:37:11 user nova-compute[72129]:       <model type="virtio"/>
Aug 01 14:37:11 user nova-compute[72129]:     </video>
Aug 01 14:37:11 user nova-compute[72129]:     <rng model="virtio">
Aug 01 14:37:11 user nova-compute[72129]:       <backend model="random">/dev/urandom</backend>
Aug 01 14:37:11 user nova-compute[72129]:     </rng>
Aug 01 14:37:11 user nova-compute[72129]:     <controller type="usb" index="0" model="none"/>
Aug 01 14:37:11 user nova-compute[72129]:     <memballoon model="virtio">
Aug 01 14:37:11 user nova-compute[72129]:       <stats period="10"/>
Aug 01 14:37:11 user nova-compute[72129]:     </memballoon>
Aug 01 14:37:11 user nova-compute[72129]:   </devices>
Aug 01 14:37:11 user nova-compute[72129]: </domain>
Aug 01 14:37:11 user nova-compute[72129]:  {{(pid=72129) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 14:37:11 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:37:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1333244913',display_name='tempest-SnapshotDataIntegrityTests-server-1333244913',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1333244913',id=52,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4qfhRfUAgGTJD4U5bIAuThWZrdvTM5El2Fh53H3141MBL5DCvI7o1K+Kxugag8SwQtuHtvDqyx18oh4mX5IroBlLLbn4l7AQIUrCFEcqaOg3XAcEEi+Q5Qr3Zv4bNv1A==',key_name='tempest-keypair-634626118',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7d4bd37adfe64390a8923850d99aa534',ramdisk_id='',reservation_id='r-1fiw344i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-365166466',owner_user_name='tempest-SnapshotDataIntegrityTests-365166466-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T14:37:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='46ae3bdbb1a9473fa0f5b875c8d6ed40',uuid=7b5266f7-4c4e-47c6-ae9f-de91882367d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b32c7e0b-2091-4c3d-bb68-05ea41b0b054", "address": "fa:16:3e:5a:79:44", "network": {"id": "ab6c1e03-f49f-473e-800f-75b628d68520", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1630528208-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d4bd37adfe64390a8923850d99aa534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32c7e0b-20", "ovs_interfaceid": "b32c7e0b-2091-4c3d-bb68-05ea41b0b054", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 14:37:11 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Converting VIF {"id": "b32c7e0b-2091-4c3d-bb68-05ea41b0b054", "address": "fa:16:3e:5a:79:44", "network": {"id": "ab6c1e03-f49f-473e-800f-75b628d68520", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1630528208-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d4bd37adfe64390a8923850d99aa534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32c7e0b-20", "ovs_interfaceid": "b32c7e0b-2091-4c3d-bb68-05ea41b0b054", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:37:11 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:79:44,bridge_name='br-int',has_traffic_filtering=True,id=b32c7e0b-2091-4c3d-bb68-05ea41b0b054,network=Network(ab6c1e03-f49f-473e-800f-75b628d68520),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb32c7e0b-20') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:37:11 user nova-compute[72129]: DEBUG os_vif [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:79:44,bridge_name='br-int',has_traffic_filtering=True,id=b32c7e0b-2091-4c3d-bb68-05ea41b0b054,network=Network(ab6c1e03-f49f-473e-800f-75b628d68520),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb32c7e0b-20') {{(pid=72129) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 14:37:11 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:37:11 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:37:11 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 14:37:11 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:37:11 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb32c7e0b-20, may_exist=True, interface_attrs={}) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:37:11 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb32c7e0b-20, col_values=(('external_ids', {'iface-id': 'b32c7e0b-2091-4c3d-bb68-05ea41b0b054', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:79:44', 'vm-uuid': '7b5266f7-4c4e-47c6-ae9f-de91882367d8'}),), if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:37:11 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:37:11 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:37:11 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:37:11 user nova-compute[72129]: INFO os_vif [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:79:44,bridge_name='br-int',has_traffic_filtering=True,id=b32c7e0b-2091-4c3d-bb68-05ea41b0b054,network=Network(ab6c1e03-f49f-473e-800f-75b628d68520),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb32c7e0b-20')
Aug 01 14:37:11 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:37:11 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] No VIF found with MAC fa:16:3e:5a:79:44, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 14:37:11 user nova-compute[72129]: DEBUG nova.network.neutron [req-6ce5422d-eeed-493e-ba38-dacd91af5647 req-ba9856d2-067c-490b-b47f-8bf5e2367ec6 service nova] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Updated VIF entry in instance network info cache for port b32c7e0b-2091-4c3d-bb68-05ea41b0b054. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 14:37:11 user nova-compute[72129]: DEBUG nova.network.neutron [req-6ce5422d-eeed-493e-ba38-dacd91af5647 req-ba9856d2-067c-490b-b47f-8bf5e2367ec6 service nova] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Updating instance_info_cache with network_info: [{"id": "b32c7e0b-2091-4c3d-bb68-05ea41b0b054", "address": "fa:16:3e:5a:79:44", "network": {"id": "ab6c1e03-f49f-473e-800f-75b628d68520", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1630528208-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d4bd37adfe64390a8923850d99aa534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32c7e0b-20", "ovs_interfaceid": "b32c7e0b-2091-4c3d-bb68-05ea41b0b054", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:37:12 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-6ce5422d-eeed-493e-ba38-dacd91af5647 req-ba9856d2-067c-490b-b47f-8bf5e2367ec6 service nova] Releasing lock "refresh_cache-7b5266f7-4c4e-47c6-ae9f-de91882367d8" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:37:12 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:37:12 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:37:12 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72129) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 14:37:12 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:37:13 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:37:13 user nova-compute[72129]: DEBUG nova.compute.manager [req-35eeae11-a216-4c98-84ad-22630af9da55 req-632d7483-8904-44a2-b310-400447ec34e9 service nova] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Received event network-vif-plugged-b32c7e0b-2091-4c3d-bb68-05ea41b0b054 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:37:13 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-35eeae11-a216-4c98-84ad-22630af9da55 req-632d7483-8904-44a2-b310-400447ec34e9 service nova] Acquiring lock "7b5266f7-4c4e-47c6-ae9f-de91882367d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:37:13 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-35eeae11-a216-4c98-84ad-22630af9da55 req-632d7483-8904-44a2-b310-400447ec34e9 service nova] Lock "7b5266f7-4c4e-47c6-ae9f-de91882367d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:37:13 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-35eeae11-a216-4c98-84ad-22630af9da55 req-632d7483-8904-44a2-b310-400447ec34e9 service nova] Lock "7b5266f7-4c4e-47c6-ae9f-de91882367d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:37:13 user nova-compute[72129]: DEBUG nova.compute.manager [req-35eeae11-a216-4c98-84ad-22630af9da55 req-632d7483-8904-44a2-b310-400447ec34e9 service nova] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] No waiting events found dispatching network-vif-plugged-b32c7e0b-2091-4c3d-bb68-05ea41b0b054 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:37:13 user nova-compute[72129]: WARNING nova.compute.manager [req-35eeae11-a216-4c98-84ad-22630af9da55 req-632d7483-8904-44a2-b310-400447ec34e9 service nova] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Received unexpected event network-vif-plugged-b32c7e0b-2091-4c3d-bb68-05ea41b0b054 for instance with vm_state building and task_state spawning.
Aug 01 14:37:13 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:37:13 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:37:13 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:37:15 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690900635.2165937, 7b5266f7-4c4e-47c6-ae9f-de91882367d8 => Resumed> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:37:15 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] VM Resumed (Lifecycle Event)
Aug 01 14:37:15 user nova-compute[72129]: DEBUG nova.compute.manager [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Instance event wait completed in 0 seconds for  {{(pid=72129) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 14:37:15 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Guest created on hypervisor {{(pid=72129) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 14:37:15 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Instance spawned successfully.
Aug 01 14:37:15 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 14:37:15 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Found default for hw_cdrom_bus of ide {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:37:15 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Found default for hw_disk_bus of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:37:15 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Found default for hw_input_bus of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:37:15 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Found default for hw_pointer_model of None {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:37:15 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Found default for hw_video_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:37:15 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Found default for hw_vif_model of virtio {{(pid=72129) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 14:37:15 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:37:15 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:37:15 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 14:37:15 user nova-compute[72129]: DEBUG nova.virt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Emitting event <LifecycleEvent: 1690900635.219121, 7b5266f7-4c4e-47c6-ae9f-de91882367d8 => Started> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:37:15 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] VM Started (Lifecycle Event)
Aug 01 14:37:15 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:37:15 user nova-compute[72129]: DEBUG nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72129) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 14:37:15 user nova-compute[72129]: INFO nova.compute.manager [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Took 6.62 seconds to spawn the instance on the hypervisor.
Aug 01 14:37:15 user nova-compute[72129]: DEBUG nova.compute.manager [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:37:15 user nova-compute[72129]: INFO nova.compute.manager [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 14:37:15 user nova-compute[72129]: DEBUG nova.compute.manager [req-e30ac13b-5bd8-4160-8262-9ae61605b41b req-865132cc-f639-4374-86bd-27c3cac446f3 service nova] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Received event network-vif-plugged-b32c7e0b-2091-4c3d-bb68-05ea41b0b054 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:37:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-e30ac13b-5bd8-4160-8262-9ae61605b41b req-865132cc-f639-4374-86bd-27c3cac446f3 service nova] Acquiring lock "7b5266f7-4c4e-47c6-ae9f-de91882367d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:37:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-e30ac13b-5bd8-4160-8262-9ae61605b41b req-865132cc-f639-4374-86bd-27c3cac446f3 service nova] Lock "7b5266f7-4c4e-47c6-ae9f-de91882367d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:37:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-e30ac13b-5bd8-4160-8262-9ae61605b41b req-865132cc-f639-4374-86bd-27c3cac446f3 service nova] Lock "7b5266f7-4c4e-47c6-ae9f-de91882367d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:37:15 user nova-compute[72129]: DEBUG nova.compute.manager [req-e30ac13b-5bd8-4160-8262-9ae61605b41b req-865132cc-f639-4374-86bd-27c3cac446f3 service nova] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] No waiting events found dispatching network-vif-plugged-b32c7e0b-2091-4c3d-bb68-05ea41b0b054 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:37:15 user nova-compute[72129]: WARNING nova.compute.manager [req-e30ac13b-5bd8-4160-8262-9ae61605b41b req-865132cc-f639-4374-86bd-27c3cac446f3 service nova] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Received unexpected event network-vif-plugged-b32c7e0b-2091-4c3d-bb68-05ea41b0b054 for instance with vm_state building and task_state spawning.
Aug 01 14:37:15 user nova-compute[72129]: INFO nova.compute.manager [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Took 7.28 seconds to build instance.
Aug 01 14:37:15 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-82e22664-c68d-42b0-99df-2c0b524a0cbb tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lock "7b5266f7-4c4e-47c6-ae9f-de91882367d8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.390s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:37:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:37:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:37:21 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:37:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:37:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:37:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:37:21 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Auditing locally available compute resources for user (node: user) {{(pid=72129) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 14:37:21 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b5266f7-4c4e-47c6-ae9f-de91882367d8/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:37:21 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b5266f7-4c4e-47c6-ae9f-de91882367d8/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:37:21 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b5266f7-4c4e-47c6-ae9f-de91882367d8/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:37:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:37:21 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b5266f7-4c4e-47c6-ae9f-de91882367d8/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:37:22 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:37:22 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:37:22 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:37:22 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Hypervisor/Node resource view: name=user free_ram=8609MB free_disk=25.10470199584961GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72129) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 14:37:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:37:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:37:22 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 7b5266f7-4c4e-47c6-ae9f-de91882367d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:37:22 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 14:37:22 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 14:37:22 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:37:22 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:37:22 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Compute_service record updated for user:user {{(pid=72129) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 14:37:22 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.226s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:37:23 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:37:23 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Starting heal instance info cache {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 14:37:23 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Rebuilding the list of instances to heal {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 14:37:23 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "refresh_cache-7b5266f7-4c4e-47c6-ae9f-de91882367d8" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:37:23 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquired lock "refresh_cache-7b5266f7-4c4e-47c6-ae9f-de91882367d8" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:37:23 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Forcefully refreshing network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 14:37:23 user nova-compute[72129]: DEBUG nova.objects.instance [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lazy-loading 'info_cache' on Instance uuid 7b5266f7-4c4e-47c6-ae9f-de91882367d8 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:37:23 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Updating instance_info_cache with network_info: [{"id": "b32c7e0b-2091-4c3d-bb68-05ea41b0b054", "address": "fa:16:3e:5a:79:44", "network": {"id": "ab6c1e03-f49f-473e-800f-75b628d68520", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1630528208-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d4bd37adfe64390a8923850d99aa534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32c7e0b-20", "ovs_interfaceid": "b32c7e0b-2091-4c3d-bb68-05ea41b0b054", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:37:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Releasing lock "refresh_cache-7b5266f7-4c4e-47c6-ae9f-de91882367d8" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:37:24 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Updated the network info_cache for instance {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 14:37:24 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:37:24 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:37:25 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:37:25 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:37:26 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:37:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:37:31 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:37:31 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:37:36 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:37:36 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:37:41 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:37:41 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:37:46 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:37:46 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:37:51 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:37:56 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:38:01 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:38:06 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:38:11 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:38:13 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:38:13 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72129) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 14:38:14 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:38:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:38:21 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:38:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:38:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:38:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:38:21 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Auditing locally available compute resources for user (node: user) {{(pid=72129) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 14:38:21 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b5266f7-4c4e-47c6-ae9f-de91882367d8/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:38:21 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b5266f7-4c4e-47c6-ae9f-de91882367d8/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:38:21 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b5266f7-4c4e-47c6-ae9f-de91882367d8/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:38:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:38:21 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b5266f7-4c4e-47c6-ae9f-de91882367d8/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:38:21 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:38:21 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:38:21 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Hypervisor/Node resource view: name=user free_ram=8806MB free_disk=25.066120147705078GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72129) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 14:38:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:38:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:38:21 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 7b5266f7-4c4e-47c6-ae9f-de91882367d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:38:21 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 14:38:21 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 14:38:21 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:38:21 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:38:21 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Compute_service record updated for user:user {{(pid=72129) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 14:38:21 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.170s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:38:24 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:38:24 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Starting heal instance info cache {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 14:38:24 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Rebuilding the list of instances to heal {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 14:38:25 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "refresh_cache-7b5266f7-4c4e-47c6-ae9f-de91882367d8" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:38:25 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquired lock "refresh_cache-7b5266f7-4c4e-47c6-ae9f-de91882367d8" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:38:25 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Forcefully refreshing network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 14:38:25 user nova-compute[72129]: DEBUG nova.objects.instance [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lazy-loading 'info_cache' on Instance uuid 7b5266f7-4c4e-47c6-ae9f-de91882367d8 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:38:25 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Updating instance_info_cache with network_info: [{"id": "b32c7e0b-2091-4c3d-bb68-05ea41b0b054", "address": "fa:16:3e:5a:79:44", "network": {"id": "ab6c1e03-f49f-473e-800f-75b628d68520", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1630528208-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d4bd37adfe64390a8923850d99aa534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32c7e0b-20", "ovs_interfaceid": "b32c7e0b-2091-4c3d-bb68-05ea41b0b054", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:38:25 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Releasing lock "refresh_cache-7b5266f7-4c4e-47c6-ae9f-de91882367d8" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:38:25 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Updated the network info_cache for instance {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 14:38:25 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:38:25 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:38:26 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:38:26 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:38:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:38:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:38:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72129) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 14:38:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:38:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:38:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:38:27 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:38:31 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:38:34 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:38:35 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:38:36 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:38:41 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:38:46 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:38:51 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:38:56 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:38:59 user nova-compute[72129]: DEBUG nova.compute.manager [req-c1875272-1f75-468e-8b7b-05028245e27a req-47de31dc-d08d-40b7-9ff7-d15ced1eddf0 service nova] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Received event network-changed-b32c7e0b-2091-4c3d-bb68-05ea41b0b054 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:38:59 user nova-compute[72129]: DEBUG nova.compute.manager [req-c1875272-1f75-468e-8b7b-05028245e27a req-47de31dc-d08d-40b7-9ff7-d15ced1eddf0 service nova] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Refreshing instance network info cache due to event network-changed-b32c7e0b-2091-4c3d-bb68-05ea41b0b054. {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 14:38:59 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-c1875272-1f75-468e-8b7b-05028245e27a req-47de31dc-d08d-40b7-9ff7-d15ced1eddf0 service nova] Acquiring lock "refresh_cache-7b5266f7-4c4e-47c6-ae9f-de91882367d8" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:38:59 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-c1875272-1f75-468e-8b7b-05028245e27a req-47de31dc-d08d-40b7-9ff7-d15ced1eddf0 service nova] Acquired lock "refresh_cache-7b5266f7-4c4e-47c6-ae9f-de91882367d8" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:38:59 user nova-compute[72129]: DEBUG nova.network.neutron [req-c1875272-1f75-468e-8b7b-05028245e27a req-47de31dc-d08d-40b7-9ff7-d15ced1eddf0 service nova] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Refreshing network info cache for port b32c7e0b-2091-4c3d-bb68-05ea41b0b054 {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 14:39:00 user nova-compute[72129]: DEBUG nova.network.neutron [req-c1875272-1f75-468e-8b7b-05028245e27a req-47de31dc-d08d-40b7-9ff7-d15ced1eddf0 service nova] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Updated VIF entry in instance network info cache for port b32c7e0b-2091-4c3d-bb68-05ea41b0b054. {{(pid=72129) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 14:39:00 user nova-compute[72129]: DEBUG nova.network.neutron [req-c1875272-1f75-468e-8b7b-05028245e27a req-47de31dc-d08d-40b7-9ff7-d15ced1eddf0 service nova] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Updating instance_info_cache with network_info: [{"id": "b32c7e0b-2091-4c3d-bb68-05ea41b0b054", "address": "fa:16:3e:5a:79:44", "network": {"id": "ab6c1e03-f49f-473e-800f-75b628d68520", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1630528208-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d4bd37adfe64390a8923850d99aa534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32c7e0b-20", "ovs_interfaceid": "b32c7e0b-2091-4c3d-bb68-05ea41b0b054", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:39:00 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-c1875272-1f75-468e-8b7b-05028245e27a req-47de31dc-d08d-40b7-9ff7-d15ced1eddf0 service nova] Releasing lock "refresh_cache-7b5266f7-4c4e-47c6-ae9f-de91882367d8" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:39:01 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:39:01 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:39:03 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-4bba14ec-2022-4b87-9352-84175c2120b2 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Acquiring lock "7b5266f7-4c4e-47c6-ae9f-de91882367d8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:39:03 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-4bba14ec-2022-4b87-9352-84175c2120b2 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lock "7b5266f7-4c4e-47c6-ae9f-de91882367d8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:39:03 user nova-compute[72129]: DEBUG nova.objects.instance [None req-4bba14ec-2022-4b87-9352-84175c2120b2 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lazy-loading 'flavor' on Instance uuid 7b5266f7-4c4e-47c6-ae9f-de91882367d8 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:39:04 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-4bba14ec-2022-4b87-9352-84175c2120b2 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lock "7b5266f7-4c4e-47c6-ae9f-de91882367d8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:39:04 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-4bba14ec-2022-4b87-9352-84175c2120b2 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Acquiring lock "7b5266f7-4c4e-47c6-ae9f-de91882367d8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:39:04 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-4bba14ec-2022-4b87-9352-84175c2120b2 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lock "7b5266f7-4c4e-47c6-ae9f-de91882367d8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:39:04 user nova-compute[72129]: INFO nova.compute.manager [None req-4bba14ec-2022-4b87-9352-84175c2120b2 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Attaching volume 9a14af04-5891-45fe-9e49-8d8f9202170b to /dev/vdb
Aug 01 14:39:04 user nova-compute[72129]: DEBUG os_brick.utils [None req-4bba14ec-2022-4b87-9352-84175c2120b2 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:39:04 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:39:04 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:39:04 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da871ba-7053-4c9f-86b1-346aaf0da70c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f9b449c2cd3d\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:39:04 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:39:04 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:39:04 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2fd1e02-0de0-48a9-a1f9-da7f54c19cb1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:39:04 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:39:04 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:39:04 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb145c6-955b-436a-84a1-833ba28cbcbd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:39:04 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2bdbcc6-7a94-4b19-9ecb-ecd8dd38df50]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:39:04 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-4bba14ec-2022-4b87-9352-84175c2120b2 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Running cmd (subprocess): nvme version {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:39:04 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-4bba14ec-2022-4b87-9352-84175c2120b2 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] 'nvme version' failed. Not Retrying. {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 14:39:04 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4bba14ec-2022-4b87-9352-84175c2120b2 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] nvme not present on system {{(pid=72129) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 14:39:04 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:39:04 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 14:39:04 user nova-compute[72129]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 14:39:04 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30fe2ec-ed83-429b-a8ed-46971054d00b]: (4, '') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:39:04 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-4bba14ec-2022-4b87-9352-84175c2120b2 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72129) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 14:39:04 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-4bba14ec-2022-4b87-9352-84175c2120b2 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 14:39:04 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-4bba14ec-2022-4b87-9352-84175c2120b2 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] LIGHTOS: no hostnqn found. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 14:39:04 user nova-compute[72129]: DEBUG os_brick.utils [None req-4bba14ec-2022-4b87-9352-84175c2120b2 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f9b449c2cd3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:39:04 user nova-compute[72129]: DEBUG nova.virt.block_device [None req-4bba14ec-2022-4b87-9352-84175c2120b2 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Updating existing volume attachment record: 6c4d9ba9-daff-4293-8ff5-24191b066d3b {{(pid=72129) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 14:39:06 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:39:06 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:39:11 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bba14ec-2022-4b87-9352-84175c2120b2 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Calling os-brick to attach iSCSI Volume {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 14:39:11 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bba14ec-2022-4b87-9352-84175c2120b2 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9a14af04-5891-45fe-9e49-8d8f9202170b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vipYAhDQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:39:11 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-4bba14ec-2022-4b87-9352-84175c2120b2 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:39:11 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-4bba14ec-2022-4b87-9352-84175c2120b2 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:39:11 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-4bba14ec-2022-4b87-9352-84175c2120b2 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:39:11 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-4bba14ec-2022-4b87-9352-84175c2120b2 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:39:11 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-4bba14ec-2022-4b87-9352-84175c2120b2 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a14af04-5891-45fe-9e49-8d8f9202170b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:39:11 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-4bba14ec-2022-4b87-9352-84175c2120b2 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a14af04-5891-45fe-9e49-8d8f9202170b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:39:11 user nova-compute[72129]: INFO os_brick.initiator.connectors.iscsi [None req-4bba14ec-2022-4b87-9352-84175c2120b2 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 14:39:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a14af04-5891-45fe-9e49-8d8f9202170b -p 172.16.0.220:3260 {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:39:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a14af04-5891-45fe-9e49-8d8f9202170b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:39:11 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d8dd84-6b4f-4e4e-bb9a-e69c78ea874f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:39:11 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bba14ec-2022-4b87-9352-84175c2120b2 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 14:39:11 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:39:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a14af04-5891-45fe-9e49-8d8f9202170b -p 172.16.0.220:3260 --interface default --op new {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:39:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a14af04-5891-45fe-9e49-8d8f9202170b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:39:11 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f3bf5a-9bd1-4f99-b48a-2f1b86f1f1a4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a14af04-5891-45fe-9e49-8d8f9202170b] added\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:39:11 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bba14ec-2022-4b87-9352-84175c2120b2 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a14af04-5891-45fe-9e49-8d8f9202170b] added
Aug 01 14:39:11 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:39:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a14af04-5891-45fe-9e49-8d8f9202170b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:39:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a14af04-5891-45fe-9e49-8d8f9202170b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:39:11 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[218d998b-6364-432f-b8db-a13968e56fdc]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:39:11 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bba14ec-2022-4b87-9352-84175c2120b2 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:39:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a14af04-5891-45fe-9e49-8d8f9202170b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:39:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a14af04-5891-45fe-9e49-8d8f9202170b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:39:11 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d79b783-aff6-4fd1-b185-47a8fa8de394]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:39:11 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bba14ec-2022-4b87-9352-84175c2120b2 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:39:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a14af04-5891-45fe-9e49-8d8f9202170b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vipYAhDQ {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:39:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a14af04-5891-45fe-9e49-8d8f9202170b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vipYAhDQ" returned: 0 in 0.032s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:39:11 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[963d2a49-48de-4b29-a5c5-d50024ade049]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:39:11 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bba14ec-2022-4b87-9352-84175c2120b2 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vipYAhDQ'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:39:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a14af04-5891-45fe-9e49-8d8f9202170b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:39:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a14af04-5891-45fe-9e49-8d8f9202170b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:39:11 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb976ff8-3a28-49f1-af96-4ef296033913]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:39:11 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bba14ec-2022-4b87-9352-84175c2120b2 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:39:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:39:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:39:11 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdeb3149-037b-4ecb-8053-e7d6347e9cf7]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:39:11 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bba14ec-2022-4b87-9352-84175c2120b2 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 14:39:11 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:39:11 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bba14ec-2022-4b87-9352-84175c2120b2 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 14:39:11 user nova-compute[72129]:  {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:39:11 user nova-compute[72129]: WARNING os_brick.initiator.connectors.iscsi [None req-4bba14ec-2022-4b87-9352-84175c2120b2 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 14:39:11 user nova-compute[72129]: 
Aug 01 14:39:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a14af04-5891-45fe-9e49-8d8f9202170b -p 172.16.0.220:3260 --login {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:39:11 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:39:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a14af04-5891-45fe-9e49-8d8f9202170b -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:39:11 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63a9c8a-b8cb-410d-9e07-f606013e5f1b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a14af04-5891-45fe-9e49-8d8f9202170b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9a14af04-5891-45fe-9e49-8d8f9202170b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:39:11 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bba14ec-2022-4b87-9352-84175c2120b2 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a14af04-5891-45fe-9e49-8d8f9202170b, portal: 172.16.0.220,3260]
Aug 01 14:39:11 user nova-compute[72129]: Login to [iface: default, target: iqn.2010-10.org.openstack:9a14af04-5891-45fe-9e49-8d8f9202170b, portal: 172.16.0.220,3260] successful.
Aug 01 14:39:11 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:39:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a14af04-5891-45fe-9e49-8d8f9202170b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:39:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a14af04-5891-45fe-9e49-8d8f9202170b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:39:11 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[052506e9-d2ae-4871-846f-5d57dfbe5c7b]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:39:11 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bba14ec-2022-4b87-9352-84175c2120b2 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:39:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:39:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:39:11 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[290d4b24-337c-4fe8-a399-4a1361592030]: (4, ('tcp: [66] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a14af04-5891-45fe-9e49-8d8f9202170b (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:39:11 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bba14ec-2022-4b87-9352-84175c2120b2 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a14af04-5891-45fe-9e49-8d8f9202170b (non-flash)
Aug 01 14:39:11 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:39:11 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bba14ec-2022-4b87-9352-84175c2120b2 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] iscsi session list stdout=tcp: [66] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a14af04-5891-45fe-9e49-8d8f9202170b (non-flash)
Aug 01 14:39:11 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:39:11 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-4bba14ec-2022-4b87-9352-84175c2120b2 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a14af04-5891-45fe-9e49-8d8f9202170b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:39:11 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bba14ec-2022-4b87-9352-84175c2120b2 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Connected to 172.16.0.220:3260 {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 14:39:11 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-4bba14ec-2022-4b87-9352-84175c2120b2 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] HCTL ('33', '-', '-', 0) found on session 66 with lun 0 {{(pid=72129) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 14:39:11 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-4bba14ec-2022-4b87-9352-84175c2120b2 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72129) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 14:39:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:39:11 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:39:11 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[5850a7e1-496f-4ceb-a72b-a50fac1620f3]: (4, ('- - 0', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:39:11 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-4bba14ec-2022-4b87-9352-84175c2120b2 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Searching for a device in session 66 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 14:39:11 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bba14ec-2022-4b87-9352-84175c2120b2 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vipYAhDQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 14:39:12 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-4bba14ec-2022-4b87-9352-84175c2120b2 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:39:12 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bba14ec-2022-4b87-9352-84175c2120b2 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '26433373962313432', 'path': '/dev/sdb'} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:39:12 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bba14ec-2022-4b87-9352-84175c2120b2 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26433373962313432', 'path': '/dev/sdb'} {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 14:39:12 user nova-compute[72129]: DEBUG nova.objects.instance [None req-4bba14ec-2022-4b87-9352-84175c2120b2 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lazy-loading 'flavor' on Instance uuid 7b5266f7-4c4e-47c6-ae9f-de91882367d8 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:39:12 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-4bba14ec-2022-4b87-9352-84175c2120b2 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 14:39:12 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:39:12 user nova-compute[72129]:   <source dev="/dev/sdb"/>
Aug 01 14:39:12 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 14:39:12 user nova-compute[72129]:   <serial>9a14af04-5891-45fe-9e49-8d8f9202170b</serial>
Aug 01 14:39:12 user nova-compute[72129]: </disk>
Aug 01 14:39:12 user nova-compute[72129]:  {{(pid=72129) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 14:39:12 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-4bba14ec-2022-4b87-9352-84175c2120b2 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:39:12 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-4bba14ec-2022-4b87-9352-84175c2120b2 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:39:12 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-4bba14ec-2022-4b87-9352-84175c2120b2 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] No VIF found with MAC fa:16:3e:5a:79:44, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 14:39:13 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-4bba14ec-2022-4b87-9352-84175c2120b2 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lock "7b5266f7-4c4e-47c6-ae9f-de91882367d8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.911s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:39:14 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:39:14 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:39:14 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72129) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 14:39:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:39:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:39:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:39:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:39:23 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:39:23 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:39:23 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:39:23 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:39:23 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Auditing locally available compute resources for user (node: user) {{(pid=72129) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 14:39:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b5266f7-4c4e-47c6-ae9f-de91882367d8/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:39:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b5266f7-4c4e-47c6-ae9f-de91882367d8/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:39:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b5266f7-4c4e-47c6-ae9f-de91882367d8/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:39:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b5266f7-4c4e-47c6-ae9f-de91882367d8/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:39:23 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72129) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 14:39:23 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:39:23 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:39:23 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Hypervisor/Node resource view: name=user free_ram=8866MB free_disk=25.06467056274414GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72129) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 14:39:23 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:39:23 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:39:23 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 7b5266f7-4c4e-47c6-ae9f-de91882367d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:39:23 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 14:39:23 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 14:39:24 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:39:24 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:39:24 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Compute_service record updated for user:user {{(pid=72129) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 14:39:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.185s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:39:25 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:39:26 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:39:26 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Starting heal instance info cache {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 14:39:26 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Rebuilding the list of instances to heal {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 14:39:26 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "refresh_cache-7b5266f7-4c4e-47c6-ae9f-de91882367d8" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:39:26 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquired lock "refresh_cache-7b5266f7-4c4e-47c6-ae9f-de91882367d8" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:39:26 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Forcefully refreshing network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 14:39:26 user nova-compute[72129]: DEBUG nova.objects.instance [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lazy-loading 'info_cache' on Instance uuid 7b5266f7-4c4e-47c6-ae9f-de91882367d8 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:39:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:39:26 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Updating instance_info_cache with network_info: [{"id": "b32c7e0b-2091-4c3d-bb68-05ea41b0b054", "address": "fa:16:3e:5a:79:44", "network": {"id": "ab6c1e03-f49f-473e-800f-75b628d68520", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1630528208-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d4bd37adfe64390a8923850d99aa534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32c7e0b-20", "ovs_interfaceid": "b32c7e0b-2091-4c3d-bb68-05ea41b0b054", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:39:26 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Releasing lock "refresh_cache-7b5266f7-4c4e-47c6-ae9f-de91882367d8" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:39:26 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Updated the network info_cache for instance {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 14:39:26 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:39:26 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:39:26 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:39:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:39:28 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:39:31 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-8c51e82d-d25e-49c7-8233-61dec86eaa32 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Acquiring lock "7b5266f7-4c4e-47c6-ae9f-de91882367d8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:39:31 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-8c51e82d-d25e-49c7-8233-61dec86eaa32 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lock "7b5266f7-4c4e-47c6-ae9f-de91882367d8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:39:31 user nova-compute[72129]: INFO nova.compute.manager [None req-8c51e82d-d25e-49c7-8233-61dec86eaa32 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Detaching volume 9a14af04-5891-45fe-9e49-8d8f9202170b
Aug 01 14:39:31 user nova-compute[72129]: INFO nova.virt.block_device [None req-8c51e82d-d25e-49c7-8233-61dec86eaa32 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Attempting to driver detach volume 9a14af04-5891-45fe-9e49-8d8f9202170b from mountpoint /dev/vdb
Aug 01 14:39:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-8c51e82d-d25e-49c7-8233-61dec86eaa32 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Attempting to detach device vdb from instance 7b5266f7-4c4e-47c6-ae9f-de91882367d8 from the persistent domain config. {{(pid=72129) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 14:39:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-8c51e82d-d25e-49c7-8233-61dec86eaa32 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 14:39:31 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:39:31 user nova-compute[72129]:   <source dev="/dev/sdb"/>
Aug 01 14:39:31 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 14:39:31 user nova-compute[72129]:   <serial>9a14af04-5891-45fe-9e49-8d8f9202170b</serial>
Aug 01 14:39:31 user nova-compute[72129]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 14:39:31 user nova-compute[72129]: </disk>
Aug 01 14:39:31 user nova-compute[72129]:  {{(pid=72129) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 14:39:31 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-8c51e82d-d25e-49c7-8233-61dec86eaa32 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Successfully detached device vdb from instance 7b5266f7-4c4e-47c6-ae9f-de91882367d8 from the persistent domain config.
Aug 01 14:39:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-8c51e82d-d25e-49c7-8233-61dec86eaa32 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7b5266f7-4c4e-47c6-ae9f-de91882367d8 from the live domain config. {{(pid=72129) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 14:39:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-8c51e82d-d25e-49c7-8233-61dec86eaa32 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 14:39:31 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:39:31 user nova-compute[72129]:   <source dev="/dev/sdb"/>
Aug 01 14:39:31 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 14:39:31 user nova-compute[72129]:   <serial>9a14af04-5891-45fe-9e49-8d8f9202170b</serial>
Aug 01 14:39:31 user nova-compute[72129]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 14:39:31 user nova-compute[72129]: </disk>
Aug 01 14:39:31 user nova-compute[72129]:  {{(pid=72129) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 14:39:31 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:39:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Received event <DeviceRemovedEvent: 1690900771.6674755, 7b5266f7-4c4e-47c6-ae9f-de91882367d8 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72129) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 14:39:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-8c51e82d-d25e-49c7-8233-61dec86eaa32 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7b5266f7-4c4e-47c6-ae9f-de91882367d8 {{(pid=72129) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 14:39:31 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-8c51e82d-d25e-49c7-8233-61dec86eaa32 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Successfully detached device vdb from instance 7b5266f7-4c4e-47c6-ae9f-de91882367d8 from the live domain config.
Aug 01 14:39:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c51e82d-d25e-49c7-8233-61dec86eaa32 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] calling os-brick to detach iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 14:39:31 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c51e82d-d25e-49c7-8233-61dec86eaa32 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, {'target_iqns': ['iqn.2010-10.org.openstack:9a14af04-5891-45fe-9e49-8d8f9202170b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vipYAhDQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:39:31 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-8c51e82d-d25e-49c7-8233-61dec86eaa32 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:39:31 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-8c51e82d-d25e-49c7-8233-61dec86eaa32 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:39:31 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-8c51e82d-d25e-49c7-8233-61dec86eaa32 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:39:31 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c51e82d-d25e-49c7-8233-61dec86eaa32 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a14af04-5891-45fe-9e49-8d8f9202170b', 0)] {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 14:39:31 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:39:31 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:39:31 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aec5450-8194-4d17-be2f-9abc066696e7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a14af04-5891-45fe-9e49-8d8f9202170b\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:39:31 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:39:31 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:39:31 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[332f433d-8289-4325-b039-a30e7e44ff71]: (4, ('tcp: [66] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a14af04-5891-45fe-9e49-8d8f9202170b (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:39:31 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c51e82d-d25e-49c7-8233-61dec86eaa32 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a14af04-5891-45fe-9e49-8d8f9202170b (non-flash)
Aug 01 14:39:31 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:39:31 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c51e82d-d25e-49c7-8233-61dec86eaa32 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] iscsi session list stdout=tcp: [66] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a14af04-5891-45fe-9e49-8d8f9202170b (non-flash)
Aug 01 14:39:31 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:39:31 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c51e82d-d25e-49c7-8233-61dec86eaa32 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2828281900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a14af04-5891-45fe-9e49-8d8f9202170b'): ({'sdb'}, set())}) {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 14:39:31 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-8c51e82d-d25e-49c7-8233-61dec86eaa32 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Removing single pathed devices sdb {{(pid=72129) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 14:39:31 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:39:31 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:39:31 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad034aa-de02-47ad-9039-c07fd0935846]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:39:31 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:39:31 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:39:31 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9b53ee-0929-4b58-a0a3-db245c0cb705]: (4, ('ok\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:39:31 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-8c51e82d-d25e-49c7-8233-61dec86eaa32 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Flushing IO for device /dev/sdb {{(pid=72129) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 14:39:31 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:39:31 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:39:31 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[131ecc77-c8b9-424f-b2d1-887f81df786a]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:39:31 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-8c51e82d-d25e-49c7-8233-61dec86eaa32 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72129) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 14:39:31 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:39:31 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:39:31 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce29d4e3-6e3d-44a7-b49c-b51b1f40e374]: (4, ('1', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:39:31 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-8c51e82d-d25e-49c7-8233-61dec86eaa32 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 14:39:31 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-8c51e82d-d25e-49c7-8233-61dec86eaa32 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] SCSI volumes sdb have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 14:39:31 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c51e82d-d25e-49c7-8233-61dec86eaa32 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a14af04-5891-45fe-9e49-8d8f9202170b')] {{(pid=72129) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 14:39:31 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a14af04-5891-45fe-9e49-8d8f9202170b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:39:31 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a14af04-5891-45fe-9e49-8d8f9202170b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:39:31 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:39:31 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ff5b19-6757-4896-8724-ee46ba6fcdfd]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:39:31 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c51e82d-d25e-49c7-8233-61dec86eaa32 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:39:31 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a14af04-5891-45fe-9e49-8d8f9202170b -p 172.16.0.220:3260 --logout {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:39:31 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a14af04-5891-45fe-9e49-8d8f9202170b -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:39:31 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f949bc4-a70a-4f9f-983b-88b811a79787]: (4, ('Logging out of session [sid: 66, target: iqn.2010-10.org.openstack:9a14af04-5891-45fe-9e49-8d8f9202170b, portal: 172.16.0.220,3260]\nLogout of [sid: 66, target: iqn.2010-10.org.openstack:9a14af04-5891-45fe-9e49-8d8f9202170b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:39:31 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c51e82d-d25e-49c7-8233-61dec86eaa32 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 66, target: iqn.2010-10.org.openstack:9a14af04-5891-45fe-9e49-8d8f9202170b, portal: 172.16.0.220,3260]
Aug 01 14:39:31 user nova-compute[72129]: Logout of [sid: 66, target: iqn.2010-10.org.openstack:9a14af04-5891-45fe-9e49-8d8f9202170b, portal: 172.16.0.220,3260] successful.
Aug 01 14:39:31 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:39:31 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a14af04-5891-45fe-9e49-8d8f9202170b -p 172.16.0.220:3260 --op delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:39:31 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a14af04-5891-45fe-9e49-8d8f9202170b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:39:31 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa117f03-7151-4d12-9695-191a02265c66]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:39:31 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c51e82d-d25e-49c7-8233-61dec86eaa32 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:39:31 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-8c51e82d-d25e-49c7-8233-61dec86eaa32 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.261s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:39:31 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c51e82d-d25e-49c7-8233-61dec86eaa32 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] <== disconnect_volume: return (262ms) None {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:39:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c51e82d-d25e-49c7-8233-61dec86eaa32 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Disconnected iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 14:39:32 user nova-compute[72129]: DEBUG nova.objects.instance [None req-8c51e82d-d25e-49c7-8233-61dec86eaa32 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lazy-loading 'flavor' on Instance uuid 7b5266f7-4c4e-47c6-ae9f-de91882367d8 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:39:32 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-8c51e82d-d25e-49c7-8233-61dec86eaa32 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lock "7b5266f7-4c4e-47c6-ae9f-de91882367d8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.580s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:39:36 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:39:41 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:39:46 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:39:51 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:39:56 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:40:01 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:40:06 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:40:11 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:40:14 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:40:14 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72129) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 14:40:15 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:40:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:40:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:40:23 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:40:23 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:40:23 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:40:23 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:40:23 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Auditing locally available compute resources for user (node: user) {{(pid=72129) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 14:40:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b5266f7-4c4e-47c6-ae9f-de91882367d8/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:40:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b5266f7-4c4e-47c6-ae9f-de91882367d8/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:40:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b5266f7-4c4e-47c6-ae9f-de91882367d8/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:40:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b5266f7-4c4e-47c6-ae9f-de91882367d8/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:40:23 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:40:23 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:40:23 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Hypervisor/Node resource view: name=user free_ram=8852MB free_disk=25.06378936767578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72129) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 14:40:23 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:40:23 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:40:23 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 7b5266f7-4c4e-47c6-ae9f-de91882367d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:40:23 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 14:40:23 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 14:40:23 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:40:23 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:40:23 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Compute_service record updated for user:user {{(pid=72129) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 14:40:23 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.166s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:40:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-bb587e24-eac1-424a-8d8a-6bf7f68dffae tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Acquiring lock "7b5266f7-4c4e-47c6-ae9f-de91882367d8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:40:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-bb587e24-eac1-424a-8d8a-6bf7f68dffae tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lock "7b5266f7-4c4e-47c6-ae9f-de91882367d8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:40:24 user nova-compute[72129]: DEBUG nova.objects.instance [None req-bb587e24-eac1-424a-8d8a-6bf7f68dffae tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lazy-loading 'flavor' on Instance uuid 7b5266f7-4c4e-47c6-ae9f-de91882367d8 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:40:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-bb587e24-eac1-424a-8d8a-6bf7f68dffae tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lock "7b5266f7-4c4e-47c6-ae9f-de91882367d8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:40:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-bb587e24-eac1-424a-8d8a-6bf7f68dffae tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Acquiring lock "7b5266f7-4c4e-47c6-ae9f-de91882367d8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:40:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-bb587e24-eac1-424a-8d8a-6bf7f68dffae tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lock "7b5266f7-4c4e-47c6-ae9f-de91882367d8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:40:24 user nova-compute[72129]: INFO nova.compute.manager [None req-bb587e24-eac1-424a-8d8a-6bf7f68dffae tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Attaching volume 134cc7d6-6f7d-4c79-ae6a-f9a27d0de921 to /dev/vdb
Aug 01 14:40:24 user nova-compute[72129]: DEBUG os_brick.utils [None req-bb587e24-eac1-424a-8d8a-6bf7f68dffae tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:40:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:40:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:40:24 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[096709a8-49a1-4ce0-afa4-634b261f3e86]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f9b449c2cd3d\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:40:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:40:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:40:24 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1ae382-0c87-4755-9f18-30361ea43866]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:40:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:40:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:40:24 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a79130-fb73-439e-bcfb-61730b85824f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:40:24 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[f643f4bc-6ace-4113-ae13-5909f1f593c4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:40:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-bb587e24-eac1-424a-8d8a-6bf7f68dffae tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Running cmd (subprocess): nvme version {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:40:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-bb587e24-eac1-424a-8d8a-6bf7f68dffae tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] 'nvme version' failed. Not Retrying. {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 14:40:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bb587e24-eac1-424a-8d8a-6bf7f68dffae tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] nvme not present on system {{(pid=72129) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 14:40:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:40:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 14:40:24 user nova-compute[72129]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 14:40:24 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf9b1b2-3d96-4b2f-b46b-2b2828927e14]: (4, '') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:40:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-bb587e24-eac1-424a-8d8a-6bf7f68dffae tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72129) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 14:40:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-bb587e24-eac1-424a-8d8a-6bf7f68dffae tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 14:40:24 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-bb587e24-eac1-424a-8d8a-6bf7f68dffae tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] LIGHTOS: no hostnqn found. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 14:40:24 user nova-compute[72129]: DEBUG os_brick.utils [None req-bb587e24-eac1-424a-8d8a-6bf7f68dffae tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f9b449c2cd3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:40:24 user nova-compute[72129]: DEBUG nova.virt.block_device [None req-bb587e24-eac1-424a-8d8a-6bf7f68dffae tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Updating existing volume attachment record: 89752a70-3391-4887-8459-f42b4dad15dd {{(pid=72129) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 14:40:25 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:40:26 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:40:26 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Starting heal instance info cache {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 14:40:26 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Rebuilding the list of instances to heal {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 14:40:26 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "refresh_cache-7b5266f7-4c4e-47c6-ae9f-de91882367d8" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:40:26 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquired lock "refresh_cache-7b5266f7-4c4e-47c6-ae9f-de91882367d8" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:40:26 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Forcefully refreshing network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 14:40:26 user nova-compute[72129]: DEBUG nova.objects.instance [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lazy-loading 'info_cache' on Instance uuid 7b5266f7-4c4e-47c6-ae9f-de91882367d8 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:40:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:40:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:40:26 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Updating instance_info_cache with network_info: [{"id": "b32c7e0b-2091-4c3d-bb68-05ea41b0b054", "address": "fa:16:3e:5a:79:44", "network": {"id": "ab6c1e03-f49f-473e-800f-75b628d68520", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1630528208-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d4bd37adfe64390a8923850d99aa534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32c7e0b-20", "ovs_interfaceid": "b32c7e0b-2091-4c3d-bb68-05ea41b0b054", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:40:26 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Releasing lock "refresh_cache-7b5266f7-4c4e-47c6-ae9f-de91882367d8" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:40:26 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Updated the network info_cache for instance {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 14:40:26 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:40:26 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:40:28 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:40:30 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:40:31 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:40:31 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb587e24-eac1-424a-8d8a-6bf7f68dffae tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Calling os-brick to attach iSCSI Volume {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 14:40:31 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb587e24-eac1-424a-8d8a-6bf7f68dffae tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:134cc7d6-6f7d-4c79-ae6a-f9a27d0de921'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JOhSnPUf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:40:31 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-bb587e24-eac1-424a-8d8a-6bf7f68dffae tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:40:31 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-bb587e24-eac1-424a-8d8a-6bf7f68dffae tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:40:31 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-bb587e24-eac1-424a-8d8a-6bf7f68dffae tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:40:31 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-bb587e24-eac1-424a-8d8a-6bf7f68dffae tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:40:31 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-bb587e24-eac1-424a-8d8a-6bf7f68dffae tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:134cc7d6-6f7d-4c79-ae6a-f9a27d0de921" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:40:31 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-bb587e24-eac1-424a-8d8a-6bf7f68dffae tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:134cc7d6-6f7d-4c79-ae6a-f9a27d0de921" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:40:31 user nova-compute[72129]: INFO os_brick.initiator.connectors.iscsi [None req-bb587e24-eac1-424a-8d8a-6bf7f68dffae tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 14:40:31 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:134cc7d6-6f7d-4c79-ae6a-f9a27d0de921 -p 172.16.0.220:3260 {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:40:31 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:134cc7d6-6f7d-4c79-ae6a-f9a27d0de921 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:40:31 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[081a6f23-09df-4c9a-856a-90e0fc062978]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:40:31 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb587e24-eac1-424a-8d8a-6bf7f68dffae tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 14:40:31 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:40:31 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:134cc7d6-6f7d-4c79-ae6a-f9a27d0de921 -p 172.16.0.220:3260 --interface default --op new {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:40:31 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:134cc7d6-6f7d-4c79-ae6a-f9a27d0de921 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:40:31 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14a7373-aa9f-407d-9232-82a787dbf210]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:134cc7d6-6f7d-4c79-ae6a-f9a27d0de921] added\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:40:31 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb587e24-eac1-424a-8d8a-6bf7f68dffae tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:134cc7d6-6f7d-4c79-ae6a-f9a27d0de921] added
Aug 01 14:40:31 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:40:31 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:134cc7d6-6f7d-4c79-ae6a-f9a27d0de921 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:40:31 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:134cc7d6-6f7d-4c79-ae6a-f9a27d0de921 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:40:31 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ebe9ded-3a43-4856-ab03-782da6d85a8e]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:40:31 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb587e24-eac1-424a-8d8a-6bf7f68dffae tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:40:31 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:134cc7d6-6f7d-4c79-ae6a-f9a27d0de921 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:40:31 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:134cc7d6-6f7d-4c79-ae6a-f9a27d0de921 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:40:31 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[87367bae-d800-4901-9439-843db5f06ae3]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:40:31 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb587e24-eac1-424a-8d8a-6bf7f68dffae tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:40:31 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:134cc7d6-6f7d-4c79-ae6a-f9a27d0de921 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JOhSnPUf {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:40:31 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:134cc7d6-6f7d-4c79-ae6a-f9a27d0de921 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JOhSnPUf" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:40:31 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d83bb79-b7ed-4c57-a539-84813ce1d136]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:40:31 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb587e24-eac1-424a-8d8a-6bf7f68dffae tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JOhSnPUf'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:40:31 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:134cc7d6-6f7d-4c79-ae6a-f9a27d0de921 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:40:31 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:134cc7d6-6f7d-4c79-ae6a-f9a27d0de921 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:40:31 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e543b4-95d8-45a9-9bfc-e7964a584c36]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:40:31 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb587e24-eac1-424a-8d8a-6bf7f68dffae tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:40:31 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:40:31 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:40:31 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea9246b-3b26-43d8-b755-57ca465e3192]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:40:31 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb587e24-eac1-424a-8d8a-6bf7f68dffae tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 14:40:31 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:40:31 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb587e24-eac1-424a-8d8a-6bf7f68dffae tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 14:40:31 user nova-compute[72129]:  {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:40:31 user nova-compute[72129]: WARNING os_brick.initiator.connectors.iscsi [None req-bb587e24-eac1-424a-8d8a-6bf7f68dffae tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 14:40:31 user nova-compute[72129]: 
Aug 01 14:40:31 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:134cc7d6-6f7d-4c79-ae6a-f9a27d0de921 -p 172.16.0.220:3260 --login {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:40:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:134cc7d6-6f7d-4c79-ae6a-f9a27d0de921 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:40:32 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[510b9688-5271-4716-ab94-418061a71c87]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:134cc7d6-6f7d-4c79-ae6a-f9a27d0de921, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:134cc7d6-6f7d-4c79-ae6a-f9a27d0de921, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:40:32 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb587e24-eac1-424a-8d8a-6bf7f68dffae tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:134cc7d6-6f7d-4c79-ae6a-f9a27d0de921, portal: 172.16.0.220,3260]
Aug 01 14:40:32 user nova-compute[72129]: Login to [iface: default, target: iqn.2010-10.org.openstack:134cc7d6-6f7d-4c79-ae6a-f9a27d0de921, portal: 172.16.0.220,3260] successful.
Aug 01 14:40:32 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:40:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:134cc7d6-6f7d-4c79-ae6a-f9a27d0de921 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:40:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:134cc7d6-6f7d-4c79-ae6a-f9a27d0de921 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:40:32 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e9e276-316c-4efe-b424-5d7fc444f04f]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:40:32 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb587e24-eac1-424a-8d8a-6bf7f68dffae tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:40:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:40:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:40:32 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e38a31-69a7-48fc-83b8-074666a460de]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cc7d6-6f7d-4c79-ae6a-f9a27d0de921 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:40:32 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb587e24-eac1-424a-8d8a-6bf7f68dffae tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cc7d6-6f7d-4c79-ae6a-f9a27d0de921 (non-flash)
Aug 01 14:40:32 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:40:32 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb587e24-eac1-424a-8d8a-6bf7f68dffae tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cc7d6-6f7d-4c79-ae6a-f9a27d0de921 (non-flash)
Aug 01 14:40:32 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:40:32 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-bb587e24-eac1-424a-8d8a-6bf7f68dffae tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:134cc7d6-6f7d-4c79-ae6a-f9a27d0de921" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:40:32 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb587e24-eac1-424a-8d8a-6bf7f68dffae tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Connected to 172.16.0.220:3260 {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 14:40:32 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-bb587e24-eac1-424a-8d8a-6bf7f68dffae tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=72129) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 14:40:32 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-bb587e24-eac1-424a-8d8a-6bf7f68dffae tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72129) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 14:40:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:40:32 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:40:32 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[7986ff98-83a0-48a6-955d-270754ea00e9]: (4, ('- - 0', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:40:32 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-bb587e24-eac1-424a-8d8a-6bf7f68dffae tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: None {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 14:40:33 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-bb587e24-eac1-424a-8d8a-6bf7f68dffae tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 14:40:33 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb587e24-eac1-424a-8d8a-6bf7f68dffae tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JOhSnPUf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 14:40:33 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-bb587e24-eac1-424a-8d8a-6bf7f68dffae tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:40:33 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb587e24-eac1-424a-8d8a-6bf7f68dffae tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '23063613837343166', 'path': '/dev/sdb'} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:40:33 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb587e24-eac1-424a-8d8a-6bf7f68dffae tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23063613837343166', 'path': '/dev/sdb'} {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 14:40:33 user nova-compute[72129]: DEBUG nova.objects.instance [None req-bb587e24-eac1-424a-8d8a-6bf7f68dffae tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lazy-loading 'flavor' on Instance uuid 7b5266f7-4c4e-47c6-ae9f-de91882367d8 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:40:33 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-bb587e24-eac1-424a-8d8a-6bf7f68dffae tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 14:40:33 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:40:33 user nova-compute[72129]:   <source dev="/dev/sdb"/>
Aug 01 14:40:33 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 14:40:33 user nova-compute[72129]:   <serial>134cc7d6-6f7d-4c79-ae6a-f9a27d0de921</serial>
Aug 01 14:40:33 user nova-compute[72129]: </disk>
Aug 01 14:40:33 user nova-compute[72129]:  {{(pid=72129) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 14:40:33 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-bb587e24-eac1-424a-8d8a-6bf7f68dffae tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:40:33 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-bb587e24-eac1-424a-8d8a-6bf7f68dffae tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:40:33 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-bb587e24-eac1-424a-8d8a-6bf7f68dffae tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] No VIF found with MAC fa:16:3e:5a:79:44, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 14:40:33 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-bb587e24-eac1-424a-8d8a-6bf7f68dffae tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lock "7b5266f7-4c4e-47c6-ae9f-de91882367d8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.967s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:40:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-80e0d18c-6e19-408b-9029-f03f3a90cfbf tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Acquiring lock "7b5266f7-4c4e-47c6-ae9f-de91882367d8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:40:35 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-80e0d18c-6e19-408b-9029-f03f3a90cfbf tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lock "7b5266f7-4c4e-47c6-ae9f-de91882367d8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:40:35 user nova-compute[72129]: INFO nova.compute.manager [None req-80e0d18c-6e19-408b-9029-f03f3a90cfbf tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Detaching volume 134cc7d6-6f7d-4c79-ae6a-f9a27d0de921
Aug 01 14:40:35 user nova-compute[72129]: INFO nova.virt.block_device [None req-80e0d18c-6e19-408b-9029-f03f3a90cfbf tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Attempting to driver detach volume 134cc7d6-6f7d-4c79-ae6a-f9a27d0de921 from mountpoint /dev/vdb
Aug 01 14:40:35 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-80e0d18c-6e19-408b-9029-f03f3a90cfbf tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Attempting to detach device vdb from instance 7b5266f7-4c4e-47c6-ae9f-de91882367d8 from the persistent domain config. {{(pid=72129) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 14:40:35 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-80e0d18c-6e19-408b-9029-f03f3a90cfbf tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 14:40:35 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:40:35 user nova-compute[72129]:   <source dev="/dev/sdb"/>
Aug 01 14:40:35 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 14:40:35 user nova-compute[72129]:   <serial>134cc7d6-6f7d-4c79-ae6a-f9a27d0de921</serial>
Aug 01 14:40:35 user nova-compute[72129]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 14:40:35 user nova-compute[72129]: </disk>
Aug 01 14:40:35 user nova-compute[72129]:  {{(pid=72129) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 14:40:35 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-80e0d18c-6e19-408b-9029-f03f3a90cfbf tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Successfully detached device vdb from instance 7b5266f7-4c4e-47c6-ae9f-de91882367d8 from the persistent domain config.
Aug 01 14:40:35 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-80e0d18c-6e19-408b-9029-f03f3a90cfbf tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7b5266f7-4c4e-47c6-ae9f-de91882367d8 from the live domain config. {{(pid=72129) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 14:40:35 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-80e0d18c-6e19-408b-9029-f03f3a90cfbf tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 14:40:35 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:40:35 user nova-compute[72129]:   <source dev="/dev/sdb"/>
Aug 01 14:40:35 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 14:40:35 user nova-compute[72129]:   <serial>134cc7d6-6f7d-4c79-ae6a-f9a27d0de921</serial>
Aug 01 14:40:35 user nova-compute[72129]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 14:40:35 user nova-compute[72129]: </disk>
Aug 01 14:40:35 user nova-compute[72129]:  {{(pid=72129) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 14:40:36 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Received event <DeviceRemovedEvent: 1690900836.3332415, 7b5266f7-4c4e-47c6-ae9f-de91882367d8 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72129) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 14:40:36 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-80e0d18c-6e19-408b-9029-f03f3a90cfbf tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7b5266f7-4c4e-47c6-ae9f-de91882367d8 {{(pid=72129) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 14:40:36 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-80e0d18c-6e19-408b-9029-f03f3a90cfbf tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Successfully detached device vdb from instance 7b5266f7-4c4e-47c6-ae9f-de91882367d8 from the live domain config.
Aug 01 14:40:36 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80e0d18c-6e19-408b-9029-f03f3a90cfbf tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] calling os-brick to detach iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 14:40:36 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e0d18c-6e19-408b-9029-f03f3a90cfbf tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, {'target_iqns': ['iqn.2010-10.org.openstack:134cc7d6-6f7d-4c79-ae6a-f9a27d0de921'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JOhSnPUf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:40:36 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-80e0d18c-6e19-408b-9029-f03f3a90cfbf tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:40:36 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-80e0d18c-6e19-408b-9029-f03f3a90cfbf tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:40:36 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-80e0d18c-6e19-408b-9029-f03f3a90cfbf tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:40:36 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e0d18c-6e19-408b-9029-f03f3a90cfbf tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:134cc7d6-6f7d-4c79-ae6a-f9a27d0de921', 0)] {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 14:40:36 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:40:36 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:40:36 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c6724e4-5507-41f8-8a2f-61c24e7a9dad]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:134cc7d6-6f7d-4c79-ae6a-f9a27d0de921\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:40:36 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:40:36 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:40:36 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f2ccc9-a4b3-4a37-a808-6b3461e9da53]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cc7d6-6f7d-4c79-ae6a-f9a27d0de921 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:40:36 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e0d18c-6e19-408b-9029-f03f3a90cfbf tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cc7d6-6f7d-4c79-ae6a-f9a27d0de921 (non-flash)
Aug 01 14:40:36 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:40:36 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e0d18c-6e19-408b-9029-f03f3a90cfbf tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:134cc7d6-6f7d-4c79-ae6a-f9a27d0de921 (non-flash)
Aug 01 14:40:36 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:40:36 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e0d18c-6e19-408b-9029-f03f3a90cfbf tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f282898e830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:134cc7d6-6f7d-4c79-ae6a-f9a27d0de921'): ({'sdb'}, set())}) {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 14:40:36 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-80e0d18c-6e19-408b-9029-f03f3a90cfbf tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Removing single pathed devices sdb {{(pid=72129) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 14:40:36 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:40:36 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:40:36 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe178f1-b4cd-483c-af1d-61df89761249]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:40:36 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:40:36 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:40:36 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[caba5b6e-b190-45c4-9cb3-228ab65089bd]: (4, ('ok\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:40:36 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-80e0d18c-6e19-408b-9029-f03f3a90cfbf tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Flushing IO for device /dev/sdb {{(pid=72129) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 14:40:36 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:40:36 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:40:36 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3fc23f-2d48-456c-bd8b-42e90e159609]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:40:36 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-80e0d18c-6e19-408b-9029-f03f3a90cfbf tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72129) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 14:40:36 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:40:36 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:40:36 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:40:36 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[292f0a62-a660-4e92-88cf-6e0f50f799d8]: (4, ('1', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:40:36 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-80e0d18c-6e19-408b-9029-f03f3a90cfbf tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 14:40:36 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-80e0d18c-6e19-408b-9029-f03f3a90cfbf tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] SCSI volumes sdb have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 14:40:36 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e0d18c-6e19-408b-9029-f03f3a90cfbf tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:134cc7d6-6f7d-4c79-ae6a-f9a27d0de921')] {{(pid=72129) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 14:40:36 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:134cc7d6-6f7d-4c79-ae6a-f9a27d0de921 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:40:36 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:134cc7d6-6f7d-4c79-ae6a-f9a27d0de921 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:40:36 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c895a1d4-3fd2-4643-a8dc-3a0761126dc4]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:40:36 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e0d18c-6e19-408b-9029-f03f3a90cfbf tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:40:36 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:134cc7d6-6f7d-4c79-ae6a-f9a27d0de921 -p 172.16.0.220:3260 --logout {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:40:36 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:134cc7d6-6f7d-4c79-ae6a-f9a27d0de921 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:40:36 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58fdd8f-caa3-4619-af81-53a94cf98cba]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:134cc7d6-6f7d-4c79-ae6a-f9a27d0de921, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:134cc7d6-6f7d-4c79-ae6a-f9a27d0de921, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:40:36 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e0d18c-6e19-408b-9029-f03f3a90cfbf tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:134cc7d6-6f7d-4c79-ae6a-f9a27d0de921, portal: 172.16.0.220,3260]
Aug 01 14:40:36 user nova-compute[72129]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:134cc7d6-6f7d-4c79-ae6a-f9a27d0de921, portal: 172.16.0.220,3260] successful.
Aug 01 14:40:36 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:40:36 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:134cc7d6-6f7d-4c79-ae6a-f9a27d0de921 -p 172.16.0.220:3260 --op delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:40:36 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:134cc7d6-6f7d-4c79-ae6a-f9a27d0de921 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:40:36 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee9e26d-1e25-4dd2-a60d-686a7c497525]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:40:36 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e0d18c-6e19-408b-9029-f03f3a90cfbf tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:40:36 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-80e0d18c-6e19-408b-9029-f03f3a90cfbf tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.259s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:40:36 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e0d18c-6e19-408b-9029-f03f3a90cfbf tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] <== disconnect_volume: return (260ms) None {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:40:36 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80e0d18c-6e19-408b-9029-f03f3a90cfbf tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Disconnected iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 14:40:36 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:40:37 user nova-compute[72129]: DEBUG nova.objects.instance [None req-80e0d18c-6e19-408b-9029-f03f3a90cfbf tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lazy-loading 'flavor' on Instance uuid 7b5266f7-4c4e-47c6-ae9f-de91882367d8 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:40:37 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-80e0d18c-6e19-408b-9029-f03f3a90cfbf tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lock "7b5266f7-4c4e-47c6-ae9f-de91882367d8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.542s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:40:38 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:40:41 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:40:46 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:40:51 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:40:56 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:41:01 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:41:06 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:41:11 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:41:15 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:41:16 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:41:16 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72129) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 14:41:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:41:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:41:23 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:41:23 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:41:23 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:41:23 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:41:23 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Auditing locally available compute resources for user (node: user) {{(pid=72129) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 14:41:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b5266f7-4c4e-47c6-ae9f-de91882367d8/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:41:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b5266f7-4c4e-47c6-ae9f-de91882367d8/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:41:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b5266f7-4c4e-47c6-ae9f-de91882367d8/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:41:23 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b5266f7-4c4e-47c6-ae9f-de91882367d8/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:41:23 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:41:23 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:41:23 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Hypervisor/Node resource view: name=user free_ram=8872MB free_disk=25.062911987304688GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72129) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 14:41:23 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:41:23 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:41:24 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 7b5266f7-4c4e-47c6-ae9f-de91882367d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:41:24 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 14:41:24 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 14:41:24 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Refreshing inventories for resource provider c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 14:41:24 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Updating ProviderTree inventory for provider c2f345c3-9b82-4164-b21d-1eef8e661842 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 14:41:24 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Updating inventory in ProviderTree for provider c2f345c3-9b82-4164-b21d-1eef8e661842 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 14:41:24 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Refreshing aggregate associations for resource provider c2f345c3-9b82-4164-b21d-1eef8e661842, aggregates: None {{(pid=72129) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 14:41:24 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Refreshing trait associations for resource provider c2f345c3-9b82-4164-b21d-1eef8e661842, traits: COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE {{(pid=72129) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 14:41:24 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:41:24 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:41:24 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Compute_service record updated for user:user {{(pid=72129) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 14:41:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.450s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:41:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:41:28 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:41:28 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Starting heal instance info cache {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 14:41:28 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Rebuilding the list of instances to heal {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 14:41:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "refresh_cache-7b5266f7-4c4e-47c6-ae9f-de91882367d8" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:41:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquired lock "refresh_cache-7b5266f7-4c4e-47c6-ae9f-de91882367d8" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:41:28 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Forcefully refreshing network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 14:41:28 user nova-compute[72129]: DEBUG nova.objects.instance [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lazy-loading 'info_cache' on Instance uuid 7b5266f7-4c4e-47c6-ae9f-de91882367d8 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:41:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-72cd9901-d480-4b55-bddf-983658f0fdd6 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Acquiring lock "7b5266f7-4c4e-47c6-ae9f-de91882367d8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:41:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-72cd9901-d480-4b55-bddf-983658f0fdd6 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lock "7b5266f7-4c4e-47c6-ae9f-de91882367d8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:41:28 user nova-compute[72129]: DEBUG nova.objects.instance [None req-72cd9901-d480-4b55-bddf-983658f0fdd6 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lazy-loading 'flavor' on Instance uuid 7b5266f7-4c4e-47c6-ae9f-de91882367d8 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:41:28 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Updating instance_info_cache with network_info: [{"id": "b32c7e0b-2091-4c3d-bb68-05ea41b0b054", "address": "fa:16:3e:5a:79:44", "network": {"id": "ab6c1e03-f49f-473e-800f-75b628d68520", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1630528208-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d4bd37adfe64390a8923850d99aa534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32c7e0b-20", "ovs_interfaceid": "b32c7e0b-2091-4c3d-bb68-05ea41b0b054", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:41:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Releasing lock "refresh_cache-7b5266f7-4c4e-47c6-ae9f-de91882367d8" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:41:28 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Updated the network info_cache for instance {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 14:41:28 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:41:28 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:41:28 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:41:28 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:41:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-72cd9901-d480-4b55-bddf-983658f0fdd6 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lock "7b5266f7-4c4e-47c6-ae9f-de91882367d8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:41:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-72cd9901-d480-4b55-bddf-983658f0fdd6 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Acquiring lock "7b5266f7-4c4e-47c6-ae9f-de91882367d8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:41:28 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-72cd9901-d480-4b55-bddf-983658f0fdd6 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lock "7b5266f7-4c4e-47c6-ae9f-de91882367d8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:41:28 user nova-compute[72129]: INFO nova.compute.manager [None req-72cd9901-d480-4b55-bddf-983658f0fdd6 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Attaching volume f97687e5-1744-48b0-9294-22062689203e to /dev/vdb
Aug 01 14:41:29 user nova-compute[72129]: DEBUG os_brick.utils [None req-72cd9901-d480-4b55-bddf-983658f0fdd6 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:41:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:41:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:41:29 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c834b4dc-9447-40fa-997a-587b40cc8095]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f9b449c2cd3d\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:41:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:41:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:41:29 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[42054286-fcb8-469e-9796-f3a60fc61e76]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:41:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:41:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:41:29 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0df695-3b53-4030-871b-b5937112647a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:41:29 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[b805df4a-f246-4bab-9309-4ae0aafabc2e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:41:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-72cd9901-d480-4b55-bddf-983658f0fdd6 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Running cmd (subprocess): nvme version {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:41:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-72cd9901-d480-4b55-bddf-983658f0fdd6 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] 'nvme version' failed. Not Retrying. {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 14:41:29 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.nvmeof [None req-72cd9901-d480-4b55-bddf-983658f0fdd6 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] nvme not present on system {{(pid=72129) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 14:41:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:41:29 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 14:41:29 user nova-compute[72129]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 14:41:29 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[04bcfd5c-66bb-4790-8283-94db80a516df]: (4, '') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:41:29 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-72cd9901-d480-4b55-bddf-983658f0fdd6 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72129) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 14:41:29 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-72cd9901-d480-4b55-bddf-983658f0fdd6 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 14:41:29 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-72cd9901-d480-4b55-bddf-983658f0fdd6 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] LIGHTOS: no hostnqn found. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 14:41:29 user nova-compute[72129]: DEBUG os_brick.utils [None req-72cd9901-d480-4b55-bddf-983658f0fdd6 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f9b449c2cd3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:41:29 user nova-compute[72129]: DEBUG nova.virt.block_device [None req-72cd9901-d480-4b55-bddf-983658f0fdd6 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Updating existing volume attachment record: cb1ca0a0-efd0-4444-a676-45d617fd4510 {{(pid=72129) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 14:41:30 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:41:31 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:41:31 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:41:36 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72cd9901-d480-4b55-bddf-983658f0fdd6 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Calling os-brick to attach iSCSI Volume {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 14:41:36 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-72cd9901-d480-4b55-bddf-983658f0fdd6 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f97687e5-1744-48b0-9294-22062689203e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yDVUzJAx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:41:36 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-72cd9901-d480-4b55-bddf-983658f0fdd6 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:41:36 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-72cd9901-d480-4b55-bddf-983658f0fdd6 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:41:36 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-72cd9901-d480-4b55-bddf-983658f0fdd6 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:41:36 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-72cd9901-d480-4b55-bddf-983658f0fdd6 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:41:36 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-72cd9901-d480-4b55-bddf-983658f0fdd6 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f97687e5-1744-48b0-9294-22062689203e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:41:36 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-72cd9901-d480-4b55-bddf-983658f0fdd6 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f97687e5-1744-48b0-9294-22062689203e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:41:36 user nova-compute[72129]: INFO os_brick.initiator.connectors.iscsi [None req-72cd9901-d480-4b55-bddf-983658f0fdd6 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 14:41:36 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f97687e5-1744-48b0-9294-22062689203e -p 172.16.0.220:3260 {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:41:36 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f97687e5-1744-48b0-9294-22062689203e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:41:36 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[021bd0f4-4a62-46f1-8a70-bf91025cd32f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:41:36 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-72cd9901-d480-4b55-bddf-983658f0fdd6 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 14:41:36 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:41:36 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f97687e5-1744-48b0-9294-22062689203e -p 172.16.0.220:3260 --interface default --op new {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:41:36 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f97687e5-1744-48b0-9294-22062689203e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:41:36 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[3348c248-fe52-48a2-bd9a-cf34f835ce2e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f97687e5-1744-48b0-9294-22062689203e] added\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:41:36 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-72cd9901-d480-4b55-bddf-983658f0fdd6 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f97687e5-1744-48b0-9294-22062689203e] added
Aug 01 14:41:36 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:41:36 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f97687e5-1744-48b0-9294-22062689203e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:41:36 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f97687e5-1744-48b0-9294-22062689203e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:41:36 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[241fcf07-4bb1-4355-b007-41e7a8e673b3]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:41:36 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-72cd9901-d480-4b55-bddf-983658f0fdd6 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:41:36 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f97687e5-1744-48b0-9294-22062689203e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:41:36 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f97687e5-1744-48b0-9294-22062689203e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:41:36 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[3abd7e22-c2a5-4ffb-9105-4768462673f0]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:41:36 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-72cd9901-d480-4b55-bddf-983658f0fdd6 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:41:36 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f97687e5-1744-48b0-9294-22062689203e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yDVUzJAx {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:41:36 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f97687e5-1744-48b0-9294-22062689203e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yDVUzJAx" returned: 0 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:41:36 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b4b5c4-14fa-48b3-a454-fd63a05444d9]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:41:36 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-72cd9901-d480-4b55-bddf-983658f0fdd6 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yDVUzJAx'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:41:36 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f97687e5-1744-48b0-9294-22062689203e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:41:36 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f97687e5-1744-48b0-9294-22062689203e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:41:36 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[018423a0-1f8a-4861-b1dc-79bbd2408ce5]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:41:36 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-72cd9901-d480-4b55-bddf-983658f0fdd6 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:41:36 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:41:36 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:41:36 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe06b0ab-ebfb-4a22-a51f-1676ea9a45df]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:41:36 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-72cd9901-d480-4b55-bddf-983658f0fdd6 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 14:41:36 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:41:36 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-72cd9901-d480-4b55-bddf-983658f0fdd6 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 14:41:36 user nova-compute[72129]:  {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:41:36 user nova-compute[72129]: WARNING os_brick.initiator.connectors.iscsi [None req-72cd9901-d480-4b55-bddf-983658f0fdd6 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 14:41:36 user nova-compute[72129]: 
Aug 01 14:41:36 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f97687e5-1744-48b0-9294-22062689203e -p 172.16.0.220:3260 --login {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:41:36 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f97687e5-1744-48b0-9294-22062689203e -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:41:36 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa71225f-6433-4d2b-bfe1-c8f28edf7060]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f97687e5-1744-48b0-9294-22062689203e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f97687e5-1744-48b0-9294-22062689203e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:41:36 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-72cd9901-d480-4b55-bddf-983658f0fdd6 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f97687e5-1744-48b0-9294-22062689203e, portal: 172.16.0.220,3260]
Aug 01 14:41:36 user nova-compute[72129]: Login to [iface: default, target: iqn.2010-10.org.openstack:f97687e5-1744-48b0-9294-22062689203e, portal: 172.16.0.220,3260] successful.
Aug 01 14:41:36 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:41:36 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f97687e5-1744-48b0-9294-22062689203e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:41:36 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f97687e5-1744-48b0-9294-22062689203e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:41:36 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e8a2ec-552a-48d1-a0ed-24a5155b10f8]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:41:36 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-72cd9901-d480-4b55-bddf-983658f0fdd6 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:41:36 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:41:36 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:41:36 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb65606c-7bcb-4e80-9db4-68d46d72f156]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f97687e5-1744-48b0-9294-22062689203e (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:41:36 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-72cd9901-d480-4b55-bddf-983658f0fdd6 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f97687e5-1744-48b0-9294-22062689203e (non-flash)
Aug 01 14:41:36 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:41:36 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-72cd9901-d480-4b55-bddf-983658f0fdd6 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f97687e5-1744-48b0-9294-22062689203e (non-flash)
Aug 01 14:41:36 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:41:36 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-72cd9901-d480-4b55-bddf-983658f0fdd6 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f97687e5-1744-48b0-9294-22062689203e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:41:36 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-72cd9901-d480-4b55-bddf-983658f0fdd6 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Connected to 172.16.0.220:3260 {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 14:41:36 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-72cd9901-d480-4b55-bddf-983658f0fdd6 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=72129) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 14:41:36 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-72cd9901-d480-4b55-bddf-983658f0fdd6 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72129) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 14:41:36 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:41:36 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:41:36 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5011be-eca4-47f8-88f8-9e33c8f48c9c]: (4, ('- - 0', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:41:36 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-72cd9901-d480-4b55-bddf-983658f0fdd6 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: None {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 14:41:36 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:41:36 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:41:37 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-72cd9901-d480-4b55-bddf-983658f0fdd6 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 14:41:37 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-72cd9901-d480-4b55-bddf-983658f0fdd6 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yDVUzJAx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 14:41:37 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-72cd9901-d480-4b55-bddf-983658f0fdd6 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.279s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:41:37 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-72cd9901-d480-4b55-bddf-983658f0fdd6 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] <== connect_volume: return (1280ms) {'type': 'block', 'scsi_wwn': '23236333735653031', 'path': '/dev/sdb'} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:41:37 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72cd9901-d480-4b55-bddf-983658f0fdd6 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236333735653031', 'path': '/dev/sdb'} {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 14:41:37 user nova-compute[72129]: DEBUG nova.objects.instance [None req-72cd9901-d480-4b55-bddf-983658f0fdd6 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lazy-loading 'flavor' on Instance uuid 7b5266f7-4c4e-47c6-ae9f-de91882367d8 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:41:37 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-72cd9901-d480-4b55-bddf-983658f0fdd6 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 14:41:37 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:41:37 user nova-compute[72129]:   <source dev="/dev/sdb"/>
Aug 01 14:41:37 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 14:41:37 user nova-compute[72129]:   <serial>f97687e5-1744-48b0-9294-22062689203e</serial>
Aug 01 14:41:37 user nova-compute[72129]: </disk>
Aug 01 14:41:37 user nova-compute[72129]:  {{(pid=72129) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 14:41:37 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-72cd9901-d480-4b55-bddf-983658f0fdd6 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:41:37 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-72cd9901-d480-4b55-bddf-983658f0fdd6 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:41:37 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-72cd9901-d480-4b55-bddf-983658f0fdd6 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] No VIF found with MAC fa:16:3e:5a:79:44, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 14:41:37 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-72cd9901-d480-4b55-bddf-983658f0fdd6 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lock "7b5266f7-4c4e-47c6-ae9f-de91882367d8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.930s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:41:38 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:41:40 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-be7af0dd-8ef2-4c83-b54f-64a916f8ba62 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Acquiring lock "7b5266f7-4c4e-47c6-ae9f-de91882367d8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:41:40 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-be7af0dd-8ef2-4c83-b54f-64a916f8ba62 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lock "7b5266f7-4c4e-47c6-ae9f-de91882367d8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:41:40 user nova-compute[72129]: INFO nova.compute.manager [None req-be7af0dd-8ef2-4c83-b54f-64a916f8ba62 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Detaching volume f97687e5-1744-48b0-9294-22062689203e
Aug 01 14:41:40 user nova-compute[72129]: INFO nova.virt.block_device [None req-be7af0dd-8ef2-4c83-b54f-64a916f8ba62 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Attempting to driver detach volume f97687e5-1744-48b0-9294-22062689203e from mountpoint /dev/vdb
Aug 01 14:41:40 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-be7af0dd-8ef2-4c83-b54f-64a916f8ba62 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Attempting to detach device vdb from instance 7b5266f7-4c4e-47c6-ae9f-de91882367d8 from the persistent domain config. {{(pid=72129) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 14:41:40 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-be7af0dd-8ef2-4c83-b54f-64a916f8ba62 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 14:41:40 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:41:40 user nova-compute[72129]:   <source dev="/dev/sdb"/>
Aug 01 14:41:40 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 14:41:40 user nova-compute[72129]:   <serial>f97687e5-1744-48b0-9294-22062689203e</serial>
Aug 01 14:41:40 user nova-compute[72129]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 14:41:40 user nova-compute[72129]: </disk>
Aug 01 14:41:40 user nova-compute[72129]:  {{(pid=72129) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 14:41:40 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-be7af0dd-8ef2-4c83-b54f-64a916f8ba62 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Successfully detached device vdb from instance 7b5266f7-4c4e-47c6-ae9f-de91882367d8 from the persistent domain config.
Aug 01 14:41:40 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-be7af0dd-8ef2-4c83-b54f-64a916f8ba62 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7b5266f7-4c4e-47c6-ae9f-de91882367d8 from the live domain config. {{(pid=72129) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 14:41:40 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-be7af0dd-8ef2-4c83-b54f-64a916f8ba62 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 14:41:40 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:41:40 user nova-compute[72129]:   <source dev="/dev/sdb"/>
Aug 01 14:41:40 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 14:41:40 user nova-compute[72129]:   <serial>f97687e5-1744-48b0-9294-22062689203e</serial>
Aug 01 14:41:40 user nova-compute[72129]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 14:41:40 user nova-compute[72129]: </disk>
Aug 01 14:41:40 user nova-compute[72129]:  {{(pid=72129) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 14:41:40 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Received event <DeviceRemovedEvent: 1690900900.8948963, 7b5266f7-4c4e-47c6-ae9f-de91882367d8 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72129) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 14:41:40 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-be7af0dd-8ef2-4c83-b54f-64a916f8ba62 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7b5266f7-4c4e-47c6-ae9f-de91882367d8 {{(pid=72129) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 14:41:40 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-be7af0dd-8ef2-4c83-b54f-64a916f8ba62 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Successfully detached device vdb from instance 7b5266f7-4c4e-47c6-ae9f-de91882367d8 from the live domain config.
Aug 01 14:41:40 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be7af0dd-8ef2-4c83-b54f-64a916f8ba62 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] calling os-brick to detach iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 14:41:40 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7af0dd-8ef2-4c83-b54f-64a916f8ba62 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, {'target_iqns': ['iqn.2010-10.org.openstack:f97687e5-1744-48b0-9294-22062689203e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yDVUzJAx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:41:40 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-be7af0dd-8ef2-4c83-b54f-64a916f8ba62 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:41:40 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-be7af0dd-8ef2-4c83-b54f-64a916f8ba62 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:41:40 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-be7af0dd-8ef2-4c83-b54f-64a916f8ba62 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:41:40 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7af0dd-8ef2-4c83-b54f-64a916f8ba62 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f97687e5-1744-48b0-9294-22062689203e', 0)] {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 14:41:40 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:41:40 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:41:40 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[14690712-8d03-4981-8a78-a3f0da782bc9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f97687e5-1744-48b0-9294-22062689203e\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:41:40 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:41:40 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:41:40 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[e43fbc23-811c-4555-91ed-9e7bd0450a2a]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f97687e5-1744-48b0-9294-22062689203e (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:41:40 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7af0dd-8ef2-4c83-b54f-64a916f8ba62 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f97687e5-1744-48b0-9294-22062689203e (non-flash)
Aug 01 14:41:40 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:41:40 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7af0dd-8ef2-4c83-b54f-64a916f8ba62 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f97687e5-1744-48b0-9294-22062689203e (non-flash)
Aug 01 14:41:40 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:41:40 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7af0dd-8ef2-4c83-b54f-64a916f8ba62 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2810343250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f97687e5-1744-48b0-9294-22062689203e'): ({'sdb'}, set())}) {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 14:41:40 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-be7af0dd-8ef2-4c83-b54f-64a916f8ba62 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Removing single pathed devices sdb {{(pid=72129) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 14:41:40 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:41:40 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:41:40 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06a6674-cf1a-48a0-bafd-a9b743dab84e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:41:40 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:41:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:41:41 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0aa249-e542-43a3-948d-7c29d3588618]: (4, ('ok\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:41:41 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-be7af0dd-8ef2-4c83-b54f-64a916f8ba62 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Flushing IO for device /dev/sdb {{(pid=72129) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 14:41:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:41:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:41:41 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f06eb19-d053-4377-abf7-cf0fafceea8a]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:41:41 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-be7af0dd-8ef2-4c83-b54f-64a916f8ba62 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72129) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 14:41:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:41:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:41:41 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e0e60f-571a-4eca-88ce-4ca7cd1865d7]: (4, ('1', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:41:41 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-be7af0dd-8ef2-4c83-b54f-64a916f8ba62 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 14:41:41 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-be7af0dd-8ef2-4c83-b54f-64a916f8ba62 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] SCSI volumes sdb have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 14:41:41 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7af0dd-8ef2-4c83-b54f-64a916f8ba62 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f97687e5-1744-48b0-9294-22062689203e')] {{(pid=72129) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 14:41:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f97687e5-1744-48b0-9294-22062689203e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:41:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f97687e5-1744-48b0-9294-22062689203e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:41:41 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6323327-2107-4e16-b32e-e5adc0650ce5]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:41:41 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7af0dd-8ef2-4c83-b54f-64a916f8ba62 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:41:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f97687e5-1744-48b0-9294-22062689203e -p 172.16.0.220:3260 --logout {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:41:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f97687e5-1744-48b0-9294-22062689203e -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:41:41 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[79baf578-f681-43c8-8dbc-44a8507dec5d]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:f97687e5-1744-48b0-9294-22062689203e, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:f97687e5-1744-48b0-9294-22062689203e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:41:41 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7af0dd-8ef2-4c83-b54f-64a916f8ba62 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:f97687e5-1744-48b0-9294-22062689203e, portal: 172.16.0.220,3260]
Aug 01 14:41:41 user nova-compute[72129]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:f97687e5-1744-48b0-9294-22062689203e, portal: 172.16.0.220,3260] successful.
Aug 01 14:41:41 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:41:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f97687e5-1744-48b0-9294-22062689203e -p 172.16.0.220:3260 --op delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:41:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f97687e5-1744-48b0-9294-22062689203e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:41:41 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[5280937a-8bc9-4efa-a2fd-7b607f3504b1]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:41:41 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7af0dd-8ef2-4c83-b54f-64a916f8ba62 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:41:41 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-be7af0dd-8ef2-4c83-b54f-64a916f8ba62 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.252s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:41:41 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-be7af0dd-8ef2-4c83-b54f-64a916f8ba62 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] <== disconnect_volume: return (253ms) None {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:41:41 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be7af0dd-8ef2-4c83-b54f-64a916f8ba62 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Disconnected iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 14:41:41 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:41:41 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:41:41 user nova-compute[72129]: DEBUG nova.objects.instance [None req-be7af0dd-8ef2-4c83-b54f-64a916f8ba62 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lazy-loading 'flavor' on Instance uuid 7b5266f7-4c4e-47c6-ae9f-de91882367d8 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:41:41 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-be7af0dd-8ef2-4c83-b54f-64a916f8ba62 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lock "7b5266f7-4c4e-47c6-ae9f-de91882367d8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.613s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:41:46 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:41:48 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:41:48 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72129) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 14:41:51 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:41:56 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:42:01 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:42:06 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:42:06 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Cleaning up deleted instances {{(pid=72129) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 14:42:06 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] There are 0 instances to clean {{(pid=72129) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 14:42:06 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:42:06 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:42:06 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72129) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 14:42:06 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:42:06 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:42:06 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:42:11 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:42:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:42:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:42:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72129) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 14:42:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:42:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:42:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:42:17 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:42:18 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:42:18 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72129) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 14:42:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:42:24 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:42:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:42:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:42:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:42:24 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Auditing locally available compute resources for user (node: user) {{(pid=72129) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 14:42:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b5266f7-4c4e-47c6-ae9f-de91882367d8/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:42:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b5266f7-4c4e-47c6-ae9f-de91882367d8/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:42:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b5266f7-4c4e-47c6-ae9f-de91882367d8/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:42:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b5266f7-4c4e-47c6-ae9f-de91882367d8/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:42:24 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:42:24 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:42:24 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Hypervisor/Node resource view: name=user free_ram=8856MB free_disk=25.061885833740234GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72129) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 14:42:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:42:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:42:24 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 7b5266f7-4c4e-47c6-ae9f-de91882367d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:42:24 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 14:42:24 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 14:42:24 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:42:24 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:42:24 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Compute_service record updated for user:user {{(pid=72129) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 14:42:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.159s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:42:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:42:28 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:42:28 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Starting heal instance info cache {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 14:42:28 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Rebuilding the list of instances to heal {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 14:42:29 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "refresh_cache-7b5266f7-4c4e-47c6-ae9f-de91882367d8" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:42:29 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquired lock "refresh_cache-7b5266f7-4c4e-47c6-ae9f-de91882367d8" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:42:29 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Forcefully refreshing network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 14:42:29 user nova-compute[72129]: DEBUG nova.objects.instance [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lazy-loading 'info_cache' on Instance uuid 7b5266f7-4c4e-47c6-ae9f-de91882367d8 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:42:29 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Updating instance_info_cache with network_info: [{"id": "b32c7e0b-2091-4c3d-bb68-05ea41b0b054", "address": "fa:16:3e:5a:79:44", "network": {"id": "ab6c1e03-f49f-473e-800f-75b628d68520", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1630528208-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d4bd37adfe64390a8923850d99aa534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32c7e0b-20", "ovs_interfaceid": "b32c7e0b-2091-4c3d-bb68-05ea41b0b054", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:42:29 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Releasing lock "refresh_cache-7b5266f7-4c4e-47c6-ae9f-de91882367d8" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:42:29 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Updated the network info_cache for instance {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 14:42:29 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:42:29 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:42:29 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:42:29 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:42:30 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:42:31 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:42:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-df814e32-e4b0-48c8-b314-34d56473448a tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Acquiring lock "7b5266f7-4c4e-47c6-ae9f-de91882367d8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:42:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-df814e32-e4b0-48c8-b314-34d56473448a tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lock "7b5266f7-4c4e-47c6-ae9f-de91882367d8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:42:34 user nova-compute[72129]: DEBUG nova.objects.instance [None req-df814e32-e4b0-48c8-b314-34d56473448a tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lazy-loading 'flavor' on Instance uuid 7b5266f7-4c4e-47c6-ae9f-de91882367d8 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:42:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-df814e32-e4b0-48c8-b314-34d56473448a tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lock "7b5266f7-4c4e-47c6-ae9f-de91882367d8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:42:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-df814e32-e4b0-48c8-b314-34d56473448a tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Acquiring lock "7b5266f7-4c4e-47c6-ae9f-de91882367d8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:42:34 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-df814e32-e4b0-48c8-b314-34d56473448a tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lock "7b5266f7-4c4e-47c6-ae9f-de91882367d8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:42:34 user nova-compute[72129]: INFO nova.compute.manager [None req-df814e32-e4b0-48c8-b314-34d56473448a tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Attaching volume 451514cf-7eea-4810-8154-562985368046 to /dev/vdb
Aug 01 14:42:34 user nova-compute[72129]: DEBUG os_brick.utils [None req-df814e32-e4b0-48c8-b314-34d56473448a tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:42:34 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:42:34 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:42:34 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c791f5-523e-4c42-884d-20a15e84f516]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f9b449c2cd3d\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:42:34 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:42:34 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:42:34 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[84125b9f-aa02-49b0-a00c-0ab2da0b6a73]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:42:34 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:42:34 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:42:34 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[51eb29d8-3213-470d-a675-229d7ede9d7b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:42:34 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1f7459-4e43-4a07-8598-61a3af74f4fc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:42:34 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-df814e32-e4b0-48c8-b314-34d56473448a tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Running cmd (subprocess): nvme version {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:42:34 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-df814e32-e4b0-48c8-b314-34d56473448a tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] 'nvme version' failed. Not Retrying. {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 14:42:34 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.nvmeof [None req-df814e32-e4b0-48c8-b314-34d56473448a tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] nvme not present on system {{(pid=72129) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 14:42:34 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:42:34 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 14:42:34 user nova-compute[72129]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 14:42:34 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[3887323a-cf14-4180-bfb4-b56519df2f47]: (4, '') {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:42:34 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-df814e32-e4b0-48c8-b314-34d56473448a tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72129) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 14:42:34 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-df814e32-e4b0-48c8-b314-34d56473448a tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 14:42:34 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.lightos [None req-df814e32-e4b0-48c8-b314-34d56473448a tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] LIGHTOS: no hostnqn found. {{(pid=72129) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 14:42:34 user nova-compute[72129]: DEBUG os_brick.utils [None req-df814e32-e4b0-48c8-b314-34d56473448a tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f9b449c2cd3d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:42:34 user nova-compute[72129]: DEBUG nova.virt.block_device [None req-df814e32-e4b0-48c8-b314-34d56473448a tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Updating existing volume attachment record: bdb89a0a-de64-4925-8796-8d4c27ba2b1d {{(pid=72129) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 14:42:36 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:42:36 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:42:41 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:42:41 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df814e32-e4b0-48c8-b314-34d56473448a tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Calling os-brick to attach iSCSI Volume {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 14:42:41 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-df814e32-e4b0-48c8-b314-34d56473448a tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:451514cf-7eea-4810-8154-562985368046'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hbVwzMpK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:42:41 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-df814e32-e4b0-48c8-b314-34d56473448a tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:42:41 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-df814e32-e4b0-48c8-b314-34d56473448a tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:42:41 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-df814e32-e4b0-48c8-b314-34d56473448a tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:42:41 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-df814e32-e4b0-48c8-b314-34d56473448a tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:42:41 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-df814e32-e4b0-48c8-b314-34d56473448a tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:451514cf-7eea-4810-8154-562985368046" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:42:41 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-df814e32-e4b0-48c8-b314-34d56473448a tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:451514cf-7eea-4810-8154-562985368046" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:42:41 user nova-compute[72129]: INFO os_brick.initiator.connectors.iscsi [None req-df814e32-e4b0-48c8-b314-34d56473448a tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 14:42:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:451514cf-7eea-4810-8154-562985368046 -p 172.16.0.220:3260 {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:42:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:451514cf-7eea-4810-8154-562985368046 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:42:41 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[135a3509-8705-4a63-bac0-09cacc233e49]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:42:41 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-df814e32-e4b0-48c8-b314-34d56473448a tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 14:42:41 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:42:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:451514cf-7eea-4810-8154-562985368046 -p 172.16.0.220:3260 --interface default --op new {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:42:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:451514cf-7eea-4810-8154-562985368046 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:42:41 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[255671c2-39c5-45bc-9fdb-9c31faf0680a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:451514cf-7eea-4810-8154-562985368046] added\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:42:41 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-df814e32-e4b0-48c8-b314-34d56473448a tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:451514cf-7eea-4810-8154-562985368046] added
Aug 01 14:42:41 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:42:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:451514cf-7eea-4810-8154-562985368046 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:42:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:451514cf-7eea-4810-8154-562985368046 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:42:41 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a65099-76dc-44c9-a22f-506580f8efe0]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:42:41 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-df814e32-e4b0-48c8-b314-34d56473448a tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:42:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:451514cf-7eea-4810-8154-562985368046 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:42:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:451514cf-7eea-4810-8154-562985368046 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.033s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:42:41 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[1faf16c1-222c-46ec-9523-9483762fb423]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:42:41 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-df814e32-e4b0-48c8-b314-34d56473448a tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:42:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:451514cf-7eea-4810-8154-562985368046 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hbVwzMpK {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:42:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:451514cf-7eea-4810-8154-562985368046 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hbVwzMpK" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:42:41 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13ef122-5d39-4627-8d8d-507be119af15]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:42:41 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-df814e32-e4b0-48c8-b314-34d56473448a tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hbVwzMpK'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:42:41 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:451514cf-7eea-4810-8154-562985368046 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:42:41 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:42:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:451514cf-7eea-4810-8154-562985368046 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:42:42 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[f554f69f-5fa3-4fdb-aa70-b9c93287ef40]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:42:42 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-df814e32-e4b0-48c8-b314-34d56473448a tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:42:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:42:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:42:42 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[59753ab4-867a-4e9d-b093-8646ae6cbff8]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:42:42 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-df814e32-e4b0-48c8-b314-34d56473448a tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 14:42:42 user nova-compute[72129]:  {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:42:42 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-df814e32-e4b0-48c8-b314-34d56473448a tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 14:42:42 user nova-compute[72129]:  {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:42:42 user nova-compute[72129]: WARNING os_brick.initiator.connectors.iscsi [None req-df814e32-e4b0-48c8-b314-34d56473448a tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 14:42:42 user nova-compute[72129]: 
Aug 01 14:42:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:451514cf-7eea-4810-8154-562985368046 -p 172.16.0.220:3260 --login {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:42:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:451514cf-7eea-4810-8154-562985368046 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:42:42 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc555a5a-ddaf-4e35-9ec9-f73f6110645d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:451514cf-7eea-4810-8154-562985368046, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:451514cf-7eea-4810-8154-562985368046, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:42:42 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-df814e32-e4b0-48c8-b314-34d56473448a tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:451514cf-7eea-4810-8154-562985368046, portal: 172.16.0.220,3260]
Aug 01 14:42:42 user nova-compute[72129]: Login to [iface: default, target: iqn.2010-10.org.openstack:451514cf-7eea-4810-8154-562985368046, portal: 172.16.0.220,3260] successful.
Aug 01 14:42:42 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:42:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:451514cf-7eea-4810-8154-562985368046 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:42:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:451514cf-7eea-4810-8154-562985368046 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:42:42 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[be9f92a9-5147-4435-8b6b-0e3b3d8210f4]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:42:42 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-df814e32-e4b0-48c8-b314-34d56473448a tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:42:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:42:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:42:42 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[1264bbf0-77b6-4fcd-9c1f-801822170729]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:451514cf-7eea-4810-8154-562985368046 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:42:42 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-df814e32-e4b0-48c8-b314-34d56473448a tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:451514cf-7eea-4810-8154-562985368046 (non-flash)
Aug 01 14:42:42 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:42:42 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-df814e32-e4b0-48c8-b314-34d56473448a tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:451514cf-7eea-4810-8154-562985368046 (non-flash)
Aug 01 14:42:42 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:42:42 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-df814e32-e4b0-48c8-b314-34d56473448a tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:451514cf-7eea-4810-8154-562985368046" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:42:42 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-df814e32-e4b0-48c8-b314-34d56473448a tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Connected to 172.16.0.220:3260 {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 14:42:42 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-df814e32-e4b0-48c8-b314-34d56473448a tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=72129) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 14:42:42 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-df814e32-e4b0-48c8-b314-34d56473448a tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72129) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 14:42:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:42:42 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:42:42 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b964057-03e0-4d8f-bd75-a558cbd6eb1c]: (4, ('- - 0', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:42:42 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-df814e32-e4b0-48c8-b314-34d56473448a tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: None {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 14:42:43 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-df814e32-e4b0-48c8-b314-34d56473448a tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72129) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 14:42:43 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-df814e32-e4b0-48c8-b314-34d56473448a tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hbVwzMpK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72129) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 14:42:43 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-df814e32-e4b0-48c8-b314-34d56473448a tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:42:43 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-df814e32-e4b0-48c8-b314-34d56473448a tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23135316237363239', 'path': '/dev/sdb'} {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:42:43 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df814e32-e4b0-48c8-b314-34d56473448a tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23135316237363239', 'path': '/dev/sdb'} {{(pid=72129) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 14:42:43 user nova-compute[72129]: DEBUG nova.objects.instance [None req-df814e32-e4b0-48c8-b314-34d56473448a tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lazy-loading 'flavor' on Instance uuid 7b5266f7-4c4e-47c6-ae9f-de91882367d8 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:42:43 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-df814e32-e4b0-48c8-b314-34d56473448a tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 14:42:43 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:42:43 user nova-compute[72129]:   <source dev="/dev/sdb"/>
Aug 01 14:42:43 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 14:42:43 user nova-compute[72129]:   <serial>451514cf-7eea-4810-8154-562985368046</serial>
Aug 01 14:42:43 user nova-compute[72129]: </disk>
Aug 01 14:42:43 user nova-compute[72129]:  {{(pid=72129) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 14:42:43 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-df814e32-e4b0-48c8-b314-34d56473448a tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] No BDM found with device name vda, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:42:43 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-df814e32-e4b0-48c8-b314-34d56473448a tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72129) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 14:42:43 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-df814e32-e4b0-48c8-b314-34d56473448a tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] No VIF found with MAC fa:16:3e:5a:79:44, not building metadata {{(pid=72129) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 14:42:43 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-df814e32-e4b0-48c8-b314-34d56473448a tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lock "7b5266f7-4c4e-47c6-ae9f-de91882367d8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.058s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:42:46 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-805e9aab-0c3e-4f88-9dee-9affb2008878 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Acquiring lock "7b5266f7-4c4e-47c6-ae9f-de91882367d8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:42:46 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-805e9aab-0c3e-4f88-9dee-9affb2008878 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lock "7b5266f7-4c4e-47c6-ae9f-de91882367d8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:42:46 user nova-compute[72129]: INFO nova.compute.manager [None req-805e9aab-0c3e-4f88-9dee-9affb2008878 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Detaching volume 451514cf-7eea-4810-8154-562985368046
Aug 01 14:42:46 user nova-compute[72129]: INFO nova.virt.block_device [None req-805e9aab-0c3e-4f88-9dee-9affb2008878 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Attempting to driver detach volume 451514cf-7eea-4810-8154-562985368046 from mountpoint /dev/vdb
Aug 01 14:42:46 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-805e9aab-0c3e-4f88-9dee-9affb2008878 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Attempting to detach device vdb from instance 7b5266f7-4c4e-47c6-ae9f-de91882367d8 from the persistent domain config. {{(pid=72129) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 14:42:46 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-805e9aab-0c3e-4f88-9dee-9affb2008878 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 14:42:46 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:42:46 user nova-compute[72129]:   <source dev="/dev/sdb"/>
Aug 01 14:42:46 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 14:42:46 user nova-compute[72129]:   <serial>451514cf-7eea-4810-8154-562985368046</serial>
Aug 01 14:42:46 user nova-compute[72129]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 14:42:46 user nova-compute[72129]: </disk>
Aug 01 14:42:46 user nova-compute[72129]:  {{(pid=72129) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 14:42:46 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-805e9aab-0c3e-4f88-9dee-9affb2008878 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Successfully detached device vdb from instance 7b5266f7-4c4e-47c6-ae9f-de91882367d8 from the persistent domain config.
Aug 01 14:42:46 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-805e9aab-0c3e-4f88-9dee-9affb2008878 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7b5266f7-4c4e-47c6-ae9f-de91882367d8 from the live domain config. {{(pid=72129) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 14:42:46 user nova-compute[72129]: DEBUG nova.virt.libvirt.guest [None req-805e9aab-0c3e-4f88-9dee-9affb2008878 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 14:42:46 user nova-compute[72129]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 14:42:46 user nova-compute[72129]:   <source dev="/dev/sdb"/>
Aug 01 14:42:46 user nova-compute[72129]:   <target dev="vdb" bus="virtio"/>
Aug 01 14:42:46 user nova-compute[72129]:   <serial>451514cf-7eea-4810-8154-562985368046</serial>
Aug 01 14:42:46 user nova-compute[72129]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 14:42:46 user nova-compute[72129]: </disk>
Aug 01 14:42:46 user nova-compute[72129]:  {{(pid=72129) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 14:42:46 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-9b217afd-94ca-4660-b32f-ad8d0f60ee64 None None] Received event <DeviceRemovedEvent: 1690900966.516472, 7b5266f7-4c4e-47c6-ae9f-de91882367d8 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72129) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 14:42:46 user nova-compute[72129]: DEBUG nova.virt.libvirt.driver [None req-805e9aab-0c3e-4f88-9dee-9affb2008878 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7b5266f7-4c4e-47c6-ae9f-de91882367d8 {{(pid=72129) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 14:42:46 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-805e9aab-0c3e-4f88-9dee-9affb2008878 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Successfully detached device vdb from instance 7b5266f7-4c4e-47c6-ae9f-de91882367d8 from the live domain config.
Aug 01 14:42:46 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-805e9aab-0c3e-4f88-9dee-9affb2008878 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] calling os-brick to detach iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 14:42:46 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-805e9aab-0c3e-4f88-9dee-9affb2008878 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f28201712a0>, {'target_iqns': ['iqn.2010-10.org.openstack:451514cf-7eea-4810-8154-562985368046'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hbVwzMpK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 14:42:46 user nova-compute[72129]: WARNING os_brick.initiator.connectors.base [None req-805e9aab-0c3e-4f88-9dee-9affb2008878 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 14:42:46 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-805e9aab-0c3e-4f88-9dee-9affb2008878 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 14:42:46 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-805e9aab-0c3e-4f88-9dee-9affb2008878 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 14:42:46 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-805e9aab-0c3e-4f88-9dee-9affb2008878 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:451514cf-7eea-4810-8154-562985368046', 0)] {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 14:42:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:42:46 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:42:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:42:46 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d73e9b-98e5-472c-9233-89650d07386c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:451514cf-7eea-4810-8154-562985368046\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:42:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:42:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:42:46 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b04134e-a894-4dde-9c87-1edd5205faef]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:451514cf-7eea-4810-8154-562985368046 (non-flash)\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:42:46 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-805e9aab-0c3e-4f88-9dee-9affb2008878 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:451514cf-7eea-4810-8154-562985368046 (non-flash)
Aug 01 14:42:46 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 14:42:46 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-805e9aab-0c3e-4f88-9dee-9affb2008878 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:451514cf-7eea-4810-8154-562985368046 (non-flash)
Aug 01 14:42:46 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 14:42:46 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-805e9aab-0c3e-4f88-9dee-9affb2008878 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2810341ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:451514cf-7eea-4810-8154-562985368046'): ({'sdb'}, set())}) {{(pid=72129) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 14:42:46 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-805e9aab-0c3e-4f88-9dee-9affb2008878 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Removing single pathed devices sdb {{(pid=72129) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 14:42:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:42:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:42:46 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e72073-9460-4b5a-86da-677bfc5ec959]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:42:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:42:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:42:46 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[01934a45-ff8b-4a2c-8e25-a55f1d1a2a1b]: (4, ('ok\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:42:46 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-805e9aab-0c3e-4f88-9dee-9affb2008878 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Flushing IO for device /dev/sdb {{(pid=72129) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 14:42:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:42:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:42:46 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[67719eff-1c6f-4ca9-86d0-cd05bf7ff9e8]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:42:46 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-805e9aab-0c3e-4f88-9dee-9affb2008878 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72129) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 14:42:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:42:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:42:46 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb25755-d39f-4dbc-898c-7220dc30be90]: (4, ('1', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:42:46 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-805e9aab-0c3e-4f88-9dee-9affb2008878 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 14:42:46 user nova-compute[72129]: DEBUG os_brick.initiator.linuxscsi [None req-805e9aab-0c3e-4f88-9dee-9affb2008878 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] SCSI volumes sdb have been removed. {{(pid=72129) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 14:42:46 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-805e9aab-0c3e-4f88-9dee-9affb2008878 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:451514cf-7eea-4810-8154-562985368046')] {{(pid=72129) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 14:42:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:451514cf-7eea-4810-8154-562985368046 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:42:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:451514cf-7eea-4810-8154-562985368046 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:42:46 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[edcfd18b-ad37-4cae-adb4-e358827b0dee]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:42:46 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-805e9aab-0c3e-4f88-9dee-9affb2008878 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:42:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:451514cf-7eea-4810-8154-562985368046 -p 172.16.0.220:3260 --logout {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:42:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:451514cf-7eea-4810-8154-562985368046 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:42:46 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e7474e-7e3d-469d-ae33-310167477cf0]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:451514cf-7eea-4810-8154-562985368046, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:451514cf-7eea-4810-8154-562985368046, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:42:46 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-805e9aab-0c3e-4f88-9dee-9affb2008878 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:451514cf-7eea-4810-8154-562985368046, portal: 172.16.0.220,3260]
Aug 01 14:42:46 user nova-compute[72129]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:451514cf-7eea-4810-8154-562985368046, portal: 172.16.0.220,3260] successful.
Aug 01 14:42:46 user nova-compute[72129]:  stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:42:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:451514cf-7eea-4810-8154-562985368046 -p 172.16.0.220:3260 --op delete {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:42:46 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:451514cf-7eea-4810-8154-562985368046 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=82887) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:42:46 user nova-compute[72129]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9fe6880-70ba-477c-9629-37dbc90b2d18]: (4, ('', '')) {{(pid=82887) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 14:42:46 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-805e9aab-0c3e-4f88-9dee-9affb2008878 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72129) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 14:42:46 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.base [None req-805e9aab-0c3e-4f88-9dee-9affb2008878 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.248s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 14:42:46 user nova-compute[72129]: DEBUG os_brick.initiator.connectors.iscsi [None req-805e9aab-0c3e-4f88-9dee-9affb2008878 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] <== disconnect_volume: return (249ms) None {{(pid=72129) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 14:42:46 user nova-compute[72129]: DEBUG nova.virt.libvirt.volume.iscsi [None req-805e9aab-0c3e-4f88-9dee-9affb2008878 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Disconnected iSCSI Volume {{(pid=72129) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 14:42:46 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:42:47 user nova-compute[72129]: DEBUG nova.objects.instance [None req-805e9aab-0c3e-4f88-9dee-9affb2008878 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lazy-loading 'flavor' on Instance uuid 7b5266f7-4c4e-47c6-ae9f-de91882367d8 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:42:47 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-805e9aab-0c3e-4f88-9dee-9affb2008878 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lock "7b5266f7-4c4e-47c6-ae9f-de91882367d8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.630s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:42:51 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:42:56 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:42:56 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:42:56 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72129) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 14:42:56 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:42:56 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:42:56 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:43:01 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:43:06 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:43:11 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:43:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:43:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:43:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72129) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 14:43:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:43:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:43:16 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:43:19 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:43:19 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:43:19 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72129) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 14:43:21 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:43:24 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:43:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:43:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:43:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:43:24 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Auditing locally available compute resources for user (node: user) {{(pid=72129) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 14:43:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b5266f7-4c4e-47c6-ae9f-de91882367d8/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:43:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b5266f7-4c4e-47c6-ae9f-de91882367d8/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:43:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b5266f7-4c4e-47c6-ae9f-de91882367d8/disk --force-share --output=json {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 14:43:24 user nova-compute[72129]: DEBUG oslo_concurrency.processutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b5266f7-4c4e-47c6-ae9f-de91882367d8/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72129) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 14:43:24 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:43:24 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:43:24 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Hypervisor/Node resource view: name=user free_ram=8845MB free_disk=25.060863494873047GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72129) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 14:43:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:43:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:43:24 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Instance 7b5266f7-4c4e-47c6-ae9f-de91882367d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72129) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 14:43:24 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 14:43:24 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 14:43:25 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:43:25 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:43:25 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Compute_service record updated for user:user {{(pid=72129) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 14:43:25 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.170s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:43:26 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:43:29 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:43:29 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:43:30 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:43:30 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Starting heal instance info cache {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 14:43:30 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Rebuilding the list of instances to heal {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 14:43:30 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "refresh_cache-7b5266f7-4c4e-47c6-ae9f-de91882367d8" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 14:43:30 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquired lock "refresh_cache-7b5266f7-4c4e-47c6-ae9f-de91882367d8" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 14:43:30 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Forcefully refreshing network info cache for instance {{(pid=72129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 14:43:30 user nova-compute[72129]: DEBUG nova.objects.instance [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lazy-loading 'info_cache' on Instance uuid 7b5266f7-4c4e-47c6-ae9f-de91882367d8 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:43:30 user nova-compute[72129]: DEBUG nova.network.neutron [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Updating instance_info_cache with network_info: [{"id": "b32c7e0b-2091-4c3d-bb68-05ea41b0b054", "address": "fa:16:3e:5a:79:44", "network": {"id": "ab6c1e03-f49f-473e-800f-75b628d68520", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1630528208-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d4bd37adfe64390a8923850d99aa534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32c7e0b-20", "ovs_interfaceid": "b32c7e0b-2091-4c3d-bb68-05ea41b0b054", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:43:30 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Releasing lock "refresh_cache-7b5266f7-4c4e-47c6-ae9f-de91882367d8" {{(pid=72129) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 14:43:30 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Updated the network info_cache for instance {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 14:43:30 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:43:30 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:43:31 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:43:31 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:43:36 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:43:41 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:43:46 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:43:51 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:43:56 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:44:01 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:44:04 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-4c6778a5-fdb8-4196-89f3-23bd347276b5 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Acquiring lock "7b5266f7-4c4e-47c6-ae9f-de91882367d8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:44:04 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-4c6778a5-fdb8-4196-89f3-23bd347276b5 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lock "7b5266f7-4c4e-47c6-ae9f-de91882367d8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:44:04 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-4c6778a5-fdb8-4196-89f3-23bd347276b5 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Acquiring lock "7b5266f7-4c4e-47c6-ae9f-de91882367d8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:44:04 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-4c6778a5-fdb8-4196-89f3-23bd347276b5 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lock "7b5266f7-4c4e-47c6-ae9f-de91882367d8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:44:04 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-4c6778a5-fdb8-4196-89f3-23bd347276b5 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lock "7b5266f7-4c4e-47c6-ae9f-de91882367d8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:44:04 user nova-compute[72129]: INFO nova.compute.manager [None req-4c6778a5-fdb8-4196-89f3-23bd347276b5 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Terminating instance
Aug 01 14:44:04 user nova-compute[72129]: DEBUG nova.compute.manager [None req-4c6778a5-fdb8-4196-89f3-23bd347276b5 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Start destroying the instance on the hypervisor. {{(pid=72129) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 14:44:04 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:44:04 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:44:04 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:44:05 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:44:05 user nova-compute[72129]: DEBUG nova.compute.manager [req-34f07a68-2a64-4050-ae89-e154d9877a71 req-d287bbeb-26aa-4158-89f0-e470061da687 service nova] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Received event network-vif-unplugged-b32c7e0b-2091-4c3d-bb68-05ea41b0b054 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:44:05 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-34f07a68-2a64-4050-ae89-e154d9877a71 req-d287bbeb-26aa-4158-89f0-e470061da687 service nova] Acquiring lock "7b5266f7-4c4e-47c6-ae9f-de91882367d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:44:05 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-34f07a68-2a64-4050-ae89-e154d9877a71 req-d287bbeb-26aa-4158-89f0-e470061da687 service nova] Lock "7b5266f7-4c4e-47c6-ae9f-de91882367d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:44:05 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-34f07a68-2a64-4050-ae89-e154d9877a71 req-d287bbeb-26aa-4158-89f0-e470061da687 service nova] Lock "7b5266f7-4c4e-47c6-ae9f-de91882367d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:44:05 user nova-compute[72129]: DEBUG nova.compute.manager [req-34f07a68-2a64-4050-ae89-e154d9877a71 req-d287bbeb-26aa-4158-89f0-e470061da687 service nova] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] No waiting events found dispatching network-vif-unplugged-b32c7e0b-2091-4c3d-bb68-05ea41b0b054 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:44:05 user nova-compute[72129]: DEBUG nova.compute.manager [req-34f07a68-2a64-4050-ae89-e154d9877a71 req-d287bbeb-26aa-4158-89f0-e470061da687 service nova] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Received event network-vif-unplugged-b32c7e0b-2091-4c3d-bb68-05ea41b0b054 for instance with task_state deleting. {{(pid=72129) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 14:44:05 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:44:05 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:44:05 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:44:05 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:44:05 user nova-compute[72129]: INFO nova.virt.libvirt.driver [-] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Instance destroyed successfully.
Aug 01 14:44:05 user nova-compute[72129]: DEBUG nova.objects.instance [None req-4c6778a5-fdb8-4196-89f3-23bd347276b5 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lazy-loading 'resources' on Instance uuid 7b5266f7-4c4e-47c6-ae9f-de91882367d8 {{(pid=72129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 14:44:05 user nova-compute[72129]: DEBUG nova.virt.libvirt.vif [None req-4c6778a5-fdb8-4196-89f3-23bd347276b5 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T14:37:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1333244913',display_name='tempest-SnapshotDataIntegrityTests-server-1333244913',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1333244913',id=52,image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4qfhRfUAgGTJD4U5bIAuThWZrdvTM5El2Fh53H3141MBL5DCvI7o1K+Kxugag8SwQtuHtvDqyx18oh4mX5IroBlLLbn4l7AQIUrCFEcqaOg3XAcEEi+Q5Qr3Zv4bNv1A==',key_name='tempest-keypair-634626118',keypairs=<?>,launch_index=0,launched_at=2023-08-01T14:37:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7d4bd37adfe64390a8923850d99aa534',ramdisk_id='',reservation_id='r-1fiw344i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b6472c34-1b0f-4034-ba3a-7e8eb5103715',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-365166466',owner_user_name='tempest-SnapshotDataIntegrityTests-365166466-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T14:37:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='46ae3bdbb1a9473fa0f5b875c8d6ed40',uuid=7b5266f7-4c4e-47c6-ae9f-de91882367d8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b32c7e0b-2091-4c3d-bb68-05ea41b0b054", "address": "fa:16:3e:5a:79:44", "network": {"id": "ab6c1e03-f49f-473e-800f-75b628d68520", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1630528208-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d4bd37adfe64390a8923850d99aa534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32c7e0b-20", "ovs_interfaceid": "b32c7e0b-2091-4c3d-bb68-05ea41b0b054", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 14:44:05 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-4c6778a5-fdb8-4196-89f3-23bd347276b5 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Converting VIF {"id": "b32c7e0b-2091-4c3d-bb68-05ea41b0b054", "address": "fa:16:3e:5a:79:44", "network": {"id": "ab6c1e03-f49f-473e-800f-75b628d68520", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1630528208-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d4bd37adfe64390a8923850d99aa534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb32c7e0b-20", "ovs_interfaceid": "b32c7e0b-2091-4c3d-bb68-05ea41b0b054", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 14:44:05 user nova-compute[72129]: DEBUG nova.network.os_vif_util [None req-4c6778a5-fdb8-4196-89f3-23bd347276b5 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5a:79:44,bridge_name='br-int',has_traffic_filtering=True,id=b32c7e0b-2091-4c3d-bb68-05ea41b0b054,network=Network(ab6c1e03-f49f-473e-800f-75b628d68520),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb32c7e0b-20') {{(pid=72129) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 14:44:05 user nova-compute[72129]: DEBUG os_vif [None req-4c6778a5-fdb8-4196-89f3-23bd347276b5 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:79:44,bridge_name='br-int',has_traffic_filtering=True,id=b32c7e0b-2091-4c3d-bb68-05ea41b0b054,network=Network(ab6c1e03-f49f-473e-800f-75b628d68520),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb32c7e0b-20') {{(pid=72129) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 14:44:05 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:44:05 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb32c7e0b-20, bridge=br-int, if_exists=True) {{(pid=72129) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 14:44:05 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:44:05 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:44:05 user nova-compute[72129]: INFO os_vif [None req-4c6778a5-fdb8-4196-89f3-23bd347276b5 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:79:44,bridge_name='br-int',has_traffic_filtering=True,id=b32c7e0b-2091-4c3d-bb68-05ea41b0b054,network=Network(ab6c1e03-f49f-473e-800f-75b628d68520),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb32c7e0b-20')
Aug 01 14:44:05 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-4c6778a5-fdb8-4196-89f3-23bd347276b5 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Deleting instance files /opt/stack/data/nova/instances/7b5266f7-4c4e-47c6-ae9f-de91882367d8_del
Aug 01 14:44:05 user nova-compute[72129]: INFO nova.virt.libvirt.driver [None req-4c6778a5-fdb8-4196-89f3-23bd347276b5 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Deletion of /opt/stack/data/nova/instances/7b5266f7-4c4e-47c6-ae9f-de91882367d8_del complete
Aug 01 14:44:05 user nova-compute[72129]: INFO nova.compute.manager [None req-4c6778a5-fdb8-4196-89f3-23bd347276b5 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 01 14:44:05 user nova-compute[72129]: DEBUG oslo.service.loopingcall [None req-4c6778a5-fdb8-4196-89f3-23bd347276b5 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72129) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 14:44:05 user nova-compute[72129]: DEBUG nova.compute.manager [-] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Deallocating network for instance {{(pid=72129) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 14:44:05 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] deallocate_for_instance() {{(pid=72129) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 14:44:06 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:44:06 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:44:06 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:44:06 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:44:06 user nova-compute[72129]: DEBUG nova.network.neutron [-] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Updating instance_info_cache with network_info: [] {{(pid=72129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 14:44:06 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Took 1.01 seconds to deallocate network for instance.
Aug 01 14:44:06 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-4c6778a5-fdb8-4196-89f3-23bd347276b5 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:44:06 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-4c6778a5-fdb8-4196-89f3-23bd347276b5 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:44:06 user nova-compute[72129]: DEBUG nova.compute.manager [req-a6c5afa6-a405-471a-9f81-242b108d932c req-3c674616-d5de-4481-b303-2cb3daa759a6 service nova] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Received event network-vif-deleted-b32c7e0b-2091-4c3d-bb68-05ea41b0b054 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:44:07 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-4c6778a5-fdb8-4196-89f3-23bd347276b5 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:44:07 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-4c6778a5-fdb8-4196-89f3-23bd347276b5 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:44:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-4c6778a5-fdb8-4196-89f3-23bd347276b5 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.226s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:44:07 user nova-compute[72129]: INFO nova.scheduler.client.report [None req-4c6778a5-fdb8-4196-89f3-23bd347276b5 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Deleted allocations for instance 7b5266f7-4c4e-47c6-ae9f-de91882367d8
Aug 01 14:44:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-4c6778a5-fdb8-4196-89f3-23bd347276b5 tempest-SnapshotDataIntegrityTests-365166466 tempest-SnapshotDataIntegrityTests-365166466-project-member] Lock "7b5266f7-4c4e-47c6-ae9f-de91882367d8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.392s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:44:07 user nova-compute[72129]: DEBUG nova.compute.manager [req-2ed2214b-b841-42f3-b42e-d7fc86606665 req-13b6d1bc-4236-4547-8d2d-6f517b850523 service nova] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Received event network-vif-plugged-b32c7e0b-2091-4c3d-bb68-05ea41b0b054 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:44:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-2ed2214b-b841-42f3-b42e-d7fc86606665 req-13b6d1bc-4236-4547-8d2d-6f517b850523 service nova] Acquiring lock "7b5266f7-4c4e-47c6-ae9f-de91882367d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:44:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-2ed2214b-b841-42f3-b42e-d7fc86606665 req-13b6d1bc-4236-4547-8d2d-6f517b850523 service nova] Lock "7b5266f7-4c4e-47c6-ae9f-de91882367d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:44:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-2ed2214b-b841-42f3-b42e-d7fc86606665 req-13b6d1bc-4236-4547-8d2d-6f517b850523 service nova] Lock "7b5266f7-4c4e-47c6-ae9f-de91882367d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:44:07 user nova-compute[72129]: DEBUG nova.compute.manager [req-2ed2214b-b841-42f3-b42e-d7fc86606665 req-13b6d1bc-4236-4547-8d2d-6f517b850523 service nova] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] No waiting events found dispatching network-vif-plugged-b32c7e0b-2091-4c3d-bb68-05ea41b0b054 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:44:07 user nova-compute[72129]: WARNING nova.compute.manager [req-2ed2214b-b841-42f3-b42e-d7fc86606665 req-13b6d1bc-4236-4547-8d2d-6f517b850523 service nova] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Received unexpected event network-vif-plugged-b32c7e0b-2091-4c3d-bb68-05ea41b0b054 for instance with vm_state deleted and task_state None.
Aug 01 14:44:07 user nova-compute[72129]: DEBUG nova.compute.manager [req-2ed2214b-b841-42f3-b42e-d7fc86606665 req-13b6d1bc-4236-4547-8d2d-6f517b850523 service nova] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Received event network-vif-plugged-b32c7e0b-2091-4c3d-bb68-05ea41b0b054 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:44:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-2ed2214b-b841-42f3-b42e-d7fc86606665 req-13b6d1bc-4236-4547-8d2d-6f517b850523 service nova] Acquiring lock "7b5266f7-4c4e-47c6-ae9f-de91882367d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:44:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-2ed2214b-b841-42f3-b42e-d7fc86606665 req-13b6d1bc-4236-4547-8d2d-6f517b850523 service nova] Lock "7b5266f7-4c4e-47c6-ae9f-de91882367d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:44:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-2ed2214b-b841-42f3-b42e-d7fc86606665 req-13b6d1bc-4236-4547-8d2d-6f517b850523 service nova] Lock "7b5266f7-4c4e-47c6-ae9f-de91882367d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:44:07 user nova-compute[72129]: DEBUG nova.compute.manager [req-2ed2214b-b841-42f3-b42e-d7fc86606665 req-13b6d1bc-4236-4547-8d2d-6f517b850523 service nova] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] No waiting events found dispatching network-vif-plugged-b32c7e0b-2091-4c3d-bb68-05ea41b0b054 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:44:07 user nova-compute[72129]: WARNING nova.compute.manager [req-2ed2214b-b841-42f3-b42e-d7fc86606665 req-13b6d1bc-4236-4547-8d2d-6f517b850523 service nova] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Received unexpected event network-vif-plugged-b32c7e0b-2091-4c3d-bb68-05ea41b0b054 for instance with vm_state deleted and task_state None.
Aug 01 14:44:07 user nova-compute[72129]: DEBUG nova.compute.manager [req-2ed2214b-b841-42f3-b42e-d7fc86606665 req-13b6d1bc-4236-4547-8d2d-6f517b850523 service nova] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Received event network-vif-plugged-b32c7e0b-2091-4c3d-bb68-05ea41b0b054 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:44:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-2ed2214b-b841-42f3-b42e-d7fc86606665 req-13b6d1bc-4236-4547-8d2d-6f517b850523 service nova] Acquiring lock "7b5266f7-4c4e-47c6-ae9f-de91882367d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:44:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-2ed2214b-b841-42f3-b42e-d7fc86606665 req-13b6d1bc-4236-4547-8d2d-6f517b850523 service nova] Lock "7b5266f7-4c4e-47c6-ae9f-de91882367d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:44:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-2ed2214b-b841-42f3-b42e-d7fc86606665 req-13b6d1bc-4236-4547-8d2d-6f517b850523 service nova] Lock "7b5266f7-4c4e-47c6-ae9f-de91882367d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:44:07 user nova-compute[72129]: DEBUG nova.compute.manager [req-2ed2214b-b841-42f3-b42e-d7fc86606665 req-13b6d1bc-4236-4547-8d2d-6f517b850523 service nova] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] No waiting events found dispatching network-vif-plugged-b32c7e0b-2091-4c3d-bb68-05ea41b0b054 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:44:07 user nova-compute[72129]: WARNING nova.compute.manager [req-2ed2214b-b841-42f3-b42e-d7fc86606665 req-13b6d1bc-4236-4547-8d2d-6f517b850523 service nova] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Received unexpected event network-vif-plugged-b32c7e0b-2091-4c3d-bb68-05ea41b0b054 for instance with vm_state deleted and task_state None.
Aug 01 14:44:07 user nova-compute[72129]: DEBUG nova.compute.manager [req-2ed2214b-b841-42f3-b42e-d7fc86606665 req-13b6d1bc-4236-4547-8d2d-6f517b850523 service nova] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Received event network-vif-unplugged-b32c7e0b-2091-4c3d-bb68-05ea41b0b054 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:44:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-2ed2214b-b841-42f3-b42e-d7fc86606665 req-13b6d1bc-4236-4547-8d2d-6f517b850523 service nova] Acquiring lock "7b5266f7-4c4e-47c6-ae9f-de91882367d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:44:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-2ed2214b-b841-42f3-b42e-d7fc86606665 req-13b6d1bc-4236-4547-8d2d-6f517b850523 service nova] Lock "7b5266f7-4c4e-47c6-ae9f-de91882367d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:44:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-2ed2214b-b841-42f3-b42e-d7fc86606665 req-13b6d1bc-4236-4547-8d2d-6f517b850523 service nova] Lock "7b5266f7-4c4e-47c6-ae9f-de91882367d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:44:07 user nova-compute[72129]: DEBUG nova.compute.manager [req-2ed2214b-b841-42f3-b42e-d7fc86606665 req-13b6d1bc-4236-4547-8d2d-6f517b850523 service nova] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] No waiting events found dispatching network-vif-unplugged-b32c7e0b-2091-4c3d-bb68-05ea41b0b054 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:44:07 user nova-compute[72129]: WARNING nova.compute.manager [req-2ed2214b-b841-42f3-b42e-d7fc86606665 req-13b6d1bc-4236-4547-8d2d-6f517b850523 service nova] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Received unexpected event network-vif-unplugged-b32c7e0b-2091-4c3d-bb68-05ea41b0b054 for instance with vm_state deleted and task_state None.
Aug 01 14:44:07 user nova-compute[72129]: DEBUG nova.compute.manager [req-2ed2214b-b841-42f3-b42e-d7fc86606665 req-13b6d1bc-4236-4547-8d2d-6f517b850523 service nova] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Received event network-vif-plugged-b32c7e0b-2091-4c3d-bb68-05ea41b0b054 {{(pid=72129) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 14:44:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-2ed2214b-b841-42f3-b42e-d7fc86606665 req-13b6d1bc-4236-4547-8d2d-6f517b850523 service nova] Acquiring lock "7b5266f7-4c4e-47c6-ae9f-de91882367d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:44:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-2ed2214b-b841-42f3-b42e-d7fc86606665 req-13b6d1bc-4236-4547-8d2d-6f517b850523 service nova] Lock "7b5266f7-4c4e-47c6-ae9f-de91882367d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:44:07 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [req-2ed2214b-b841-42f3-b42e-d7fc86606665 req-13b6d1bc-4236-4547-8d2d-6f517b850523 service nova] Lock "7b5266f7-4c4e-47c6-ae9f-de91882367d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:44:07 user nova-compute[72129]: DEBUG nova.compute.manager [req-2ed2214b-b841-42f3-b42e-d7fc86606665 req-13b6d1bc-4236-4547-8d2d-6f517b850523 service nova] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] No waiting events found dispatching network-vif-plugged-b32c7e0b-2091-4c3d-bb68-05ea41b0b054 {{(pid=72129) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 14:44:07 user nova-compute[72129]: WARNING nova.compute.manager [req-2ed2214b-b841-42f3-b42e-d7fc86606665 req-13b6d1bc-4236-4547-8d2d-6f517b850523 service nova] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Received unexpected event network-vif-plugged-b32c7e0b-2091-4c3d-bb68-05ea41b0b054 for instance with vm_state deleted and task_state None.
Aug 01 14:44:10 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:44:15 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:44:15 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:44:15 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72129) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 14:44:15 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:44:15 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:44:15 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:44:19 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:44:20 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:44:20 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72129) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 14:44:20 user nova-compute[72129]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690901045.6420004, 7b5266f7-4c4e-47c6-ae9f-de91882367d8 => Stopped> {{(pid=72129) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 14:44:20 user nova-compute[72129]: INFO nova.compute.manager [-] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] VM Stopped (Lifecycle Event)
Aug 01 14:44:20 user nova-compute[72129]: DEBUG nova.compute.manager [None req-19cbba7d-22ba-4e08-afc2-d3390a69ccd7 None None] [instance: 7b5266f7-4c4e-47c6-ae9f-de91882367d8] Checking state {{(pid=72129) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 14:44:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:44:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:44:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72129) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 14:44:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:44:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:44:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:44:24 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:44:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:44:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:44:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:44:24 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Auditing locally available compute resources for user (node: user) {{(pid=72129) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 14:44:24 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:44:24 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:44:24 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Hypervisor/Node resource view: name=user free_ram=8979MB free_disk=25.08780288696289GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72129) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 14:44:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:44:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:44:24 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 14:44:24 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 14:44:24 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:44:24 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:44:24 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Compute_service record updated for user:user {{(pid=72129) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 14:44:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.157s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:44:25 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:44:30 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:44:30 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:44:30 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:44:30 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:44:30 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:44:30 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72129) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 14:44:30 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:44:30 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:44:30 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:44:31 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:44:31 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:44:32 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:44:32 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Starting heal instance info cache {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 14:44:32 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Rebuilding the list of instances to heal {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 14:44:32 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Didn't find any instances for network info cache update. {{(pid=72129) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 14:44:35 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:44:35 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:44:35 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72129) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 14:44:35 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:44:35 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:44:35 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:44:40 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:44:40 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:44:40 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72129) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 14:44:40 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:44:40 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:44:40 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:44:42 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:44:45 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:44:50 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:44:55 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:44:59 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:45:00 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:45:00 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:45:02 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:45:05 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:45:10 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:45:15 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:45:15 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:45:15 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72129) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 14:45:15 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:45:15 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:45:15 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:45:20 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:45:20 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:45:20 user nova-compute[72129]: DEBUG nova.compute.manager [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72129) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 14:45:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:45:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:45:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72129) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 14:45:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:45:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:45:20 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:45:24 user nova-compute[72129]: DEBUG oslo_service.periodic_task [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72129) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 14:45:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:45:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:45:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:45:24 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Auditing locally available compute resources for user (node: user) {{(pid=72129) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 14:45:24 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:45:24 user nova-compute[72129]: WARNING nova.virt.libvirt.driver [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 14:45:24 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Hypervisor/Node resource view: name=user free_ram=9106MB free_disk=25.05523681640625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72129) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 14:45:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 14:45:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 14:45:24 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 14:45:24 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72129) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 14:45:24 user nova-compute[72129]: DEBUG nova.compute.provider_tree [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed in ProviderTree for provider: c2f345c3-9b82-4164-b21d-1eef8e661842 {{(pid=72129) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 14:45:24 user nova-compute[72129]: DEBUG nova.scheduler.client.report [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Inventory has not changed for provider c2f345c3-9b82-4164-b21d-1eef8e661842 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72129) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 14:45:24 user nova-compute[72129]: DEBUG nova.compute.resource_tracker [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Compute_service record updated for user:user {{(pid=72129) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 14:45:24 user nova-compute[72129]: DEBUG oslo_concurrency.lockutils [None req-656b24e5-3ce2-4583-b8fd-fb44b08aa289 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.132s {{(pid=72129) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 14:45:25 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 14:45:25 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 14:45:25 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72129) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 14:45:25 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:45:25 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72129) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 14:45:25 user nova-compute[72129]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=72129) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}